Nov 16 03:42:02 user nova-compute[103546]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=103546) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 16 03:42:02 user nova-compute[103546]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=103546) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 16 03:42:02 user nova-compute[103546]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=103546) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 16 03:42:02 user nova-compute[103546]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 16 03:42:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:42:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:42:02 user nova-compute[103546]: INFO nova.virt.driver [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 16 03:42:03 user nova-compute[103546]: INFO nova.compute.provider_config [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] Acquiring lock "singleton_lock" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] Acquired lock "singleton_lock" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] Releasing lock "singleton_lock" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] Full set of CONF: {{(pid=103546) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] ******************************************************************************** {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] Configuration options gathered from: {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] ================================================================================ {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] allow_resize_to_same_host      = True {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] arq_binding_timeout            = 300 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] backdoor_port                  = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] backdoor_socket                = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] block_device_allocate_retries  = 300 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] block_device_allocate_retries_interval = 5 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cert                           = self.pem {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] compute_monitors               = [] {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] config_dir                     = [] {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] config_drive_format            = iso9660 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] config_source                  = [] {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] console_host                   = user {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] control_exchange               = nova {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cpu_allocation_ratio           = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] daemon                         = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] debug                          = True {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] default_access_ip_network_name = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] default_availability_zone      = nova {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] default_ephemeral_format       = ext4 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] default_green_pool_size        = 1000 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] default_schedule_zone          = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] disk_allocation_ratio          = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] enable_new_services            = True {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] enabled_apis                   = ['osapi_compute'] {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] enabled_ssl_apis               = [] {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] flat_injected                  = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] force_config_drive             = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] force_raw_images               = True {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] graceful_shutdown_timeout      = 5 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] heal_instance_info_cache_interval = 60 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] host                           = user {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] instance_build_timeout         = 0 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] instance_delete_interval       = 300 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] instance_format                = [instance: %(uuid)s]  {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] instance_name_template         = instance-%08x {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] instance_usage_audit           = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] instance_usage_audit_period    = month {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] internal_service_availability_zone = internal {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] key                            = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] live_migration_retry_count     = 30 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] log_config_append              = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] log_dir                        = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] log_file                       = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] log_options                    = True {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] log_rotate_interval            = 1 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] log_rotate_interval_type       = days {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] log_rotation_type              = none {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] long_rpc_timeout               = 1800 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] max_concurrent_builds          = 10 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] max_concurrent_live_migrations = 1 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] max_concurrent_snapshots       = 5 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] max_local_block_devices        = 3 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] max_logfile_count              = 30 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] max_logfile_size_mb            = 200 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] maximum_instance_delete_attempts = 5 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] metadata_listen                = 0.0.0.0 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] metadata_listen_port           = 8775 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] metadata_workers               = 3 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] migrate_max_retries            = -1 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] mkisofs_cmd                    = genisoimage {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] my_ip                          = 10.0.0.210 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] network_allocate_retries       = 0 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] osapi_compute_listen_port      = 8774 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] osapi_compute_unique_server_name_scope =  {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] osapi_compute_workers          = 3 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] password_length                = 12 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] periodic_enable                = True {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] periodic_fuzzy_delay           = 60 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] pointer_model                  = ps2mouse {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] preallocate_images             = none {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] publish_errors                 = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] pybasedir                      = /opt/stack/nova {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] ram_allocation_ratio           = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] rate_limit_burst               = 0 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] rate_limit_except_level        = CRITICAL {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] rate_limit_interval            = 0 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] reboot_timeout                 = 0 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] reclaim_instance_interval      = 0 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] record                         = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] reimage_timeout_per_gb         = 60 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] report_interval                = 120 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] rescue_timeout                 = 0 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] reserved_host_cpus             = 0 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] reserved_host_disk_mb          = 0 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] reserved_host_memory_mb        = 512 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] reserved_huge_pages            = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] resize_confirm_window          = 0 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] resize_fs_using_block_device   = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] resume_guests_state_on_host_boot = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] rpc_response_timeout           = 60 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] run_external_periodic_tasks    = True {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] running_deleted_instance_action = reap {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] running_deleted_instance_poll_interval = 1800 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] running_deleted_instance_timeout = 0 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] scheduler_instance_sync_interval = 120 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] service_down_time              = 720 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] servicegroup_driver            = db {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] shelved_offload_time           = 0 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] shelved_poll_interval          = 3600 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] shutdown_timeout               = 0 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] source_is_ipv6                 = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] ssl_only                       = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] state_path                     = /opt/stack/data/nova {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] sync_power_state_interval      = 600 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] sync_power_state_pool_size     = 1000 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] syslog_log_facility            = LOG_USER {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] tempdir                        = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] timeout_nbd                    = 10 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] transport_url                  = **** {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] update_resources_interval      = 0 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] use_cow_images                 = True {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] use_eventlog                   = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] use_journal                    = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] use_json                       = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] use_rootwrap_daemon            = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] use_stderr                     = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] use_syslog                     = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vcpu_pin_set                   = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vif_plugging_is_fatal          = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vif_plugging_timeout           = 0 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] virt_mkfs                      = [] {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] volume_usage_poll_interval     = 0 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] watch_log_file                 = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] web                            = /usr/share/spice-html5 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_concurrency.disable_process_locking = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] api.auth_strategy              = keystone {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] api.compute_link_prefix        = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] api.dhcp_domain                = novalocal {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] api.enable_instance_password   = True {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] api.glance_link_prefix         = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] api.instance_list_per_project_cells = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] api.list_records_by_skipping_down_cells = True {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] api.local_metadata_per_cell    = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] api.max_limit                  = 1000 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] api.metadata_cache_expiration  = 15 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] api.neutron_default_tenant_id  = default {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] api.use_forwarded_for          = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] api.use_neutron_default_nets   = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] api.vendordata_dynamic_targets = [] {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] api.vendordata_jsonfile_path   = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cache.backend                  = dogpile.cache.memcached {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cache.backend_argument         = **** {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cache.config_prefix            = cache.oslo {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cache.dead_timeout             = 60.0 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cache.debug_cache_backend      = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cache.enable_retry_client      = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cache.enable_socket_keepalive  = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cache.enabled                  = True {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cache.expiration_time          = 600 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cache.hashclient_retry_attempts = 2 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cache.memcache_dead_retry      = 300 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cache.memcache_password        =  {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cache.memcache_pool_maxsize    = 10 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cache.memcache_sasl_enabled    = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cache.memcache_username        =  {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cache.proxies                  = [] {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cache.retry_attempts           = 2 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cache.retry_delay              = 0.0 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cache.socket_keepalive_count   = 1 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cache.socket_keepalive_idle    = 1 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cache.socket_keepalive_interval = 1 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cache.tls_allowed_ciphers      = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cache.tls_cafile               = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cache.tls_certfile             = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cache.tls_enabled              = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cache.tls_keyfile              = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cinder.auth_section            = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cinder.auth_type               = password {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cinder.cafile                  = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cinder.certfile                = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cinder.collect_timing          = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cinder.cross_az_attach         = True {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cinder.debug                   = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cinder.endpoint_template       = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cinder.http_retries            = 3 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cinder.insecure                = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cinder.keyfile                 = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cinder.os_region_name          = RegionOne {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cinder.split_loggers           = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cinder.timeout                 = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] compute.cpu_dedicated_set      = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] compute.cpu_shared_set         = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] compute.image_type_exclude_list = [] {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] compute.max_concurrent_disk_ops = 0 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] compute.max_disk_devices_to_attach = -1 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] compute.resource_provider_association_refresh = 300 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] compute.shutdown_retry_interval = 10 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] conductor.workers              = 3 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] console.allowed_origins        = [] {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] console.ssl_ciphers            = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] console.ssl_minimum_version    = default {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] consoleauth.token_ttl          = 600 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cyborg.cafile                  = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cyborg.certfile                = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cyborg.collect_timing          = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cyborg.connect_retries         = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cyborg.connect_retry_delay     = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cyborg.endpoint_override       = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cyborg.insecure                = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cyborg.keyfile                 = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cyborg.max_version             = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cyborg.min_version             = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cyborg.region_name             = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cyborg.service_name            = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cyborg.service_type            = accelerator {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cyborg.split_loggers           = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cyborg.status_code_retries     = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cyborg.status_code_retry_delay = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cyborg.timeout                 = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] cyborg.version                 = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] database.backend               = sqlalchemy {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] database.connection            = **** {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] database.connection_debug      = 0 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] database.connection_parameters =  {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] database.connection_recycle_time = 3600 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] database.connection_trace      = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] database.db_inc_retry_interval = True {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] database.db_max_retries        = 20 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] database.db_max_retry_interval = 10 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] database.db_retry_interval     = 1 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] database.max_overflow          = 50 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] database.max_pool_size         = 5 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] database.max_retries           = 10 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] database.mysql_wsrep_sync_wait = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] database.pool_timeout          = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] database.retry_interval        = 10 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] database.slave_connection      = **** {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] database.sqlite_synchronous    = True {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] api_database.backend           = sqlalchemy {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] api_database.connection        = **** {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] api_database.connection_debug  = 0 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] api_database.connection_parameters =  {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] api_database.connection_recycle_time = 3600 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] api_database.connection_trace  = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] api_database.db_inc_retry_interval = True {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] api_database.db_max_retries    = 20 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] api_database.db_max_retry_interval = 10 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] api_database.db_retry_interval = 1 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] api_database.max_overflow      = 50 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] api_database.max_pool_size     = 5 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] api_database.max_retries       = 10 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] api_database.pool_timeout      = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] api_database.retry_interval    = 10 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] api_database.slave_connection  = **** {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] api_database.sqlite_synchronous = True {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] devices.enabled_mdev_types     = [] {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] ephemeral_storage_encryption.enabled = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] glance.api_servers             = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] glance.cafile                  = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] glance.certfile                = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] glance.collect_timing          = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] glance.connect_retries         = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] glance.connect_retry_delay     = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] glance.debug                   = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] glance.default_trusted_certificate_ids = [] {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] glance.enable_certificate_validation = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] glance.enable_rbd_download     = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] glance.endpoint_override       = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] glance.insecure                = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] glance.keyfile                 = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] glance.max_version             = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] glance.min_version             = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] glance.num_retries             = 3 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] glance.rbd_ceph_conf           =  {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] glance.rbd_connect_timeout     = 5 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] glance.rbd_pool                =  {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] glance.rbd_user                =  {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] glance.region_name             = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] glance.service_name            = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] glance.service_type            = image {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] glance.split_loggers           = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] glance.status_code_retries     = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] glance.status_code_retry_delay = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] glance.timeout                 = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] glance.verify_glance_signatures = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] glance.version                 = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] guestfs.debug                  = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] hyperv.config_drive_cdrom      = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] hyperv.config_drive_inject_password = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] hyperv.enable_instance_metrics_collection = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] hyperv.enable_remotefx         = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] hyperv.instances_path_share    =  {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] hyperv.iscsi_initiator_list    = [] {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] hyperv.limit_cpu_features      = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] hyperv.power_state_check_timeframe = 60 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] hyperv.use_multipath_io        = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] hyperv.volume_attach_retry_count = 10 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] hyperv.vswitch_name            = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] mks.enabled                    = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] image_cache.manager_interval   = 2400 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] image_cache.precache_concurrency = 1 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] image_cache.remove_unused_base_images = True {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] image_cache.subdirectory_name  = _base {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] ironic.api_max_retries         = 60 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] ironic.api_retry_interval      = 2 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] ironic.auth_section            = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] ironic.auth_type               = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] ironic.cafile                  = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] ironic.certfile                = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] ironic.collect_timing          = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] ironic.conductor_group         = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] ironic.connect_retries         = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] ironic.connect_retry_delay     = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] ironic.endpoint_override       = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] ironic.insecure                = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] ironic.keyfile                 = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] ironic.max_version             = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] ironic.min_version             = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] ironic.peer_list               = [] {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] ironic.region_name             = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] ironic.serial_console_state_timeout = 10 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] ironic.service_name            = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] ironic.service_type            = baremetal {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] ironic.split_loggers           = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] ironic.status_code_retries     = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] ironic.status_code_retry_delay = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] ironic.timeout                 = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] ironic.version                 = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] key_manager.fixed_key          = **** {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] barbican.barbican_api_version  = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] barbican.barbican_endpoint     = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] barbican.barbican_endpoint_type = public {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] barbican.barbican_region_name  = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] barbican.cafile                = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] barbican.certfile              = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] barbican.collect_timing        = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] barbican.insecure              = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] barbican.keyfile               = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] barbican.number_of_retries     = 60 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] barbican.retry_delay           = 1 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] barbican.send_service_user_token = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] barbican.split_loggers         = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] barbican.timeout               = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] barbican.verify_ssl            = True {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] barbican.verify_ssl_path       = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] barbican_service_user.auth_section = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] barbican_service_user.auth_type = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] barbican_service_user.cafile   = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] barbican_service_user.certfile = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] barbican_service_user.collect_timing = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] barbican_service_user.insecure = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] barbican_service_user.keyfile  = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] barbican_service_user.split_loggers = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] barbican_service_user.timeout  = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vault.approle_role_id          = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vault.approle_secret_id        = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vault.cafile                   = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vault.certfile                 = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vault.collect_timing           = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vault.insecure                 = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vault.keyfile                  = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vault.kv_mountpoint            = secret {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vault.kv_path                  = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vault.kv_version               = 2 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vault.namespace                = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vault.root_token_id            = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vault.split_loggers            = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vault.ssl_ca_crt_file          = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vault.timeout                  = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vault.use_ssl                  = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] keystone.auth_section          = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] keystone.auth_type             = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] keystone.cafile                = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] keystone.certfile              = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] keystone.collect_timing        = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] keystone.connect_retries       = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] keystone.connect_retry_delay   = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] keystone.endpoint_override     = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] keystone.insecure              = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] keystone.keyfile               = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] keystone.max_version           = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] keystone.min_version           = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] keystone.region_name           = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] keystone.service_name          = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] keystone.service_type          = identity {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] keystone.split_loggers         = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] keystone.status_code_retries   = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] keystone.status_code_retry_delay = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] keystone.timeout               = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] keystone.version               = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.connection_uri         =  {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.cpu_mode               = custom {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: WARNING oslo_config.cfg [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.cpu_power_governor_high = performance {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.cpu_power_governor_low = powersave {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.cpu_power_management   = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.device_detach_attempts = 8 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.device_detach_timeout  = 20 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.disk_cachemodes        = [] {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.disk_prefix            = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.enabled_perf_events    = [] {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.file_backed_memory     = 0 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.gid_maps               = [] {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.hw_disk_discard        = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.hw_machine_type        = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.images_rbd_glance_store_name =  {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.images_rbd_pool        = rbd {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.images_type            = default {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.images_volume_group    = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.inject_key             = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.inject_partition       = -2 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.inject_password        = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.iscsi_iface            = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.iser_use_multipath     = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.live_migration_bandwidth = 0 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.live_migration_downtime = 500 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.live_migration_inbound_addr = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.live_migration_permit_post_copy = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.live_migration_scheme  = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.live_migration_timeout_action = abort {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.live_migration_tunnelled = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: WARNING oslo_config.cfg [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 16 03:42:03 user nova-compute[103546]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 16 03:42:03 user nova-compute[103546]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 16 03:42:03 user nova-compute[103546]: and ``live_migration_inbound_addr`` respectively.
Nov 16 03:42:03 user nova-compute[103546]: ).  Its value may be silently ignored in the future.
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.live_migration_with_native_tls = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.max_queues             = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.nfs_mount_options      = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.num_memory_encrypted_guests = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.num_pcie_ports         = 0 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.pmem_namespaces        = [] {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.quobyte_client_cfg     = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.rbd_secret_uuid        = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.rbd_user               = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.remote_filesystem_transport = ssh {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.rescue_image_id        = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.rescue_kernel_id       = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.rescue_ramdisk_id      = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.rx_queue_size          = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.smbfs_mount_options    =  {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.snapshot_compression   = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.snapshot_image_format  = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.sparse_logical_volumes = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.swtpm_enabled          = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.swtpm_group            = tss {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.swtpm_user             = tss {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.sysinfo_serial         = unique {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.tb_cache_size          = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.tx_queue_size          = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.uid_maps               = [] {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.use_virtio_for_bridges = True {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.virt_type              = kvm {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.volume_clear           = zero {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.volume_clear_size      = 0 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.volume_use_multipath   = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.vzstorage_cache_path   = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.vzstorage_mount_user   = stack {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] neutron.auth_section           = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] neutron.auth_type              = password {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] neutron.cafile                 = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] neutron.certfile               = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] neutron.collect_timing         = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] neutron.connect_retries        = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] neutron.connect_retry_delay    = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] neutron.default_floating_pool  = public {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] neutron.endpoint_override      = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] neutron.extension_sync_interval = 600 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] neutron.http_retries           = 3 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] neutron.insecure               = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] neutron.keyfile                = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] neutron.max_version            = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] neutron.min_version            = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] neutron.ovs_bridge             = br-int {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] neutron.physnets               = [] {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] neutron.region_name            = RegionOne {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] neutron.service_metadata_proxy = True {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] neutron.service_name           = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] neutron.service_type           = network {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] neutron.split_loggers          = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] neutron.status_code_retries    = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] neutron.status_code_retry_delay = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] neutron.timeout                = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] neutron.version                = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] notifications.bdms_in_notifications = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] notifications.default_level    = INFO {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] notifications.notification_format = unversioned {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] notifications.notify_on_state_change = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] pci.alias                      = [] {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] pci.device_spec                = [] {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] pci.report_in_placement        = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] placement.auth_section         = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] placement.auth_type            = password {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] placement.cafile               = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] placement.certfile             = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] placement.collect_timing       = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] placement.connect_retries      = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] placement.connect_retry_delay  = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] placement.default_domain_id    = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] placement.default_domain_name  = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] placement.domain_id            = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] placement.domain_name          = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] placement.endpoint_override    = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] placement.insecure             = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] placement.keyfile              = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] placement.max_version          = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] placement.min_version          = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] placement.password             = **** {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] placement.project_domain_id    = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] placement.project_domain_name  = Default {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] placement.project_id           = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] placement.project_name         = service {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] placement.region_name          = RegionOne {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] placement.service_name         = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] placement.service_type         = placement {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] placement.split_loggers        = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] placement.status_code_retries  = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] placement.status_code_retry_delay = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] placement.system_scope         = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] placement.timeout              = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] placement.trust_id             = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] placement.user_domain_id       = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] placement.user_domain_name     = Default {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] placement.user_id              = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] placement.username             = placement {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] placement.version              = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] quota.cores                    = 20 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] quota.count_usage_from_placement = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] quota.injected_file_content_bytes = 10240 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] quota.injected_file_path_length = 255 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] quota.injected_files           = 5 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] quota.instances                = 10 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] quota.key_pairs                = 100 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] quota.metadata_items           = 128 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] quota.ram                      = 51200 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] quota.recheck_quota            = True {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] quota.server_group_members     = 10 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] quota.server_groups            = 10 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] rdp.enabled                    = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] scheduler.image_metadata_prefilter = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] scheduler.max_attempts         = 3 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] scheduler.max_placement_results = 1000 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] scheduler.query_placement_for_image_type_support = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] scheduler.workers              = 3 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] filter_scheduler.host_subset_size = 1 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] filter_scheduler.isolated_hosts = [] {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] filter_scheduler.isolated_images = [] {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] filter_scheduler.pci_in_placement = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] filter_scheduler.track_instance_changes = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] metrics.required               = True {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] metrics.weight_multiplier      = 1.0 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] metrics.weight_setting         = [] {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] serial_console.enabled         = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] serial_console.port_range      = 10000:20000 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] serial_console.serialproxy_port = 6083 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] service_user.auth_section      = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] service_user.auth_type         = password {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] service_user.cafile            = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] service_user.certfile          = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] service_user.collect_timing    = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] service_user.insecure          = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] service_user.keyfile           = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] service_user.send_service_user_token = True {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] service_user.split_loggers     = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] service_user.timeout           = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] spice.agent_enabled            = True {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] spice.enabled                  = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] spice.html5proxy_port          = 6082 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] spice.image_compression        = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] spice.jpeg_compression         = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] spice.playback_compression     = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] spice.server_listen            = 127.0.0.1 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] spice.streaming_mode           = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] spice.zlib_compression         = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] upgrade_levels.baseapi         = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] upgrade_levels.cert            = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] upgrade_levels.compute         = auto {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] upgrade_levels.conductor       = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] upgrade_levels.scheduler       = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vendordata_dynamic_auth.auth_section = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vendordata_dynamic_auth.auth_type = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vendordata_dynamic_auth.cafile = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vendordata_dynamic_auth.certfile = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vendordata_dynamic_auth.insecure = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vendordata_dynamic_auth.keyfile = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vendordata_dynamic_auth.timeout = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vmware.api_retry_count         = 10 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vmware.ca_file                 = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vmware.cache_prefix            = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vmware.cluster_name            = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vmware.connection_pool_size    = 10 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vmware.console_delay_seconds   = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vmware.datastore_regex         = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vmware.host_ip                 = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vmware.host_password           = **** {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vmware.host_port               = 443 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vmware.host_username           = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vmware.insecure                = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vmware.integration_bridge      = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vmware.maximum_objects         = 100 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vmware.pbm_default_policy      = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vmware.pbm_enabled             = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vmware.pbm_wsdl_location       = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vmware.serial_port_proxy_uri   = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vmware.serial_port_service_uri = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vmware.task_poll_interval      = 0.5 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vmware.use_linked_clone        = True {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vmware.vnc_keymap              = en-us {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vmware.vnc_port                = 5900 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vmware.vnc_port_total          = 10000 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vnc.auth_schemes               = ['none'] {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vnc.enabled                    = True {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vnc.novncproxy_port            = 6080 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vnc.server_listen              = 0.0.0.0 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vnc.vencrypt_ca_certs          = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vnc.vencrypt_client_cert       = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vnc.vencrypt_client_key        = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] workarounds.disable_rootwrap   = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] workarounds.enable_numa_live_migration = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] workarounds.libvirt_disable_apic = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] wsgi.client_socket_timeout     = 900 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] wsgi.default_pool_size         = 1000 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] wsgi.keep_alive                = True {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] wsgi.max_header_line           = 16384 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] wsgi.ssl_ca_file               = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] wsgi.ssl_cert_file             = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] wsgi.ssl_key_file              = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] wsgi.tcp_keepidle              = 600 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] zvm.ca_file                    = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] zvm.cloud_connector_url        = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] zvm.reachable_timeout          = 300 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_policy.enforce_new_defaults = True {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_policy.enforce_scope      = True {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_policy.policy_default_rule = default {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_policy.policy_file        = policy.yaml {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] profiler.connection_string     = messaging:// {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] profiler.enabled               = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] profiler.es_doc_type           = notification {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] profiler.es_scroll_size        = 10000 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] profiler.es_scroll_time        = 2m {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] profiler.filter_error_trace    = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] profiler.hmac_keys             = **** {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] profiler.sentinel_service_name = mymaster {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] profiler.socket_timeout        = 0.1 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] profiler.trace_requests        = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] profiler.trace_sqlalchemy      = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] profiler_jaeger.process_tags   = {} {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] profiler_jaeger.service_name_prefix = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] profiler_otlp.service_name_prefix = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] remote_debug.host              = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] remote_debug.port              = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_messaging_rabbit.ssl      = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_messaging_notifications.retry = -1 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_messaging_notifications.transport_url = **** {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_limit.auth_section        = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_limit.auth_type           = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_limit.cafile              = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_limit.certfile            = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_limit.collect_timing      = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_limit.connect_retries     = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_limit.connect_retry_delay = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_limit.endpoint_id         = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_limit.endpoint_override   = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_limit.insecure            = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_limit.keyfile             = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_limit.max_version         = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_limit.min_version         = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_limit.region_name         = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_limit.service_name        = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_limit.service_type        = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_limit.split_loggers       = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_limit.status_code_retries = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_limit.status_code_retry_delay = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_limit.timeout             = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_limit.valid_interfaces    = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_limit.version             = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_reports.file_event_handler = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] oslo_reports.log_dir           = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vif_plug_ovs_privileged.group  = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] vif_plug_ovs_privileged.user   = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] os_vif_linux_bridge.flat_interface = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] os_vif_ovs.isolate_vif         = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] os_vif_ovs.per_port_bridge     = False {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] os_brick.lock_path             = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] privsep_osbrick.capabilities   = [21] {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] privsep_osbrick.group          = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] privsep_osbrick.helper_command = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] privsep_osbrick.user           = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] nova_sys_admin.group           = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] nova_sys_admin.helper_command  = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] nova_sys_admin.user            = None {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG oslo_service.service [None req-35f2c8f4-720a-4dce-b790-1af6372d37b1 None None] ******************************************************************************** {{(pid=103546) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 16 03:42:03 user nova-compute[103546]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 16 03:42:03 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Connecting to libvirt: qemu:///system {{(pid=103546) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f60ccf763e0> {{(pid=103546) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 16 03:42:03 user nova-compute[103546]: libvirt:  error : internal error: could not initialize domain event timer
Nov 16 03:42:03 user nova-compute[103546]: WARNING nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 16 03:42:03 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f60ccf763e0> {{(pid=103546) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Starting native event thread {{(pid=103546) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Starting green dispatch thread {{(pid=103546) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 16 03:42:03 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Starting connection event dispatch thread {{(pid=103546) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 16 03:42:03 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Connection event '1' reason 'None'
Nov 16 03:42:03 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 16 03:42:03 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.mount [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Initialising _HostMountState generation 0 {{(pid=103546) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 16 03:42:10 user nova-compute[103546]: INFO nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Libvirt host capabilities <capabilities>
Nov 16 03:42:10 user nova-compute[103546]:   <host>
Nov 16 03:42:10 user nova-compute[103546]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 16 03:42:10 user nova-compute[103546]:     <cpu>
Nov 16 03:42:10 user nova-compute[103546]:       <arch>x86_64</arch>
Nov 16 03:42:10 user nova-compute[103546]:       <model>IvyBridge-IBRS</model>
Nov 16 03:42:10 user nova-compute[103546]:       <vendor>Intel</vendor>
Nov 16 03:42:10 user nova-compute[103546]:       <microcode version='1070'/>
Nov 16 03:42:10 user nova-compute[103546]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 16 03:42:10 user nova-compute[103546]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature name='ss'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature name='vmx'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature name='pcid'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature name='osxsave'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature name='hypervisor'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature name='arat'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature name='tsc_adjust'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature name='md-clear'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature name='stibp'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature name='arch-capabilities'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature name='ssbd'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature name='invtsc'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature name='rsba'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature name='skip-l1dfl-vmentry'/>
Nov 16 03:42:10 user nova-compute[103546]:       <pages unit='KiB' size='4'/>
Nov 16 03:42:10 user nova-compute[103546]:       <pages unit='KiB' size='2048'/>
Nov 16 03:42:10 user nova-compute[103546]:     </cpu>
Nov 16 03:42:10 user nova-compute[103546]:     <power_management>
Nov 16 03:42:10 user nova-compute[103546]:       <suspend_mem/>
Nov 16 03:42:10 user nova-compute[103546]:       <suspend_disk/>
Nov 16 03:42:10 user nova-compute[103546]:       <suspend_hybrid/>
Nov 16 03:42:10 user nova-compute[103546]:     </power_management>
Nov 16 03:42:10 user nova-compute[103546]:     <iommu support='no'/>
Nov 16 03:42:10 user nova-compute[103546]:     <migration_features>
Nov 16 03:42:10 user nova-compute[103546]:       <live/>
Nov 16 03:42:10 user nova-compute[103546]:       <uri_transports>
Nov 16 03:42:10 user nova-compute[103546]:         <uri_transport>tcp</uri_transport>
Nov 16 03:42:10 user nova-compute[103546]:         <uri_transport>rdma</uri_transport>
Nov 16 03:42:10 user nova-compute[103546]:       </uri_transports>
Nov 16 03:42:10 user nova-compute[103546]:     </migration_features>
Nov 16 03:42:10 user nova-compute[103546]:     <topology>
Nov 16 03:42:10 user nova-compute[103546]:       <cells num='2'>
Nov 16 03:42:10 user nova-compute[103546]:         <cell id='0'>
Nov 16 03:42:10 user nova-compute[103546]:           <memory unit='KiB'>8189224</memory>
Nov 16 03:42:10 user nova-compute[103546]:           <pages unit='KiB' size='4'>2047306</pages>
Nov 16 03:42:10 user nova-compute[103546]:           <pages unit='KiB' size='2048'>0</pages>
Nov 16 03:42:10 user nova-compute[103546]:           <distances>
Nov 16 03:42:10 user nova-compute[103546]:             <sibling id='0' value='10'/>
Nov 16 03:42:10 user nova-compute[103546]:             <sibling id='1' value='20'/>
Nov 16 03:42:10 user nova-compute[103546]:           </distances>
Nov 16 03:42:10 user nova-compute[103546]:           <cpus num='6'>
Nov 16 03:42:10 user nova-compute[103546]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 16 03:42:10 user nova-compute[103546]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 16 03:42:10 user nova-compute[103546]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 16 03:42:10 user nova-compute[103546]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 16 03:42:10 user nova-compute[103546]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 16 03:42:10 user nova-compute[103546]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 16 03:42:10 user nova-compute[103546]:           </cpus>
Nov 16 03:42:10 user nova-compute[103546]:         </cell>
Nov 16 03:42:10 user nova-compute[103546]:         <cell id='1'>
Nov 16 03:42:10 user nova-compute[103546]:           <memory unit='KiB'>8206460</memory>
Nov 16 03:42:10 user nova-compute[103546]:           <pages unit='KiB' size='4'>2051615</pages>
Nov 16 03:42:10 user nova-compute[103546]:           <pages unit='KiB' size='2048'>0</pages>
Nov 16 03:42:10 user nova-compute[103546]:           <distances>
Nov 16 03:42:10 user nova-compute[103546]:             <sibling id='0' value='20'/>
Nov 16 03:42:10 user nova-compute[103546]:             <sibling id='1' value='10'/>
Nov 16 03:42:10 user nova-compute[103546]:           </distances>
Nov 16 03:42:10 user nova-compute[103546]:           <cpus num='6'>
Nov 16 03:42:10 user nova-compute[103546]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 16 03:42:10 user nova-compute[103546]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 16 03:42:10 user nova-compute[103546]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 16 03:42:10 user nova-compute[103546]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 16 03:42:10 user nova-compute[103546]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 16 03:42:10 user nova-compute[103546]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 16 03:42:10 user nova-compute[103546]:           </cpus>
Nov 16 03:42:10 user nova-compute[103546]:         </cell>
Nov 16 03:42:10 user nova-compute[103546]:       </cells>
Nov 16 03:42:10 user nova-compute[103546]:     </topology>
Nov 16 03:42:10 user nova-compute[103546]:     <cache>
Nov 16 03:42:10 user nova-compute[103546]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 16 03:42:10 user nova-compute[103546]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 16 03:42:10 user nova-compute[103546]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 16 03:42:10 user nova-compute[103546]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 16 03:42:10 user nova-compute[103546]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 16 03:42:10 user nova-compute[103546]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 16 03:42:10 user nova-compute[103546]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 16 03:42:10 user nova-compute[103546]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 16 03:42:10 user nova-compute[103546]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 16 03:42:10 user nova-compute[103546]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 16 03:42:10 user nova-compute[103546]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 16 03:42:10 user nova-compute[103546]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 16 03:42:10 user nova-compute[103546]:     </cache>
Nov 16 03:42:10 user nova-compute[103546]:     <secmodel>
Nov 16 03:42:10 user nova-compute[103546]:       <model>apparmor</model>
Nov 16 03:42:10 user nova-compute[103546]:       <doi>0</doi>
Nov 16 03:42:10 user nova-compute[103546]:     </secmodel>
Nov 16 03:42:10 user nova-compute[103546]:     <secmodel>
Nov 16 03:42:10 user nova-compute[103546]:       <model>dac</model>
Nov 16 03:42:10 user nova-compute[103546]:       <doi>0</doi>
Nov 16 03:42:10 user nova-compute[103546]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 16 03:42:10 user nova-compute[103546]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 16 03:42:10 user nova-compute[103546]:     </secmodel>
Nov 16 03:42:10 user nova-compute[103546]:   </host>
Nov 16 03:42:10 user nova-compute[103546]:   <guest>
Nov 16 03:42:10 user nova-compute[103546]:     <os_type>hvm</os_type>
Nov 16 03:42:10 user nova-compute[103546]:     <arch name='alpha'>
Nov 16 03:42:10 user nova-compute[103546]:       <wordsize>64</wordsize>
Nov 16 03:42:10 user nova-compute[103546]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='4'>clipper</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <domain type='qemu'/>
Nov 16 03:42:10 user nova-compute[103546]:     </arch>
Nov 16 03:42:10 user nova-compute[103546]:     <features>
Nov 16 03:42:10 user nova-compute[103546]:       <cpuselection/>
Nov 16 03:42:10 user nova-compute[103546]:       <deviceboot/>
Nov 16 03:42:10 user nova-compute[103546]:       <disksnapshot default='on' toggle='no'/>
Nov 16 03:42:10 user nova-compute[103546]:     </features>
Nov 16 03:42:10 user nova-compute[103546]:   </guest>
Nov 16 03:42:10 user nova-compute[103546]:   <guest>
Nov 16 03:42:10 user nova-compute[103546]:     <os_type>hvm</os_type>
Nov 16 03:42:10 user nova-compute[103546]:     <arch name='armv6l'>
Nov 16 03:42:10 user nova-compute[103546]:       <wordsize>32</wordsize>
Nov 16 03:42:10 user nova-compute[103546]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>integratorcp</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>borzoi</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>spitz</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2'>nuri</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2'>musca-b1</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>versatileab</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>kzm</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2'>musca-a</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2'>smdkc210</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>sx1</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>z2</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>tosa</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='4'>sabrelite</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>realview-eb</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>n810</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>n800</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>versatilepb</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>terrier</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>mainstone</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='4'>midway</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>musicpal</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>microbit</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>cubieboard</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>verdex</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>netduino2</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='4'>raspi2b</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>cheetah</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='4'>highbank</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>akita</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>connex</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>collie</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>raspi0</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <domain type='qemu'/>
Nov 16 03:42:10 user nova-compute[103546]:     </arch>
Nov 16 03:42:10 user nova-compute[103546]:     <features>
Nov 16 03:42:10 user nova-compute[103546]:       <cpuselection/>
Nov 16 03:42:10 user nova-compute[103546]:       <deviceboot/>
Nov 16 03:42:10 user nova-compute[103546]:       <disksnapshot default='on' toggle='no'/>
Nov 16 03:42:10 user nova-compute[103546]:     </features>
Nov 16 03:42:10 user nova-compute[103546]:   </guest>
Nov 16 03:42:10 user nova-compute[103546]:   <guest>
Nov 16 03:42:10 user nova-compute[103546]:     <os_type>hvm</os_type>
Nov 16 03:42:10 user nova-compute[103546]:     <arch name='armv7l'>
Nov 16 03:42:10 user nova-compute[103546]:       <wordsize>32</wordsize>
Nov 16 03:42:10 user nova-compute[103546]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>integratorcp</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>borzoi</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>spitz</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2'>nuri</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2'>musca-b1</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>versatileab</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>kzm</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2'>musca-a</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2'>smdkc210</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>sx1</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>z2</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>tosa</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='4'>sabrelite</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>realview-eb</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>n810</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>n800</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>versatilepb</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>terrier</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>mainstone</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='4'>midway</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>musicpal</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>microbit</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>cubieboard</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>verdex</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>netduino2</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='4'>raspi2b</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>cheetah</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='4'>highbank</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>akita</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>connex</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>collie</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>raspi0</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <domain type='qemu'/>
Nov 16 03:42:10 user nova-compute[103546]:     </arch>
Nov 16 03:42:10 user nova-compute[103546]:     <features>
Nov 16 03:42:10 user nova-compute[103546]:       <cpuselection/>
Nov 16 03:42:10 user nova-compute[103546]:       <deviceboot/>
Nov 16 03:42:10 user nova-compute[103546]:       <disksnapshot default='on' toggle='no'/>
Nov 16 03:42:10 user nova-compute[103546]:     </features>
Nov 16 03:42:10 user nova-compute[103546]:   </guest>
Nov 16 03:42:10 user nova-compute[103546]:   <guest>
Nov 16 03:42:10 user nova-compute[103546]:     <os_type>hvm</os_type>
Nov 16 03:42:10 user nova-compute[103546]:     <arch name='aarch64'>
Nov 16 03:42:10 user nova-compute[103546]:       <wordsize>64</wordsize>
Nov 16 03:42:10 user nova-compute[103546]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>integratorcp</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>borzoi</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>spitz</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2'>nuri</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2'>musca-b1</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>versatileab</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>kzm</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2'>musca-a</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2'>smdkc210</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>sx1</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>z2</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>tosa</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='4'>sabrelite</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>realview-eb</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>n810</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>n800</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>versatilepb</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>terrier</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>mainstone</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='4'>midway</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>musicpal</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>microbit</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>cubieboard</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>verdex</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>netduino2</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='4'>raspi3b</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='4'>raspi2b</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>cheetah</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='4'>highbank</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>akita</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>connex</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>collie</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>raspi0</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <domain type='qemu'/>
Nov 16 03:42:10 user nova-compute[103546]:     </arch>
Nov 16 03:42:10 user nova-compute[103546]:     <features>
Nov 16 03:42:10 user nova-compute[103546]:       <acpi default='on' toggle='yes'/>
Nov 16 03:42:10 user nova-compute[103546]:       <cpuselection/>
Nov 16 03:42:10 user nova-compute[103546]:       <deviceboot/>
Nov 16 03:42:10 user nova-compute[103546]:       <disksnapshot default='on' toggle='no'/>
Nov 16 03:42:10 user nova-compute[103546]:     </features>
Nov 16 03:42:10 user nova-compute[103546]:   </guest>
Nov 16 03:42:10 user nova-compute[103546]:   <guest>
Nov 16 03:42:10 user nova-compute[103546]:     <os_type>hvm</os_type>
Nov 16 03:42:10 user nova-compute[103546]:     <arch name='cris'>
Nov 16 03:42:10 user nova-compute[103546]:       <wordsize>32</wordsize>
Nov 16 03:42:10 user nova-compute[103546]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <domain type='qemu'/>
Nov 16 03:42:10 user nova-compute[103546]:     </arch>
Nov 16 03:42:10 user nova-compute[103546]:     <features>
Nov 16 03:42:10 user nova-compute[103546]:       <cpuselection/>
Nov 16 03:42:10 user nova-compute[103546]:       <deviceboot/>
Nov 16 03:42:10 user nova-compute[103546]:       <disksnapshot default='on' toggle='no'/>
Nov 16 03:42:10 user nova-compute[103546]:     </features>
Nov 16 03:42:10 user nova-compute[103546]:   </guest>
Nov 16 03:42:10 user nova-compute[103546]:   <guest>
Nov 16 03:42:10 user nova-compute[103546]:     <os_type>hvm</os_type>
Nov 16 03:42:10 user nova-compute[103546]:     <arch name='i686'>
Nov 16 03:42:10 user nova-compute[103546]:       <wordsize>32</wordsize>
Nov 16 03:42:10 user nova-compute[103546]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>x-remote</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>isapc</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>microvm</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <domain type='qemu'/>
Nov 16 03:42:10 user nova-compute[103546]:       <domain type='kvm'/>
Nov 16 03:42:10 user nova-compute[103546]:     </arch>
Nov 16 03:42:10 user nova-compute[103546]:     <features>
Nov 16 03:42:10 user nova-compute[103546]:       <pae/>
Nov 16 03:42:10 user nova-compute[103546]:       <nonpae/>
Nov 16 03:42:10 user nova-compute[103546]:       <acpi default='on' toggle='yes'/>
Nov 16 03:42:10 user nova-compute[103546]:       <apic default='on' toggle='no'/>
Nov 16 03:42:10 user nova-compute[103546]:       <cpuselection/>
Nov 16 03:42:10 user nova-compute[103546]:       <deviceboot/>
Nov 16 03:42:10 user nova-compute[103546]:       <disksnapshot default='on' toggle='no'/>
Nov 16 03:42:10 user nova-compute[103546]:     </features>
Nov 16 03:42:10 user nova-compute[103546]:   </guest>
Nov 16 03:42:10 user nova-compute[103546]:   <guest>
Nov 16 03:42:10 user nova-compute[103546]:     <os_type>hvm</os_type>
Nov 16 03:42:10 user nova-compute[103546]:     <arch name='m68k'>
Nov 16 03:42:10 user nova-compute[103546]:       <wordsize>32</wordsize>
Nov 16 03:42:10 user nova-compute[103546]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>an5206</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>q800</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>next-cube</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <domain type='qemu'/>
Nov 16 03:42:10 user nova-compute[103546]:     </arch>
Nov 16 03:42:10 user nova-compute[103546]:     <features>
Nov 16 03:42:10 user nova-compute[103546]:       <cpuselection/>
Nov 16 03:42:10 user nova-compute[103546]:       <deviceboot/>
Nov 16 03:42:10 user nova-compute[103546]:       <disksnapshot default='on' toggle='no'/>
Nov 16 03:42:10 user nova-compute[103546]:     </features>
Nov 16 03:42:10 user nova-compute[103546]:   </guest>
Nov 16 03:42:10 user nova-compute[103546]:   <guest>
Nov 16 03:42:10 user nova-compute[103546]:     <os_type>hvm</os_type>
Nov 16 03:42:10 user nova-compute[103546]:     <arch name='microblaze'>
Nov 16 03:42:10 user nova-compute[103546]:       <wordsize>32</wordsize>
Nov 16 03:42:10 user nova-compute[103546]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <domain type='qemu'/>
Nov 16 03:42:10 user nova-compute[103546]:     </arch>
Nov 16 03:42:10 user nova-compute[103546]:     <features>
Nov 16 03:42:10 user nova-compute[103546]:       <cpuselection/>
Nov 16 03:42:10 user nova-compute[103546]:       <deviceboot/>
Nov 16 03:42:10 user nova-compute[103546]:       <disksnapshot default='on' toggle='no'/>
Nov 16 03:42:10 user nova-compute[103546]:     </features>
Nov 16 03:42:10 user nova-compute[103546]:   </guest>
Nov 16 03:42:10 user nova-compute[103546]:   <guest>
Nov 16 03:42:10 user nova-compute[103546]:     <os_type>hvm</os_type>
Nov 16 03:42:10 user nova-compute[103546]:     <arch name='microblazeel'>
Nov 16 03:42:10 user nova-compute[103546]:       <wordsize>32</wordsize>
Nov 16 03:42:10 user nova-compute[103546]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <domain type='qemu'/>
Nov 16 03:42:10 user nova-compute[103546]:     </arch>
Nov 16 03:42:10 user nova-compute[103546]:     <features>
Nov 16 03:42:10 user nova-compute[103546]:       <cpuselection/>
Nov 16 03:42:10 user nova-compute[103546]:       <deviceboot/>
Nov 16 03:42:10 user nova-compute[103546]:       <disksnapshot default='on' toggle='no'/>
Nov 16 03:42:10 user nova-compute[103546]:     </features>
Nov 16 03:42:10 user nova-compute[103546]:   </guest>
Nov 16 03:42:10 user nova-compute[103546]:   <guest>
Nov 16 03:42:10 user nova-compute[103546]:     <os_type>hvm</os_type>
Nov 16 03:42:10 user nova-compute[103546]:     <arch name='mips'>
Nov 16 03:42:10 user nova-compute[103546]:       <wordsize>32</wordsize>
Nov 16 03:42:10 user nova-compute[103546]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='16'>malta</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>mipssim</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <domain type='qemu'/>
Nov 16 03:42:10 user nova-compute[103546]:     </arch>
Nov 16 03:42:10 user nova-compute[103546]:     <features>
Nov 16 03:42:10 user nova-compute[103546]:       <cpuselection/>
Nov 16 03:42:10 user nova-compute[103546]:       <deviceboot/>
Nov 16 03:42:10 user nova-compute[103546]:       <disksnapshot default='on' toggle='no'/>
Nov 16 03:42:10 user nova-compute[103546]:     </features>
Nov 16 03:42:10 user nova-compute[103546]:   </guest>
Nov 16 03:42:10 user nova-compute[103546]:   <guest>
Nov 16 03:42:10 user nova-compute[103546]:     <os_type>hvm</os_type>
Nov 16 03:42:10 user nova-compute[103546]:     <arch name='mipsel'>
Nov 16 03:42:10 user nova-compute[103546]:       <wordsize>32</wordsize>
Nov 16 03:42:10 user nova-compute[103546]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='16'>malta</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>mipssim</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <domain type='qemu'/>
Nov 16 03:42:10 user nova-compute[103546]:     </arch>
Nov 16 03:42:10 user nova-compute[103546]:     <features>
Nov 16 03:42:10 user nova-compute[103546]:       <cpuselection/>
Nov 16 03:42:10 user nova-compute[103546]:       <deviceboot/>
Nov 16 03:42:10 user nova-compute[103546]:       <disksnapshot default='on' toggle='no'/>
Nov 16 03:42:10 user nova-compute[103546]:     </features>
Nov 16 03:42:10 user nova-compute[103546]:   </guest>
Nov 16 03:42:10 user nova-compute[103546]:   <guest>
Nov 16 03:42:10 user nova-compute[103546]:     <os_type>hvm</os_type>
Nov 16 03:42:10 user nova-compute[103546]:     <arch name='mips64'>
Nov 16 03:42:10 user nova-compute[103546]:       <wordsize>64</wordsize>
Nov 16 03:42:10 user nova-compute[103546]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='16'>malta</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>mipssim</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>pica61</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>magnum</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <domain type='qemu'/>
Nov 16 03:42:10 user nova-compute[103546]:     </arch>
Nov 16 03:42:10 user nova-compute[103546]:     <features>
Nov 16 03:42:10 user nova-compute[103546]:       <cpuselection/>
Nov 16 03:42:10 user nova-compute[103546]:       <deviceboot/>
Nov 16 03:42:10 user nova-compute[103546]:       <disksnapshot default='on' toggle='no'/>
Nov 16 03:42:10 user nova-compute[103546]:     </features>
Nov 16 03:42:10 user nova-compute[103546]:   </guest>
Nov 16 03:42:10 user nova-compute[103546]:   <guest>
Nov 16 03:42:10 user nova-compute[103546]:     <os_type>hvm</os_type>
Nov 16 03:42:10 user nova-compute[103546]:     <arch name='mips64el'>
Nov 16 03:42:10 user nova-compute[103546]:       <wordsize>64</wordsize>
Nov 16 03:42:10 user nova-compute[103546]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='16'>malta</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>mipssim</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>pica61</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>magnum</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='16'>boston</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <domain type='qemu'/>
Nov 16 03:42:10 user nova-compute[103546]:     </arch>
Nov 16 03:42:10 user nova-compute[103546]:     <features>
Nov 16 03:42:10 user nova-compute[103546]:       <cpuselection/>
Nov 16 03:42:10 user nova-compute[103546]:       <deviceboot/>
Nov 16 03:42:10 user nova-compute[103546]:       <disksnapshot default='on' toggle='no'/>
Nov 16 03:42:10 user nova-compute[103546]:     </features>
Nov 16 03:42:10 user nova-compute[103546]:   </guest>
Nov 16 03:42:10 user nova-compute[103546]:   <guest>
Nov 16 03:42:10 user nova-compute[103546]:     <os_type>hvm</os_type>
Nov 16 03:42:10 user nova-compute[103546]:     <arch name='ppc'>
Nov 16 03:42:10 user nova-compute[103546]:       <wordsize>32</wordsize>
Nov 16 03:42:10 user nova-compute[103546]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>g3beige</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>mac99</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='32'>ppce500</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>pegasos2</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>sam460ex</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>bamboo</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>40p</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>ref405ep</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>taihu</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <domain type='qemu'/>
Nov 16 03:42:10 user nova-compute[103546]:     </arch>
Nov 16 03:42:10 user nova-compute[103546]:     <features>
Nov 16 03:42:10 user nova-compute[103546]:       <cpuselection/>
Nov 16 03:42:10 user nova-compute[103546]:       <deviceboot/>
Nov 16 03:42:10 user nova-compute[103546]:       <disksnapshot default='on' toggle='no'/>
Nov 16 03:42:10 user nova-compute[103546]:     </features>
Nov 16 03:42:10 user nova-compute[103546]:   </guest>
Nov 16 03:42:10 user nova-compute[103546]:   <guest>
Nov 16 03:42:10 user nova-compute[103546]:     <os_type>hvm</os_type>
Nov 16 03:42:10 user nova-compute[103546]:     <arch name='ppc64'>
Nov 16 03:42:10 user nova-compute[103546]:       <wordsize>64</wordsize>
Nov 16 03:42:10 user nova-compute[103546]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2048'>powernv9</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>taihu</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2048'>powernv10</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='32'>ppce500</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>40p</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>pegasos2</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>bamboo</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>g3beige</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>mac99</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>sam460ex</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>ref405ep</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2048'>powernv8</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <domain type='qemu'/>
Nov 16 03:42:10 user nova-compute[103546]:     </arch>
Nov 16 03:42:10 user nova-compute[103546]:     <features>
Nov 16 03:42:10 user nova-compute[103546]:       <cpuselection/>
Nov 16 03:42:10 user nova-compute[103546]:       <deviceboot/>
Nov 16 03:42:10 user nova-compute[103546]:       <disksnapshot default='on' toggle='no'/>
Nov 16 03:42:10 user nova-compute[103546]:     </features>
Nov 16 03:42:10 user nova-compute[103546]:   </guest>
Nov 16 03:42:10 user nova-compute[103546]:   <guest>
Nov 16 03:42:10 user nova-compute[103546]:     <os_type>hvm</os_type>
Nov 16 03:42:10 user nova-compute[103546]:     <arch name='ppc64le'>
Nov 16 03:42:10 user nova-compute[103546]:       <wordsize>64</wordsize>
Nov 16 03:42:10 user nova-compute[103546]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2048'>powernv9</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>taihu</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2048'>powernv10</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='32'>ppce500</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>40p</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>pegasos2</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>bamboo</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>g3beige</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>mac99</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>sam460ex</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>ref405ep</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2048'>powernv8</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <domain type='qemu'/>
Nov 16 03:42:10 user nova-compute[103546]:     </arch>
Nov 16 03:42:10 user nova-compute[103546]:     <features>
Nov 16 03:42:10 user nova-compute[103546]:       <cpuselection/>
Nov 16 03:42:10 user nova-compute[103546]:       <deviceboot/>
Nov 16 03:42:10 user nova-compute[103546]:       <disksnapshot default='on' toggle='no'/>
Nov 16 03:42:10 user nova-compute[103546]:     </features>
Nov 16 03:42:10 user nova-compute[103546]:   </guest>
Nov 16 03:42:10 user nova-compute[103546]:   <guest>
Nov 16 03:42:10 user nova-compute[103546]:     <os_type>hvm</os_type>
Nov 16 03:42:10 user nova-compute[103546]:     <arch name='riscv32'>
Nov 16 03:42:10 user nova-compute[103546]:       <wordsize>32</wordsize>
Nov 16 03:42:10 user nova-compute[103546]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='8'>spike</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>opentitan</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='5'>sifive_u</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>sifive_e</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='8'>virt</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <domain type='qemu'/>
Nov 16 03:42:10 user nova-compute[103546]:     </arch>
Nov 16 03:42:10 user nova-compute[103546]:     <features>
Nov 16 03:42:10 user nova-compute[103546]:       <cpuselection/>
Nov 16 03:42:10 user nova-compute[103546]:       <deviceboot/>
Nov 16 03:42:10 user nova-compute[103546]:       <disksnapshot default='on' toggle='no'/>
Nov 16 03:42:10 user nova-compute[103546]:     </features>
Nov 16 03:42:10 user nova-compute[103546]:   </guest>
Nov 16 03:42:10 user nova-compute[103546]:   <guest>
Nov 16 03:42:10 user nova-compute[103546]:     <os_type>hvm</os_type>
Nov 16 03:42:10 user nova-compute[103546]:     <arch name='riscv64'>
Nov 16 03:42:10 user nova-compute[103546]:       <wordsize>64</wordsize>
Nov 16 03:42:10 user nova-compute[103546]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='8'>spike</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='5'>sifive_u</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>shakti_c</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>sifive_e</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='8'>virt</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <domain type='qemu'/>
Nov 16 03:42:10 user nova-compute[103546]:     </arch>
Nov 16 03:42:10 user nova-compute[103546]:     <features>
Nov 16 03:42:10 user nova-compute[103546]:       <cpuselection/>
Nov 16 03:42:10 user nova-compute[103546]:       <deviceboot/>
Nov 16 03:42:10 user nova-compute[103546]:       <disksnapshot default='on' toggle='no'/>
Nov 16 03:42:10 user nova-compute[103546]:     </features>
Nov 16 03:42:10 user nova-compute[103546]:   </guest>
Nov 16 03:42:10 user nova-compute[103546]:   <guest>
Nov 16 03:42:10 user nova-compute[103546]:     <os_type>hvm</os_type>
Nov 16 03:42:10 user nova-compute[103546]:     <arch name='s390x'>
Nov 16 03:42:10 user nova-compute[103546]:       <wordsize>64</wordsize>
Nov 16 03:42:10 user nova-compute[103546]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <domain type='qemu'/>
Nov 16 03:42:10 user nova-compute[103546]:     </arch>
Nov 16 03:42:10 user nova-compute[103546]:     <features>
Nov 16 03:42:10 user nova-compute[103546]:       <cpuselection/>
Nov 16 03:42:10 user nova-compute[103546]:       <deviceboot/>
Nov 16 03:42:10 user nova-compute[103546]:       <disksnapshot default='on' toggle='no'/>
Nov 16 03:42:10 user nova-compute[103546]:     </features>
Nov 16 03:42:10 user nova-compute[103546]:   </guest>
Nov 16 03:42:10 user nova-compute[103546]:   <guest>
Nov 16 03:42:10 user nova-compute[103546]:     <os_type>hvm</os_type>
Nov 16 03:42:10 user nova-compute[103546]:     <arch name='sh4'>
Nov 16 03:42:10 user nova-compute[103546]:       <wordsize>32</wordsize>
Nov 16 03:42:10 user nova-compute[103546]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>shix</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>r2d</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <domain type='qemu'/>
Nov 16 03:42:10 user nova-compute[103546]:     </arch>
Nov 16 03:42:10 user nova-compute[103546]:     <features>
Nov 16 03:42:10 user nova-compute[103546]:       <cpuselection/>
Nov 16 03:42:10 user nova-compute[103546]:       <deviceboot/>
Nov 16 03:42:10 user nova-compute[103546]:       <disksnapshot default='on' toggle='no'/>
Nov 16 03:42:10 user nova-compute[103546]:     </features>
Nov 16 03:42:10 user nova-compute[103546]:   </guest>
Nov 16 03:42:10 user nova-compute[103546]:   <guest>
Nov 16 03:42:10 user nova-compute[103546]:     <os_type>hvm</os_type>
Nov 16 03:42:10 user nova-compute[103546]:     <arch name='sh4eb'>
Nov 16 03:42:10 user nova-compute[103546]:       <wordsize>64</wordsize>
Nov 16 03:42:10 user nova-compute[103546]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>shix</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>r2d</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <domain type='qemu'/>
Nov 16 03:42:10 user nova-compute[103546]:     </arch>
Nov 16 03:42:10 user nova-compute[103546]:     <features>
Nov 16 03:42:10 user nova-compute[103546]:       <cpuselection/>
Nov 16 03:42:10 user nova-compute[103546]:       <deviceboot/>
Nov 16 03:42:10 user nova-compute[103546]:       <disksnapshot default='on' toggle='no'/>
Nov 16 03:42:10 user nova-compute[103546]:     </features>
Nov 16 03:42:10 user nova-compute[103546]:   </guest>
Nov 16 03:42:10 user nova-compute[103546]:   <guest>
Nov 16 03:42:10 user nova-compute[103546]:     <os_type>hvm</os_type>
Nov 16 03:42:10 user nova-compute[103546]:     <arch name='sparc'>
Nov 16 03:42:10 user nova-compute[103546]:       <wordsize>32</wordsize>
Nov 16 03:42:10 user nova-compute[103546]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>SS-5</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='4'>SS-20</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>LX</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>SS-4</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='4'>SS-10</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>Voyager</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <domain type='qemu'/>
Nov 16 03:42:10 user nova-compute[103546]:     </arch>
Nov 16 03:42:10 user nova-compute[103546]:     <features>
Nov 16 03:42:10 user nova-compute[103546]:       <cpuselection/>
Nov 16 03:42:10 user nova-compute[103546]:       <deviceboot/>
Nov 16 03:42:10 user nova-compute[103546]:       <disksnapshot default='on' toggle='no'/>
Nov 16 03:42:10 user nova-compute[103546]:     </features>
Nov 16 03:42:10 user nova-compute[103546]:   </guest>
Nov 16 03:42:10 user nova-compute[103546]:   <guest>
Nov 16 03:42:10 user nova-compute[103546]:     <os_type>hvm</os_type>
Nov 16 03:42:10 user nova-compute[103546]:     <arch name='sparc64'>
Nov 16 03:42:10 user nova-compute[103546]:       <wordsize>64</wordsize>
Nov 16 03:42:10 user nova-compute[103546]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>sun4u</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>niagara</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>sun4v</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <domain type='qemu'/>
Nov 16 03:42:10 user nova-compute[103546]:     </arch>
Nov 16 03:42:10 user nova-compute[103546]:     <features>
Nov 16 03:42:10 user nova-compute[103546]:       <cpuselection/>
Nov 16 03:42:10 user nova-compute[103546]:       <deviceboot/>
Nov 16 03:42:10 user nova-compute[103546]:       <disksnapshot default='on' toggle='no'/>
Nov 16 03:42:10 user nova-compute[103546]:     </features>
Nov 16 03:42:10 user nova-compute[103546]:   </guest>
Nov 16 03:42:10 user nova-compute[103546]:   <guest>
Nov 16 03:42:10 user nova-compute[103546]:     <os_type>hvm</os_type>
Nov 16 03:42:10 user nova-compute[103546]:     <arch name='x86_64'>
Nov 16 03:42:10 user nova-compute[103546]:       <wordsize>64</wordsize>
Nov 16 03:42:10 user nova-compute[103546]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>x-remote</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='1'>isapc</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>microvm</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <domain type='qemu'/>
Nov 16 03:42:10 user nova-compute[103546]:       <domain type='kvm'/>
Nov 16 03:42:10 user nova-compute[103546]:     </arch>
Nov 16 03:42:10 user nova-compute[103546]:     <features>
Nov 16 03:42:10 user nova-compute[103546]:       <acpi default='on' toggle='yes'/>
Nov 16 03:42:10 user nova-compute[103546]:       <apic default='on' toggle='no'/>
Nov 16 03:42:10 user nova-compute[103546]:       <cpuselection/>
Nov 16 03:42:10 user nova-compute[103546]:       <deviceboot/>
Nov 16 03:42:10 user nova-compute[103546]:       <disksnapshot default='on' toggle='no'/>
Nov 16 03:42:10 user nova-compute[103546]:     </features>
Nov 16 03:42:10 user nova-compute[103546]:   </guest>
Nov 16 03:42:10 user nova-compute[103546]:   <guest>
Nov 16 03:42:10 user nova-compute[103546]:     <os_type>hvm</os_type>
Nov 16 03:42:10 user nova-compute[103546]:     <arch name='xtensa'>
Nov 16 03:42:10 user nova-compute[103546]:       <wordsize>32</wordsize>
Nov 16 03:42:10 user nova-compute[103546]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='4'>sim</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='32'>kc705</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='32'>ml605</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='32'>virt</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='32'>lx200</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='32'>lx60</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <domain type='qemu'/>
Nov 16 03:42:10 user nova-compute[103546]:     </arch>
Nov 16 03:42:10 user nova-compute[103546]:     <features>
Nov 16 03:42:10 user nova-compute[103546]:       <cpuselection/>
Nov 16 03:42:10 user nova-compute[103546]:       <deviceboot/>
Nov 16 03:42:10 user nova-compute[103546]:       <disksnapshot default='on' toggle='no'/>
Nov 16 03:42:10 user nova-compute[103546]:     </features>
Nov 16 03:42:10 user nova-compute[103546]:   </guest>
Nov 16 03:42:10 user nova-compute[103546]:   <guest>
Nov 16 03:42:10 user nova-compute[103546]:     <os_type>hvm</os_type>
Nov 16 03:42:10 user nova-compute[103546]:     <arch name='xtensaeb'>
Nov 16 03:42:10 user nova-compute[103546]:       <wordsize>32</wordsize>
Nov 16 03:42:10 user nova-compute[103546]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='4'>sim</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='32'>kc705</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='32'>ml605</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='32'>virt</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='32'>lx200</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='32'>lx60</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 16 03:42:10 user nova-compute[103546]:       <domain type='qemu'/>
Nov 16 03:42:10 user nova-compute[103546]:     </arch>
Nov 16 03:42:10 user nova-compute[103546]:     <features>
Nov 16 03:42:10 user nova-compute[103546]:       <cpuselection/>
Nov 16 03:42:10 user nova-compute[103546]:       <deviceboot/>
Nov 16 03:42:10 user nova-compute[103546]:       <disksnapshot default='on' toggle='no'/>
Nov 16 03:42:10 user nova-compute[103546]:     </features>
Nov 16 03:42:10 user nova-compute[103546]:   </guest>
Nov 16 03:42:10 user nova-compute[103546]: </capabilities>
Nov 16 03:42:10 user nova-compute[103546]: 
Nov 16 03:42:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=103546) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 03:42:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=103546) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 03:42:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=103546) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 03:42:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=103546) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 03:42:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=103546) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 03:42:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=103546) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 03:42:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=103546) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 03:42:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=103546) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 03:42:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=103546) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 03:42:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Getting domain capabilities for cris via machine types: {None} {{(pid=103546) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 03:42:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=103546) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 03:42:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Getting domain capabilities for i686 via machine types: {'pc', 'ubuntu', 'ubuntu-q35', 'q35'} {{(pid=103546) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 03:42:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 16 03:42:10 user nova-compute[103546]: <domainCapabilities>
Nov 16 03:42:10 user nova-compute[103546]:   <path>/usr/bin/qemu-system-i386</path>
Nov 16 03:42:10 user nova-compute[103546]:   <domain>kvm</domain>
Nov 16 03:42:10 user nova-compute[103546]:   <machine>pc-i440fx-6.2</machine>
Nov 16 03:42:10 user nova-compute[103546]:   <arch>i686</arch>
Nov 16 03:42:10 user nova-compute[103546]:   <vcpu max='255'/>
Nov 16 03:42:10 user nova-compute[103546]:   <iothreads supported='yes'/>
Nov 16 03:42:10 user nova-compute[103546]:   <os supported='yes'>
Nov 16 03:42:10 user nova-compute[103546]:     <enum name='firmware'/>
Nov 16 03:42:10 user nova-compute[103546]:     <loader supported='yes'>
Nov 16 03:42:10 user nova-compute[103546]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 16 03:42:10 user nova-compute[103546]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 16 03:42:10 user nova-compute[103546]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 16 03:42:10 user nova-compute[103546]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 16 03:42:10 user nova-compute[103546]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='type'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>rom</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>pflash</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='readonly'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>yes</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>no</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='secure'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>no</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:     </loader>
Nov 16 03:42:10 user nova-compute[103546]:   </os>
Nov 16 03:42:10 user nova-compute[103546]:   <cpu>
Nov 16 03:42:10 user nova-compute[103546]:     <mode name='host-passthrough' supported='yes'>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='hostPassthroughMigratable'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>off</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:     </mode>
Nov 16 03:42:10 user nova-compute[103546]:     <mode name='maximum' supported='yes'>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='maximumMigratable'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>on</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>off</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:     </mode>
Nov 16 03:42:10 user nova-compute[103546]:     <mode name='host-model' supported='yes'>
Nov 16 03:42:10 user nova-compute[103546]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 03:42:10 user nova-compute[103546]:       <vendor>Intel</vendor>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='require' name='ss'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='require' name='vmx'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='require' name='pcid'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='require' name='hypervisor'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='require' name='arat'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='require' name='umip'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='require' name='md-clear'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='require' name='stibp'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='require' name='ssbd'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='require' name='ibpb'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='require' name='ibrs'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='require' name='amd-stibp'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='disable' name='erms'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='disable' name='lm'/>
Nov 16 03:42:10 user nova-compute[103546]:     </mode>
Nov 16 03:42:10 user nova-compute[103546]:     <mode name='custom' supported='yes'>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>qemu64</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='yes'>qemu32</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>phenom</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='yes'>pentium3</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='yes'>pentium2</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='yes'>pentium</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>n270</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>kvm64</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='yes'>kvm32</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='yes'>coreduo</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>core2duo</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>athlon</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Westmere-IBRS</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Westmere</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Snowridge</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Skylake-Server</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Skylake-Client</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>SandyBridge</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Penryn</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Opteron_G5</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Opteron_G4</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Opteron_G3</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Opteron_G2</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Opteron_G1</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Nehalem-IBRS</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Nehalem</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>IvyBridge</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Icelake-Server</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Haswell</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>EPYC-Rome</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>EPYC-Milan</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>EPYC</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Dhyana</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Cooperlake</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Conroe</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Broadwell</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='yes'>486</model>
Nov 16 03:42:10 user nova-compute[103546]:     </mode>
Nov 16 03:42:10 user nova-compute[103546]:   </cpu>
Nov 16 03:42:10 user nova-compute[103546]:   <memoryBacking supported='yes'>
Nov 16 03:42:10 user nova-compute[103546]:     <enum name='sourceType'>
Nov 16 03:42:10 user nova-compute[103546]:       <value>file</value>
Nov 16 03:42:10 user nova-compute[103546]:       <value>anonymous</value>
Nov 16 03:42:10 user nova-compute[103546]:       <value>memfd</value>
Nov 16 03:42:10 user nova-compute[103546]:     </enum>
Nov 16 03:42:10 user nova-compute[103546]:   </memoryBacking>
Nov 16 03:42:10 user nova-compute[103546]:   <devices>
Nov 16 03:42:10 user nova-compute[103546]:     <disk supported='yes'>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='diskDevice'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>disk</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>cdrom</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>floppy</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>lun</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='bus'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>ide</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>fdc</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>scsi</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>virtio</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>usb</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>sata</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='model'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>virtio</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>virtio-transitional</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>virtio-non-transitional</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:     </disk>
Nov 16 03:42:10 user nova-compute[103546]:     <graphics supported='yes'>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='type'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>sdl</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>vnc</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>spice</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>egl-headless</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:     </graphics>
Nov 16 03:42:10 user nova-compute[103546]:     <video supported='yes'>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='modelType'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>vga</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>cirrus</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>vmvga</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>qxl</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>virtio</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>none</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>bochs</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>ramfb</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:     </video>
Nov 16 03:42:10 user nova-compute[103546]:     <hostdev supported='yes'>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='mode'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>subsystem</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='startupPolicy'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>default</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>mandatory</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>requisite</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>optional</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='subsysType'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>usb</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>pci</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>scsi</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='capsType'/>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='pciBackend'/>
Nov 16 03:42:10 user nova-compute[103546]:     </hostdev>
Nov 16 03:42:10 user nova-compute[103546]:     <rng supported='yes'>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='model'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>virtio</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>virtio-transitional</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>virtio-non-transitional</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='backendModel'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>random</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>egd</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>builtin</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:     </rng>
Nov 16 03:42:10 user nova-compute[103546]:     <filesystem supported='yes'>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='driverType'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>path</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>handle</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>virtiofs</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:     </filesystem>
Nov 16 03:42:10 user nova-compute[103546]:     <tpm supported='yes'>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='model'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>tpm-tis</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>tpm-crb</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='backendModel'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>passthrough</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>emulator</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:     </tpm>
Nov 16 03:42:10 user nova-compute[103546]:   </devices>
Nov 16 03:42:10 user nova-compute[103546]:   <features>
Nov 16 03:42:10 user nova-compute[103546]:     <gic supported='no'/>
Nov 16 03:42:10 user nova-compute[103546]:     <vmcoreinfo supported='yes'/>
Nov 16 03:42:10 user nova-compute[103546]:     <genid supported='yes'/>
Nov 16 03:42:10 user nova-compute[103546]:     <backingStoreInput supported='yes'/>
Nov 16 03:42:10 user nova-compute[103546]:     <backup supported='yes'/>
Nov 16 03:42:10 user nova-compute[103546]:     <sev supported='no'/>
Nov 16 03:42:10 user nova-compute[103546]:   </features>
Nov 16 03:42:10 user nova-compute[103546]: </domainCapabilities>
Nov 16 03:42:10 user nova-compute[103546]:  {{(pid=103546) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 03:42:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 16 03:42:10 user nova-compute[103546]: <domainCapabilities>
Nov 16 03:42:10 user nova-compute[103546]:   <path>/usr/bin/qemu-system-i386</path>
Nov 16 03:42:10 user nova-compute[103546]:   <domain>kvm</domain>
Nov 16 03:42:10 user nova-compute[103546]:   <machine>pc-i440fx-jammy</machine>
Nov 16 03:42:10 user nova-compute[103546]:   <arch>i686</arch>
Nov 16 03:42:10 user nova-compute[103546]:   <vcpu max='255'/>
Nov 16 03:42:10 user nova-compute[103546]:   <iothreads supported='yes'/>
Nov 16 03:42:10 user nova-compute[103546]:   <os supported='yes'>
Nov 16 03:42:10 user nova-compute[103546]:     <enum name='firmware'/>
Nov 16 03:42:10 user nova-compute[103546]:     <loader supported='yes'>
Nov 16 03:42:10 user nova-compute[103546]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 16 03:42:10 user nova-compute[103546]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 16 03:42:10 user nova-compute[103546]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 16 03:42:10 user nova-compute[103546]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 16 03:42:10 user nova-compute[103546]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='type'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>rom</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>pflash</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='readonly'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>yes</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>no</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='secure'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>no</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:     </loader>
Nov 16 03:42:10 user nova-compute[103546]:   </os>
Nov 16 03:42:10 user nova-compute[103546]:   <cpu>
Nov 16 03:42:10 user nova-compute[103546]:     <mode name='host-passthrough' supported='yes'>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='hostPassthroughMigratable'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>off</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:     </mode>
Nov 16 03:42:10 user nova-compute[103546]:     <mode name='maximum' supported='yes'>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='maximumMigratable'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>on</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>off</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:     </mode>
Nov 16 03:42:10 user nova-compute[103546]:     <mode name='host-model' supported='yes'>
Nov 16 03:42:10 user nova-compute[103546]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 03:42:10 user nova-compute[103546]:       <vendor>Intel</vendor>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='require' name='ss'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='require' name='vmx'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='require' name='pcid'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='require' name='hypervisor'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='require' name='arat'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='require' name='umip'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='require' name='md-clear'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='require' name='stibp'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='require' name='ssbd'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='require' name='ibpb'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='require' name='ibrs'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='require' name='amd-stibp'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='disable' name='erms'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='disable' name='lm'/>
Nov 16 03:42:10 user nova-compute[103546]:     </mode>
Nov 16 03:42:10 user nova-compute[103546]:     <mode name='custom' supported='yes'>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>qemu64</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='yes'>qemu32</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>phenom</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='yes'>pentium3</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='yes'>pentium2</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='yes'>pentium</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>n270</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>kvm64</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='yes'>kvm32</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='yes'>coreduo</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>core2duo</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>athlon</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Westmere-IBRS</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Westmere</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Snowridge</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Skylake-Server</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Skylake-Client</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>SandyBridge</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Penryn</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Opteron_G5</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Opteron_G4</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Opteron_G3</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Opteron_G2</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Opteron_G1</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Nehalem-IBRS</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Nehalem</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>IvyBridge</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Icelake-Server</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Haswell</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>EPYC-Rome</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>EPYC-Milan</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>EPYC</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Dhyana</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Cooperlake</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Conroe</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Broadwell</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='yes'>486</model>
Nov 16 03:42:10 user nova-compute[103546]:     </mode>
Nov 16 03:42:10 user nova-compute[103546]:   </cpu>
Nov 16 03:42:10 user nova-compute[103546]:   <memoryBacking supported='yes'>
Nov 16 03:42:10 user nova-compute[103546]:     <enum name='sourceType'>
Nov 16 03:42:10 user nova-compute[103546]:       <value>file</value>
Nov 16 03:42:10 user nova-compute[103546]:       <value>anonymous</value>
Nov 16 03:42:10 user nova-compute[103546]:       <value>memfd</value>
Nov 16 03:42:10 user nova-compute[103546]:     </enum>
Nov 16 03:42:10 user nova-compute[103546]:   </memoryBacking>
Nov 16 03:42:10 user nova-compute[103546]:   <devices>
Nov 16 03:42:10 user nova-compute[103546]:     <disk supported='yes'>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='diskDevice'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>disk</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>cdrom</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>floppy</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>lun</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='bus'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>ide</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>fdc</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>scsi</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>virtio</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>usb</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>sata</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='model'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>virtio</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>virtio-transitional</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>virtio-non-transitional</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:     </disk>
Nov 16 03:42:10 user nova-compute[103546]:     <graphics supported='yes'>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='type'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>sdl</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>vnc</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>spice</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>egl-headless</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:     </graphics>
Nov 16 03:42:10 user nova-compute[103546]:     <video supported='yes'>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='modelType'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>vga</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>cirrus</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>vmvga</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>qxl</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>virtio</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>none</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>bochs</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>ramfb</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:     </video>
Nov 16 03:42:10 user nova-compute[103546]:     <hostdev supported='yes'>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='mode'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>subsystem</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='startupPolicy'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>default</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>mandatory</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>requisite</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>optional</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='subsysType'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>usb</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>pci</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>scsi</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='capsType'/>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='pciBackend'/>
Nov 16 03:42:10 user nova-compute[103546]:     </hostdev>
Nov 16 03:42:10 user nova-compute[103546]:     <rng supported='yes'>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='model'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>virtio</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>virtio-transitional</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>virtio-non-transitional</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='backendModel'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>random</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>egd</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>builtin</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:     </rng>
Nov 16 03:42:10 user nova-compute[103546]:     <filesystem supported='yes'>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='driverType'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>path</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>handle</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>virtiofs</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:     </filesystem>
Nov 16 03:42:10 user nova-compute[103546]:     <tpm supported='yes'>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='model'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>tpm-tis</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>tpm-crb</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='backendModel'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>passthrough</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>emulator</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:     </tpm>
Nov 16 03:42:10 user nova-compute[103546]:   </devices>
Nov 16 03:42:10 user nova-compute[103546]:   <features>
Nov 16 03:42:10 user nova-compute[103546]:     <gic supported='no'/>
Nov 16 03:42:10 user nova-compute[103546]:     <vmcoreinfo supported='yes'/>
Nov 16 03:42:10 user nova-compute[103546]:     <genid supported='yes'/>
Nov 16 03:42:10 user nova-compute[103546]:     <backingStoreInput supported='yes'/>
Nov 16 03:42:10 user nova-compute[103546]:     <backup supported='yes'/>
Nov 16 03:42:10 user nova-compute[103546]:     <sev supported='no'/>
Nov 16 03:42:10 user nova-compute[103546]:   </features>
Nov 16 03:42:10 user nova-compute[103546]: </domainCapabilities>
Nov 16 03:42:10 user nova-compute[103546]:  {{(pid=103546) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 03:42:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 16 03:42:10 user nova-compute[103546]: <domainCapabilities>
Nov 16 03:42:10 user nova-compute[103546]:   <path>/usr/bin/qemu-system-i386</path>
Nov 16 03:42:10 user nova-compute[103546]:   <domain>kvm</domain>
Nov 16 03:42:10 user nova-compute[103546]:   <machine>pc-q35-jammy</machine>
Nov 16 03:42:10 user nova-compute[103546]:   <arch>i686</arch>
Nov 16 03:42:10 user nova-compute[103546]:   <vcpu max='288'/>
Nov 16 03:42:10 user nova-compute[103546]:   <iothreads supported='yes'/>
Nov 16 03:42:10 user nova-compute[103546]:   <os supported='yes'>
Nov 16 03:42:10 user nova-compute[103546]:     <enum name='firmware'/>
Nov 16 03:42:10 user nova-compute[103546]:     <loader supported='yes'>
Nov 16 03:42:10 user nova-compute[103546]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 16 03:42:10 user nova-compute[103546]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 16 03:42:10 user nova-compute[103546]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 16 03:42:10 user nova-compute[103546]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 16 03:42:10 user nova-compute[103546]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='type'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>rom</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>pflash</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='readonly'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>yes</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>no</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='secure'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>no</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:     </loader>
Nov 16 03:42:10 user nova-compute[103546]:   </os>
Nov 16 03:42:10 user nova-compute[103546]:   <cpu>
Nov 16 03:42:10 user nova-compute[103546]:     <mode name='host-passthrough' supported='yes'>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='hostPassthroughMigratable'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>off</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:     </mode>
Nov 16 03:42:10 user nova-compute[103546]:     <mode name='maximum' supported='yes'>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='maximumMigratable'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>on</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>off</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:     </mode>
Nov 16 03:42:10 user nova-compute[103546]:     <mode name='host-model' supported='yes'>
Nov 16 03:42:10 user nova-compute[103546]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 03:42:10 user nova-compute[103546]:       <vendor>Intel</vendor>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='require' name='ss'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='require' name='vmx'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='require' name='pcid'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='require' name='hypervisor'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='require' name='arat'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='require' name='umip'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='require' name='md-clear'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='require' name='stibp'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='require' name='ssbd'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='require' name='ibpb'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='require' name='ibrs'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='require' name='amd-stibp'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='disable' name='erms'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='disable' name='lm'/>
Nov 16 03:42:10 user nova-compute[103546]:     </mode>
Nov 16 03:42:10 user nova-compute[103546]:     <mode name='custom' supported='yes'>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>qemu64</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='yes'>qemu32</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>phenom</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='yes'>pentium3</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='yes'>pentium2</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='yes'>pentium</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>n270</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>kvm64</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='yes'>kvm32</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='yes'>coreduo</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>core2duo</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>athlon</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Westmere-IBRS</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Westmere</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Snowridge</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Skylake-Server</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Skylake-Client</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>SandyBridge</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Penryn</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Opteron_G5</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Opteron_G4</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Opteron_G3</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Opteron_G2</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Opteron_G1</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Nehalem-IBRS</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Nehalem</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>IvyBridge</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Icelake-Server</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Haswell</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>EPYC-Rome</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>EPYC-Milan</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>EPYC</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Dhyana</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Cooperlake</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Conroe</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Broadwell</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='yes'>486</model>
Nov 16 03:42:10 user nova-compute[103546]:     </mode>
Nov 16 03:42:10 user nova-compute[103546]:   </cpu>
Nov 16 03:42:10 user nova-compute[103546]:   <memoryBacking supported='yes'>
Nov 16 03:42:10 user nova-compute[103546]:     <enum name='sourceType'>
Nov 16 03:42:10 user nova-compute[103546]:       <value>file</value>
Nov 16 03:42:10 user nova-compute[103546]:       <value>anonymous</value>
Nov 16 03:42:10 user nova-compute[103546]:       <value>memfd</value>
Nov 16 03:42:10 user nova-compute[103546]:     </enum>
Nov 16 03:42:10 user nova-compute[103546]:   </memoryBacking>
Nov 16 03:42:10 user nova-compute[103546]:   <devices>
Nov 16 03:42:10 user nova-compute[103546]:     <disk supported='yes'>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='diskDevice'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>disk</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>cdrom</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>floppy</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>lun</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='bus'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>fdc</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>scsi</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>virtio</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>usb</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>sata</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='model'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>virtio</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>virtio-transitional</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>virtio-non-transitional</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:     </disk>
Nov 16 03:42:10 user nova-compute[103546]:     <graphics supported='yes'>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='type'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>sdl</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>vnc</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>spice</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>egl-headless</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:     </graphics>
Nov 16 03:42:10 user nova-compute[103546]:     <video supported='yes'>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='modelType'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>vga</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>cirrus</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>vmvga</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>qxl</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>virtio</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>none</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>bochs</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>ramfb</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:     </video>
Nov 16 03:42:10 user nova-compute[103546]:     <hostdev supported='yes'>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='mode'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>subsystem</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='startupPolicy'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>default</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>mandatory</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>requisite</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>optional</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='subsysType'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>usb</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>pci</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>scsi</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='capsType'/>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='pciBackend'/>
Nov 16 03:42:10 user nova-compute[103546]:     </hostdev>
Nov 16 03:42:10 user nova-compute[103546]:     <rng supported='yes'>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='model'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>virtio</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>virtio-transitional</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>virtio-non-transitional</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='backendModel'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>random</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>egd</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>builtin</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:     </rng>
Nov 16 03:42:10 user nova-compute[103546]:     <filesystem supported='yes'>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='driverType'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>path</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>handle</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>virtiofs</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:     </filesystem>
Nov 16 03:42:10 user nova-compute[103546]:     <tpm supported='yes'>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='model'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>tpm-tis</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>tpm-crb</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='backendModel'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>passthrough</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>emulator</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:     </tpm>
Nov 16 03:42:10 user nova-compute[103546]:   </devices>
Nov 16 03:42:10 user nova-compute[103546]:   <features>
Nov 16 03:42:10 user nova-compute[103546]:     <gic supported='no'/>
Nov 16 03:42:10 user nova-compute[103546]:     <vmcoreinfo supported='yes'/>
Nov 16 03:42:10 user nova-compute[103546]:     <genid supported='yes'/>
Nov 16 03:42:10 user nova-compute[103546]:     <backingStoreInput supported='yes'/>
Nov 16 03:42:10 user nova-compute[103546]:     <backup supported='yes'/>
Nov 16 03:42:10 user nova-compute[103546]:     <sev supported='no'/>
Nov 16 03:42:10 user nova-compute[103546]:   </features>
Nov 16 03:42:10 user nova-compute[103546]: </domainCapabilities>
Nov 16 03:42:10 user nova-compute[103546]:  {{(pid=103546) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 03:42:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 16 03:42:10 user nova-compute[103546]: <domainCapabilities>
Nov 16 03:42:10 user nova-compute[103546]:   <path>/usr/bin/qemu-system-i386</path>
Nov 16 03:42:10 user nova-compute[103546]:   <domain>kvm</domain>
Nov 16 03:42:10 user nova-compute[103546]:   <machine>pc-q35-6.2</machine>
Nov 16 03:42:10 user nova-compute[103546]:   <arch>i686</arch>
Nov 16 03:42:10 user nova-compute[103546]:   <vcpu max='288'/>
Nov 16 03:42:10 user nova-compute[103546]:   <iothreads supported='yes'/>
Nov 16 03:42:10 user nova-compute[103546]:   <os supported='yes'>
Nov 16 03:42:10 user nova-compute[103546]:     <enum name='firmware'/>
Nov 16 03:42:10 user nova-compute[103546]:     <loader supported='yes'>
Nov 16 03:42:10 user nova-compute[103546]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 16 03:42:10 user nova-compute[103546]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 16 03:42:10 user nova-compute[103546]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 16 03:42:10 user nova-compute[103546]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 16 03:42:10 user nova-compute[103546]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='type'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>rom</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>pflash</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='readonly'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>yes</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>no</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='secure'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>no</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:     </loader>
Nov 16 03:42:10 user nova-compute[103546]:   </os>
Nov 16 03:42:10 user nova-compute[103546]:   <cpu>
Nov 16 03:42:10 user nova-compute[103546]:     <mode name='host-passthrough' supported='yes'>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='hostPassthroughMigratable'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>off</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:     </mode>
Nov 16 03:42:10 user nova-compute[103546]:     <mode name='maximum' supported='yes'>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='maximumMigratable'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>on</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>off</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:     </mode>
Nov 16 03:42:10 user nova-compute[103546]:     <mode name='host-model' supported='yes'>
Nov 16 03:42:10 user nova-compute[103546]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 03:42:10 user nova-compute[103546]:       <vendor>Intel</vendor>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='require' name='ss'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='require' name='vmx'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='require' name='pcid'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='require' name='hypervisor'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='require' name='arat'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='require' name='umip'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='require' name='md-clear'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='require' name='stibp'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='require' name='ssbd'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='require' name='ibpb'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='require' name='ibrs'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='require' name='amd-stibp'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='disable' name='erms'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 03:42:10 user nova-compute[103546]:       <feature policy='disable' name='lm'/>
Nov 16 03:42:10 user nova-compute[103546]:     </mode>
Nov 16 03:42:10 user nova-compute[103546]:     <mode name='custom' supported='yes'>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>qemu64</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='yes'>qemu32</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>phenom</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='yes'>pentium3</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='yes'>pentium2</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='yes'>pentium</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>n270</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>kvm64</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='yes'>kvm32</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='yes'>coreduo</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>core2duo</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>athlon</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Westmere-IBRS</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Westmere</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Snowridge</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Skylake-Server</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Skylake-Client</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>SandyBridge</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Penryn</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Opteron_G5</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Opteron_G4</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Opteron_G3</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Opteron_G2</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Opteron_G1</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Nehalem-IBRS</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Nehalem</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>IvyBridge</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Icelake-Server</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Haswell</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>EPYC-Rome</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>EPYC-Milan</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>EPYC</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Dhyana</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Cooperlake</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Conroe</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='no'>Broadwell</model>
Nov 16 03:42:10 user nova-compute[103546]:       <model usable='yes'>486</model>
Nov 16 03:42:10 user nova-compute[103546]:     </mode>
Nov 16 03:42:10 user nova-compute[103546]:   </cpu>
Nov 16 03:42:10 user nova-compute[103546]:   <memoryBacking supported='yes'>
Nov 16 03:42:10 user nova-compute[103546]:     <enum name='sourceType'>
Nov 16 03:42:10 user nova-compute[103546]:       <value>file</value>
Nov 16 03:42:10 user nova-compute[103546]:       <value>anonymous</value>
Nov 16 03:42:10 user nova-compute[103546]:       <value>memfd</value>
Nov 16 03:42:10 user nova-compute[103546]:     </enum>
Nov 16 03:42:10 user nova-compute[103546]:   </memoryBacking>
Nov 16 03:42:10 user nova-compute[103546]:   <devices>
Nov 16 03:42:10 user nova-compute[103546]:     <disk supported='yes'>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='diskDevice'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>disk</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>cdrom</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>floppy</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>lun</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='bus'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>fdc</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>scsi</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>virtio</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>usb</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>sata</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='model'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>virtio</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>virtio-transitional</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>virtio-non-transitional</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:     </disk>
Nov 16 03:42:10 user nova-compute[103546]:     <graphics supported='yes'>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='type'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>sdl</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>vnc</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>spice</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>egl-headless</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:     </graphics>
Nov 16 03:42:10 user nova-compute[103546]:     <video supported='yes'>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='modelType'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>vga</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>cirrus</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>vmvga</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>qxl</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>virtio</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>none</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>bochs</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>ramfb</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:     </video>
Nov 16 03:42:10 user nova-compute[103546]:     <hostdev supported='yes'>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='mode'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>subsystem</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='startupPolicy'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>default</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>mandatory</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>requisite</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>optional</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='subsysType'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>usb</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>pci</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>scsi</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='capsType'/>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='pciBackend'/>
Nov 16 03:42:10 user nova-compute[103546]:     </hostdev>
Nov 16 03:42:10 user nova-compute[103546]:     <rng supported='yes'>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='model'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>virtio</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>virtio-transitional</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>virtio-non-transitional</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='backendModel'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>random</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>egd</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>builtin</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:     </rng>
Nov 16 03:42:10 user nova-compute[103546]:     <filesystem supported='yes'>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='driverType'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>path</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>handle</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>virtiofs</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:     </filesystem>
Nov 16 03:42:10 user nova-compute[103546]:     <tpm supported='yes'>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='model'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>tpm-tis</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>tpm-crb</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='backendModel'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>passthrough</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>emulator</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:     </tpm>
Nov 16 03:42:10 user nova-compute[103546]:   </devices>
Nov 16 03:42:10 user nova-compute[103546]:   <features>
Nov 16 03:42:10 user nova-compute[103546]:     <gic supported='no'/>
Nov 16 03:42:10 user nova-compute[103546]:     <vmcoreinfo supported='yes'/>
Nov 16 03:42:10 user nova-compute[103546]:     <genid supported='yes'/>
Nov 16 03:42:10 user nova-compute[103546]:     <backingStoreInput supported='yes'/>
Nov 16 03:42:10 user nova-compute[103546]:     <backup supported='yes'/>
Nov 16 03:42:10 user nova-compute[103546]:     <sev supported='no'/>
Nov 16 03:42:10 user nova-compute[103546]:   </features>
Nov 16 03:42:10 user nova-compute[103546]: </domainCapabilities>
Nov 16 03:42:10 user nova-compute[103546]:  {{(pid=103546) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 03:42:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=103546) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 03:42:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=103546) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 03:42:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=103546) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 03:42:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=103546) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 03:42:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=103546) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 03:42:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=103546) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 03:42:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=103546) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 03:42:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Getting domain capabilities for mips via machine types: {None} {{(pid=103546) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 03:42:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=103546) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 03:42:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=103546) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 03:42:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=103546) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 03:42:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=103546) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 03:42:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=103546) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 03:42:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=103546) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 03:42:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=103546) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 03:42:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=103546) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 03:42:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=103546) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 03:42:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=103546) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 03:42:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=103546) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 03:42:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=103546) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 03:42:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=103546) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 03:42:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=103546) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 03:42:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=103546) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 03:42:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=103546) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 03:42:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=103546) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 03:42:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=103546) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 03:42:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=103546) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 03:42:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=103546) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 03:42:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=103546) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 03:42:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=103546) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 03:42:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=103546) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 03:42:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=103546) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 03:42:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=103546) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 03:42:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=103546) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 03:42:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=103546) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 03:42:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=103546) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 03:42:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=103546) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 03:42:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=103546) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 03:42:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'ubuntu', 'ubuntu-q35', 'q35'} {{(pid=103546) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 03:42:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 16 03:42:10 user nova-compute[103546]: <domainCapabilities>
Nov 16 03:42:10 user nova-compute[103546]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 16 03:42:10 user nova-compute[103546]:   <domain>kvm</domain>
Nov 16 03:42:10 user nova-compute[103546]:   <machine>pc-i440fx-6.2</machine>
Nov 16 03:42:10 user nova-compute[103546]:   <arch>x86_64</arch>
Nov 16 03:42:10 user nova-compute[103546]:   <vcpu max='255'/>
Nov 16 03:42:10 user nova-compute[103546]:   <iothreads supported='yes'/>
Nov 16 03:42:10 user nova-compute[103546]:   <os supported='yes'>
Nov 16 03:42:10 user nova-compute[103546]:     <enum name='firmware'>
Nov 16 03:42:10 user nova-compute[103546]:       <value>efi</value>
Nov 16 03:42:10 user nova-compute[103546]:     </enum>
Nov 16 03:42:10 user nova-compute[103546]:     <loader supported='yes'>
Nov 16 03:42:10 user nova-compute[103546]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='type'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>rom</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>pflash</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='readonly'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>yes</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>no</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='secure'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>no</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:     </loader>
Nov 16 03:42:10 user nova-compute[103546]:   </os>
Nov 16 03:42:10 user nova-compute[103546]:   <cpu>
Nov 16 03:42:10 user nova-compute[103546]:     <mode name='host-passthrough' supported='yes'>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='hostPassthroughMigratable'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>on</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>off</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:     </mode>
Nov 16 03:42:10 user nova-compute[103546]:     <mode name='maximum' supported='yes'>
Nov 16 03:42:10 user nova-compute[103546]:       <enum name='maximumMigratable'>
Nov 16 03:42:10 user nova-compute[103546]:         <value>on</value>
Nov 16 03:42:10 user nova-compute[103546]:         <value>off</value>
Nov 16 03:42:10 user nova-compute[103546]:       </enum>
Nov 16 03:42:10 user nova-compute[103546]:     </mode>
Nov 16 03:42:10 user nova-compute[103546]:     <mode name='host-model' supported='yes'>
Nov 16 03:42:11 user nova-compute[103546]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 03:42:11 user nova-compute[103546]:       <vendor>Intel</vendor>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='ss'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='vmx'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='pcid'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='hypervisor'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='arat'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='umip'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='md-clear'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='stibp'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='ssbd'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='invtsc'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='ibpb'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='ibrs'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='amd-stibp'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='rsba'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='pschange-mc-no'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='disable' name='erms'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 03:42:11 user nova-compute[103546]:     </mode>
Nov 16 03:42:11 user nova-compute[103546]:     <mode name='custom' supported='yes'>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>qemu64</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>qemu32</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>phenom</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>pentium3</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>pentium2</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>pentium</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>n270</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>kvm64</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>kvm32</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>coreduo</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>core2duo</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>athlon</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>Westmere-IBRS</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>Westmere</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Snowridge</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Skylake-Server</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Skylake-Client</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>SandyBridge</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>Penryn</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Opteron_G5</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Opteron_G4</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Opteron_G3</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Opteron_G2</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>Opteron_G1</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>Nehalem</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>IvyBridge</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Icelake-Server</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Haswell</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>EPYC-Rome</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>EPYC-Milan</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>EPYC</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Dhyana</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Cooperlake</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>Conroe</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Broadwell</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>486</model>
Nov 16 03:42:11 user nova-compute[103546]:     </mode>
Nov 16 03:42:11 user nova-compute[103546]:   </cpu>
Nov 16 03:42:11 user nova-compute[103546]:   <memoryBacking supported='yes'>
Nov 16 03:42:11 user nova-compute[103546]:     <enum name='sourceType'>
Nov 16 03:42:11 user nova-compute[103546]:       <value>file</value>
Nov 16 03:42:11 user nova-compute[103546]:       <value>anonymous</value>
Nov 16 03:42:11 user nova-compute[103546]:       <value>memfd</value>
Nov 16 03:42:11 user nova-compute[103546]:     </enum>
Nov 16 03:42:11 user nova-compute[103546]:   </memoryBacking>
Nov 16 03:42:11 user nova-compute[103546]:   <devices>
Nov 16 03:42:11 user nova-compute[103546]:     <disk supported='yes'>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='diskDevice'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>disk</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>cdrom</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>floppy</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>lun</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='bus'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>ide</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>fdc</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>scsi</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>virtio</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>usb</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>sata</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='model'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>virtio</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>virtio-transitional</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>virtio-non-transitional</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:     </disk>
Nov 16 03:42:11 user nova-compute[103546]:     <graphics supported='yes'>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='type'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>sdl</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>vnc</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>spice</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>egl-headless</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:     </graphics>
Nov 16 03:42:11 user nova-compute[103546]:     <video supported='yes'>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='modelType'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>vga</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>cirrus</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>vmvga</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>qxl</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>virtio</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>none</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>bochs</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>ramfb</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:     </video>
Nov 16 03:42:11 user nova-compute[103546]:     <hostdev supported='yes'>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='mode'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>subsystem</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='startupPolicy'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>default</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>mandatory</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>requisite</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>optional</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='subsysType'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>usb</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>pci</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>scsi</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='capsType'/>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='pciBackend'/>
Nov 16 03:42:11 user nova-compute[103546]:     </hostdev>
Nov 16 03:42:11 user nova-compute[103546]:     <rng supported='yes'>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='model'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>virtio</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>virtio-transitional</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>virtio-non-transitional</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='backendModel'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>random</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>egd</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>builtin</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:     </rng>
Nov 16 03:42:11 user nova-compute[103546]:     <filesystem supported='yes'>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='driverType'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>path</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>handle</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>virtiofs</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:     </filesystem>
Nov 16 03:42:11 user nova-compute[103546]:     <tpm supported='yes'>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='model'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>tpm-tis</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>tpm-crb</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='backendModel'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>passthrough</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>emulator</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:     </tpm>
Nov 16 03:42:11 user nova-compute[103546]:   </devices>
Nov 16 03:42:11 user nova-compute[103546]:   <features>
Nov 16 03:42:11 user nova-compute[103546]:     <gic supported='no'/>
Nov 16 03:42:11 user nova-compute[103546]:     <vmcoreinfo supported='yes'/>
Nov 16 03:42:11 user nova-compute[103546]:     <genid supported='yes'/>
Nov 16 03:42:11 user nova-compute[103546]:     <backingStoreInput supported='yes'/>
Nov 16 03:42:11 user nova-compute[103546]:     <backup supported='yes'/>
Nov 16 03:42:11 user nova-compute[103546]:     <sev supported='no'/>
Nov 16 03:42:11 user nova-compute[103546]:   </features>
Nov 16 03:42:11 user nova-compute[103546]: </domainCapabilities>
Nov 16 03:42:11 user nova-compute[103546]:  {{(pid=103546) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 03:42:11 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 16 03:42:11 user nova-compute[103546]: <domainCapabilities>
Nov 16 03:42:11 user nova-compute[103546]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 16 03:42:11 user nova-compute[103546]:   <domain>kvm</domain>
Nov 16 03:42:11 user nova-compute[103546]:   <machine>pc-i440fx-jammy</machine>
Nov 16 03:42:11 user nova-compute[103546]:   <arch>x86_64</arch>
Nov 16 03:42:11 user nova-compute[103546]:   <vcpu max='255'/>
Nov 16 03:42:11 user nova-compute[103546]:   <iothreads supported='yes'/>
Nov 16 03:42:11 user nova-compute[103546]:   <os supported='yes'>
Nov 16 03:42:11 user nova-compute[103546]:     <enum name='firmware'>
Nov 16 03:42:11 user nova-compute[103546]:       <value>efi</value>
Nov 16 03:42:11 user nova-compute[103546]:     </enum>
Nov 16 03:42:11 user nova-compute[103546]:     <loader supported='yes'>
Nov 16 03:42:11 user nova-compute[103546]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='type'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>rom</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>pflash</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='readonly'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>yes</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>no</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='secure'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>no</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:     </loader>
Nov 16 03:42:11 user nova-compute[103546]:   </os>
Nov 16 03:42:11 user nova-compute[103546]:   <cpu>
Nov 16 03:42:11 user nova-compute[103546]:     <mode name='host-passthrough' supported='yes'>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='hostPassthroughMigratable'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>on</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>off</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:     </mode>
Nov 16 03:42:11 user nova-compute[103546]:     <mode name='maximum' supported='yes'>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='maximumMigratable'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>on</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>off</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:     </mode>
Nov 16 03:42:11 user nova-compute[103546]:     <mode name='host-model' supported='yes'>
Nov 16 03:42:11 user nova-compute[103546]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 03:42:11 user nova-compute[103546]:       <vendor>Intel</vendor>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='ss'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='vmx'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='pcid'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='hypervisor'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='arat'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='umip'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='md-clear'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='stibp'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='ssbd'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='invtsc'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='ibpb'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='ibrs'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='amd-stibp'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='rsba'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='pschange-mc-no'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='disable' name='erms'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 03:42:11 user nova-compute[103546]:     </mode>
Nov 16 03:42:11 user nova-compute[103546]:     <mode name='custom' supported='yes'>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>qemu64</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>qemu32</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>phenom</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>pentium3</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>pentium2</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>pentium</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>n270</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>kvm64</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>kvm32</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>coreduo</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>core2duo</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>athlon</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>Westmere-IBRS</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>Westmere</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Snowridge</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Skylake-Server</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Skylake-Client</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>SandyBridge</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>Penryn</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Opteron_G5</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Opteron_G4</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Opteron_G3</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Opteron_G2</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>Opteron_G1</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>Nehalem</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>IvyBridge</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Icelake-Server</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Haswell</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>EPYC-Rome</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>EPYC-Milan</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>EPYC</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Dhyana</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Cooperlake</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>Conroe</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Broadwell</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>486</model>
Nov 16 03:42:11 user nova-compute[103546]:     </mode>
Nov 16 03:42:11 user nova-compute[103546]:   </cpu>
Nov 16 03:42:11 user nova-compute[103546]:   <memoryBacking supported='yes'>
Nov 16 03:42:11 user nova-compute[103546]:     <enum name='sourceType'>
Nov 16 03:42:11 user nova-compute[103546]:       <value>file</value>
Nov 16 03:42:11 user nova-compute[103546]:       <value>anonymous</value>
Nov 16 03:42:11 user nova-compute[103546]:       <value>memfd</value>
Nov 16 03:42:11 user nova-compute[103546]:     </enum>
Nov 16 03:42:11 user nova-compute[103546]:   </memoryBacking>
Nov 16 03:42:11 user nova-compute[103546]:   <devices>
Nov 16 03:42:11 user nova-compute[103546]:     <disk supported='yes'>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='diskDevice'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>disk</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>cdrom</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>floppy</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>lun</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='bus'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>ide</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>fdc</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>scsi</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>virtio</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>usb</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>sata</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='model'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>virtio</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>virtio-transitional</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>virtio-non-transitional</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:     </disk>
Nov 16 03:42:11 user nova-compute[103546]:     <graphics supported='yes'>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='type'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>sdl</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>vnc</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>spice</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>egl-headless</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:     </graphics>
Nov 16 03:42:11 user nova-compute[103546]:     <video supported='yes'>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='modelType'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>vga</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>cirrus</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>vmvga</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>qxl</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>virtio</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>none</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>bochs</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>ramfb</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:     </video>
Nov 16 03:42:11 user nova-compute[103546]:     <hostdev supported='yes'>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='mode'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>subsystem</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='startupPolicy'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>default</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>mandatory</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>requisite</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>optional</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='subsysType'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>usb</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>pci</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>scsi</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='capsType'/>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='pciBackend'/>
Nov 16 03:42:11 user nova-compute[103546]:     </hostdev>
Nov 16 03:42:11 user nova-compute[103546]:     <rng supported='yes'>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='model'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>virtio</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>virtio-transitional</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>virtio-non-transitional</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='backendModel'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>random</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>egd</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>builtin</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:     </rng>
Nov 16 03:42:11 user nova-compute[103546]:     <filesystem supported='yes'>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='driverType'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>path</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>handle</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>virtiofs</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:     </filesystem>
Nov 16 03:42:11 user nova-compute[103546]:     <tpm supported='yes'>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='model'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>tpm-tis</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>tpm-crb</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='backendModel'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>passthrough</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>emulator</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:     </tpm>
Nov 16 03:42:11 user nova-compute[103546]:   </devices>
Nov 16 03:42:11 user nova-compute[103546]:   <features>
Nov 16 03:42:11 user nova-compute[103546]:     <gic supported='no'/>
Nov 16 03:42:11 user nova-compute[103546]:     <vmcoreinfo supported='yes'/>
Nov 16 03:42:11 user nova-compute[103546]:     <genid supported='yes'/>
Nov 16 03:42:11 user nova-compute[103546]:     <backingStoreInput supported='yes'/>
Nov 16 03:42:11 user nova-compute[103546]:     <backup supported='yes'/>
Nov 16 03:42:11 user nova-compute[103546]:     <sev supported='no'/>
Nov 16 03:42:11 user nova-compute[103546]:   </features>
Nov 16 03:42:11 user nova-compute[103546]: </domainCapabilities>
Nov 16 03:42:11 user nova-compute[103546]:  {{(pid=103546) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 03:42:11 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 16 03:42:11 user nova-compute[103546]: <domainCapabilities>
Nov 16 03:42:11 user nova-compute[103546]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 16 03:42:11 user nova-compute[103546]:   <domain>kvm</domain>
Nov 16 03:42:11 user nova-compute[103546]:   <machine>pc-q35-jammy</machine>
Nov 16 03:42:11 user nova-compute[103546]:   <arch>x86_64</arch>
Nov 16 03:42:11 user nova-compute[103546]:   <vcpu max='288'/>
Nov 16 03:42:11 user nova-compute[103546]:   <iothreads supported='yes'/>
Nov 16 03:42:11 user nova-compute[103546]:   <os supported='yes'>
Nov 16 03:42:11 user nova-compute[103546]:     <enum name='firmware'>
Nov 16 03:42:11 user nova-compute[103546]:       <value>efi</value>
Nov 16 03:42:11 user nova-compute[103546]:     </enum>
Nov 16 03:42:11 user nova-compute[103546]:     <loader supported='yes'>
Nov 16 03:42:11 user nova-compute[103546]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 16 03:42:11 user nova-compute[103546]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 16 03:42:11 user nova-compute[103546]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='type'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>rom</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>pflash</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='readonly'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>yes</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>no</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='secure'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>yes</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>no</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:     </loader>
Nov 16 03:42:11 user nova-compute[103546]:   </os>
Nov 16 03:42:11 user nova-compute[103546]:   <cpu>
Nov 16 03:42:11 user nova-compute[103546]:     <mode name='host-passthrough' supported='yes'>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='hostPassthroughMigratable'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>on</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>off</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:     </mode>
Nov 16 03:42:11 user nova-compute[103546]:     <mode name='maximum' supported='yes'>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='maximumMigratable'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>on</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>off</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:     </mode>
Nov 16 03:42:11 user nova-compute[103546]:     <mode name='host-model' supported='yes'>
Nov 16 03:42:11 user nova-compute[103546]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 03:42:11 user nova-compute[103546]:       <vendor>Intel</vendor>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='ss'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='vmx'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='pcid'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='hypervisor'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='arat'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='umip'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='md-clear'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='stibp'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='ssbd'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='invtsc'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='ibpb'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='ibrs'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='amd-stibp'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='rsba'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='pschange-mc-no'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='disable' name='erms'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 03:42:11 user nova-compute[103546]:     </mode>
Nov 16 03:42:11 user nova-compute[103546]:     <mode name='custom' supported='yes'>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>qemu64</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>qemu32</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>phenom</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>pentium3</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>pentium2</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>pentium</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>n270</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>kvm64</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>kvm32</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>coreduo</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>core2duo</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>athlon</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>Westmere-IBRS</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>Westmere</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Snowridge</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Skylake-Server</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Skylake-Client</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>SandyBridge</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>Penryn</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Opteron_G5</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Opteron_G4</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Opteron_G3</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Opteron_G2</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>Opteron_G1</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>Nehalem</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>IvyBridge</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Icelake-Server</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Haswell</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>EPYC-Rome</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>EPYC-Milan</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>EPYC</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Dhyana</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Cooperlake</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>Conroe</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Broadwell</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>486</model>
Nov 16 03:42:11 user nova-compute[103546]:     </mode>
Nov 16 03:42:11 user nova-compute[103546]:   </cpu>
Nov 16 03:42:11 user nova-compute[103546]:   <memoryBacking supported='yes'>
Nov 16 03:42:11 user nova-compute[103546]:     <enum name='sourceType'>
Nov 16 03:42:11 user nova-compute[103546]:       <value>file</value>
Nov 16 03:42:11 user nova-compute[103546]:       <value>anonymous</value>
Nov 16 03:42:11 user nova-compute[103546]:       <value>memfd</value>
Nov 16 03:42:11 user nova-compute[103546]:     </enum>
Nov 16 03:42:11 user nova-compute[103546]:   </memoryBacking>
Nov 16 03:42:11 user nova-compute[103546]:   <devices>
Nov 16 03:42:11 user nova-compute[103546]:     <disk supported='yes'>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='diskDevice'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>disk</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>cdrom</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>floppy</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>lun</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='bus'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>fdc</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>scsi</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>virtio</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>usb</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>sata</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='model'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>virtio</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>virtio-transitional</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>virtio-non-transitional</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:     </disk>
Nov 16 03:42:11 user nova-compute[103546]:     <graphics supported='yes'>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='type'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>sdl</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>vnc</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>spice</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>egl-headless</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:     </graphics>
Nov 16 03:42:11 user nova-compute[103546]:     <video supported='yes'>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='modelType'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>vga</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>cirrus</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>vmvga</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>qxl</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>virtio</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>none</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>bochs</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>ramfb</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:     </video>
Nov 16 03:42:11 user nova-compute[103546]:     <hostdev supported='yes'>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='mode'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>subsystem</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='startupPolicy'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>default</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>mandatory</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>requisite</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>optional</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='subsysType'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>usb</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>pci</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>scsi</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='capsType'/>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='pciBackend'/>
Nov 16 03:42:11 user nova-compute[103546]:     </hostdev>
Nov 16 03:42:11 user nova-compute[103546]:     <rng supported='yes'>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='model'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>virtio</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>virtio-transitional</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>virtio-non-transitional</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='backendModel'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>random</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>egd</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>builtin</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:     </rng>
Nov 16 03:42:11 user nova-compute[103546]:     <filesystem supported='yes'>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='driverType'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>path</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>handle</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>virtiofs</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:     </filesystem>
Nov 16 03:42:11 user nova-compute[103546]:     <tpm supported='yes'>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='model'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>tpm-tis</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>tpm-crb</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='backendModel'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>passthrough</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>emulator</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:     </tpm>
Nov 16 03:42:11 user nova-compute[103546]:   </devices>
Nov 16 03:42:11 user nova-compute[103546]:   <features>
Nov 16 03:42:11 user nova-compute[103546]:     <gic supported='no'/>
Nov 16 03:42:11 user nova-compute[103546]:     <vmcoreinfo supported='yes'/>
Nov 16 03:42:11 user nova-compute[103546]:     <genid supported='yes'/>
Nov 16 03:42:11 user nova-compute[103546]:     <backingStoreInput supported='yes'/>
Nov 16 03:42:11 user nova-compute[103546]:     <backup supported='yes'/>
Nov 16 03:42:11 user nova-compute[103546]:     <sev supported='no'/>
Nov 16 03:42:11 user nova-compute[103546]:   </features>
Nov 16 03:42:11 user nova-compute[103546]: </domainCapabilities>
Nov 16 03:42:11 user nova-compute[103546]:  {{(pid=103546) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 03:42:11 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 16 03:42:11 user nova-compute[103546]: <domainCapabilities>
Nov 16 03:42:11 user nova-compute[103546]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 16 03:42:11 user nova-compute[103546]:   <domain>kvm</domain>
Nov 16 03:42:11 user nova-compute[103546]:   <machine>pc-q35-6.2</machine>
Nov 16 03:42:11 user nova-compute[103546]:   <arch>x86_64</arch>
Nov 16 03:42:11 user nova-compute[103546]:   <vcpu max='288'/>
Nov 16 03:42:11 user nova-compute[103546]:   <iothreads supported='yes'/>
Nov 16 03:42:11 user nova-compute[103546]:   <os supported='yes'>
Nov 16 03:42:11 user nova-compute[103546]:     <enum name='firmware'>
Nov 16 03:42:11 user nova-compute[103546]:       <value>efi</value>
Nov 16 03:42:11 user nova-compute[103546]:     </enum>
Nov 16 03:42:11 user nova-compute[103546]:     <loader supported='yes'>
Nov 16 03:42:11 user nova-compute[103546]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 16 03:42:11 user nova-compute[103546]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 16 03:42:11 user nova-compute[103546]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='type'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>rom</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>pflash</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='readonly'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>yes</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>no</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='secure'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>yes</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>no</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:     </loader>
Nov 16 03:42:11 user nova-compute[103546]:   </os>
Nov 16 03:42:11 user nova-compute[103546]:   <cpu>
Nov 16 03:42:11 user nova-compute[103546]:     <mode name='host-passthrough' supported='yes'>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='hostPassthroughMigratable'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>on</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>off</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:     </mode>
Nov 16 03:42:11 user nova-compute[103546]:     <mode name='maximum' supported='yes'>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='maximumMigratable'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>on</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>off</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:     </mode>
Nov 16 03:42:11 user nova-compute[103546]:     <mode name='host-model' supported='yes'>
Nov 16 03:42:11 user nova-compute[103546]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 03:42:11 user nova-compute[103546]:       <vendor>Intel</vendor>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='ss'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='vmx'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='pcid'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='hypervisor'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='arat'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='umip'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='md-clear'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='stibp'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='ssbd'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='invtsc'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='ibpb'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='ibrs'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='amd-stibp'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='rsba'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='require' name='pschange-mc-no'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='disable' name='erms'/>
Nov 16 03:42:11 user nova-compute[103546]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 03:42:11 user nova-compute[103546]:     </mode>
Nov 16 03:42:11 user nova-compute[103546]:     <mode name='custom' supported='yes'>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>qemu64</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>qemu32</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>phenom</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>pentium3</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>pentium2</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>pentium</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>n270</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>kvm64</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>kvm32</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>coreduo</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>core2duo</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>athlon</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>Westmere-IBRS</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>Westmere</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Snowridge</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Skylake-Server</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Skylake-Client</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>SandyBridge</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>Penryn</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Opteron_G5</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Opteron_G4</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Opteron_G3</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Opteron_G2</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>Opteron_G1</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>Nehalem</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>IvyBridge</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Icelake-Server</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Haswell</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>EPYC-Rome</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>EPYC-Milan</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>EPYC</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Dhyana</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Cooperlake</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>Conroe</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='no'>Broadwell</model>
Nov 16 03:42:11 user nova-compute[103546]:       <model usable='yes'>486</model>
Nov 16 03:42:11 user nova-compute[103546]:     </mode>
Nov 16 03:42:11 user nova-compute[103546]:   </cpu>
Nov 16 03:42:11 user nova-compute[103546]:   <memoryBacking supported='yes'>
Nov 16 03:42:11 user nova-compute[103546]:     <enum name='sourceType'>
Nov 16 03:42:11 user nova-compute[103546]:       <value>file</value>
Nov 16 03:42:11 user nova-compute[103546]:       <value>anonymous</value>
Nov 16 03:42:11 user nova-compute[103546]:       <value>memfd</value>
Nov 16 03:42:11 user nova-compute[103546]:     </enum>
Nov 16 03:42:11 user nova-compute[103546]:   </memoryBacking>
Nov 16 03:42:11 user nova-compute[103546]:   <devices>
Nov 16 03:42:11 user nova-compute[103546]:     <disk supported='yes'>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='diskDevice'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>disk</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>cdrom</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>floppy</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>lun</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='bus'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>fdc</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>scsi</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>virtio</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>usb</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>sata</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='model'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>virtio</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>virtio-transitional</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>virtio-non-transitional</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:     </disk>
Nov 16 03:42:11 user nova-compute[103546]:     <graphics supported='yes'>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='type'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>sdl</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>vnc</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>spice</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>egl-headless</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:     </graphics>
Nov 16 03:42:11 user nova-compute[103546]:     <video supported='yes'>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='modelType'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>vga</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>cirrus</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>vmvga</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>qxl</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>virtio</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>none</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>bochs</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>ramfb</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:     </video>
Nov 16 03:42:11 user nova-compute[103546]:     <hostdev supported='yes'>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='mode'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>subsystem</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='startupPolicy'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>default</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>mandatory</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>requisite</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>optional</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='subsysType'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>usb</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>pci</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>scsi</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='capsType'/>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='pciBackend'/>
Nov 16 03:42:11 user nova-compute[103546]:     </hostdev>
Nov 16 03:42:11 user nova-compute[103546]:     <rng supported='yes'>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='model'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>virtio</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>virtio-transitional</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>virtio-non-transitional</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='backendModel'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>random</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>egd</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>builtin</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:     </rng>
Nov 16 03:42:11 user nova-compute[103546]:     <filesystem supported='yes'>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='driverType'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>path</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>handle</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>virtiofs</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:     </filesystem>
Nov 16 03:42:11 user nova-compute[103546]:     <tpm supported='yes'>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='model'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>tpm-tis</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>tpm-crb</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:       <enum name='backendModel'>
Nov 16 03:42:11 user nova-compute[103546]:         <value>passthrough</value>
Nov 16 03:42:11 user nova-compute[103546]:         <value>emulator</value>
Nov 16 03:42:11 user nova-compute[103546]:       </enum>
Nov 16 03:42:11 user nova-compute[103546]:     </tpm>
Nov 16 03:42:11 user nova-compute[103546]:   </devices>
Nov 16 03:42:11 user nova-compute[103546]:   <features>
Nov 16 03:42:11 user nova-compute[103546]:     <gic supported='no'/>
Nov 16 03:42:11 user nova-compute[103546]:     <vmcoreinfo supported='yes'/>
Nov 16 03:42:11 user nova-compute[103546]:     <genid supported='yes'/>
Nov 16 03:42:11 user nova-compute[103546]:     <backingStoreInput supported='yes'/>
Nov 16 03:42:11 user nova-compute[103546]:     <backup supported='yes'/>
Nov 16 03:42:11 user nova-compute[103546]:     <sev supported='no'/>
Nov 16 03:42:11 user nova-compute[103546]:   </features>
Nov 16 03:42:11 user nova-compute[103546]: </domainCapabilities>
Nov 16 03:42:11 user nova-compute[103546]:  {{(pid=103546) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 03:42:11 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=103546) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 03:42:11 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=103546) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 03:42:11 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=103546) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 03:42:11 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=103546) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 03:42:11 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Checking secure boot support for host arch (x86_64) {{(pid=103546) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 16 03:42:11 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Checking secure boot support for host arch (x86_64) {{(pid=103546) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 16 03:42:11 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Checking secure boot support for host arch (x86_64) {{(pid=103546) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 16 03:42:11 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Checking secure boot support for host arch (x86_64) {{(pid=103546) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 16 03:42:11 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Checking secure boot support for host arch (x86_64) {{(pid=103546) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 16 03:42:11 user nova-compute[103546]: INFO nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Secure Boot support detected
Nov 16 03:42:11 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] cpu compare xml: <cpu match="exact">
Nov 16 03:42:11 user nova-compute[103546]:   <model>Nehalem</model>
Nov 16 03:42:11 user nova-compute[103546]: </cpu>
Nov 16 03:42:11 user nova-compute[103546]:  {{(pid=103546) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 16 03:42:11 user nova-compute[103546]: INFO nova.virt.node [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Generated node identity 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a
Nov 16 03:42:11 user nova-compute[103546]: INFO nova.virt.node [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Wrote node identity 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a to /opt/stack/data/nova/compute_id
Nov 16 03:42:11 user nova-compute[103546]: WARNING nova.compute.manager [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Compute nodes ['0b01254b-dc4d-4d00-a9a7-dd4ef815de7a'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 16 03:42:11 user nova-compute[103546]: INFO nova.compute.manager [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 16 03:42:11 user nova-compute[103546]: WARNING nova.compute.manager [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 16 03:42:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:42:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:42:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:42:11 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Auditing locally available compute resources for user (node: user) {{(pid=103546) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 03:42:11 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:42:11 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:42:11 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Hypervisor/Node resource view: name=user free_ram=11040MB free_disk=26.178905487060547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=103546) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 03:42:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:42:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:42:11 user nova-compute[103546]: WARNING nova.compute.resource_tracker [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] No compute node record for user:0b01254b-dc4d-4d00-a9a7-dd4ef815de7a: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a could not be found.
Nov 16 03:42:11 user nova-compute[103546]: INFO nova.compute.resource_tracker [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Compute node record created for user:user with uuid: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a
Nov 16 03:42:11 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 03:42:11 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 03:42:11 user nova-compute[103546]: INFO nova.scheduler.client.report [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] [req-80f86c24-624c-46e6-a4c5-22e0b026093e] Created resource provider record via placement API for resource provider with UUID 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a and name user.
Nov 16 03:42:11 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=103546) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 16 03:42:11 user nova-compute[103546]: INFO nova.virt.libvirt.host [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] kernel doesn't support AMD SEV
Nov 16 03:42:11 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Updating inventory in ProviderTree for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 03:42:11 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 03:42:11 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Libvirt baseline CPU <cpu>
Nov 16 03:42:11 user nova-compute[103546]:   <arch>x86_64</arch>
Nov 16 03:42:11 user nova-compute[103546]:   <model>Nehalem</model>
Nov 16 03:42:11 user nova-compute[103546]:   <vendor>Intel</vendor>
Nov 16 03:42:11 user nova-compute[103546]:   <topology sockets="6" cores="1" threads="1"/>
Nov 16 03:42:11 user nova-compute[103546]: </cpu>
Nov 16 03:42:11 user nova-compute[103546]:  {{(pid=103546) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 16 03:42:11 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Updated inventory for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 16 03:42:11 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Updating resource provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a generation from 0 to 1 during operation: update_inventory {{(pid=103546) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 16 03:42:11 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Updating inventory in ProviderTree for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 03:42:11 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Updating resource provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a generation from 1 to 2 during operation: update_traits {{(pid=103546) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 16 03:42:11 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Compute_service record updated for user:user {{(pid=103546) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 03:42:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.583s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:42:11 user nova-compute[103546]: DEBUG nova.service [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Creating RPC server for service compute {{(pid=103546) start /opt/stack/nova/nova/service.py:182}}
Nov 16 03:42:11 user nova-compute[103546]: DEBUG nova.service [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] Join ServiceGroup membership for this service compute {{(pid=103546) start /opt/stack/nova/nova/service.py:199}}
Nov 16 03:42:11 user nova-compute[103546]: DEBUG nova.servicegroup.drivers.db [None req-f7677c99-f1fb-4c28-9513-97b0fbc1bb1f None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=103546) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 16 03:43:04 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:43:04 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:43:04 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Starting heal instance info cache {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 03:43:04 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Rebuilding the list of instances to heal {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 03:43:04 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Didn't find any instances for network info cache update. {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 03:43:04 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:43:04 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:43:04 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:43:04 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:43:04 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:43:04 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._sync_power_states {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:43:05 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:43:05 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=103546) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 03:43:05 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager.update_available_resource {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:43:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:43:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:43:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:43:05 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Auditing locally available compute resources for user (node: user) {{(pid=103546) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 03:43:05 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:43:05 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:43:05 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Hypervisor/Node resource view: name=user free_ram=10405MB free_disk=26.090389251708984GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=103546) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 03:43:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:43:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:43:05 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 03:43:05 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 03:43:05 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:43:05 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:43:05 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Compute_service record updated for user:user {{(pid=103546) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 03:43:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.139s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:43:05 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:44:03 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:44:03 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:44:03 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:44:03 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=103546) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 03:44:03 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:44:03 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:44:03 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:44:03 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:44:03 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager.update_available_resource {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:44:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:44:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:44:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:44:03 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Auditing locally available compute resources for user (node: user) {{(pid=103546) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 03:44:03 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:44:03 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:44:03 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Hypervisor/Node resource view: name=user free_ram=10365MB free_disk=26.147918701171875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=103546) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 03:44:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:44:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:44:04 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 03:44:04 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 03:44:04 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:44:04 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:44:04 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Compute_service record updated for user:user {{(pid=103546) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 03:44:04 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.100s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:44:05 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:44:05 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Starting heal instance info cache {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 03:44:05 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Rebuilding the list of instances to heal {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 03:44:05 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Didn't find any instances for network info cache update. {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 03:44:05 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:45:02 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:45:03 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:45:03 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:45:03 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=103546) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 03:45:04 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:45:04 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:45:04 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Starting heal instance info cache {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 03:45:04 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Rebuilding the list of instances to heal {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 03:45:04 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Didn't find any instances for network info cache update. {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 03:45:04 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:45:04 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager.update_available_resource {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:45:04 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:45:04 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:45:04 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:45:04 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Auditing locally available compute resources for user (node: user) {{(pid=103546) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 03:45:05 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:45:05 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:45:05 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Hypervisor/Node resource view: name=user free_ram=10350MB free_disk=25.899425506591797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=103546) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 03:45:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:45:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:45:05 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 03:45:05 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 03:45:05 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:45:05 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:45:05 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Compute_service record updated for user:user {{(pid=103546) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 03:45:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.170s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:45:06 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:45:06 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:46:02 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:46:02 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:46:03 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:46:03 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:46:03 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=103546) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 03:46:04 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:46:04 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Starting heal instance info cache {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 03:46:04 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Rebuilding the list of instances to heal {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 03:46:04 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Didn't find any instances for network info cache update. {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 03:46:04 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:46:06 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:46:06 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager.update_available_resource {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:46:06 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:46:06 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:46:06 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:46:06 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Auditing locally available compute resources for user (node: user) {{(pid=103546) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 03:46:07 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:46:07 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:46:07 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Hypervisor/Node resource view: name=user free_ram=9649MB free_disk=25.927608489990234GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=103546) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 03:46:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:46:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.004s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:46:07 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 03:46:07 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 03:46:07 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:46:07 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:46:07 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Compute_service record updated for user:user {{(pid=103546) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 03:46:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.190s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:46:08 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:46:08 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:46:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Acquiring lock "279e2954-d786-4544-903d-8edc63646e2d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:46:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Lock "279e2954-d786-4544-903d-8edc63646e2d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:46:13 user nova-compute[103546]: DEBUG nova.compute.manager [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 279e2954-d786-4544-903d-8edc63646e2d] Starting instance... {{(pid=103546) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 03:46:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:46:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:46:13 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=103546) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 03:46:13 user nova-compute[103546]: INFO nova.compute.claims [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 279e2954-d786-4544-903d-8edc63646e2d] Claim successful on node user
Nov 16 03:46:13 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:46:14 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:46:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.328s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:46:14 user nova-compute[103546]: DEBUG nova.compute.manager [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 279e2954-d786-4544-903d-8edc63646e2d] Start building networks asynchronously for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 03:46:14 user nova-compute[103546]: DEBUG nova.compute.manager [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 279e2954-d786-4544-903d-8edc63646e2d] Allocating IP information in the background. {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 03:46:14 user nova-compute[103546]: DEBUG nova.network.neutron [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 279e2954-d786-4544-903d-8edc63646e2d] allocate_for_instance() {{(pid=103546) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 03:46:14 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 279e2954-d786-4544-903d-8edc63646e2d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 03:46:14 user nova-compute[103546]: DEBUG nova.compute.manager [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 279e2954-d786-4544-903d-8edc63646e2d] Start building block device mappings for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 03:46:14 user nova-compute[103546]: DEBUG nova.compute.manager [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 279e2954-d786-4544-903d-8edc63646e2d] Start spawning the instance on the hypervisor. {{(pid=103546) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 03:46:14 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 279e2954-d786-4544-903d-8edc63646e2d] Creating instance directory {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 03:46:14 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 279e2954-d786-4544-903d-8edc63646e2d] Creating image(s)
Nov 16 03:46:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Acquiring lock "/opt/stack/data/nova/instances/279e2954-d786-4544-903d-8edc63646e2d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:46:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Lock "/opt/stack/data/nova/instances/279e2954-d786-4544-903d-8edc63646e2d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:46:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Lock "/opt/stack/data/nova/instances/279e2954-d786-4544-903d-8edc63646e2d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:46:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Acquiring lock "8c9efafb670bfe5842ba1f4ce398924612164af7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:46:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:46:14 user nova-compute[103546]: DEBUG nova.policy [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fe3fb261884b45b0bdc984b79bc1dc96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f227c815224d55afdb3eba43e68757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103546) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 03:46:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7.part --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:46:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7.part --force-share --output=json" returned: 0 in 0.178s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:46:15 user nova-compute[103546]: DEBUG nova.virt.images [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] 5c6f539a-01e5-4478-bf8f-a14310b5d7dd was qcow2, converting to raw {{(pid=103546) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 03:46:15 user nova-compute[103546]: DEBUG nova.privsep.utils [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=103546) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 03:46:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7.part /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7.converted {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:46:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7.part /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7.converted" returned: 0 in 0.258s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:46:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7.converted --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:46:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7.converted --force-share --output=json" returned: 0 in 0.172s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:46:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.518s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:46:15 user nova-compute[103546]: INFO oslo.privsep.daemon [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpa8jffaey/privsep.sock']
Nov 16 03:46:15 user sudo[112791]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpa8jffaey/privsep.sock
Nov 16 03:46:15 user sudo[112791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 16 03:46:17 user sudo[112791]: pam_unix(sudo:session): session closed for user root
Nov 16 03:46:17 user nova-compute[103546]: INFO oslo.privsep.daemon [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Spawned new privsep daemon via rootwrap
Nov 16 03:46:17 user nova-compute[103546]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 16 03:46:17 user nova-compute[103546]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 16 03:46:17 user nova-compute[103546]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 16 03:46:17 user nova-compute[103546]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 112794
Nov 16 03:46:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:46:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.174s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:46:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Acquiring lock "8c9efafb670bfe5842ba1f4ce398924612164af7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:46:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:46:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:46:17 user nova-compute[103546]: DEBUG nova.network.neutron [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 279e2954-d786-4544-903d-8edc63646e2d] Successfully created port: e60cc693-67d4-45a3-a97e-40bb5f753c9d {{(pid=103546) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 03:46:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.163s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:46:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/279e2954-d786-4544-903d-8edc63646e2d/disk 1073741824 {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:46:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/279e2954-d786-4544-903d-8edc63646e2d/disk 1073741824" returned: 0 in 0.046s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:46:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:46:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:46:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.155s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:46:17 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Checking if we can resize image /opt/stack/data/nova/instances/279e2954-d786-4544-903d-8edc63646e2d/disk. size=1073741824 {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 03:46:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e2954-d786-4544-903d-8edc63646e2d/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:46:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e2954-d786-4544-903d-8edc63646e2d/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:46:18 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Cannot resize image /opt/stack/data/nova/instances/279e2954-d786-4544-903d-8edc63646e2d/disk to a smaller size. {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 03:46:18 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 279e2954-d786-4544-903d-8edc63646e2d] Created local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 03:46:18 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 279e2954-d786-4544-903d-8edc63646e2d] Ensure instance console log exists: /opt/stack/data/nova/instances/279e2954-d786-4544-903d-8edc63646e2d/console.log {{(pid=103546) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 03:46:18 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:46:18 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:46:18 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:46:20 user nova-compute[103546]: DEBUG nova.network.neutron [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 279e2954-d786-4544-903d-8edc63646e2d] Successfully updated port: e60cc693-67d4-45a3-a97e-40bb5f753c9d {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 03:46:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Acquiring lock "refresh_cache-279e2954-d786-4544-903d-8edc63646e2d" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:46:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Acquired lock "refresh_cache-279e2954-d786-4544-903d-8edc63646e2d" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:46:20 user nova-compute[103546]: DEBUG nova.network.neutron [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 279e2954-d786-4544-903d-8edc63646e2d] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 03:46:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Acquiring lock "51554aab-44ec-4161-b926-9c07a3f838a5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:46:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Lock "51554aab-44ec-4161-b926-9c07a3f838a5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:46:20 user nova-compute[103546]: DEBUG nova.compute.manager [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Starting instance... {{(pid=103546) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 03:46:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:46:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:46:20 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=103546) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 03:46:20 user nova-compute[103546]: INFO nova.compute.claims [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Claim successful on node user
Nov 16 03:46:20 user nova-compute[103546]: DEBUG nova.network.neutron [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 279e2954-d786-4544-903d-8edc63646e2d] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 03:46:20 user nova-compute[103546]: DEBUG nova.compute.manager [req-7a617aca-791e-4a20-9ce3-3ffd9dfd109b req-51f7c557-aed7-463a-98a7-d769ec13cc7f service nova] [instance: 279e2954-d786-4544-903d-8edc63646e2d] Received event network-changed-e60cc693-67d4-45a3-a97e-40bb5f753c9d {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:46:20 user nova-compute[103546]: DEBUG nova.compute.manager [req-7a617aca-791e-4a20-9ce3-3ffd9dfd109b req-51f7c557-aed7-463a-98a7-d769ec13cc7f service nova] [instance: 279e2954-d786-4544-903d-8edc63646e2d] Refreshing instance network info cache due to event network-changed-e60cc693-67d4-45a3-a97e-40bb5f753c9d. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:46:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-7a617aca-791e-4a20-9ce3-3ffd9dfd109b req-51f7c557-aed7-463a-98a7-d769ec13cc7f service nova] Acquiring lock "refresh_cache-279e2954-d786-4544-903d-8edc63646e2d" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:46:21 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:46:21 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:46:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.326s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:46:21 user nova-compute[103546]: DEBUG nova.compute.manager [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Start building networks asynchronously for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 03:46:21 user nova-compute[103546]: DEBUG nova.compute.manager [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Allocating IP information in the background. {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 03:46:21 user nova-compute[103546]: DEBUG nova.network.neutron [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] allocate_for_instance() {{(pid=103546) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 03:46:21 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 03:46:21 user nova-compute[103546]: DEBUG nova.compute.manager [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Start building block device mappings for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 03:46:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Acquiring lock "7862d05d-4293-46a5-98aa-41967a572fe3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:46:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "7862d05d-4293-46a5-98aa-41967a572fe3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:46:21 user nova-compute[103546]: DEBUG nova.compute.manager [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Start spawning the instance on the hypervisor. {{(pid=103546) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 03:46:21 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Creating instance directory {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 03:46:21 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Creating image(s)
Nov 16 03:46:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Acquiring lock "/opt/stack/data/nova/instances/51554aab-44ec-4161-b926-9c07a3f838a5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:46:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Lock "/opt/stack/data/nova/instances/51554aab-44ec-4161-b926-9c07a3f838a5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:46:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Lock "/opt/stack/data/nova/instances/51554aab-44ec-4161-b926-9c07a3f838a5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:46:21 user nova-compute[103546]: DEBUG nova.policy [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd4bf11ccac9f4203808f8dca52cde36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76ca2da0c584a7382040eb113da4c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103546) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 03:46:21 user nova-compute[103546]: DEBUG nova.compute.manager [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Starting instance... {{(pid=103546) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 03:46:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:46:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:46:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:46:21 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=103546) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 03:46:21 user nova-compute[103546]: INFO nova.compute.claims [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Claim successful on node user
Nov 16 03:46:21 user nova-compute[103546]: DEBUG nova.network.neutron [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 279e2954-d786-4544-903d-8edc63646e2d] Updating instance_info_cache with network_info: [{"id": "e60cc693-67d4-45a3-a97e-40bb5f753c9d", "address": "fa:16:3e:44:ef:27", "network": {"id": "56e4e469-bfda-4ab1-9fdd-e3aa1a0655fc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-669383710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f227c815224d55afdb3eba43e68757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape60cc693-67", "ovs_interfaceid": "e60cc693-67d4-45a3-a97e-40bb5f753c9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:46:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Releasing lock "refresh_cache-279e2954-d786-4544-903d-8edc63646e2d" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:46:21 user nova-compute[103546]: DEBUG nova.compute.manager [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 279e2954-d786-4544-903d-8edc63646e2d] Instance network_info: |[{"id": "e60cc693-67d4-45a3-a97e-40bb5f753c9d", "address": "fa:16:3e:44:ef:27", "network": {"id": "56e4e469-bfda-4ab1-9fdd-e3aa1a0655fc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-669383710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f227c815224d55afdb3eba43e68757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape60cc693-67", "ovs_interfaceid": "e60cc693-67d4-45a3-a97e-40bb5f753c9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 03:46:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-7a617aca-791e-4a20-9ce3-3ffd9dfd109b req-51f7c557-aed7-463a-98a7-d769ec13cc7f service nova] Acquired lock "refresh_cache-279e2954-d786-4544-903d-8edc63646e2d" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:46:21 user nova-compute[103546]: DEBUG nova.network.neutron [req-7a617aca-791e-4a20-9ce3-3ffd9dfd109b req-51f7c557-aed7-463a-98a7-d769ec13cc7f service nova] [instance: 279e2954-d786-4544-903d-8edc63646e2d] Refreshing network info cache for port e60cc693-67d4-45a3-a97e-40bb5f753c9d {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:46:21 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 279e2954-d786-4544-903d-8edc63646e2d] Start _get_guest_xml network_info=[{"id": "e60cc693-67d4-45a3-a97e-40bb5f753c9d", "address": "fa:16:3e:44:ef:27", "network": {"id": "56e4e469-bfda-4ab1-9fdd-e3aa1a0655fc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-669383710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f227c815224d55afdb3eba43e68757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape60cc693-67", "ovs_interfaceid": "e60cc693-67d4-45a3-a97e-40bb5f753c9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '5c6f539a-01e5-4478-bf8f-a14310b5d7dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 03:46:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.170s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:46:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Acquiring lock "8c9efafb670bfe5842ba1f4ce398924612164af7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:46:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:46:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:46:21 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:46:21 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:46:21 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 03:46:21 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 03:46:21 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 03:46:21 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 03:46:21 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 03:46:21 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 03:46:21 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 03:46:21 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 03:46:21 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 03:46:21 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 03:46:21 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 03:46:21 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 03:46:21 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 03:46:21 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 03:46:21 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 03:46:21 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 03:46:21 user nova-compute[103546]: DEBUG nova.privsep.utils [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=103546) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 03:46:21 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:46:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1301859585',display_name='tempest-ServersNegativeTestJSON-server-1301859585',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1301859585',id=1,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c3f227c815224d55afdb3eba43e68757',ramdisk_id='',reservation_id='r-gi09kwkt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-740287726',owner_user_name='tempest-ServersNegativeTestJSON-740287726-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:46:14Z,user_data=None,user_id='fe3fb261884b45b0bdc984b79bc1dc96',uuid=279e2954-d786-4544-903d-8edc63646e2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e60cc693-67d4-45a3-a97e-40bb5f753c9d", "address": "fa:16:3e:44:ef:27", "network": {"id": "56e4e469-bfda-4ab1-9fdd-e3aa1a0655fc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-669383710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f227c815224d55afdb3eba43e68757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape60cc693-67", "ovs_interfaceid": "e60cc693-67d4-45a3-a97e-40bb5f753c9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 03:46:21 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Converting VIF {"id": "e60cc693-67d4-45a3-a97e-40bb5f753c9d", "address": "fa:16:3e:44:ef:27", "network": {"id": "56e4e469-bfda-4ab1-9fdd-e3aa1a0655fc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-669383710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f227c815224d55afdb3eba43e68757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape60cc693-67", "ovs_interfaceid": "e60cc693-67d4-45a3-a97e-40bb5f753c9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:46:21 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:ef:27,bridge_name='br-int',has_traffic_filtering=True,id=e60cc693-67d4-45a3-a97e-40bb5f753c9d,network=Network(56e4e469-bfda-4ab1-9fdd-e3aa1a0655fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape60cc693-67') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:46:21 user nova-compute[103546]: DEBUG nova.objects.instance [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Lazy-loading 'pci_devices' on Instance uuid 279e2954-d786-4544-903d-8edc63646e2d {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:46:21 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 279e2954-d786-4544-903d-8edc63646e2d] End _get_guest_xml xml=<domain type="kvm">
Nov 16 03:46:21 user nova-compute[103546]:   <uuid>279e2954-d786-4544-903d-8edc63646e2d</uuid>
Nov 16 03:46:21 user nova-compute[103546]:   <name>instance-00000001</name>
Nov 16 03:46:21 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 03:46:21 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 03:46:21 user nova-compute[103546]:   <metadata>
Nov 16 03:46:21 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 03:46:21 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 03:46:21 user nova-compute[103546]:       <nova:name>tempest-ServersNegativeTestJSON-server-1301859585</nova:name>
Nov 16 03:46:21 user nova-compute[103546]:       <nova:creationTime>2023-11-16 03:46:21</nova:creationTime>
Nov 16 03:46:21 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 03:46:21 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 03:46:21 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 03:46:21 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 03:46:21 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 03:46:21 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 03:46:21 user nova-compute[103546]:       </nova:flavor>
Nov 16 03:46:21 user nova-compute[103546]:       <nova:owner>
Nov 16 03:46:21 user nova-compute[103546]:         <nova:user uuid="fe3fb261884b45b0bdc984b79bc1dc96">tempest-ServersNegativeTestJSON-740287726-project-member</nova:user>
Nov 16 03:46:21 user nova-compute[103546]:         <nova:project uuid="c3f227c815224d55afdb3eba43e68757">tempest-ServersNegativeTestJSON-740287726</nova:project>
Nov 16 03:46:21 user nova-compute[103546]:       </nova:owner>
Nov 16 03:46:21 user nova-compute[103546]:       <nova:root type="image" uuid="5c6f539a-01e5-4478-bf8f-a14310b5d7dd"/>
Nov 16 03:46:21 user nova-compute[103546]:       <nova:ports>
Nov 16 03:46:21 user nova-compute[103546]:         <nova:port uuid="e60cc693-67d4-45a3-a97e-40bb5f753c9d">
Nov 16 03:46:21 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 03:46:21 user nova-compute[103546]:         </nova:port>
Nov 16 03:46:21 user nova-compute[103546]:       </nova:ports>
Nov 16 03:46:21 user nova-compute[103546]:     </nova:instance>
Nov 16 03:46:21 user nova-compute[103546]:   </metadata>
Nov 16 03:46:21 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 03:46:21 user nova-compute[103546]:     <system>
Nov 16 03:46:21 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 03:46:21 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 03:46:21 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 03:46:21 user nova-compute[103546]:       <entry name="serial">279e2954-d786-4544-903d-8edc63646e2d</entry>
Nov 16 03:46:21 user nova-compute[103546]:       <entry name="uuid">279e2954-d786-4544-903d-8edc63646e2d</entry>
Nov 16 03:46:21 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 03:46:21 user nova-compute[103546]:     </system>
Nov 16 03:46:21 user nova-compute[103546]:   </sysinfo>
Nov 16 03:46:21 user nova-compute[103546]:   <os>
Nov 16 03:46:21 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 03:46:21 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 03:46:21 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 03:46:21 user nova-compute[103546]:   </os>
Nov 16 03:46:21 user nova-compute[103546]:   <features>
Nov 16 03:46:21 user nova-compute[103546]:     <acpi/>
Nov 16 03:46:21 user nova-compute[103546]:     <apic/>
Nov 16 03:46:21 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 03:46:21 user nova-compute[103546]:   </features>
Nov 16 03:46:21 user nova-compute[103546]:   <clock offset="utc">
Nov 16 03:46:21 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 03:46:21 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 03:46:21 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 03:46:21 user nova-compute[103546]:   </clock>
Nov 16 03:46:21 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 03:46:21 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 03:46:21 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 03:46:21 user nova-compute[103546]:   </cpu>
Nov 16 03:46:21 user nova-compute[103546]:   <devices>
Nov 16 03:46:21 user nova-compute[103546]:     <disk type="file" device="disk">
Nov 16 03:46:21 user nova-compute[103546]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 03:46:21 user nova-compute[103546]:       <source file="/opt/stack/data/nova/instances/279e2954-d786-4544-903d-8edc63646e2d/disk"/>
Nov 16 03:46:21 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 03:46:21 user nova-compute[103546]:     </disk>
Nov 16 03:46:21 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 03:46:21 user nova-compute[103546]:       <mac address="fa:16:3e:44:ef:27"/>
Nov 16 03:46:21 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:46:21 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 03:46:21 user nova-compute[103546]:       <target dev="tape60cc693-67"/>
Nov 16 03:46:21 user nova-compute[103546]:     </interface>
Nov 16 03:46:21 user nova-compute[103546]:     <serial type="pty">
Nov 16 03:46:21 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/279e2954-d786-4544-903d-8edc63646e2d/console.log" append="off"/>
Nov 16 03:46:21 user nova-compute[103546]:     </serial>
Nov 16 03:46:21 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 03:46:21 user nova-compute[103546]:     <video>
Nov 16 03:46:21 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:46:21 user nova-compute[103546]:     </video>
Nov 16 03:46:21 user nova-compute[103546]:     <rng model="virtio">
Nov 16 03:46:21 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 03:46:21 user nova-compute[103546]:     </rng>
Nov 16 03:46:21 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 03:46:21 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 03:46:21 user nova-compute[103546]:       <stats period="10"/>
Nov 16 03:46:21 user nova-compute[103546]:     </memballoon>
Nov 16 03:46:21 user nova-compute[103546]:   </devices>
Nov 16 03:46:21 user nova-compute[103546]: </domain>
Nov 16 03:46:21 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 03:46:21 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:46:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1301859585',display_name='tempest-ServersNegativeTestJSON-server-1301859585',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1301859585',id=1,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c3f227c815224d55afdb3eba43e68757',ramdisk_id='',reservation_id='r-gi09kwkt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-740287726',owner_user_name='tempest-ServersNegativeTestJSON-740287726-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:46:14Z,user_data=None,user_id='fe3fb261884b45b0bdc984b79bc1dc96',uuid=279e2954-d786-4544-903d-8edc63646e2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e60cc693-67d4-45a3-a97e-40bb5f753c9d", "address": "fa:16:3e:44:ef:27", "network": {"id": "56e4e469-bfda-4ab1-9fdd-e3aa1a0655fc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-669383710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f227c815224d55afdb3eba43e68757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape60cc693-67", "ovs_interfaceid": "e60cc693-67d4-45a3-a97e-40bb5f753c9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 03:46:21 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Converting VIF {"id": "e60cc693-67d4-45a3-a97e-40bb5f753c9d", "address": "fa:16:3e:44:ef:27", "network": {"id": "56e4e469-bfda-4ab1-9fdd-e3aa1a0655fc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-669383710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f227c815224d55afdb3eba43e68757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape60cc693-67", "ovs_interfaceid": "e60cc693-67d4-45a3-a97e-40bb5f753c9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:46:21 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:ef:27,bridge_name='br-int',has_traffic_filtering=True,id=e60cc693-67d4-45a3-a97e-40bb5f753c9d,network=Network(56e4e469-bfda-4ab1-9fdd-e3aa1a0655fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape60cc693-67') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:46:21 user nova-compute[103546]: DEBUG os_vif [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:ef:27,bridge_name='br-int',has_traffic_filtering=True,id=e60cc693-67d4-45a3-a97e-40bb5f753c9d,network=Network(56e4e469-bfda-4ab1-9fdd-e3aa1a0655fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape60cc693-67') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 03:46:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.184s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:46:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Created schema index Interface.name {{(pid=103546) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 16 03:46:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Created schema index Port.name {{(pid=103546) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 16 03:46:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Created schema index Bridge.name {{(pid=103546) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 16 03:46:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 03:46:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/51554aab-44ec-4161-b926-9c07a3f838a5/disk 1073741824 {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:46:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [POLLOUT] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 03:46:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/51554aab-44ec-4161-b926-9c07a3f838a5/disk 1073741824" returned: 0 in 0.118s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:46:22 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.346s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:46:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:46:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:46:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 03:46:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b7097ff2-0cc0-58c4-a19f-dcf79236f818', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:46:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:46:22 user nova-compute[103546]: INFO oslo.privsep.daemon [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpu4l668l1/privsep.sock']
Nov 16 03:46:22 user sudo[112840]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpu4l668l1/privsep.sock
Nov 16 03:46:22 user sudo[112840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 16 03:46:22 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:46:22 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:46:22 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.550s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:46:22 user nova-compute[103546]: DEBUG nova.compute.manager [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Start building networks asynchronously for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 03:46:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.161s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:46:22 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Checking if we can resize image /opt/stack/data/nova/instances/51554aab-44ec-4161-b926-9c07a3f838a5/disk. size=1073741824 {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 03:46:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51554aab-44ec-4161-b926-9c07a3f838a5/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:46:22 user nova-compute[103546]: DEBUG nova.compute.manager [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Allocating IP information in the background. {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 03:46:22 user nova-compute[103546]: DEBUG nova.network.neutron [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] allocate_for_instance() {{(pid=103546) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 03:46:22 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 03:46:22 user nova-compute[103546]: DEBUG nova.compute.manager [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Start building block device mappings for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 03:46:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51554aab-44ec-4161-b926-9c07a3f838a5/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:46:22 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Cannot resize image /opt/stack/data/nova/instances/51554aab-44ec-4161-b926-9c07a3f838a5/disk to a smaller size. {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 03:46:22 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Created local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 03:46:22 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Ensure instance console log exists: /opt/stack/data/nova/instances/51554aab-44ec-4161-b926-9c07a3f838a5/console.log {{(pid=103546) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 03:46:22 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:46:22 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:46:22 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:46:22 user nova-compute[103546]: DEBUG nova.compute.manager [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Start spawning the instance on the hypervisor. {{(pid=103546) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 03:46:22 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Creating instance directory {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 03:46:22 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Creating image(s)
Nov 16 03:46:22 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Acquiring lock "/opt/stack/data/nova/instances/7862d05d-4293-46a5-98aa-41967a572fe3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:46:22 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "/opt/stack/data/nova/instances/7862d05d-4293-46a5-98aa-41967a572fe3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:46:22 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "/opt/stack/data/nova/instances/7862d05d-4293-46a5-98aa-41967a572fe3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:46:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:46:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.172s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:46:22 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Acquiring lock "8c9efafb670bfe5842ba1f4ce398924612164af7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:46:22 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:46:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:46:22 user nova-compute[103546]: DEBUG nova.policy [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '21d4e9052a614968bda331f028920ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63722fdf17e4408299de8c215c133812', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103546) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 03:46:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.166s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:46:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/7862d05d-4293-46a5-98aa-41967a572fe3/disk 1073741824 {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:46:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/7862d05d-4293-46a5-98aa-41967a572fe3/disk 1073741824" returned: 0 in 0.054s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:46:22 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:46:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:46:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.181s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:46:22 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7862d05d-4293-46a5-98aa-41967a572fe3/disk. size=1073741824 {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 03:46:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7862d05d-4293-46a5-98aa-41967a572fe3/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:46:23 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7862d05d-4293-46a5-98aa-41967a572fe3/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:46:23 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Cannot resize image /opt/stack/data/nova/instances/7862d05d-4293-46a5-98aa-41967a572fe3/disk to a smaller size. {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 03:46:23 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Created local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 03:46:23 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Ensure instance console log exists: /opt/stack/data/nova/instances/7862d05d-4293-46a5-98aa-41967a572fe3/console.log {{(pid=103546) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 03:46:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:46:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:46:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:46:23 user sudo[112840]: pam_unix(sudo:session): session closed for user root
Nov 16 03:46:23 user nova-compute[103546]: INFO oslo.privsep.daemon [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Spawned new privsep daemon via rootwrap
Nov 16 03:46:23 user nova-compute[103546]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 16 03:46:23 user nova-compute[103546]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 16 03:46:23 user nova-compute[103546]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 16 03:46:23 user nova-compute[103546]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 112870
Nov 16 03:46:23 user nova-compute[103546]: DEBUG nova.network.neutron [req-7a617aca-791e-4a20-9ce3-3ffd9dfd109b req-51f7c557-aed7-463a-98a7-d769ec13cc7f service nova] [instance: 279e2954-d786-4544-903d-8edc63646e2d] Updated VIF entry in instance network info cache for port e60cc693-67d4-45a3-a97e-40bb5f753c9d. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 03:46:23 user nova-compute[103546]: DEBUG nova.network.neutron [req-7a617aca-791e-4a20-9ce3-3ffd9dfd109b req-51f7c557-aed7-463a-98a7-d769ec13cc7f service nova] [instance: 279e2954-d786-4544-903d-8edc63646e2d] Updating instance_info_cache with network_info: [{"id": "e60cc693-67d4-45a3-a97e-40bb5f753c9d", "address": "fa:16:3e:44:ef:27", "network": {"id": "56e4e469-bfda-4ab1-9fdd-e3aa1a0655fc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-669383710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f227c815224d55afdb3eba43e68757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape60cc693-67", "ovs_interfaceid": "e60cc693-67d4-45a3-a97e-40bb5f753c9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:46:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-7a617aca-791e-4a20-9ce3-3ffd9dfd109b req-51f7c557-aed7-463a-98a7-d769ec13cc7f service nova] Releasing lock "refresh_cache-279e2954-d786-4544-903d-8edc63646e2d" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:46:23 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:23 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape60cc693-67, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:46:23 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape60cc693-67, col_values=(('qos', UUID('8e74a104-0b7e-42c9-937a-5350e3416d82')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:46:23 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape60cc693-67, col_values=(('external_ids', {'iface-id': 'e60cc693-67d4-45a3-a97e-40bb5f753c9d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:ef:27', 'vm-uuid': '279e2954-d786-4544-903d-8edc63646e2d'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:46:23 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:23 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:46:23 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:23 user nova-compute[103546]: INFO os_vif [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:ef:27,bridge_name='br-int',has_traffic_filtering=True,id=e60cc693-67d4-45a3-a97e-40bb5f753c9d,network=Network(56e4e469-bfda-4ab1-9fdd-e3aa1a0655fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape60cc693-67')
Nov 16 03:46:23 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:46:23 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] No VIF found with MAC fa:16:3e:44:ef:27, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 03:46:24 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:24 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:25 user nova-compute[103546]: DEBUG nova.network.neutron [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Successfully created port: e36fae5d-773f-47c0-b79a-5aadf6412cbc {{(pid=103546) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 03:46:25 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:25 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:25 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:25 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:25 user nova-compute[103546]: DEBUG nova.network.neutron [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Successfully created port: 26fd759d-5cb8-4798-ab59-c7f5cb7773e8 {{(pid=103546) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 03:46:25 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:26 user nova-compute[103546]: DEBUG nova.compute.manager [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 279e2954-d786-4544-903d-8edc63646e2d] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 03:46:26 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 279e2954-d786-4544-903d-8edc63646e2d] Guest created on hypervisor {{(pid=103546) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 03:46:26 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 279e2954-d786-4544-903d-8edc63646e2d] Instance spawned successfully.
Nov 16 03:46:26 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 279e2954-d786-4544-903d-8edc63646e2d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 03:46:26 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 279e2954-d786-4544-903d-8edc63646e2d] Found default for hw_cdrom_bus of ide {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:46:26 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 279e2954-d786-4544-903d-8edc63646e2d] Found default for hw_disk_bus of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:46:26 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 279e2954-d786-4544-903d-8edc63646e2d] Found default for hw_input_bus of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:46:26 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 279e2954-d786-4544-903d-8edc63646e2d] Found default for hw_pointer_model of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:46:26 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 279e2954-d786-4544-903d-8edc63646e2d] Found default for hw_video_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:46:26 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 279e2954-d786-4544-903d-8edc63646e2d] Found default for hw_vif_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:46:26 user nova-compute[103546]: INFO nova.compute.manager [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 279e2954-d786-4544-903d-8edc63646e2d] Took 12.51 seconds to spawn the instance on the hypervisor.
Nov 16 03:46:26 user nova-compute[103546]: DEBUG nova.compute.manager [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 279e2954-d786-4544-903d-8edc63646e2d] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 03:46:27 user nova-compute[103546]: INFO nova.compute.manager [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 279e2954-d786-4544-903d-8edc63646e2d] Took 13.64 seconds to build instance.
Nov 16 03:46:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cd622764-90d3-436a-b040-dbff4108342e tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Lock "279e2954-d786-4544-903d-8edc63646e2d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.958s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:46:27 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:27 user nova-compute[103546]: DEBUG nova.network.neutron [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Successfully updated port: 26fd759d-5cb8-4798-ab59-c7f5cb7773e8 {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 03:46:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Acquiring lock "refresh_cache-7862d05d-4293-46a5-98aa-41967a572fe3" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:46:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Acquired lock "refresh_cache-7862d05d-4293-46a5-98aa-41967a572fe3" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:46:27 user nova-compute[103546]: DEBUG nova.network.neutron [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 03:46:27 user nova-compute[103546]: DEBUG nova.compute.manager [req-a6cdaa21-8f02-4ca8-995a-ca6e044e2796 req-11439efe-0a30-4a25-b3c7-778171100248 service nova] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Received event network-changed-26fd759d-5cb8-4798-ab59-c7f5cb7773e8 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:46:27 user nova-compute[103546]: DEBUG nova.compute.manager [req-a6cdaa21-8f02-4ca8-995a-ca6e044e2796 req-11439efe-0a30-4a25-b3c7-778171100248 service nova] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Refreshing instance network info cache due to event network-changed-26fd759d-5cb8-4798-ab59-c7f5cb7773e8. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:46:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a6cdaa21-8f02-4ca8-995a-ca6e044e2796 req-11439efe-0a30-4a25-b3c7-778171100248 service nova] Acquiring lock "refresh_cache-7862d05d-4293-46a5-98aa-41967a572fe3" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:46:27 user nova-compute[103546]: DEBUG nova.network.neutron [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 03:46:27 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:27 user nova-compute[103546]: DEBUG nova.network.neutron [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Successfully updated port: e36fae5d-773f-47c0-b79a-5aadf6412cbc {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 03:46:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Acquiring lock "refresh_cache-51554aab-44ec-4161-b926-9c07a3f838a5" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:46:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Acquired lock "refresh_cache-51554aab-44ec-4161-b926-9c07a3f838a5" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:46:27 user nova-compute[103546]: DEBUG nova.network.neutron [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 03:46:28 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:28 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:28 user nova-compute[103546]: DEBUG nova.network.neutron [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 03:46:28 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:28 user nova-compute[103546]: DEBUG nova.compute.manager [req-270024ab-ba37-43a0-8ffb-254016086dec req-5505b0b1-6366-43b6-9f4e-881658281d43 service nova] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Received event network-changed-e36fae5d-773f-47c0-b79a-5aadf6412cbc {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:46:28 user nova-compute[103546]: DEBUG nova.compute.manager [req-270024ab-ba37-43a0-8ffb-254016086dec req-5505b0b1-6366-43b6-9f4e-881658281d43 service nova] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Refreshing instance network info cache due to event network-changed-e36fae5d-773f-47c0-b79a-5aadf6412cbc. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:46:28 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-270024ab-ba37-43a0-8ffb-254016086dec req-5505b0b1-6366-43b6-9f4e-881658281d43 service nova] Acquiring lock "refresh_cache-51554aab-44ec-4161-b926-9c07a3f838a5" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:46:28 user nova-compute[103546]: DEBUG nova.network.neutron [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Updating instance_info_cache with network_info: [{"id": "26fd759d-5cb8-4798-ab59-c7f5cb7773e8", "address": "fa:16:3e:a0:1a:6c", "network": {"id": "b2fca984-f1e9-4c86-a3a5-b8d5b9950555", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-172535633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63722fdf17e4408299de8c215c133812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26fd759d-5c", "ovs_interfaceid": "26fd759d-5cb8-4798-ab59-c7f5cb7773e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:46:28 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Releasing lock "refresh_cache-7862d05d-4293-46a5-98aa-41967a572fe3" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:46:28 user nova-compute[103546]: DEBUG nova.compute.manager [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Instance network_info: |[{"id": "26fd759d-5cb8-4798-ab59-c7f5cb7773e8", "address": "fa:16:3e:a0:1a:6c", "network": {"id": "b2fca984-f1e9-4c86-a3a5-b8d5b9950555", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-172535633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63722fdf17e4408299de8c215c133812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26fd759d-5c", "ovs_interfaceid": "26fd759d-5cb8-4798-ab59-c7f5cb7773e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 03:46:28 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a6cdaa21-8f02-4ca8-995a-ca6e044e2796 req-11439efe-0a30-4a25-b3c7-778171100248 service nova] Acquired lock "refresh_cache-7862d05d-4293-46a5-98aa-41967a572fe3" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:46:28 user nova-compute[103546]: DEBUG nova.network.neutron [req-a6cdaa21-8f02-4ca8-995a-ca6e044e2796 req-11439efe-0a30-4a25-b3c7-778171100248 service nova] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Refreshing network info cache for port 26fd759d-5cb8-4798-ab59-c7f5cb7773e8 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:46:28 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Start _get_guest_xml network_info=[{"id": "26fd759d-5cb8-4798-ab59-c7f5cb7773e8", "address": "fa:16:3e:a0:1a:6c", "network": {"id": "b2fca984-f1e9-4c86-a3a5-b8d5b9950555", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-172535633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63722fdf17e4408299de8c215c133812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26fd759d-5c", "ovs_interfaceid": "26fd759d-5cb8-4798-ab59-c7f5cb7773e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '5c6f539a-01e5-4478-bf8f-a14310b5d7dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 03:46:28 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:46:28 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:46:28 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 03:46:28 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 03:46:28 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 03:46:28 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 03:46:28 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 03:46:28 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 03:46:28 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 03:46:28 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 03:46:28 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 03:46:28 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 03:46:28 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 03:46:28 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 03:46:28 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 03:46:28 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 03:46:28 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 03:46:28 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 03:46:28 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:46:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1027244547',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1027244547',id=3,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIFxV00qDStRyM0aDchwn6O7nlyPBZ3FOeBCFyiv8nQiisuU4RVmz5Isxf+3jZU4Uk5uvGKisEupEEQry1rV9qqNWz0A/tXtKp7pERmtHb5Hdrh+a6bO5Ag2wMW0itUDaA==',key_name='tempest-keypair-494888',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63722fdf17e4408299de8c215c133812',ramdisk_id='',reservation_id='r-l9s12mms',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1382373405',owner_user_name='tempest-AttachVolumeShelveTestJSON-1382373405-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:46:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21d4e9052a614968bda331f028920ca7',uuid=7862d05d-4293-46a5-98aa-41967a572fe3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26fd759d-5cb8-4798-ab59-c7f5cb7773e8", "address": "fa:16:3e:a0:1a:6c", "network": {"id": "b2fca984-f1e9-4c86-a3a5-b8d5b9950555", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-172535633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63722fdf17e4408299de8c215c133812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26fd759d-5c", "ovs_interfaceid": "26fd759d-5cb8-4798-ab59-c7f5cb7773e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 03:46:28 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Converting VIF {"id": "26fd759d-5cb8-4798-ab59-c7f5cb7773e8", "address": "fa:16:3e:a0:1a:6c", "network": {"id": "b2fca984-f1e9-4c86-a3a5-b8d5b9950555", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-172535633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63722fdf17e4408299de8c215c133812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26fd759d-5c", "ovs_interfaceid": "26fd759d-5cb8-4798-ab59-c7f5cb7773e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:46:28 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:1a:6c,bridge_name='br-int',has_traffic_filtering=True,id=26fd759d-5cb8-4798-ab59-c7f5cb7773e8,network=Network(b2fca984-f1e9-4c86-a3a5-b8d5b9950555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26fd759d-5c') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:46:28 user nova-compute[103546]: DEBUG nova.objects.instance [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lazy-loading 'pci_devices' on Instance uuid 7862d05d-4293-46a5-98aa-41967a572fe3 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:46:28 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] End _get_guest_xml xml=<domain type="kvm">
Nov 16 03:46:28 user nova-compute[103546]:   <uuid>7862d05d-4293-46a5-98aa-41967a572fe3</uuid>
Nov 16 03:46:28 user nova-compute[103546]:   <name>instance-00000003</name>
Nov 16 03:46:28 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 03:46:28 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 03:46:28 user nova-compute[103546]:   <metadata>
Nov 16 03:46:28 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 03:46:28 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 03:46:28 user nova-compute[103546]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1027244547</nova:name>
Nov 16 03:46:28 user nova-compute[103546]:       <nova:creationTime>2023-11-16 03:46:28</nova:creationTime>
Nov 16 03:46:28 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 03:46:28 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 03:46:28 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 03:46:28 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 03:46:28 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 03:46:28 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 03:46:28 user nova-compute[103546]:       </nova:flavor>
Nov 16 03:46:28 user nova-compute[103546]:       <nova:owner>
Nov 16 03:46:28 user nova-compute[103546]:         <nova:user uuid="21d4e9052a614968bda331f028920ca7">tempest-AttachVolumeShelveTestJSON-1382373405-project-member</nova:user>
Nov 16 03:46:28 user nova-compute[103546]:         <nova:project uuid="63722fdf17e4408299de8c215c133812">tempest-AttachVolumeShelveTestJSON-1382373405</nova:project>
Nov 16 03:46:28 user nova-compute[103546]:       </nova:owner>
Nov 16 03:46:28 user nova-compute[103546]:       <nova:root type="image" uuid="5c6f539a-01e5-4478-bf8f-a14310b5d7dd"/>
Nov 16 03:46:28 user nova-compute[103546]:       <nova:ports>
Nov 16 03:46:28 user nova-compute[103546]:         <nova:port uuid="26fd759d-5cb8-4798-ab59-c7f5cb7773e8">
Nov 16 03:46:28 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 16 03:46:28 user nova-compute[103546]:         </nova:port>
Nov 16 03:46:28 user nova-compute[103546]:       </nova:ports>
Nov 16 03:46:28 user nova-compute[103546]:     </nova:instance>
Nov 16 03:46:28 user nova-compute[103546]:   </metadata>
Nov 16 03:46:28 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 03:46:28 user nova-compute[103546]:     <system>
Nov 16 03:46:28 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 03:46:28 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 03:46:28 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 03:46:28 user nova-compute[103546]:       <entry name="serial">7862d05d-4293-46a5-98aa-41967a572fe3</entry>
Nov 16 03:46:28 user nova-compute[103546]:       <entry name="uuid">7862d05d-4293-46a5-98aa-41967a572fe3</entry>
Nov 16 03:46:28 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 03:46:28 user nova-compute[103546]:     </system>
Nov 16 03:46:28 user nova-compute[103546]:   </sysinfo>
Nov 16 03:46:28 user nova-compute[103546]:   <os>
Nov 16 03:46:28 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 03:46:28 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 03:46:28 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 03:46:28 user nova-compute[103546]:   </os>
Nov 16 03:46:28 user nova-compute[103546]:   <features>
Nov 16 03:46:28 user nova-compute[103546]:     <acpi/>
Nov 16 03:46:28 user nova-compute[103546]:     <apic/>
Nov 16 03:46:28 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 03:46:28 user nova-compute[103546]:   </features>
Nov 16 03:46:28 user nova-compute[103546]:   <clock offset="utc">
Nov 16 03:46:28 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 03:46:28 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 03:46:28 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 03:46:28 user nova-compute[103546]:   </clock>
Nov 16 03:46:28 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 03:46:28 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 03:46:28 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 03:46:28 user nova-compute[103546]:   </cpu>
Nov 16 03:46:28 user nova-compute[103546]:   <devices>
Nov 16 03:46:28 user nova-compute[103546]:     <disk type="file" device="disk">
Nov 16 03:46:28 user nova-compute[103546]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 03:46:28 user nova-compute[103546]:       <source file="/opt/stack/data/nova/instances/7862d05d-4293-46a5-98aa-41967a572fe3/disk"/>
Nov 16 03:46:28 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 03:46:28 user nova-compute[103546]:     </disk>
Nov 16 03:46:28 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 03:46:28 user nova-compute[103546]:       <mac address="fa:16:3e:a0:1a:6c"/>
Nov 16 03:46:28 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:46:28 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 03:46:28 user nova-compute[103546]:       <target dev="tap26fd759d-5c"/>
Nov 16 03:46:28 user nova-compute[103546]:     </interface>
Nov 16 03:46:28 user nova-compute[103546]:     <serial type="pty">
Nov 16 03:46:28 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/7862d05d-4293-46a5-98aa-41967a572fe3/console.log" append="off"/>
Nov 16 03:46:28 user nova-compute[103546]:     </serial>
Nov 16 03:46:28 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 03:46:28 user nova-compute[103546]:     <video>
Nov 16 03:46:28 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:46:28 user nova-compute[103546]:     </video>
Nov 16 03:46:28 user nova-compute[103546]:     <rng model="virtio">
Nov 16 03:46:28 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 03:46:28 user nova-compute[103546]:     </rng>
Nov 16 03:46:28 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 03:46:28 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 03:46:28 user nova-compute[103546]:       <stats period="10"/>
Nov 16 03:46:28 user nova-compute[103546]:     </memballoon>
Nov 16 03:46:28 user nova-compute[103546]:   </devices>
Nov 16 03:46:28 user nova-compute[103546]: </domain>
Nov 16 03:46:28 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 03:46:28 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:46:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1027244547',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1027244547',id=3,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIFxV00qDStRyM0aDchwn6O7nlyPBZ3FOeBCFyiv8nQiisuU4RVmz5Isxf+3jZU4Uk5uvGKisEupEEQry1rV9qqNWz0A/tXtKp7pERmtHb5Hdrh+a6bO5Ag2wMW0itUDaA==',key_name='tempest-keypair-494888',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63722fdf17e4408299de8c215c133812',ramdisk_id='',reservation_id='r-l9s12mms',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1382373405',owner_user_name='tempest-AttachVolumeShelveTestJSON-1382373405-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:46:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21d4e9052a614968bda331f028920ca7',uuid=7862d05d-4293-46a5-98aa-41967a572fe3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26fd759d-5cb8-4798-ab59-c7f5cb7773e8", "address": "fa:16:3e:a0:1a:6c", "network": {"id": "b2fca984-f1e9-4c86-a3a5-b8d5b9950555", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-172535633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63722fdf17e4408299de8c215c133812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26fd759d-5c", "ovs_interfaceid": "26fd759d-5cb8-4798-ab59-c7f5cb7773e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 03:46:28 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Converting VIF {"id": "26fd759d-5cb8-4798-ab59-c7f5cb7773e8", "address": "fa:16:3e:a0:1a:6c", "network": {"id": "b2fca984-f1e9-4c86-a3a5-b8d5b9950555", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-172535633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63722fdf17e4408299de8c215c133812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26fd759d-5c", "ovs_interfaceid": "26fd759d-5cb8-4798-ab59-c7f5cb7773e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:46:28 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:1a:6c,bridge_name='br-int',has_traffic_filtering=True,id=26fd759d-5cb8-4798-ab59-c7f5cb7773e8,network=Network(b2fca984-f1e9-4c86-a3a5-b8d5b9950555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26fd759d-5c') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:46:28 user nova-compute[103546]: DEBUG os_vif [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:1a:6c,bridge_name='br-int',has_traffic_filtering=True,id=26fd759d-5cb8-4798-ab59-c7f5cb7773e8,network=Network(b2fca984-f1e9-4c86-a3a5-b8d5b9950555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26fd759d-5c') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 03:46:28 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:28 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:46:28 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 03:46:28 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:28 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'be84f374-dc49-5eb4-a303-0e41caf501f4', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:46:28 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:28 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:28 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:28 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26fd759d-5c, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:46:28 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap26fd759d-5c, col_values=(('qos', UUID('d35a2752-a729-4836-afca-3a1a8ac338bf')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:46:28 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap26fd759d-5c, col_values=(('external_ids', {'iface-id': '26fd759d-5cb8-4798-ab59-c7f5cb7773e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:1a:6c', 'vm-uuid': '7862d05d-4293-46a5-98aa-41967a572fe3'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:46:28 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:28 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:46:28 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:28 user nova-compute[103546]: INFO os_vif [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:1a:6c,bridge_name='br-int',has_traffic_filtering=True,id=26fd759d-5cb8-4798-ab59-c7f5cb7773e8,network=Network(b2fca984-f1e9-4c86-a3a5-b8d5b9950555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26fd759d-5c')
Nov 16 03:46:28 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:46:28 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] No VIF found with MAC fa:16:3e:a0:1a:6c, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 03:46:29 user nova-compute[103546]: DEBUG nova.network.neutron [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Updating instance_info_cache with network_info: [{"id": "e36fae5d-773f-47c0-b79a-5aadf6412cbc", "address": "fa:16:3e:9a:45:d0", "network": {"id": "ef471a6e-7bd1-4a61-aa01-fd7557bfae1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-865941926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76ca2da0c584a7382040eb113da4c2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape36fae5d-77", "ovs_interfaceid": "e36fae5d-773f-47c0-b79a-5aadf6412cbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:46:29 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Releasing lock "refresh_cache-51554aab-44ec-4161-b926-9c07a3f838a5" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:46:29 user nova-compute[103546]: DEBUG nova.compute.manager [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Instance network_info: |[{"id": "e36fae5d-773f-47c0-b79a-5aadf6412cbc", "address": "fa:16:3e:9a:45:d0", "network": {"id": "ef471a6e-7bd1-4a61-aa01-fd7557bfae1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-865941926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76ca2da0c584a7382040eb113da4c2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape36fae5d-77", "ovs_interfaceid": "e36fae5d-773f-47c0-b79a-5aadf6412cbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 03:46:29 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-270024ab-ba37-43a0-8ffb-254016086dec req-5505b0b1-6366-43b6-9f4e-881658281d43 service nova] Acquired lock "refresh_cache-51554aab-44ec-4161-b926-9c07a3f838a5" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:46:29 user nova-compute[103546]: DEBUG nova.network.neutron [req-270024ab-ba37-43a0-8ffb-254016086dec req-5505b0b1-6366-43b6-9f4e-881658281d43 service nova] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Refreshing network info cache for port e36fae5d-773f-47c0-b79a-5aadf6412cbc {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:46:29 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Start _get_guest_xml network_info=[{"id": "e36fae5d-773f-47c0-b79a-5aadf6412cbc", "address": "fa:16:3e:9a:45:d0", "network": {"id": "ef471a6e-7bd1-4a61-aa01-fd7557bfae1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-865941926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76ca2da0c584a7382040eb113da4c2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape36fae5d-77", "ovs_interfaceid": "e36fae5d-773f-47c0-b79a-5aadf6412cbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '5c6f539a-01e5-4478-bf8f-a14310b5d7dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 03:46:29 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:46:29 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:46:29 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 03:46:29 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 03:46:29 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 03:46:29 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 03:46:29 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 03:46:29 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 03:46:29 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 03:46:29 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 03:46:29 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 03:46:29 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 03:46:29 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 03:46:29 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 03:46:29 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 03:46:29 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 03:46:29 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 03:46:29 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 03:46:29 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:46:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1580842921',display_name='tempest-ServerActionsTestOtherB-server-1580842921',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1580842921',id=2,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4BC4cHDV2fbJoL15YFOsrL3Jj/txUDoSxREB28Izf7niUsDWNVN4I6jw0qVmlW7BvPaNCWUAskE06oeKsT+2XD63IEOwvY2xtSda7L7/qiL3VY46L9X29CD+3k2W4RoA==',key_name='tempest-keypair-857843108',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f76ca2da0c584a7382040eb113da4c2a',ramdisk_id='',reservation_id='r-kl1f6eox',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-648062424',owner_user_name='tempest-ServerActionsTestOtherB-648062424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:46:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4bf11ccac9f4203808f8dca52cde36c',uuid=51554aab-44ec-4161-b926-9c07a3f838a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e36fae5d-773f-47c0-b79a-5aadf6412cbc", "address": "fa:16:3e:9a:45:d0", "network": {"id": "ef471a6e-7bd1-4a61-aa01-fd7557bfae1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-865941926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76ca2da0c584a7382040eb113da4c2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape36fae5d-77", "ovs_interfaceid": "e36fae5d-773f-47c0-b79a-5aadf6412cbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 03:46:29 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Converting VIF {"id": "e36fae5d-773f-47c0-b79a-5aadf6412cbc", "address": "fa:16:3e:9a:45:d0", "network": {"id": "ef471a6e-7bd1-4a61-aa01-fd7557bfae1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-865941926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76ca2da0c584a7382040eb113da4c2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape36fae5d-77", "ovs_interfaceid": "e36fae5d-773f-47c0-b79a-5aadf6412cbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:46:29 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:45:d0,bridge_name='br-int',has_traffic_filtering=True,id=e36fae5d-773f-47c0-b79a-5aadf6412cbc,network=Network(ef471a6e-7bd1-4a61-aa01-fd7557bfae1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape36fae5d-77') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:46:29 user nova-compute[103546]: DEBUG nova.objects.instance [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Lazy-loading 'pci_devices' on Instance uuid 51554aab-44ec-4161-b926-9c07a3f838a5 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:46:29 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] End _get_guest_xml xml=<domain type="kvm">
Nov 16 03:46:29 user nova-compute[103546]:   <uuid>51554aab-44ec-4161-b926-9c07a3f838a5</uuid>
Nov 16 03:46:29 user nova-compute[103546]:   <name>instance-00000002</name>
Nov 16 03:46:29 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 03:46:29 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 03:46:29 user nova-compute[103546]:   <metadata>
Nov 16 03:46:29 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 03:46:29 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 03:46:29 user nova-compute[103546]:       <nova:name>tempest-ServerActionsTestOtherB-server-1580842921</nova:name>
Nov 16 03:46:29 user nova-compute[103546]:       <nova:creationTime>2023-11-16 03:46:29</nova:creationTime>
Nov 16 03:46:29 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 03:46:29 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 03:46:29 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 03:46:29 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 03:46:29 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 03:46:29 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 03:46:29 user nova-compute[103546]:       </nova:flavor>
Nov 16 03:46:29 user nova-compute[103546]:       <nova:owner>
Nov 16 03:46:29 user nova-compute[103546]:         <nova:user uuid="d4bf11ccac9f4203808f8dca52cde36c">tempest-ServerActionsTestOtherB-648062424-project-member</nova:user>
Nov 16 03:46:29 user nova-compute[103546]:         <nova:project uuid="f76ca2da0c584a7382040eb113da4c2a">tempest-ServerActionsTestOtherB-648062424</nova:project>
Nov 16 03:46:29 user nova-compute[103546]:       </nova:owner>
Nov 16 03:46:29 user nova-compute[103546]:       <nova:root type="image" uuid="5c6f539a-01e5-4478-bf8f-a14310b5d7dd"/>
Nov 16 03:46:29 user nova-compute[103546]:       <nova:ports>
Nov 16 03:46:29 user nova-compute[103546]:         <nova:port uuid="e36fae5d-773f-47c0-b79a-5aadf6412cbc">
Nov 16 03:46:29 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 16 03:46:29 user nova-compute[103546]:         </nova:port>
Nov 16 03:46:29 user nova-compute[103546]:       </nova:ports>
Nov 16 03:46:29 user nova-compute[103546]:     </nova:instance>
Nov 16 03:46:29 user nova-compute[103546]:   </metadata>
Nov 16 03:46:29 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 03:46:29 user nova-compute[103546]:     <system>
Nov 16 03:46:29 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 03:46:29 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 03:46:29 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 03:46:29 user nova-compute[103546]:       <entry name="serial">51554aab-44ec-4161-b926-9c07a3f838a5</entry>
Nov 16 03:46:29 user nova-compute[103546]:       <entry name="uuid">51554aab-44ec-4161-b926-9c07a3f838a5</entry>
Nov 16 03:46:29 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 03:46:29 user nova-compute[103546]:     </system>
Nov 16 03:46:29 user nova-compute[103546]:   </sysinfo>
Nov 16 03:46:29 user nova-compute[103546]:   <os>
Nov 16 03:46:29 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 03:46:29 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 03:46:29 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 03:46:29 user nova-compute[103546]:   </os>
Nov 16 03:46:29 user nova-compute[103546]:   <features>
Nov 16 03:46:29 user nova-compute[103546]:     <acpi/>
Nov 16 03:46:29 user nova-compute[103546]:     <apic/>
Nov 16 03:46:29 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 03:46:29 user nova-compute[103546]:   </features>
Nov 16 03:46:29 user nova-compute[103546]:   <clock offset="utc">
Nov 16 03:46:29 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 03:46:29 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 03:46:29 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 03:46:29 user nova-compute[103546]:   </clock>
Nov 16 03:46:29 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 03:46:29 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 03:46:29 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 03:46:29 user nova-compute[103546]:   </cpu>
Nov 16 03:46:29 user nova-compute[103546]:   <devices>
Nov 16 03:46:29 user nova-compute[103546]:     <disk type="file" device="disk">
Nov 16 03:46:29 user nova-compute[103546]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 03:46:29 user nova-compute[103546]:       <source file="/opt/stack/data/nova/instances/51554aab-44ec-4161-b926-9c07a3f838a5/disk"/>
Nov 16 03:46:29 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 03:46:29 user nova-compute[103546]:     </disk>
Nov 16 03:46:29 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 03:46:29 user nova-compute[103546]:       <mac address="fa:16:3e:9a:45:d0"/>
Nov 16 03:46:29 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:46:29 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 03:46:29 user nova-compute[103546]:       <target dev="tape36fae5d-77"/>
Nov 16 03:46:29 user nova-compute[103546]:     </interface>
Nov 16 03:46:29 user nova-compute[103546]:     <serial type="pty">
Nov 16 03:46:29 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/51554aab-44ec-4161-b926-9c07a3f838a5/console.log" append="off"/>
Nov 16 03:46:29 user nova-compute[103546]:     </serial>
Nov 16 03:46:29 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 03:46:29 user nova-compute[103546]:     <video>
Nov 16 03:46:29 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:46:29 user nova-compute[103546]:     </video>
Nov 16 03:46:29 user nova-compute[103546]:     <rng model="virtio">
Nov 16 03:46:29 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 03:46:29 user nova-compute[103546]:     </rng>
Nov 16 03:46:29 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 03:46:29 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 03:46:29 user nova-compute[103546]:       <stats period="10"/>
Nov 16 03:46:29 user nova-compute[103546]:     </memballoon>
Nov 16 03:46:29 user nova-compute[103546]:   </devices>
Nov 16 03:46:29 user nova-compute[103546]: </domain>
Nov 16 03:46:29 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 03:46:29 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:46:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1580842921',display_name='tempest-ServerActionsTestOtherB-server-1580842921',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1580842921',id=2,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4BC4cHDV2fbJoL15YFOsrL3Jj/txUDoSxREB28Izf7niUsDWNVN4I6jw0qVmlW7BvPaNCWUAskE06oeKsT+2XD63IEOwvY2xtSda7L7/qiL3VY46L9X29CD+3k2W4RoA==',key_name='tempest-keypair-857843108',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f76ca2da0c584a7382040eb113da4c2a',ramdisk_id='',reservation_id='r-kl1f6eox',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-648062424',owner_user_name='tempest-ServerActionsTestOtherB-648062424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:46:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4bf11ccac9f4203808f8dca52cde36c',uuid=51554aab-44ec-4161-b926-9c07a3f838a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e36fae5d-773f-47c0-b79a-5aadf6412cbc", "address": "fa:16:3e:9a:45:d0", "network": {"id": "ef471a6e-7bd1-4a61-aa01-fd7557bfae1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-865941926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76ca2da0c584a7382040eb113da4c2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape36fae5d-77", "ovs_interfaceid": "e36fae5d-773f-47c0-b79a-5aadf6412cbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 03:46:29 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Converting VIF {"id": "e36fae5d-773f-47c0-b79a-5aadf6412cbc", "address": "fa:16:3e:9a:45:d0", "network": {"id": "ef471a6e-7bd1-4a61-aa01-fd7557bfae1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-865941926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76ca2da0c584a7382040eb113da4c2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape36fae5d-77", "ovs_interfaceid": "e36fae5d-773f-47c0-b79a-5aadf6412cbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:46:29 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:45:d0,bridge_name='br-int',has_traffic_filtering=True,id=e36fae5d-773f-47c0-b79a-5aadf6412cbc,network=Network(ef471a6e-7bd1-4a61-aa01-fd7557bfae1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape36fae5d-77') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:46:29 user nova-compute[103546]: DEBUG os_vif [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:45:d0,bridge_name='br-int',has_traffic_filtering=True,id=e36fae5d-773f-47c0-b79a-5aadf6412cbc,network=Network(ef471a6e-7bd1-4a61-aa01-fd7557bfae1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape36fae5d-77') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 03:46:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:46:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 03:46:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c8254de3-0ae2-54ca-9a2b-b650bc7f0d7f', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:46:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:46:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape36fae5d-77, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:46:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape36fae5d-77, col_values=(('qos', UUID('62fe5175-2699-4f62-8d42-d1dc7cd01c8b')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:46:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape36fae5d-77, col_values=(('external_ids', {'iface-id': 'e36fae5d-773f-47c0-b79a-5aadf6412cbc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:45:d0', 'vm-uuid': '51554aab-44ec-4161-b926-9c07a3f838a5'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:46:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:46:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:29 user nova-compute[103546]: INFO os_vif [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:45:d0,bridge_name='br-int',has_traffic_filtering=True,id=e36fae5d-773f-47c0-b79a-5aadf6412cbc,network=Network(ef471a6e-7bd1-4a61-aa01-fd7557bfae1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape36fae5d-77')
Nov 16 03:46:29 user nova-compute[103546]: DEBUG nova.network.neutron [req-a6cdaa21-8f02-4ca8-995a-ca6e044e2796 req-11439efe-0a30-4a25-b3c7-778171100248 service nova] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Updated VIF entry in instance network info cache for port 26fd759d-5cb8-4798-ab59-c7f5cb7773e8. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 03:46:29 user nova-compute[103546]: DEBUG nova.network.neutron [req-a6cdaa21-8f02-4ca8-995a-ca6e044e2796 req-11439efe-0a30-4a25-b3c7-778171100248 service nova] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Updating instance_info_cache with network_info: [{"id": "26fd759d-5cb8-4798-ab59-c7f5cb7773e8", "address": "fa:16:3e:a0:1a:6c", "network": {"id": "b2fca984-f1e9-4c86-a3a5-b8d5b9950555", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-172535633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63722fdf17e4408299de8c215c133812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26fd759d-5c", "ovs_interfaceid": "26fd759d-5cb8-4798-ab59-c7f5cb7773e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:46:29 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a6cdaa21-8f02-4ca8-995a-ca6e044e2796 req-11439efe-0a30-4a25-b3c7-778171100248 service nova] Releasing lock "refresh_cache-7862d05d-4293-46a5-98aa-41967a572fe3" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:46:29 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:46:29 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] No VIF found with MAC fa:16:3e:9a:45:d0, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 03:46:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:30 user nova-compute[103546]: DEBUG nova.network.neutron [req-270024ab-ba37-43a0-8ffb-254016086dec req-5505b0b1-6366-43b6-9f4e-881658281d43 service nova] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Updated VIF entry in instance network info cache for port e36fae5d-773f-47c0-b79a-5aadf6412cbc. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 03:46:30 user nova-compute[103546]: DEBUG nova.network.neutron [req-270024ab-ba37-43a0-8ffb-254016086dec req-5505b0b1-6366-43b6-9f4e-881658281d43 service nova] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Updating instance_info_cache with network_info: [{"id": "e36fae5d-773f-47c0-b79a-5aadf6412cbc", "address": "fa:16:3e:9a:45:d0", "network": {"id": "ef471a6e-7bd1-4a61-aa01-fd7557bfae1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-865941926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76ca2da0c584a7382040eb113da4c2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape36fae5d-77", "ovs_interfaceid": "e36fae5d-773f-47c0-b79a-5aadf6412cbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:46:30 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-270024ab-ba37-43a0-8ffb-254016086dec req-5505b0b1-6366-43b6-9f4e-881658281d43 service nova] Releasing lock "refresh_cache-51554aab-44ec-4161-b926-9c07a3f838a5" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:46:30 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:30 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:30 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:32 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:32 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:32 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:32 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:32 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:32 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:32 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:32 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:34 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:34 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:34 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:34 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:34 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:34 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:34 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:35 user nova-compute[103546]: DEBUG nova.compute.manager [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 03:46:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Guest created on hypervisor {{(pid=103546) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 03:46:35 user nova-compute[103546]: DEBUG nova.compute.manager [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 03:46:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Guest created on hypervisor {{(pid=103546) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 03:46:35 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Instance spawned successfully.
Nov 16 03:46:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 03:46:35 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Instance spawned successfully.
Nov 16 03:46:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 03:46:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Found default for hw_cdrom_bus of ide {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:46:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Found default for hw_disk_bus of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:46:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Found default for hw_input_bus of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:46:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Found default for hw_pointer_model of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:46:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Found default for hw_video_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:46:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Found default for hw_vif_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:46:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Found default for hw_cdrom_bus of ide {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:46:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Found default for hw_disk_bus of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:46:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Found default for hw_input_bus of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:46:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Found default for hw_pointer_model of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:46:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Found default for hw_video_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:46:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Found default for hw_vif_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:46:35 user nova-compute[103546]: INFO nova.compute.manager [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Took 13.15 seconds to spawn the instance on the hypervisor.
Nov 16 03:46:35 user nova-compute[103546]: DEBUG nova.compute.manager [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 03:46:35 user nova-compute[103546]: INFO nova.compute.manager [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Took 14.12 seconds to spawn the instance on the hypervisor.
Nov 16 03:46:35 user nova-compute[103546]: DEBUG nova.compute.manager [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 03:46:35 user nova-compute[103546]: INFO nova.compute.manager [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Took 14.15 seconds to build instance.
Nov 16 03:46:35 user nova-compute[103546]: INFO nova.compute.manager [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Took 14.97 seconds to build instance.
Nov 16 03:46:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1092e77f-16cb-4fe3-8976-e64e15e7f2d7 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Lock "51554aab-44ec-4161-b926-9c07a3f838a5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.119s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:46:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-64485d2c-c175-4ebd-adcd-c9a5bde91ef6 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "7862d05d-4293-46a5-98aa-41967a572fe3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.339s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:46:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Acquiring lock "c24a386f-32f5-4095-b2b3-69a70a54ff66" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:46:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Lock "c24a386f-32f5-4095-b2b3-69a70a54ff66" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:46:37 user nova-compute[103546]: DEBUG nova.compute.manager [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Starting instance... {{(pid=103546) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 03:46:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:46:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:46:37 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=103546) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 03:46:37 user nova-compute[103546]: INFO nova.compute.claims [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Claim successful on node user
Nov 16 03:46:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:37 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:46:37 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:46:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.471s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:46:37 user nova-compute[103546]: DEBUG nova.compute.manager [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Start building networks asynchronously for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 03:46:38 user nova-compute[103546]: DEBUG nova.compute.manager [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Allocating IP information in the background. {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 03:46:38 user nova-compute[103546]: DEBUG nova.network.neutron [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] allocate_for_instance() {{(pid=103546) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 03:46:38 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 03:46:38 user nova-compute[103546]: DEBUG nova.compute.manager [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Start building block device mappings for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 03:46:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Acquiring lock "05c929d5-2f1c-4be4-8864-6ec81625daac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:46:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Lock "05c929d5-2f1c-4be4-8864-6ec81625daac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:46:38 user nova-compute[103546]: DEBUG nova.compute.manager [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Starting instance... {{(pid=103546) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 03:46:38 user nova-compute[103546]: DEBUG nova.policy [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '186147c0885c4e6daf4c124dc54fe116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24d430f3bdd040ed87450fa998e0a8b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103546) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 03:46:38 user nova-compute[103546]: DEBUG nova.compute.manager [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Start spawning the instance on the hypervisor. {{(pid=103546) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 03:46:38 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Creating instance directory {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 03:46:38 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Creating image(s)
Nov 16 03:46:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Acquiring lock "/opt/stack/data/nova/instances/c24a386f-32f5-4095-b2b3-69a70a54ff66/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:46:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Lock "/opt/stack/data/nova/instances/c24a386f-32f5-4095-b2b3-69a70a54ff66/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:46:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Lock "/opt/stack/data/nova/instances/c24a386f-32f5-4095-b2b3-69a70a54ff66/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.054s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:46:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:46:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:46:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:46:38 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=103546) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 03:46:38 user nova-compute[103546]: INFO nova.compute.claims [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Claim successful on node user
Nov 16 03:46:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.299s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:46:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Acquiring lock "8c9efafb670bfe5842ba1f4ce398924612164af7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:46:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:46:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:46:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.220s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:46:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/c24a386f-32f5-4095-b2b3-69a70a54ff66/disk 1073741824 {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:46:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/c24a386f-32f5-4095-b2b3-69a70a54ff66/disk 1073741824" returned: 0 in 0.073s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:46:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.300s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:46:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:46:39 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:46:39 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:46:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.404s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:46:39 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c24a386f-32f5-4095-b2b3-69a70a54ff66/disk. size=1073741824 {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 03:46:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c24a386f-32f5-4095-b2b3-69a70a54ff66/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:46:39 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.939s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:46:39 user nova-compute[103546]: DEBUG nova.compute.manager [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Start building networks asynchronously for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 03:46:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:39 user nova-compute[103546]: DEBUG nova.compute.manager [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Allocating IP information in the background. {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 03:46:39 user nova-compute[103546]: DEBUG nova.network.neutron [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] allocate_for_instance() {{(pid=103546) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 03:46:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c24a386f-32f5-4095-b2b3-69a70a54ff66/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:46:39 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Cannot resize image /opt/stack/data/nova/instances/c24a386f-32f5-4095-b2b3-69a70a54ff66/disk to a smaller size. {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 03:46:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Created local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 03:46:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Ensure instance console log exists: /opt/stack/data/nova/instances/c24a386f-32f5-4095-b2b3-69a70a54ff66/console.log {{(pid=103546) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 03:46:39 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:46:39 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:46:39 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:46:39 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 03:46:39 user nova-compute[103546]: DEBUG nova.compute.manager [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Start building block device mappings for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 03:46:39 user nova-compute[103546]: DEBUG nova.network.neutron [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Successfully created port: 38395643-bb34-441c-ab0e-c9201f35ec04 {{(pid=103546) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 03:46:39 user nova-compute[103546]: DEBUG nova.policy [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7bf9f55ab03b4df38e0b35ed4c8967e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b2147e8194af3a15fce90bc7063b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103546) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 03:46:39 user nova-compute[103546]: DEBUG nova.compute.manager [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Start spawning the instance on the hypervisor. {{(pid=103546) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 03:46:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Creating instance directory {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 03:46:39 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Creating image(s)
Nov 16 03:46:39 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Acquiring lock "/opt/stack/data/nova/instances/05c929d5-2f1c-4be4-8864-6ec81625daac/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:46:39 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Lock "/opt/stack/data/nova/instances/05c929d5-2f1c-4be4-8864-6ec81625daac/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:46:39 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Lock "/opt/stack/data/nova/instances/05c929d5-2f1c-4be4-8864-6ec81625daac/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:46:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:46:40 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.248s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:46:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Acquiring lock "8c9efafb670bfe5842ba1f4ce398924612164af7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:46:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:46:40 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:46:40 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.221s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:46:40 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/05c929d5-2f1c-4be4-8864-6ec81625daac/disk 1073741824 {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:46:40 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/05c929d5-2f1c-4be4-8864-6ec81625daac/disk 1073741824" returned: 0 in 0.068s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:46:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.299s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:46:40 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:46:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Acquiring lock "fead4119-3ab9-4337-8b48-d3920e1112f4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:46:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Lock "fead4119-3ab9-4337-8b48-d3920e1112f4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:46:40 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.277s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:46:40 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Checking if we can resize image /opt/stack/data/nova/instances/05c929d5-2f1c-4be4-8864-6ec81625daac/disk. size=1073741824 {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 03:46:40 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c929d5-2f1c-4be4-8864-6ec81625daac/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:46:40 user nova-compute[103546]: DEBUG nova.compute.manager [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Starting instance... {{(pid=103546) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 03:46:40 user nova-compute[103546]: DEBUG nova.network.neutron [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Successfully created port: 6283c5fe-57f3-4552-b0cd-5d05b38e983c {{(pid=103546) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 03:46:40 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c929d5-2f1c-4be4-8864-6ec81625daac/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:46:40 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Cannot resize image /opt/stack/data/nova/instances/05c929d5-2f1c-4be4-8864-6ec81625daac/disk to a smaller size. {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 03:46:40 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Created local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 03:46:40 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Ensure instance console log exists: /opt/stack/data/nova/instances/05c929d5-2f1c-4be4-8864-6ec81625daac/console.log {{(pid=103546) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 03:46:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:46:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:46:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:46:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:46:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:46:40 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=103546) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 03:46:40 user nova-compute[103546]: INFO nova.compute.claims [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Claim successful on node user
Nov 16 03:46:41 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:46:41 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:46:41 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.534s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:46:41 user nova-compute[103546]: DEBUG nova.compute.manager [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Start building networks asynchronously for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 03:46:41 user nova-compute[103546]: DEBUG nova.network.neutron [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Successfully updated port: 38395643-bb34-441c-ab0e-c9201f35ec04 {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 03:46:41 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Acquiring lock "refresh_cache-c24a386f-32f5-4095-b2b3-69a70a54ff66" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:46:41 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Acquired lock "refresh_cache-c24a386f-32f5-4095-b2b3-69a70a54ff66" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:46:41 user nova-compute[103546]: DEBUG nova.network.neutron [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 03:46:41 user nova-compute[103546]: DEBUG nova.compute.manager [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Allocating IP information in the background. {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 03:46:41 user nova-compute[103546]: DEBUG nova.network.neutron [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] allocate_for_instance() {{(pid=103546) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 03:46:41 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 16 03:46:41 user nova-compute[103546]: DEBUG nova.compute.manager [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Start building block device mappings for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 03:46:41 user nova-compute[103546]: DEBUG nova.network.neutron [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 03:46:41 user nova-compute[103546]: DEBUG nova.compute.manager [req-82c6455c-6cb5-4d5e-899e-8b643374bf20 req-71157210-25dd-4262-8094-efd0feb159a7 service nova] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Received event network-changed-38395643-bb34-441c-ab0e-c9201f35ec04 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:46:41 user nova-compute[103546]: DEBUG nova.compute.manager [req-82c6455c-6cb5-4d5e-899e-8b643374bf20 req-71157210-25dd-4262-8094-efd0feb159a7 service nova] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Refreshing instance network info cache due to event network-changed-38395643-bb34-441c-ab0e-c9201f35ec04. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:46:41 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-82c6455c-6cb5-4d5e-899e-8b643374bf20 req-71157210-25dd-4262-8094-efd0feb159a7 service nova] Acquiring lock "refresh_cache-c24a386f-32f5-4095-b2b3-69a70a54ff66" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:46:41 user nova-compute[103546]: DEBUG nova.compute.manager [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Start spawning the instance on the hypervisor. {{(pid=103546) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 03:46:41 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Creating instance directory {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 03:46:41 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Creating image(s)
Nov 16 03:46:41 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Acquiring lock "/opt/stack/data/nova/instances/fead4119-3ab9-4337-8b48-d3920e1112f4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:46:41 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Lock "/opt/stack/data/nova/instances/fead4119-3ab9-4337-8b48-d3920e1112f4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:46:41 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Lock "/opt/stack/data/nova/instances/fead4119-3ab9-4337-8b48-d3920e1112f4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:46:41 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Acquiring lock "bad05ded55573e12bcd6eb828dae11d7f3886ecc" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:46:41 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Lock "bad05ded55573e12bcd6eb828dae11d7f3886ecc" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:46:42 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:42 user nova-compute[103546]: DEBUG nova.policy [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1715413924824093b543a2fd440edaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459bf831cfa74f74abcb5625afbafa27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103546) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 03:46:42 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bad05ded55573e12bcd6eb828dae11d7f3886ecc.part --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:46:42 user nova-compute[103546]: DEBUG nova.network.neutron [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Successfully updated port: 6283c5fe-57f3-4552-b0cd-5d05b38e983c {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 03:46:42 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:42 user nova-compute[103546]: DEBUG nova.compute.manager [req-6f72339a-f86d-4f3d-b5e0-41d7d7c4140c req-59d6dc7d-4709-437c-b642-d4bfb7a2a5aa service nova] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Received event network-changed-6283c5fe-57f3-4552-b0cd-5d05b38e983c {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:46:42 user nova-compute[103546]: DEBUG nova.compute.manager [req-6f72339a-f86d-4f3d-b5e0-41d7d7c4140c req-59d6dc7d-4709-437c-b642-d4bfb7a2a5aa service nova] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Refreshing instance network info cache due to event network-changed-6283c5fe-57f3-4552-b0cd-5d05b38e983c. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:46:42 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6f72339a-f86d-4f3d-b5e0-41d7d7c4140c req-59d6dc7d-4709-437c-b642-d4bfb7a2a5aa service nova] Acquiring lock "refresh_cache-05c929d5-2f1c-4be4-8864-6ec81625daac" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:46:42 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6f72339a-f86d-4f3d-b5e0-41d7d7c4140c req-59d6dc7d-4709-437c-b642-d4bfb7a2a5aa service nova] Acquired lock "refresh_cache-05c929d5-2f1c-4be4-8864-6ec81625daac" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:46:42 user nova-compute[103546]: DEBUG nova.network.neutron [req-6f72339a-f86d-4f3d-b5e0-41d7d7c4140c req-59d6dc7d-4709-437c-b642-d4bfb7a2a5aa service nova] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Refreshing network info cache for port 6283c5fe-57f3-4552-b0cd-5d05b38e983c {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:46:42 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Acquiring lock "refresh_cache-05c929d5-2f1c-4be4-8864-6ec81625daac" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:46:42 user nova-compute[103546]: DEBUG nova.network.neutron [req-6f72339a-f86d-4f3d-b5e0-41d7d7c4140c req-59d6dc7d-4709-437c-b642-d4bfb7a2a5aa service nova] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 03:46:42 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bad05ded55573e12bcd6eb828dae11d7f3886ecc.part --force-share --output=json" returned: 0 in 0.289s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:46:42 user nova-compute[103546]: DEBUG nova.virt.images [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] 27514916-7235-4bca-ac74-8ed152e6d26c was qcow2, converting to raw {{(pid=103546) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 03:46:42 user nova-compute[103546]: DEBUG nova.privsep.utils [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=103546) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 03:46:42 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bad05ded55573e12bcd6eb828dae11d7f3886ecc.part /opt/stack/data/nova/instances/_base/bad05ded55573e12bcd6eb828dae11d7f3886ecc.converted {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:46:42 user nova-compute[103546]: DEBUG nova.network.neutron [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Updating instance_info_cache with network_info: [{"id": "38395643-bb34-441c-ab0e-c9201f35ec04", "address": "fa:16:3e:2e:8e:90", "network": {"id": "32de335d-6f62-41f6-8520-1cc09523ef83", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1595594660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24d430f3bdd040ed87450fa998e0a8b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38395643-bb", "ovs_interfaceid": "38395643-bb34-441c-ab0e-c9201f35ec04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:46:42 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Releasing lock "refresh_cache-c24a386f-32f5-4095-b2b3-69a70a54ff66" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:46:42 user nova-compute[103546]: DEBUG nova.compute.manager [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Instance network_info: |[{"id": "38395643-bb34-441c-ab0e-c9201f35ec04", "address": "fa:16:3e:2e:8e:90", "network": {"id": "32de335d-6f62-41f6-8520-1cc09523ef83", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1595594660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24d430f3bdd040ed87450fa998e0a8b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38395643-bb", "ovs_interfaceid": "38395643-bb34-441c-ab0e-c9201f35ec04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 03:46:42 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-82c6455c-6cb5-4d5e-899e-8b643374bf20 req-71157210-25dd-4262-8094-efd0feb159a7 service nova] Acquired lock "refresh_cache-c24a386f-32f5-4095-b2b3-69a70a54ff66" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:46:42 user nova-compute[103546]: DEBUG nova.network.neutron [req-82c6455c-6cb5-4d5e-899e-8b643374bf20 req-71157210-25dd-4262-8094-efd0feb159a7 service nova] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Refreshing network info cache for port 38395643-bb34-441c-ab0e-c9201f35ec04 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:46:43 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Start _get_guest_xml network_info=[{"id": "38395643-bb34-441c-ab0e-c9201f35ec04", "address": "fa:16:3e:2e:8e:90", "network": {"id": "32de335d-6f62-41f6-8520-1cc09523ef83", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1595594660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24d430f3bdd040ed87450fa998e0a8b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38395643-bb", "ovs_interfaceid": "38395643-bb34-441c-ab0e-c9201f35ec04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '5c6f539a-01e5-4478-bf8f-a14310b5d7dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 03:46:43 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:46:43 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:46:43 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 03:46:43 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 03:46:43 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 03:46:43 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 03:46:43 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 03:46:43 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 03:46:43 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 03:46:43 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 03:46:43 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 03:46:43 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 03:46:43 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 03:46:43 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 03:46:43 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 03:46:43 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 03:46:43 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 03:46:43 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 03:46:43 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:46:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-555718699',display_name='tempest-TestVolumeSwap-server-555718699',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-555718699',id=4,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEuw+Ud6gYkVB/a3/qfQ4x7OmkqGfXxlndBAEDrfbMlwY1hKcHk7J74zmAmjDgpSqSYm04d2UbF6A+W7zZq6MG+5AtTKVesRtPYw7lZ34jE8yaqOpJ1F1pMqLvCcYTOwRA==',key_name='tempest-keypair-676090845',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24d430f3bdd040ed87450fa998e0a8b1',ramdisk_id='',reservation_id='r-p1rze5x9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-857315174',owner_user_name='tempest-TestVolumeSwap-857315174-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:46:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='186147c0885c4e6daf4c124dc54fe116',uuid=c24a386f-32f5-4095-b2b3-69a70a54ff66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38395643-bb34-441c-ab0e-c9201f35ec04", "address": "fa:16:3e:2e:8e:90", "network": {"id": "32de335d-6f62-41f6-8520-1cc09523ef83", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1595594660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24d430f3bdd040ed87450fa998e0a8b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38395643-bb", "ovs_interfaceid": "38395643-bb34-441c-ab0e-c9201f35ec04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 03:46:43 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Converting VIF {"id": "38395643-bb34-441c-ab0e-c9201f35ec04", "address": "fa:16:3e:2e:8e:90", "network": {"id": "32de335d-6f62-41f6-8520-1cc09523ef83", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1595594660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24d430f3bdd040ed87450fa998e0a8b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38395643-bb", "ovs_interfaceid": "38395643-bb34-441c-ab0e-c9201f35ec04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:46:43 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:8e:90,bridge_name='br-int',has_traffic_filtering=True,id=38395643-bb34-441c-ab0e-c9201f35ec04,network=Network(32de335d-6f62-41f6-8520-1cc09523ef83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38395643-bb') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:46:43 user nova-compute[103546]: DEBUG nova.objects.instance [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Lazy-loading 'pci_devices' on Instance uuid c24a386f-32f5-4095-b2b3-69a70a54ff66 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:46:43 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bad05ded55573e12bcd6eb828dae11d7f3886ecc.part /opt/stack/data/nova/instances/_base/bad05ded55573e12bcd6eb828dae11d7f3886ecc.converted" returned: 0 in 0.318s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:46:43 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bad05ded55573e12bcd6eb828dae11d7f3886ecc.converted --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:46:43 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] End _get_guest_xml xml=<domain type="kvm">
Nov 16 03:46:43 user nova-compute[103546]:   <uuid>c24a386f-32f5-4095-b2b3-69a70a54ff66</uuid>
Nov 16 03:46:43 user nova-compute[103546]:   <name>instance-00000004</name>
Nov 16 03:46:43 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 03:46:43 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 03:46:43 user nova-compute[103546]:   <metadata>
Nov 16 03:46:43 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 03:46:43 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 03:46:43 user nova-compute[103546]:       <nova:name>tempest-TestVolumeSwap-server-555718699</nova:name>
Nov 16 03:46:43 user nova-compute[103546]:       <nova:creationTime>2023-11-16 03:46:43</nova:creationTime>
Nov 16 03:46:43 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 03:46:43 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 03:46:43 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 03:46:43 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 03:46:43 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 03:46:43 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 03:46:43 user nova-compute[103546]:       </nova:flavor>
Nov 16 03:46:43 user nova-compute[103546]:       <nova:owner>
Nov 16 03:46:43 user nova-compute[103546]:         <nova:user uuid="186147c0885c4e6daf4c124dc54fe116">tempest-TestVolumeSwap-857315174-project-member</nova:user>
Nov 16 03:46:43 user nova-compute[103546]:         <nova:project uuid="24d430f3bdd040ed87450fa998e0a8b1">tempest-TestVolumeSwap-857315174</nova:project>
Nov 16 03:46:43 user nova-compute[103546]:       </nova:owner>
Nov 16 03:46:43 user nova-compute[103546]:       <nova:root type="image" uuid="5c6f539a-01e5-4478-bf8f-a14310b5d7dd"/>
Nov 16 03:46:43 user nova-compute[103546]:       <nova:ports>
Nov 16 03:46:43 user nova-compute[103546]:         <nova:port uuid="38395643-bb34-441c-ab0e-c9201f35ec04">
Nov 16 03:46:43 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 16 03:46:43 user nova-compute[103546]:         </nova:port>
Nov 16 03:46:43 user nova-compute[103546]:       </nova:ports>
Nov 16 03:46:43 user nova-compute[103546]:     </nova:instance>
Nov 16 03:46:43 user nova-compute[103546]:   </metadata>
Nov 16 03:46:43 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 03:46:43 user nova-compute[103546]:     <system>
Nov 16 03:46:43 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 03:46:43 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 03:46:43 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 03:46:43 user nova-compute[103546]:       <entry name="serial">c24a386f-32f5-4095-b2b3-69a70a54ff66</entry>
Nov 16 03:46:43 user nova-compute[103546]:       <entry name="uuid">c24a386f-32f5-4095-b2b3-69a70a54ff66</entry>
Nov 16 03:46:43 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 03:46:43 user nova-compute[103546]:     </system>
Nov 16 03:46:43 user nova-compute[103546]:   </sysinfo>
Nov 16 03:46:43 user nova-compute[103546]:   <os>
Nov 16 03:46:43 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 03:46:43 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 03:46:43 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 03:46:43 user nova-compute[103546]:   </os>
Nov 16 03:46:43 user nova-compute[103546]:   <features>
Nov 16 03:46:43 user nova-compute[103546]:     <acpi/>
Nov 16 03:46:43 user nova-compute[103546]:     <apic/>
Nov 16 03:46:43 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 03:46:43 user nova-compute[103546]:   </features>
Nov 16 03:46:43 user nova-compute[103546]:   <clock offset="utc">
Nov 16 03:46:43 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 03:46:43 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 03:46:43 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 03:46:43 user nova-compute[103546]:   </clock>
Nov 16 03:46:43 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 03:46:43 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 03:46:43 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 03:46:43 user nova-compute[103546]:   </cpu>
Nov 16 03:46:43 user nova-compute[103546]:   <devices>
Nov 16 03:46:43 user nova-compute[103546]:     <disk type="file" device="disk">
Nov 16 03:46:43 user nova-compute[103546]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 03:46:43 user nova-compute[103546]:       <source file="/opt/stack/data/nova/instances/c24a386f-32f5-4095-b2b3-69a70a54ff66/disk"/>
Nov 16 03:46:43 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 03:46:43 user nova-compute[103546]:     </disk>
Nov 16 03:46:43 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 03:46:43 user nova-compute[103546]:       <mac address="fa:16:3e:2e:8e:90"/>
Nov 16 03:46:43 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:46:43 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 03:46:43 user nova-compute[103546]:       <target dev="tap38395643-bb"/>
Nov 16 03:46:43 user nova-compute[103546]:     </interface>
Nov 16 03:46:43 user nova-compute[103546]:     <serial type="pty">
Nov 16 03:46:43 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/c24a386f-32f5-4095-b2b3-69a70a54ff66/console.log" append="off"/>
Nov 16 03:46:43 user nova-compute[103546]:     </serial>
Nov 16 03:46:43 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 03:46:43 user nova-compute[103546]:     <video>
Nov 16 03:46:43 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:46:43 user nova-compute[103546]:     </video>
Nov 16 03:46:43 user nova-compute[103546]:     <rng model="virtio">
Nov 16 03:46:43 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 03:46:43 user nova-compute[103546]:     </rng>
Nov 16 03:46:43 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 03:46:43 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 03:46:43 user nova-compute[103546]:       <stats period="10"/>
Nov 16 03:46:43 user nova-compute[103546]:     </memballoon>
Nov 16 03:46:43 user nova-compute[103546]:   </devices>
Nov 16 03:46:43 user nova-compute[103546]: </domain>
Nov 16 03:46:43 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 03:46:43 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:46:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-555718699',display_name='tempest-TestVolumeSwap-server-555718699',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-555718699',id=4,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEuw+Ud6gYkVB/a3/qfQ4x7OmkqGfXxlndBAEDrfbMlwY1hKcHk7J74zmAmjDgpSqSYm04d2UbF6A+W7zZq6MG+5AtTKVesRtPYw7lZ34jE8yaqOpJ1F1pMqLvCcYTOwRA==',key_name='tempest-keypair-676090845',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24d430f3bdd040ed87450fa998e0a8b1',ramdisk_id='',reservation_id='r-p1rze5x9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-857315174',owner_user_name='tempest-TestVolumeSwap-857315174-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:46:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='186147c0885c4e6daf4c124dc54fe116',uuid=c24a386f-32f5-4095-b2b3-69a70a54ff66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38395643-bb34-441c-ab0e-c9201f35ec04", "address": "fa:16:3e:2e:8e:90", "network": {"id": "32de335d-6f62-41f6-8520-1cc09523ef83", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1595594660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24d430f3bdd040ed87450fa998e0a8b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38395643-bb", "ovs_interfaceid": "38395643-bb34-441c-ab0e-c9201f35ec04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 03:46:43 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Converting VIF {"id": "38395643-bb34-441c-ab0e-c9201f35ec04", "address": "fa:16:3e:2e:8e:90", "network": {"id": "32de335d-6f62-41f6-8520-1cc09523ef83", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1595594660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24d430f3bdd040ed87450fa998e0a8b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38395643-bb", "ovs_interfaceid": "38395643-bb34-441c-ab0e-c9201f35ec04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:46:43 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:8e:90,bridge_name='br-int',has_traffic_filtering=True,id=38395643-bb34-441c-ab0e-c9201f35ec04,network=Network(32de335d-6f62-41f6-8520-1cc09523ef83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38395643-bb') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:46:43 user nova-compute[103546]: DEBUG os_vif [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:8e:90,bridge_name='br-int',has_traffic_filtering=True,id=38395643-bb34-441c-ab0e-c9201f35ec04,network=Network(32de335d-6f62-41f6-8520-1cc09523ef83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38395643-bb') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 03:46:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:46:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 03:46:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f96786c1-aadb-57f4-a125-8c4b936b0210', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:46:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:46:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap38395643-bb, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:46:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap38395643-bb, col_values=(('qos', UUID('415fc2a1-a96c-414f-b4ee-eebfa0fc96d8')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:46:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap38395643-bb, col_values=(('external_ids', {'iface-id': '38395643-bb34-441c-ab0e-c9201f35ec04', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:8e:90', 'vm-uuid': 'c24a386f-32f5-4095-b2b3-69a70a54ff66'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:46:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:46:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:43 user nova-compute[103546]: INFO os_vif [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:8e:90,bridge_name='br-int',has_traffic_filtering=True,id=38395643-bb34-441c-ab0e-c9201f35ec04,network=Network(32de335d-6f62-41f6-8520-1cc09523ef83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38395643-bb')
Nov 16 03:46:43 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bad05ded55573e12bcd6eb828dae11d7f3886ecc.converted --force-share --output=json" returned: 0 in 0.272s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:46:43 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Lock "bad05ded55573e12bcd6eb828dae11d7f3886ecc" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.564s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:46:43 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bad05ded55573e12bcd6eb828dae11d7f3886ecc --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:46:43 user nova-compute[103546]: DEBUG nova.network.neutron [req-6f72339a-f86d-4f3d-b5e0-41d7d7c4140c req-59d6dc7d-4709-437c-b642-d4bfb7a2a5aa service nova] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:46:43 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6f72339a-f86d-4f3d-b5e0-41d7d7c4140c req-59d6dc7d-4709-437c-b642-d4bfb7a2a5aa service nova] Releasing lock "refresh_cache-05c929d5-2f1c-4be4-8864-6ec81625daac" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:46:43 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Acquired lock "refresh_cache-05c929d5-2f1c-4be4-8864-6ec81625daac" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:46:43 user nova-compute[103546]: DEBUG nova.network.neutron [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 03:46:43 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:46:43 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] No VIF found with MAC fa:16:3e:2e:8e:90, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 03:46:43 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bad05ded55573e12bcd6eb828dae11d7f3886ecc --force-share --output=json" returned: 0 in 0.204s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:46:43 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Acquiring lock "bad05ded55573e12bcd6eb828dae11d7f3886ecc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:46:43 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Lock "bad05ded55573e12bcd6eb828dae11d7f3886ecc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:46:43 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bad05ded55573e12bcd6eb828dae11d7f3886ecc --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:46:43 user nova-compute[103546]: DEBUG nova.network.neutron [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 03:46:43 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bad05ded55573e12bcd6eb828dae11d7f3886ecc --force-share --output=json" returned: 0 in 0.223s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:46:43 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bad05ded55573e12bcd6eb828dae11d7f3886ecc,backing_fmt=raw /opt/stack/data/nova/instances/fead4119-3ab9-4337-8b48-d3920e1112f4/disk 1073741824 {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:46:44 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bad05ded55573e12bcd6eb828dae11d7f3886ecc,backing_fmt=raw /opt/stack/data/nova/instances/fead4119-3ab9-4337-8b48-d3920e1112f4/disk 1073741824" returned: 0 in 0.104s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:46:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Lock "bad05ded55573e12bcd6eb828dae11d7f3886ecc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.336s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:46:44 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bad05ded55573e12bcd6eb828dae11d7f3886ecc --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:46:44 user nova-compute[103546]: DEBUG nova.network.neutron [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Successfully created port: 55287b83-91c5-4c47-8ec5-c0da5bc3290e {{(pid=103546) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 03:46:44 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bad05ded55573e12bcd6eb828dae11d7f3886ecc --force-share --output=json" returned: 0 in 0.250s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:46:44 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fead4119-3ab9-4337-8b48-d3920e1112f4/disk. size=1073741824 {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 03:46:44 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fead4119-3ab9-4337-8b48-d3920e1112f4/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:46:44 user nova-compute[103546]: DEBUG nova.network.neutron [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Updating instance_info_cache with network_info: [{"id": "6283c5fe-57f3-4552-b0cd-5d05b38e983c", "address": "fa:16:3e:4d:ec:83", "network": {"id": "1a48a5d8-8046-4baf-9b30-4505213d862a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1526890096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998b2147e8194af3a15fce90bc7063b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6283c5fe-57", "ovs_interfaceid": "6283c5fe-57f3-4552-b0cd-5d05b38e983c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:46:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Releasing lock "refresh_cache-05c929d5-2f1c-4be4-8864-6ec81625daac" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:46:44 user nova-compute[103546]: DEBUG nova.compute.manager [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Instance network_info: |[{"id": "6283c5fe-57f3-4552-b0cd-5d05b38e983c", "address": "fa:16:3e:4d:ec:83", "network": {"id": "1a48a5d8-8046-4baf-9b30-4505213d862a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1526890096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998b2147e8194af3a15fce90bc7063b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6283c5fe-57", "ovs_interfaceid": "6283c5fe-57f3-4552-b0cd-5d05b38e983c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 03:46:44 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Start _get_guest_xml network_info=[{"id": "6283c5fe-57f3-4552-b0cd-5d05b38e983c", "address": "fa:16:3e:4d:ec:83", "network": {"id": "1a48a5d8-8046-4baf-9b30-4505213d862a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1526890096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998b2147e8194af3a15fce90bc7063b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6283c5fe-57", "ovs_interfaceid": "6283c5fe-57f3-4552-b0cd-5d05b38e983c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '5c6f539a-01e5-4478-bf8f-a14310b5d7dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 03:46:44 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:46:44 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:46:44 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 03:46:44 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 03:46:44 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 03:46:44 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 03:46:44 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 03:46:44 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 03:46:44 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 03:46:44 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 03:46:44 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 03:46:44 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 03:46:44 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 03:46:44 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 03:46:44 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 03:46:44 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 03:46:44 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 03:46:44 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 03:46:44 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:46:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2129922595',display_name='tempest-VolumesAdminNegativeTest-server-2129922595',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2129922595',id=5,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKa1C6Rh+qC1XTCUr7+ou2R1qUyOGn3m4XXoKYtqTkZNx9GmXFYEKcYTXC/eCB8+w3YwE/BUPbVFe5cpEj8Pdo1Lu/GLQwm6IAtg1poS77gPYWGy46p56gENzl98OJYlNA==',key_name='tempest-keypair-1917364052',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='998b2147e8194af3a15fce90bc7063b0',ramdisk_id='',reservation_id='r-qgsev7rm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1034179231',owner_user_name='tempest-VolumesAdminNegativeTest-1034179231-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:46:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bf9f55ab03b4df38e0b35ed4c8967e8',uuid=05c929d5-2f1c-4be4-8864-6ec81625daac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6283c5fe-57f3-4552-b0cd-5d05b38e983c", "address": "fa:16:3e:4d:ec:83", "network": {"id": "1a48a5d8-8046-4baf-9b30-4505213d862a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1526890096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998b2147e8194af3a15fce90bc7063b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6283c5fe-57", "ovs_interfaceid": "6283c5fe-57f3-4552-b0cd-5d05b38e983c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 03:46:44 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Converting VIF {"id": "6283c5fe-57f3-4552-b0cd-5d05b38e983c", "address": "fa:16:3e:4d:ec:83", "network": {"id": "1a48a5d8-8046-4baf-9b30-4505213d862a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1526890096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998b2147e8194af3a15fce90bc7063b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6283c5fe-57", "ovs_interfaceid": "6283c5fe-57f3-4552-b0cd-5d05b38e983c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:46:44 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:ec:83,bridge_name='br-int',has_traffic_filtering=True,id=6283c5fe-57f3-4552-b0cd-5d05b38e983c,network=Network(1a48a5d8-8046-4baf-9b30-4505213d862a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6283c5fe-57') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:46:44 user nova-compute[103546]: DEBUG nova.objects.instance [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Lazy-loading 'pci_devices' on Instance uuid 05c929d5-2f1c-4be4-8864-6ec81625daac {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:46:44 user nova-compute[103546]: DEBUG nova.network.neutron [req-82c6455c-6cb5-4d5e-899e-8b643374bf20 req-71157210-25dd-4262-8094-efd0feb159a7 service nova] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Updated VIF entry in instance network info cache for port 38395643-bb34-441c-ab0e-c9201f35ec04. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 03:46:44 user nova-compute[103546]: DEBUG nova.network.neutron [req-82c6455c-6cb5-4d5e-899e-8b643374bf20 req-71157210-25dd-4262-8094-efd0feb159a7 service nova] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Updating instance_info_cache with network_info: [{"id": "38395643-bb34-441c-ab0e-c9201f35ec04", "address": "fa:16:3e:2e:8e:90", "network": {"id": "32de335d-6f62-41f6-8520-1cc09523ef83", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1595594660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24d430f3bdd040ed87450fa998e0a8b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38395643-bb", "ovs_interfaceid": "38395643-bb34-441c-ab0e-c9201f35ec04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:46:44 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] End _get_guest_xml xml=<domain type="kvm">
Nov 16 03:46:44 user nova-compute[103546]:   <uuid>05c929d5-2f1c-4be4-8864-6ec81625daac</uuid>
Nov 16 03:46:44 user nova-compute[103546]:   <name>instance-00000005</name>
Nov 16 03:46:44 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 03:46:44 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 03:46:44 user nova-compute[103546]:   <metadata>
Nov 16 03:46:44 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 03:46:44 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 03:46:44 user nova-compute[103546]:       <nova:name>tempest-VolumesAdminNegativeTest-server-2129922595</nova:name>
Nov 16 03:46:44 user nova-compute[103546]:       <nova:creationTime>2023-11-16 03:46:44</nova:creationTime>
Nov 16 03:46:44 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 03:46:44 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 03:46:44 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 03:46:44 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 03:46:44 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 03:46:44 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 03:46:44 user nova-compute[103546]:       </nova:flavor>
Nov 16 03:46:44 user nova-compute[103546]:       <nova:owner>
Nov 16 03:46:44 user nova-compute[103546]:         <nova:user uuid="7bf9f55ab03b4df38e0b35ed4c8967e8">tempest-VolumesAdminNegativeTest-1034179231-project-member</nova:user>
Nov 16 03:46:44 user nova-compute[103546]:         <nova:project uuid="998b2147e8194af3a15fce90bc7063b0">tempest-VolumesAdminNegativeTest-1034179231</nova:project>
Nov 16 03:46:44 user nova-compute[103546]:       </nova:owner>
Nov 16 03:46:44 user nova-compute[103546]:       <nova:root type="image" uuid="5c6f539a-01e5-4478-bf8f-a14310b5d7dd"/>
Nov 16 03:46:44 user nova-compute[103546]:       <nova:ports>
Nov 16 03:46:44 user nova-compute[103546]:         <nova:port uuid="6283c5fe-57f3-4552-b0cd-5d05b38e983c">
Nov 16 03:46:44 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 16 03:46:44 user nova-compute[103546]:         </nova:port>
Nov 16 03:46:44 user nova-compute[103546]:       </nova:ports>
Nov 16 03:46:44 user nova-compute[103546]:     </nova:instance>
Nov 16 03:46:44 user nova-compute[103546]:   </metadata>
Nov 16 03:46:44 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 03:46:44 user nova-compute[103546]:     <system>
Nov 16 03:46:44 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 03:46:44 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 03:46:44 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 03:46:44 user nova-compute[103546]:       <entry name="serial">05c929d5-2f1c-4be4-8864-6ec81625daac</entry>
Nov 16 03:46:44 user nova-compute[103546]:       <entry name="uuid">05c929d5-2f1c-4be4-8864-6ec81625daac</entry>
Nov 16 03:46:44 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 03:46:44 user nova-compute[103546]:     </system>
Nov 16 03:46:44 user nova-compute[103546]:   </sysinfo>
Nov 16 03:46:44 user nova-compute[103546]:   <os>
Nov 16 03:46:44 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 03:46:44 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 03:46:44 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 03:46:44 user nova-compute[103546]:   </os>
Nov 16 03:46:44 user nova-compute[103546]:   <features>
Nov 16 03:46:44 user nova-compute[103546]:     <acpi/>
Nov 16 03:46:44 user nova-compute[103546]:     <apic/>
Nov 16 03:46:44 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 03:46:44 user nova-compute[103546]:   </features>
Nov 16 03:46:44 user nova-compute[103546]:   <clock offset="utc">
Nov 16 03:46:44 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 03:46:44 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 03:46:44 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 03:46:44 user nova-compute[103546]:   </clock>
Nov 16 03:46:44 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 03:46:44 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 03:46:44 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 03:46:44 user nova-compute[103546]:   </cpu>
Nov 16 03:46:44 user nova-compute[103546]:   <devices>
Nov 16 03:46:44 user nova-compute[103546]:     <disk type="file" device="disk">
Nov 16 03:46:44 user nova-compute[103546]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 03:46:44 user nova-compute[103546]:       <source file="/opt/stack/data/nova/instances/05c929d5-2f1c-4be4-8864-6ec81625daac/disk"/>
Nov 16 03:46:44 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 03:46:44 user nova-compute[103546]:     </disk>
Nov 16 03:46:44 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 03:46:44 user nova-compute[103546]:       <mac address="fa:16:3e:4d:ec:83"/>
Nov 16 03:46:44 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:46:44 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 03:46:44 user nova-compute[103546]:       <target dev="tap6283c5fe-57"/>
Nov 16 03:46:44 user nova-compute[103546]:     </interface>
Nov 16 03:46:44 user nova-compute[103546]:     <serial type="pty">
Nov 16 03:46:44 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/05c929d5-2f1c-4be4-8864-6ec81625daac/console.log" append="off"/>
Nov 16 03:46:44 user nova-compute[103546]:     </serial>
Nov 16 03:46:44 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 03:46:44 user nova-compute[103546]:     <video>
Nov 16 03:46:44 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:46:44 user nova-compute[103546]:     </video>
Nov 16 03:46:44 user nova-compute[103546]:     <rng model="virtio">
Nov 16 03:46:44 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 03:46:44 user nova-compute[103546]:     </rng>
Nov 16 03:46:44 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 03:46:44 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 03:46:44 user nova-compute[103546]:       <stats period="10"/>
Nov 16 03:46:44 user nova-compute[103546]:     </memballoon>
Nov 16 03:46:44 user nova-compute[103546]:   </devices>
Nov 16 03:46:44 user nova-compute[103546]: </domain>
Nov 16 03:46:44 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 03:46:44 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:46:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2129922595',display_name='tempest-VolumesAdminNegativeTest-server-2129922595',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2129922595',id=5,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKa1C6Rh+qC1XTCUr7+ou2R1qUyOGn3m4XXoKYtqTkZNx9GmXFYEKcYTXC/eCB8+w3YwE/BUPbVFe5cpEj8Pdo1Lu/GLQwm6IAtg1poS77gPYWGy46p56gENzl98OJYlNA==',key_name='tempest-keypair-1917364052',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='998b2147e8194af3a15fce90bc7063b0',ramdisk_id='',reservation_id='r-qgsev7rm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1034179231',owner_user_name='tempest-VolumesAdminNegativeTest-1034179231-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:46:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bf9f55ab03b4df38e0b35ed4c8967e8',uuid=05c929d5-2f1c-4be4-8864-6ec81625daac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6283c5fe-57f3-4552-b0cd-5d05b38e983c", "address": "fa:16:3e:4d:ec:83", "network": {"id": "1a48a5d8-8046-4baf-9b30-4505213d862a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1526890096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998b2147e8194af3a15fce90bc7063b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6283c5fe-57", "ovs_interfaceid": "6283c5fe-57f3-4552-b0cd-5d05b38e983c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 03:46:44 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Converting VIF {"id": "6283c5fe-57f3-4552-b0cd-5d05b38e983c", "address": "fa:16:3e:4d:ec:83", "network": {"id": "1a48a5d8-8046-4baf-9b30-4505213d862a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1526890096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998b2147e8194af3a15fce90bc7063b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6283c5fe-57", "ovs_interfaceid": "6283c5fe-57f3-4552-b0cd-5d05b38e983c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:46:44 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:ec:83,bridge_name='br-int',has_traffic_filtering=True,id=6283c5fe-57f3-4552-b0cd-5d05b38e983c,network=Network(1a48a5d8-8046-4baf-9b30-4505213d862a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6283c5fe-57') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:46:44 user nova-compute[103546]: DEBUG os_vif [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:ec:83,bridge_name='br-int',has_traffic_filtering=True,id=6283c5fe-57f3-4552-b0cd-5d05b38e983c,network=Network(1a48a5d8-8046-4baf-9b30-4505213d862a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6283c5fe-57') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 03:46:44 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:44 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:46:44 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 03:46:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-82c6455c-6cb5-4d5e-899e-8b643374bf20 req-71157210-25dd-4262-8094-efd0feb159a7 service nova] Releasing lock "refresh_cache-c24a386f-32f5-4095-b2b3-69a70a54ff66" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:46:44 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fead4119-3ab9-4337-8b48-d3920e1112f4/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:46:44 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:44 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '85fea90d-83b2-5576-ae5f-cee4fff839e1', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:46:44 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Cannot resize image /opt/stack/data/nova/instances/fead4119-3ab9-4337-8b48-d3920e1112f4/disk to a smaller size. {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 03:46:44 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Created local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 03:46:44 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Ensure instance console log exists: /opt/stack/data/nova/instances/fead4119-3ab9-4337-8b48-d3920e1112f4/console.log {{(pid=103546) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 03:46:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:46:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:46:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:46:44 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:44 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:44 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6283c5fe-57, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:46:44 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6283c5fe-57, col_values=(('qos', UUID('d8b6c287-d1f4-40c0-b34e-99132efca319')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:46:44 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6283c5fe-57, col_values=(('external_ids', {'iface-id': '6283c5fe-57f3-4552-b0cd-5d05b38e983c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:ec:83', 'vm-uuid': '05c929d5-2f1c-4be4-8864-6ec81625daac'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:46:44 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:46:44 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:44 user nova-compute[103546]: INFO os_vif [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:ec:83,bridge_name='br-int',has_traffic_filtering=True,id=6283c5fe-57f3-4552-b0cd-5d05b38e983c,network=Network(1a48a5d8-8046-4baf-9b30-4505213d862a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6283c5fe-57')
Nov 16 03:46:44 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:46:44 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] No VIF found with MAC fa:16:3e:4d:ec:83, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 03:46:45 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:45 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:45 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:45 user nova-compute[103546]: DEBUG nova.network.neutron [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Successfully updated port: 55287b83-91c5-4c47-8ec5-c0da5bc3290e {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 03:46:45 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Acquiring lock "refresh_cache-fead4119-3ab9-4337-8b48-d3920e1112f4" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:46:45 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Acquired lock "refresh_cache-fead4119-3ab9-4337-8b48-d3920e1112f4" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:46:45 user nova-compute[103546]: DEBUG nova.network.neutron [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 03:46:45 user nova-compute[103546]: DEBUG nova.compute.manager [req-50186444-d806-4f73-aa41-11b2e142b1c1 req-b3c62758-2180-4a74-ac9a-0aa5cdc10705 service nova] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Received event network-changed-55287b83-91c5-4c47-8ec5-c0da5bc3290e {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:46:45 user nova-compute[103546]: DEBUG nova.compute.manager [req-50186444-d806-4f73-aa41-11b2e142b1c1 req-b3c62758-2180-4a74-ac9a-0aa5cdc10705 service nova] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Refreshing instance network info cache due to event network-changed-55287b83-91c5-4c47-8ec5-c0da5bc3290e. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:46:45 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-50186444-d806-4f73-aa41-11b2e142b1c1 req-b3c62758-2180-4a74-ac9a-0aa5cdc10705 service nova] Acquiring lock "refresh_cache-fead4119-3ab9-4337-8b48-d3920e1112f4" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:46:45 user nova-compute[103546]: DEBUG nova.network.neutron [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 03:46:45 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Acquiring lock "549ee3db-0014-440f-bd3a-0d389f5eab88" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:46:45 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Lock "549ee3db-0014-440f-bd3a-0d389f5eab88" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:46:45 user nova-compute[103546]: DEBUG nova.compute.manager [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Starting instance... {{(pid=103546) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 03:46:45 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:45 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:46:45 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:46:45 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=103546) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 03:46:45 user nova-compute[103546]: INFO nova.compute.claims [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Claim successful on node user
Nov 16 03:46:46 user nova-compute[103546]: DEBUG nova.network.neutron [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Updating instance_info_cache with network_info: [{"id": "55287b83-91c5-4c47-8ec5-c0da5bc3290e", "address": "fa:16:3e:63:86:8e", "network": {"id": "d67be416-4ca1-4f91-9991-95aee2e04c4a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1248186454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "459bf831cfa74f74abcb5625afbafa27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55287b83-91", "ovs_interfaceid": "55287b83-91c5-4c47-8ec5-c0da5bc3290e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:46:46 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Releasing lock "refresh_cache-fead4119-3ab9-4337-8b48-d3920e1112f4" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:46:46 user nova-compute[103546]: DEBUG nova.compute.manager [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Instance network_info: |[{"id": "55287b83-91c5-4c47-8ec5-c0da5bc3290e", "address": "fa:16:3e:63:86:8e", "network": {"id": "d67be416-4ca1-4f91-9991-95aee2e04c4a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1248186454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "459bf831cfa74f74abcb5625afbafa27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55287b83-91", "ovs_interfaceid": "55287b83-91c5-4c47-8ec5-c0da5bc3290e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 03:46:46 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-50186444-d806-4f73-aa41-11b2e142b1c1 req-b3c62758-2180-4a74-ac9a-0aa5cdc10705 service nova] Acquired lock "refresh_cache-fead4119-3ab9-4337-8b48-d3920e1112f4" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:46:46 user nova-compute[103546]: DEBUG nova.network.neutron [req-50186444-d806-4f73-aa41-11b2e142b1c1 req-b3c62758-2180-4a74-ac9a-0aa5cdc10705 service nova] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Refreshing network info cache for port 55287b83-91c5-4c47-8ec5-c0da5bc3290e {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:46:46 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Start _get_guest_xml network_info=[{"id": "55287b83-91c5-4c47-8ec5-c0da5bc3290e", "address": "fa:16:3e:63:86:8e", "network": {"id": "d67be416-4ca1-4f91-9991-95aee2e04c4a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1248186454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "459bf831cfa74f74abcb5625afbafa27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55287b83-91", "ovs_interfaceid": "55287b83-91c5-4c47-8ec5-c0da5bc3290e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:46:30Z,direct_url=<?>,disk_format='qcow2',id=27514916-7235-4bca-ac74-8ed152e6d26c,min_disk=0,min_ram=0,name='',owner='a28944c8dbdc40c288705285ef48123f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:46:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'scsi', 'guest_format': None, 'device_name': '/dev/sda', 'device_type': 'disk', 'size': 0, 'image_id': '27514916-7235-4bca-ac74-8ed152e6d26c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 03:46:46 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:46:46 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:46:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:46 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 03:46:46 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 03:46:46 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 03:46:46 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 03:46:46 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 03:46:46 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:46:30Z,direct_url=<?>,disk_format='qcow2',id=27514916-7235-4bca-ac74-8ed152e6d26c,min_disk=0,min_ram=0,name='',owner='a28944c8dbdc40c288705285ef48123f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:46:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 03:46:46 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 03:46:46 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 03:46:46 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 03:46:46 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 03:46:46 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 03:46:46 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 03:46:46 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 03:46:46 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 03:46:46 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 03:46:46 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 03:46:46 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T03:46:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1723757256',display_name='tempest-AttachSCSIVolumeTestJSON-server-1723757256',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1723757256',id=6,image_ref='27514916-7235-4bca-ac74-8ed152e6d26c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEEHJrW51ra9jhpP37BWSRWPxPBqEbActvGJHuyJxwUi0tyqpW1Ys4/ut4CnE1EONIQvacihgxdwyWyTgNAMgQOB8Ipa5dWH3rU6BvGXNZ/x+YJAvxnVRrkwO7jJa0K3kQ==',key_name='tempest-keypair-1828100082',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='459bf831cfa74f74abcb5625afbafa27',ramdisk_id='',reservation_id='r-uw666qus',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='27514916-7235-4bca-ac74-8ed152e6d26c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1568574038',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1568574038-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:46:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1715413924824093b543a2fd440edaaa',uuid=fead4119-3ab9-4337-8b48-d3920e1112f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55287b83-91c5-4c47-8ec5-c0da5bc3290e", "address": "fa:16:3e:63:86:8e", "network": {"id": "d67be416-4ca1-4f91-9991-95aee2e04c4a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1248186454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "459bf831cfa74f74abcb5625afbafa27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55287b83-91", "ovs_interfaceid": "55287b83-91c5-4c47-8ec5-c0da5bc3290e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 03:46:46 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Converting VIF {"id": "55287b83-91c5-4c47-8ec5-c0da5bc3290e", "address": "fa:16:3e:63:86:8e", "network": {"id": "d67be416-4ca1-4f91-9991-95aee2e04c4a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1248186454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "459bf831cfa74f74abcb5625afbafa27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55287b83-91", "ovs_interfaceid": "55287b83-91c5-4c47-8ec5-c0da5bc3290e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:46:46 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:86:8e,bridge_name='br-int',has_traffic_filtering=True,id=55287b83-91c5-4c47-8ec5-c0da5bc3290e,network=Network(d67be416-4ca1-4f91-9991-95aee2e04c4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55287b83-91') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:46:46 user nova-compute[103546]: DEBUG nova.objects.instance [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Lazy-loading 'pci_devices' on Instance uuid fead4119-3ab9-4337-8b48-d3920e1112f4 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:46:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:46 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] End _get_guest_xml xml=<domain type="kvm">
Nov 16 03:46:46 user nova-compute[103546]:   <uuid>fead4119-3ab9-4337-8b48-d3920e1112f4</uuid>
Nov 16 03:46:46 user nova-compute[103546]:   <name>instance-00000006</name>
Nov 16 03:46:46 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 03:46:46 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 03:46:46 user nova-compute[103546]:   <metadata>
Nov 16 03:46:46 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 03:46:46 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 03:46:46 user nova-compute[103546]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1723757256</nova:name>
Nov 16 03:46:46 user nova-compute[103546]:       <nova:creationTime>2023-11-16 03:46:46</nova:creationTime>
Nov 16 03:46:46 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 03:46:46 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 03:46:46 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 03:46:46 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 03:46:46 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 03:46:46 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 03:46:46 user nova-compute[103546]:       </nova:flavor>
Nov 16 03:46:46 user nova-compute[103546]:       <nova:owner>
Nov 16 03:46:46 user nova-compute[103546]:         <nova:user uuid="1715413924824093b543a2fd440edaaa">tempest-AttachSCSIVolumeTestJSON-1568574038-project-member</nova:user>
Nov 16 03:46:46 user nova-compute[103546]:         <nova:project uuid="459bf831cfa74f74abcb5625afbafa27">tempest-AttachSCSIVolumeTestJSON-1568574038</nova:project>
Nov 16 03:46:46 user nova-compute[103546]:       </nova:owner>
Nov 16 03:46:46 user nova-compute[103546]:       <nova:root type="image" uuid="27514916-7235-4bca-ac74-8ed152e6d26c"/>
Nov 16 03:46:46 user nova-compute[103546]:       <nova:ports>
Nov 16 03:46:46 user nova-compute[103546]:         <nova:port uuid="55287b83-91c5-4c47-8ec5-c0da5bc3290e">
Nov 16 03:46:46 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 16 03:46:46 user nova-compute[103546]:         </nova:port>
Nov 16 03:46:46 user nova-compute[103546]:       </nova:ports>
Nov 16 03:46:46 user nova-compute[103546]:     </nova:instance>
Nov 16 03:46:46 user nova-compute[103546]:   </metadata>
Nov 16 03:46:46 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 03:46:46 user nova-compute[103546]:     <system>
Nov 16 03:46:46 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 03:46:46 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 03:46:46 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 03:46:46 user nova-compute[103546]:       <entry name="serial">fead4119-3ab9-4337-8b48-d3920e1112f4</entry>
Nov 16 03:46:46 user nova-compute[103546]:       <entry name="uuid">fead4119-3ab9-4337-8b48-d3920e1112f4</entry>
Nov 16 03:46:46 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 03:46:46 user nova-compute[103546]:     </system>
Nov 16 03:46:46 user nova-compute[103546]:   </sysinfo>
Nov 16 03:46:46 user nova-compute[103546]:   <os>
Nov 16 03:46:46 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 03:46:46 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 03:46:46 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 03:46:46 user nova-compute[103546]:   </os>
Nov 16 03:46:46 user nova-compute[103546]:   <features>
Nov 16 03:46:46 user nova-compute[103546]:     <acpi/>
Nov 16 03:46:46 user nova-compute[103546]:     <apic/>
Nov 16 03:46:46 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 03:46:46 user nova-compute[103546]:   </features>
Nov 16 03:46:46 user nova-compute[103546]:   <clock offset="utc">
Nov 16 03:46:46 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 03:46:46 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 03:46:46 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 03:46:46 user nova-compute[103546]:   </clock>
Nov 16 03:46:46 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 03:46:46 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 03:46:46 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 03:46:46 user nova-compute[103546]:   </cpu>
Nov 16 03:46:46 user nova-compute[103546]:   <devices>
Nov 16 03:46:46 user nova-compute[103546]:     <disk type="file" device="disk">
Nov 16 03:46:46 user nova-compute[103546]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 03:46:46 user nova-compute[103546]:       <source file="/opt/stack/data/nova/instances/fead4119-3ab9-4337-8b48-d3920e1112f4/disk"/>
Nov 16 03:46:46 user nova-compute[103546]:       <target dev="sda" bus="scsi"/>
Nov 16 03:46:46 user nova-compute[103546]:       <address type="drive" controller="0" unit="0"/>
Nov 16 03:46:46 user nova-compute[103546]:     </disk>
Nov 16 03:46:46 user nova-compute[103546]:     <disk type="file" device="cdrom">
Nov 16 03:46:46 user nova-compute[103546]:       <driver name="qemu" type="raw" cache="none"/>
Nov 16 03:46:46 user nova-compute[103546]:       <source file="/opt/stack/data/nova/instances/fead4119-3ab9-4337-8b48-d3920e1112f4/disk.config"/>
Nov 16 03:46:46 user nova-compute[103546]:       <target dev="sdb" bus="scsi"/>
Nov 16 03:46:46 user nova-compute[103546]:       <address type="drive" controller="0" unit="1"/>
Nov 16 03:46:46 user nova-compute[103546]:     </disk>
Nov 16 03:46:46 user nova-compute[103546]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 16 03:46:46 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 03:46:46 user nova-compute[103546]:       <mac address="fa:16:3e:63:86:8e"/>
Nov 16 03:46:46 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:46:46 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 03:46:46 user nova-compute[103546]:       <target dev="tap55287b83-91"/>
Nov 16 03:46:46 user nova-compute[103546]:     </interface>
Nov 16 03:46:46 user nova-compute[103546]:     <serial type="pty">
Nov 16 03:46:46 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/fead4119-3ab9-4337-8b48-d3920e1112f4/console.log" append="off"/>
Nov 16 03:46:46 user nova-compute[103546]:     </serial>
Nov 16 03:46:46 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 03:46:46 user nova-compute[103546]:     <video>
Nov 16 03:46:46 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:46:46 user nova-compute[103546]:     </video>
Nov 16 03:46:46 user nova-compute[103546]:     <rng model="virtio">
Nov 16 03:46:46 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 03:46:46 user nova-compute[103546]:     </rng>
Nov 16 03:46:46 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 03:46:46 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 03:46:46 user nova-compute[103546]:       <stats period="10"/>
Nov 16 03:46:46 user nova-compute[103546]:     </memballoon>
Nov 16 03:46:46 user nova-compute[103546]:   </devices>
Nov 16 03:46:46 user nova-compute[103546]: </domain>
Nov 16 03:46:46 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 03:46:46 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T03:46:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1723757256',display_name='tempest-AttachSCSIVolumeTestJSON-server-1723757256',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1723757256',id=6,image_ref='27514916-7235-4bca-ac74-8ed152e6d26c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEEHJrW51ra9jhpP37BWSRWPxPBqEbActvGJHuyJxwUi0tyqpW1Ys4/ut4CnE1EONIQvacihgxdwyWyTgNAMgQOB8Ipa5dWH3rU6BvGXNZ/x+YJAvxnVRrkwO7jJa0K3kQ==',key_name='tempest-keypair-1828100082',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='459bf831cfa74f74abcb5625afbafa27',ramdisk_id='',reservation_id='r-uw666qus',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='27514916-7235-4bca-ac74-8ed152e6d26c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1568574038',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1568574038-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:46:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1715413924824093b543a2fd440edaaa',uuid=fead4119-3ab9-4337-8b48-d3920e1112f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55287b83-91c5-4c47-8ec5-c0da5bc3290e", "address": "fa:16:3e:63:86:8e", "network": {"id": "d67be416-4ca1-4f91-9991-95aee2e04c4a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1248186454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "459bf831cfa74f74abcb5625afbafa27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55287b83-91", "ovs_interfaceid": "55287b83-91c5-4c47-8ec5-c0da5bc3290e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 03:46:46 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Converting VIF {"id": "55287b83-91c5-4c47-8ec5-c0da5bc3290e", "address": "fa:16:3e:63:86:8e", "network": {"id": "d67be416-4ca1-4f91-9991-95aee2e04c4a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1248186454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "459bf831cfa74f74abcb5625afbafa27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55287b83-91", "ovs_interfaceid": "55287b83-91c5-4c47-8ec5-c0da5bc3290e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:46:46 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:86:8e,bridge_name='br-int',has_traffic_filtering=True,id=55287b83-91c5-4c47-8ec5-c0da5bc3290e,network=Network(d67be416-4ca1-4f91-9991-95aee2e04c4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55287b83-91') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:46:46 user nova-compute[103546]: DEBUG os_vif [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:86:8e,bridge_name='br-int',has_traffic_filtering=True,id=55287b83-91c5-4c47-8ec5-c0da5bc3290e,network=Network(d67be416-4ca1-4f91-9991-95aee2e04c4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55287b83-91') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 03:46:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:46:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 03:46:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '953dd4bc-fe6d-5feb-9918-8376aeaf7aa8', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:46:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:46:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap55287b83-91, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:46:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap55287b83-91, col_values=(('qos', UUID('a47b11f7-9ed7-49d4-aa0d-8cf7c9872ec9')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:46:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap55287b83-91, col_values=(('external_ids', {'iface-id': '55287b83-91c5-4c47-8ec5-c0da5bc3290e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:86:8e', 'vm-uuid': 'fead4119-3ab9-4337-8b48-d3920e1112f4'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:46:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:46:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:46 user nova-compute[103546]: INFO os_vif [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:86:8e,bridge_name='br-int',has_traffic_filtering=True,id=55287b83-91c5-4c47-8ec5-c0da5bc3290e,network=Network(d67be416-4ca1-4f91-9991-95aee2e04c4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55287b83-91')
Nov 16 03:46:46 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:46:46 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:46:46 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] No BDM found with device name sda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:46:46 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] No BDM found with device name sdb, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:46:46 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] No VIF found with MAC fa:16:3e:63:86:8e, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 03:46:46 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Using config drive
Nov 16 03:46:46 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.652s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:46:46 user nova-compute[103546]: DEBUG nova.compute.manager [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Start building networks asynchronously for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 03:46:46 user nova-compute[103546]: DEBUG nova.compute.manager [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Allocating IP information in the background. {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 03:46:46 user nova-compute[103546]: DEBUG nova.network.neutron [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] allocate_for_instance() {{(pid=103546) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 03:46:46 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 03:46:46 user nova-compute[103546]: DEBUG nova.compute.manager [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Start building block device mappings for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 03:46:46 user nova-compute[103546]: DEBUG nova.compute.manager [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Start spawning the instance on the hypervisor. {{(pid=103546) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 03:46:46 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Creating instance directory {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 03:46:46 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Creating image(s)
Nov 16 03:46:46 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Acquiring lock "/opt/stack/data/nova/instances/549ee3db-0014-440f-bd3a-0d389f5eab88/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:46:46 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Lock "/opt/stack/data/nova/instances/549ee3db-0014-440f-bd3a-0d389f5eab88/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:46:46 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Lock "/opt/stack/data/nova/instances/549ee3db-0014-440f-bd3a-0d389f5eab88/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:46:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:46:46 user nova-compute[103546]: DEBUG nova.policy [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '843e14f393d849a9abc7759907a303ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4445eb24618042ab9d24c869de5ccaab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103546) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 03:46:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:47 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.267s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:46:47 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Acquiring lock "8c9efafb670bfe5842ba1f4ce398924612164af7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:46:47 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:46:47 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:46:47 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Creating config drive at /opt/stack/data/nova/instances/fead4119-3ab9-4337-8b48-d3920e1112f4/disk.config
Nov 16 03:46:47 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/fead4119-3ab9-4337-8b48-d3920e1112f4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp_d0fibzr {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:46:47 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/fead4119-3ab9-4337-8b48-d3920e1112f4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp_d0fibzr" returned: 0 in 0.079s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:46:47 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.287s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:46:47 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/549ee3db-0014-440f-bd3a-0d389f5eab88/disk 1073741824 {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:46:47 user nova-compute[103546]: DEBUG nova.network.neutron [req-50186444-d806-4f73-aa41-11b2e142b1c1 req-b3c62758-2180-4a74-ac9a-0aa5cdc10705 service nova] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Updated VIF entry in instance network info cache for port 55287b83-91c5-4c47-8ec5-c0da5bc3290e. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 03:46:47 user nova-compute[103546]: DEBUG nova.network.neutron [req-50186444-d806-4f73-aa41-11b2e142b1c1 req-b3c62758-2180-4a74-ac9a-0aa5cdc10705 service nova] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Updating instance_info_cache with network_info: [{"id": "55287b83-91c5-4c47-8ec5-c0da5bc3290e", "address": "fa:16:3e:63:86:8e", "network": {"id": "d67be416-4ca1-4f91-9991-95aee2e04c4a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1248186454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "459bf831cfa74f74abcb5625afbafa27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55287b83-91", "ovs_interfaceid": "55287b83-91c5-4c47-8ec5-c0da5bc3290e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:46:47 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/549ee3db-0014-440f-bd3a-0d389f5eab88/disk 1073741824" returned: 0 in 0.071s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:46:47 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.367s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:46:47 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:46:47 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-50186444-d806-4f73-aa41-11b2e142b1c1 req-b3c62758-2180-4a74-ac9a-0aa5cdc10705 service nova] Releasing lock "refresh_cache-fead4119-3ab9-4337-8b48-d3920e1112f4" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:46:47 user nova-compute[103546]: DEBUG nova.compute.manager [req-9a717693-55f4-4a4d-9db3-0ec37ee59801 req-2b8e4479-9b80-4532-9475-1921738be4ba service nova] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Received event network-vif-plugged-26fd759d-5cb8-4798-ab59-c7f5cb7773e8 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:46:47 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-9a717693-55f4-4a4d-9db3-0ec37ee59801 req-2b8e4479-9b80-4532-9475-1921738be4ba service nova] Acquiring lock "7862d05d-4293-46a5-98aa-41967a572fe3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:46:47 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-9a717693-55f4-4a4d-9db3-0ec37ee59801 req-2b8e4479-9b80-4532-9475-1921738be4ba service nova] Lock "7862d05d-4293-46a5-98aa-41967a572fe3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:46:47 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-9a717693-55f4-4a4d-9db3-0ec37ee59801 req-2b8e4479-9b80-4532-9475-1921738be4ba service nova] Lock "7862d05d-4293-46a5-98aa-41967a572fe3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:46:47 user nova-compute[103546]: DEBUG nova.compute.manager [req-9a717693-55f4-4a4d-9db3-0ec37ee59801 req-2b8e4479-9b80-4532-9475-1921738be4ba service nova] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] No waiting events found dispatching network-vif-plugged-26fd759d-5cb8-4798-ab59-c7f5cb7773e8 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:46:47 user nova-compute[103546]: WARNING nova.compute.manager [req-9a717693-55f4-4a4d-9db3-0ec37ee59801 req-2b8e4479-9b80-4532-9475-1921738be4ba service nova] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Received unexpected event network-vif-plugged-26fd759d-5cb8-4798-ab59-c7f5cb7773e8 for instance with vm_state active and task_state None.
Nov 16 03:46:47 user nova-compute[103546]: DEBUG nova.compute.manager [req-9a717693-55f4-4a4d-9db3-0ec37ee59801 req-2b8e4479-9b80-4532-9475-1921738be4ba service nova] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Received event network-vif-plugged-26fd759d-5cb8-4798-ab59-c7f5cb7773e8 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:46:47 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-9a717693-55f4-4a4d-9db3-0ec37ee59801 req-2b8e4479-9b80-4532-9475-1921738be4ba service nova] Acquiring lock "7862d05d-4293-46a5-98aa-41967a572fe3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:46:47 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-9a717693-55f4-4a4d-9db3-0ec37ee59801 req-2b8e4479-9b80-4532-9475-1921738be4ba service nova] Lock "7862d05d-4293-46a5-98aa-41967a572fe3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:46:47 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-9a717693-55f4-4a4d-9db3-0ec37ee59801 req-2b8e4479-9b80-4532-9475-1921738be4ba service nova] Lock "7862d05d-4293-46a5-98aa-41967a572fe3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:46:47 user nova-compute[103546]: DEBUG nova.compute.manager [req-9a717693-55f4-4a4d-9db3-0ec37ee59801 req-2b8e4479-9b80-4532-9475-1921738be4ba service nova] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] No waiting events found dispatching network-vif-plugged-26fd759d-5cb8-4798-ab59-c7f5cb7773e8 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:46:47 user nova-compute[103546]: WARNING nova.compute.manager [req-9a717693-55f4-4a4d-9db3-0ec37ee59801 req-2b8e4479-9b80-4532-9475-1921738be4ba service nova] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Received unexpected event network-vif-plugged-26fd759d-5cb8-4798-ab59-c7f5cb7773e8 for instance with vm_state active and task_state None.
Nov 16 03:46:47 user nova-compute[103546]: DEBUG nova.compute.manager [req-9a717693-55f4-4a4d-9db3-0ec37ee59801 req-2b8e4479-9b80-4532-9475-1921738be4ba service nova] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Received event network-vif-plugged-38395643-bb34-441c-ab0e-c9201f35ec04 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:46:47 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-9a717693-55f4-4a4d-9db3-0ec37ee59801 req-2b8e4479-9b80-4532-9475-1921738be4ba service nova] Acquiring lock "c24a386f-32f5-4095-b2b3-69a70a54ff66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:46:47 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-9a717693-55f4-4a4d-9db3-0ec37ee59801 req-2b8e4479-9b80-4532-9475-1921738be4ba service nova] Lock "c24a386f-32f5-4095-b2b3-69a70a54ff66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:46:47 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-9a717693-55f4-4a4d-9db3-0ec37ee59801 req-2b8e4479-9b80-4532-9475-1921738be4ba service nova] Lock "c24a386f-32f5-4095-b2b3-69a70a54ff66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:46:47 user nova-compute[103546]: DEBUG nova.compute.manager [req-9a717693-55f4-4a4d-9db3-0ec37ee59801 req-2b8e4479-9b80-4532-9475-1921738be4ba service nova] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] No waiting events found dispatching network-vif-plugged-38395643-bb34-441c-ab0e-c9201f35ec04 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:46:47 user nova-compute[103546]: WARNING nova.compute.manager [req-9a717693-55f4-4a4d-9db3-0ec37ee59801 req-2b8e4479-9b80-4532-9475-1921738be4ba service nova] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Received unexpected event network-vif-plugged-38395643-bb34-441c-ab0e-c9201f35ec04 for instance with vm_state building and task_state spawning.
Nov 16 03:46:47 user nova-compute[103546]: DEBUG nova.compute.manager [req-9a717693-55f4-4a4d-9db3-0ec37ee59801 req-2b8e4479-9b80-4532-9475-1921738be4ba service nova] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Received event network-vif-plugged-38395643-bb34-441c-ab0e-c9201f35ec04 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:46:47 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-9a717693-55f4-4a4d-9db3-0ec37ee59801 req-2b8e4479-9b80-4532-9475-1921738be4ba service nova] Acquiring lock "c24a386f-32f5-4095-b2b3-69a70a54ff66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:46:47 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-9a717693-55f4-4a4d-9db3-0ec37ee59801 req-2b8e4479-9b80-4532-9475-1921738be4ba service nova] Lock "c24a386f-32f5-4095-b2b3-69a70a54ff66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:46:47 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-9a717693-55f4-4a4d-9db3-0ec37ee59801 req-2b8e4479-9b80-4532-9475-1921738be4ba service nova] Lock "c24a386f-32f5-4095-b2b3-69a70a54ff66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:46:47 user nova-compute[103546]: DEBUG nova.compute.manager [req-9a717693-55f4-4a4d-9db3-0ec37ee59801 req-2b8e4479-9b80-4532-9475-1921738be4ba service nova] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] No waiting events found dispatching network-vif-plugged-38395643-bb34-441c-ab0e-c9201f35ec04 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:46:47 user nova-compute[103546]: WARNING nova.compute.manager [req-9a717693-55f4-4a4d-9db3-0ec37ee59801 req-2b8e4479-9b80-4532-9475-1921738be4ba service nova] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Received unexpected event network-vif-plugged-38395643-bb34-441c-ab0e-c9201f35ec04 for instance with vm_state building and task_state spawning.
Nov 16 03:46:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:47 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.239s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:46:47 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Checking if we can resize image /opt/stack/data/nova/instances/549ee3db-0014-440f-bd3a-0d389f5eab88/disk. size=1073741824 {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 03:46:47 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/549ee3db-0014-440f-bd3a-0d389f5eab88/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:46:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:47 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/549ee3db-0014-440f-bd3a-0d389f5eab88/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:46:47 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Cannot resize image /opt/stack/data/nova/instances/549ee3db-0014-440f-bd3a-0d389f5eab88/disk to a smaller size. {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 03:46:47 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Created local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 03:46:47 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Ensure instance console log exists: /opt/stack/data/nova/instances/549ee3db-0014-440f-bd3a-0d389f5eab88/console.log {{(pid=103546) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 03:46:47 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:46:47 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:46:47 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:46:48 user nova-compute[103546]: DEBUG nova.network.neutron [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Successfully created port: 48a6af37-c461-4721-b870-432cf404dcf7 {{(pid=103546) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 03:46:48 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:48 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:48 user nova-compute[103546]: DEBUG nova.network.neutron [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Successfully updated port: 48a6af37-c461-4721-b870-432cf404dcf7 {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 03:46:48 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Acquiring lock "refresh_cache-549ee3db-0014-440f-bd3a-0d389f5eab88" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:46:49 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Acquired lock "refresh_cache-549ee3db-0014-440f-bd3a-0d389f5eab88" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:46:49 user nova-compute[103546]: DEBUG nova.network.neutron [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 03:46:49 user nova-compute[103546]: DEBUG nova.network.neutron [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 03:46:49 user nova-compute[103546]: DEBUG nova.compute.manager [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 03:46:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Guest created on hypervisor {{(pid=103546) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 03:46:49 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Instance spawned successfully.
Nov 16 03:46:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 03:46:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Found default for hw_cdrom_bus of ide {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:46:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Found default for hw_disk_bus of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:46:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Found default for hw_input_bus of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:46:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Found default for hw_pointer_model of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:46:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Found default for hw_video_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:46:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Found default for hw_vif_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:46:49 user nova-compute[103546]: DEBUG nova.network.neutron [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Updating instance_info_cache with network_info: [{"id": "48a6af37-c461-4721-b870-432cf404dcf7", "address": "fa:16:3e:5b:50:00", "network": {"id": "4c04adce-4d50-4cc1-8c17-5cebba34fbec", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-399866268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4445eb24618042ab9d24c869de5ccaab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48a6af37-c4", "ovs_interfaceid": "48a6af37-c461-4721-b870-432cf404dcf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:46:49 user nova-compute[103546]: DEBUG nova.compute.manager [req-4f0987c0-f9c3-4800-ab00-6e4d2ba31afa req-514910d0-ddb0-4a97-9cb3-e7ce4edcaaf9 service nova] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Received event network-changed-48a6af37-c461-4721-b870-432cf404dcf7 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:46:49 user nova-compute[103546]: DEBUG nova.compute.manager [req-4f0987c0-f9c3-4800-ab00-6e4d2ba31afa req-514910d0-ddb0-4a97-9cb3-e7ce4edcaaf9 service nova] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Refreshing instance network info cache due to event network-changed-48a6af37-c461-4721-b870-432cf404dcf7. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:46:49 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-4f0987c0-f9c3-4800-ab00-6e4d2ba31afa req-514910d0-ddb0-4a97-9cb3-e7ce4edcaaf9 service nova] Acquiring lock "refresh_cache-549ee3db-0014-440f-bd3a-0d389f5eab88" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:46:49 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Releasing lock "refresh_cache-549ee3db-0014-440f-bd3a-0d389f5eab88" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:46:49 user nova-compute[103546]: DEBUG nova.compute.manager [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Instance network_info: |[{"id": "48a6af37-c461-4721-b870-432cf404dcf7", "address": "fa:16:3e:5b:50:00", "network": {"id": "4c04adce-4d50-4cc1-8c17-5cebba34fbec", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-399866268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4445eb24618042ab9d24c869de5ccaab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48a6af37-c4", "ovs_interfaceid": "48a6af37-c461-4721-b870-432cf404dcf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 03:46:49 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-4f0987c0-f9c3-4800-ab00-6e4d2ba31afa req-514910d0-ddb0-4a97-9cb3-e7ce4edcaaf9 service nova] Acquired lock "refresh_cache-549ee3db-0014-440f-bd3a-0d389f5eab88" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:46:49 user nova-compute[103546]: DEBUG nova.network.neutron [req-4f0987c0-f9c3-4800-ab00-6e4d2ba31afa req-514910d0-ddb0-4a97-9cb3-e7ce4edcaaf9 service nova] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Refreshing network info cache for port 48a6af37-c461-4721-b870-432cf404dcf7 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:46:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Start _get_guest_xml network_info=[{"id": "48a6af37-c461-4721-b870-432cf404dcf7", "address": "fa:16:3e:5b:50:00", "network": {"id": "4c04adce-4d50-4cc1-8c17-5cebba34fbec", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-399866268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4445eb24618042ab9d24c869de5ccaab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48a6af37-c4", "ovs_interfaceid": "48a6af37-c461-4721-b870-432cf404dcf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '5c6f539a-01e5-4478-bf8f-a14310b5d7dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 03:46:49 user nova-compute[103546]: INFO nova.compute.manager [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Took 11.43 seconds to spawn the instance on the hypervisor.
Nov 16 03:46:49 user nova-compute[103546]: DEBUG nova.compute.manager [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 03:46:49 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:46:49 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:46:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 03:46:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 03:46:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 03:46:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 03:46:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 03:46:49 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 03:46:49 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 03:46:49 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 03:46:49 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 03:46:49 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 03:46:49 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 03:46:49 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 03:46:49 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 03:46:49 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 03:46:49 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 03:46:49 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 03:46:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T03:46:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-350344638',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-350344638',id=7,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJC87S7hgP6v1mMgMgWP5mrEmsB7FxLODxvVGTyu4rK6Vav//N6bGlF4cB4wdjC5yBjD4JDskSZdj5aiBMflE+VUYysZErN4auZ89tuKfEpG07XZH2cPGYOTHxF0eBL3Dw==',key_name='tempest-keypair-83664986',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4445eb24618042ab9d24c869de5ccaab',ramdisk_id='',reservation_id='r-s6hqst93',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-401054631',owner_user_name='tempest-TaggedAttachmentsTest-401054631-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:46:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='843e14f393d849a9abc7759907a303ea',uuid=549ee3db-0014-440f-bd3a-0d389f5eab88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48a6af37-c461-4721-b870-432cf404dcf7", "address": "fa:16:3e:5b:50:00", "network": {"id": "4c04adce-4d50-4cc1-8c17-5cebba34fbec", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-399866268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4445eb24618042ab9d24c869de5ccaab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48a6af37-c4", "ovs_interfaceid": "48a6af37-c461-4721-b870-432cf404dcf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 03:46:49 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Converting VIF {"id": "48a6af37-c461-4721-b870-432cf404dcf7", "address": "fa:16:3e:5b:50:00", "network": {"id": "4c04adce-4d50-4cc1-8c17-5cebba34fbec", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-399866268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4445eb24618042ab9d24c869de5ccaab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48a6af37-c4", "ovs_interfaceid": "48a6af37-c461-4721-b870-432cf404dcf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:46:49 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:50:00,bridge_name='br-int',has_traffic_filtering=True,id=48a6af37-c461-4721-b870-432cf404dcf7,network=Network(4c04adce-4d50-4cc1-8c17-5cebba34fbec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48a6af37-c4') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:46:49 user nova-compute[103546]: DEBUG nova.objects.instance [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Lazy-loading 'pci_devices' on Instance uuid 549ee3db-0014-440f-bd3a-0d389f5eab88 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:46:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:49 user nova-compute[103546]: INFO nova.compute.manager [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Took 12.48 seconds to build instance.
Nov 16 03:46:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] End _get_guest_xml xml=<domain type="kvm">
Nov 16 03:46:49 user nova-compute[103546]:   <uuid>549ee3db-0014-440f-bd3a-0d389f5eab88</uuid>
Nov 16 03:46:49 user nova-compute[103546]:   <name>instance-00000007</name>
Nov 16 03:46:49 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 03:46:49 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 03:46:49 user nova-compute[103546]:   <metadata>
Nov 16 03:46:49 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 03:46:49 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 03:46:49 user nova-compute[103546]:       <nova:name>tempest-device-tagging-server-350344638</nova:name>
Nov 16 03:46:49 user nova-compute[103546]:       <nova:creationTime>2023-11-16 03:46:49</nova:creationTime>
Nov 16 03:46:49 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 03:46:49 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 03:46:49 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 03:46:49 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 03:46:49 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 03:46:49 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 03:46:49 user nova-compute[103546]:       </nova:flavor>
Nov 16 03:46:49 user nova-compute[103546]:       <nova:owner>
Nov 16 03:46:49 user nova-compute[103546]:         <nova:user uuid="843e14f393d849a9abc7759907a303ea">tempest-TaggedAttachmentsTest-401054631-project-member</nova:user>
Nov 16 03:46:49 user nova-compute[103546]:         <nova:project uuid="4445eb24618042ab9d24c869de5ccaab">tempest-TaggedAttachmentsTest-401054631</nova:project>
Nov 16 03:46:49 user nova-compute[103546]:       </nova:owner>
Nov 16 03:46:49 user nova-compute[103546]:       <nova:root type="image" uuid="5c6f539a-01e5-4478-bf8f-a14310b5d7dd"/>
Nov 16 03:46:49 user nova-compute[103546]:       <nova:ports>
Nov 16 03:46:49 user nova-compute[103546]:         <nova:port uuid="48a6af37-c461-4721-b870-432cf404dcf7">
Nov 16 03:46:49 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 16 03:46:49 user nova-compute[103546]:         </nova:port>
Nov 16 03:46:49 user nova-compute[103546]:       </nova:ports>
Nov 16 03:46:49 user nova-compute[103546]:     </nova:instance>
Nov 16 03:46:49 user nova-compute[103546]:   </metadata>
Nov 16 03:46:49 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 03:46:49 user nova-compute[103546]:     <system>
Nov 16 03:46:49 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 03:46:49 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 03:46:49 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 03:46:49 user nova-compute[103546]:       <entry name="serial">549ee3db-0014-440f-bd3a-0d389f5eab88</entry>
Nov 16 03:46:49 user nova-compute[103546]:       <entry name="uuid">549ee3db-0014-440f-bd3a-0d389f5eab88</entry>
Nov 16 03:46:49 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 03:46:49 user nova-compute[103546]:     </system>
Nov 16 03:46:49 user nova-compute[103546]:   </sysinfo>
Nov 16 03:46:49 user nova-compute[103546]:   <os>
Nov 16 03:46:49 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 03:46:49 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 03:46:49 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 03:46:49 user nova-compute[103546]:   </os>
Nov 16 03:46:49 user nova-compute[103546]:   <features>
Nov 16 03:46:49 user nova-compute[103546]:     <acpi/>
Nov 16 03:46:49 user nova-compute[103546]:     <apic/>
Nov 16 03:46:49 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 03:46:49 user nova-compute[103546]:   </features>
Nov 16 03:46:49 user nova-compute[103546]:   <clock offset="utc">
Nov 16 03:46:49 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 03:46:49 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 03:46:49 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 03:46:49 user nova-compute[103546]:   </clock>
Nov 16 03:46:49 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 03:46:49 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 03:46:49 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 03:46:49 user nova-compute[103546]:   </cpu>
Nov 16 03:46:49 user nova-compute[103546]:   <devices>
Nov 16 03:46:49 user nova-compute[103546]:     <disk type="file" device="disk">
Nov 16 03:46:49 user nova-compute[103546]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 03:46:49 user nova-compute[103546]:       <source file="/opt/stack/data/nova/instances/549ee3db-0014-440f-bd3a-0d389f5eab88/disk"/>
Nov 16 03:46:49 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 03:46:49 user nova-compute[103546]:     </disk>
Nov 16 03:46:49 user nova-compute[103546]:     <disk type="file" device="cdrom">
Nov 16 03:46:49 user nova-compute[103546]:       <driver name="qemu" type="raw" cache="none"/>
Nov 16 03:46:49 user nova-compute[103546]:       <source file="/opt/stack/data/nova/instances/549ee3db-0014-440f-bd3a-0d389f5eab88/disk.config"/>
Nov 16 03:46:49 user nova-compute[103546]:       <target dev="hda" bus="ide"/>
Nov 16 03:46:49 user nova-compute[103546]:     </disk>
Nov 16 03:46:49 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 03:46:49 user nova-compute[103546]:       <mac address="fa:16:3e:5b:50:00"/>
Nov 16 03:46:49 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:46:49 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 03:46:49 user nova-compute[103546]:       <target dev="tap48a6af37-c4"/>
Nov 16 03:46:49 user nova-compute[103546]:     </interface>
Nov 16 03:46:49 user nova-compute[103546]:     <serial type="pty">
Nov 16 03:46:49 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/549ee3db-0014-440f-bd3a-0d389f5eab88/console.log" append="off"/>
Nov 16 03:46:49 user nova-compute[103546]:     </serial>
Nov 16 03:46:49 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 03:46:49 user nova-compute[103546]:     <video>
Nov 16 03:46:49 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:46:49 user nova-compute[103546]:     </video>
Nov 16 03:46:49 user nova-compute[103546]:     <rng model="virtio">
Nov 16 03:46:49 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 03:46:49 user nova-compute[103546]:     </rng>
Nov 16 03:46:49 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 03:46:49 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 03:46:49 user nova-compute[103546]:       <stats period="10"/>
Nov 16 03:46:49 user nova-compute[103546]:     </memballoon>
Nov 16 03:46:49 user nova-compute[103546]:   </devices>
Nov 16 03:46:49 user nova-compute[103546]: </domain>
Nov 16 03:46:49 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 03:46:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T03:46:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-350344638',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-350344638',id=7,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJC87S7hgP6v1mMgMgWP5mrEmsB7FxLODxvVGTyu4rK6Vav//N6bGlF4cB4wdjC5yBjD4JDskSZdj5aiBMflE+VUYysZErN4auZ89tuKfEpG07XZH2cPGYOTHxF0eBL3Dw==',key_name='tempest-keypair-83664986',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4445eb24618042ab9d24c869de5ccaab',ramdisk_id='',reservation_id='r-s6hqst93',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-401054631',owner_user_name='tempest-TaggedAttachmentsTest-401054631-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:46:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='843e14f393d849a9abc7759907a303ea',uuid=549ee3db-0014-440f-bd3a-0d389f5eab88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48a6af37-c461-4721-b870-432cf404dcf7", "address": "fa:16:3e:5b:50:00", "network": {"id": "4c04adce-4d50-4cc1-8c17-5cebba34fbec", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-399866268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4445eb24618042ab9d24c869de5ccaab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48a6af37-c4", "ovs_interfaceid": "48a6af37-c461-4721-b870-432cf404dcf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 03:46:49 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Converting VIF {"id": "48a6af37-c461-4721-b870-432cf404dcf7", "address": "fa:16:3e:5b:50:00", "network": {"id": "4c04adce-4d50-4cc1-8c17-5cebba34fbec", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-399866268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4445eb24618042ab9d24c869de5ccaab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48a6af37-c4", "ovs_interfaceid": "48a6af37-c461-4721-b870-432cf404dcf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:46:49 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:50:00,bridge_name='br-int',has_traffic_filtering=True,id=48a6af37-c461-4721-b870-432cf404dcf7,network=Network(4c04adce-4d50-4cc1-8c17-5cebba34fbec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48a6af37-c4') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:46:49 user nova-compute[103546]: DEBUG os_vif [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:50:00,bridge_name='br-int',has_traffic_filtering=True,id=48a6af37-c461-4721-b870-432cf404dcf7,network=Network(4c04adce-4d50-4cc1-8c17-5cebba34fbec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48a6af37-c4') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 03:46:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:46:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 03:46:49 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-74650c66-45ec-46d1-a9fa-62a24c105463 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Lock "c24a386f-32f5-4095-b2b3-69a70a54ff66" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.732s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:46:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a6f6bc4f-29af-5ad3-86c8-2d6f5370d485', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:46:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:46:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap48a6af37-c4, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:46:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap48a6af37-c4, col_values=(('qos', UUID('dc5fcd5f-5d3d-42f2-bfe9-d3b8f33e9dbe')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:46:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap48a6af37-c4, col_values=(('external_ids', {'iface-id': '48a6af37-c461-4721-b870-432cf404dcf7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:50:00', 'vm-uuid': '549ee3db-0014-440f-bd3a-0d389f5eab88'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:46:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:46:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:49 user nova-compute[103546]: INFO os_vif [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:50:00,bridge_name='br-int',has_traffic_filtering=True,id=48a6af37-c461-4721-b870-432cf404dcf7,network=Network(4c04adce-4d50-4cc1-8c17-5cebba34fbec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48a6af37-c4')
Nov 16 03:46:50 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:46:50 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] No BDM found with device name hda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:46:50 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] No VIF found with MAC fa:16:3e:5b:50:00, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 03:46:50 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Using config drive
Nov 16 03:46:50 user nova-compute[103546]: DEBUG nova.compute.manager [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 03:46:50 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Guest created on hypervisor {{(pid=103546) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 03:46:50 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Instance spawned successfully.
Nov 16 03:46:50 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 03:46:50 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Found default for hw_cdrom_bus of ide {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:46:50 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Found default for hw_disk_bus of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:46:50 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Found default for hw_input_bus of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:46:50 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Found default for hw_pointer_model of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:46:50 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Found default for hw_video_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:46:50 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Found default for hw_vif_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:46:50 user nova-compute[103546]: INFO nova.compute.manager [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Took 10.73 seconds to spawn the instance on the hypervisor.
Nov 16 03:46:50 user nova-compute[103546]: DEBUG nova.compute.manager [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 03:46:50 user nova-compute[103546]: INFO nova.compute.manager [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Took 12.37 seconds to build instance.
Nov 16 03:46:50 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Creating config drive at /opt/stack/data/nova/instances/549ee3db-0014-440f-bd3a-0d389f5eab88/disk.config
Nov 16 03:46:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/549ee3db-0014-440f-bd3a-0d389f5eab88/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpa63_w5qu {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:46:50 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-311fc01c-c0c6-45d3-9579-a6753ad90f91 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Lock "05c929d5-2f1c-4be4-8864-6ec81625daac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.777s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:46:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/549ee3db-0014-440f-bd3a-0d389f5eab88/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpa63_w5qu" returned: 0 in 0.071s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:46:51 user nova-compute[103546]: DEBUG nova.network.neutron [req-4f0987c0-f9c3-4800-ab00-6e4d2ba31afa req-514910d0-ddb0-4a97-9cb3-e7ce4edcaaf9 service nova] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Updated VIF entry in instance network info cache for port 48a6af37-c461-4721-b870-432cf404dcf7. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 03:46:51 user nova-compute[103546]: DEBUG nova.network.neutron [req-4f0987c0-f9c3-4800-ab00-6e4d2ba31afa req-514910d0-ddb0-4a97-9cb3-e7ce4edcaaf9 service nova] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Updating instance_info_cache with network_info: [{"id": "48a6af37-c461-4721-b870-432cf404dcf7", "address": "fa:16:3e:5b:50:00", "network": {"id": "4c04adce-4d50-4cc1-8c17-5cebba34fbec", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-399866268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4445eb24618042ab9d24c869de5ccaab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48a6af37-c4", "ovs_interfaceid": "48a6af37-c461-4721-b870-432cf404dcf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:46:51 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-4f0987c0-f9c3-4800-ab00-6e4d2ba31afa req-514910d0-ddb0-4a97-9cb3-e7ce4edcaaf9 service nova] Releasing lock "refresh_cache-549ee3db-0014-440f-bd3a-0d389f5eab88" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:46:51 user nova-compute[103546]: DEBUG nova.compute.manager [req-4f0987c0-f9c3-4800-ab00-6e4d2ba31afa req-514910d0-ddb0-4a97-9cb3-e7ce4edcaaf9 service nova] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Received event network-vif-plugged-55287b83-91c5-4c47-8ec5-c0da5bc3290e {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:46:51 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-4f0987c0-f9c3-4800-ab00-6e4d2ba31afa req-514910d0-ddb0-4a97-9cb3-e7ce4edcaaf9 service nova] Acquiring lock "fead4119-3ab9-4337-8b48-d3920e1112f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:46:51 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-4f0987c0-f9c3-4800-ab00-6e4d2ba31afa req-514910d0-ddb0-4a97-9cb3-e7ce4edcaaf9 service nova] Lock "fead4119-3ab9-4337-8b48-d3920e1112f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:46:51 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-4f0987c0-f9c3-4800-ab00-6e4d2ba31afa req-514910d0-ddb0-4a97-9cb3-e7ce4edcaaf9 service nova] Lock "fead4119-3ab9-4337-8b48-d3920e1112f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:46:51 user nova-compute[103546]: DEBUG nova.compute.manager [req-4f0987c0-f9c3-4800-ab00-6e4d2ba31afa req-514910d0-ddb0-4a97-9cb3-e7ce4edcaaf9 service nova] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] No waiting events found dispatching network-vif-plugged-55287b83-91c5-4c47-8ec5-c0da5bc3290e {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:46:51 user nova-compute[103546]: WARNING nova.compute.manager [req-4f0987c0-f9c3-4800-ab00-6e4d2ba31afa req-514910d0-ddb0-4a97-9cb3-e7ce4edcaaf9 service nova] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Received unexpected event network-vif-plugged-55287b83-91c5-4c47-8ec5-c0da5bc3290e for instance with vm_state building and task_state spawning.
Nov 16 03:46:52 user nova-compute[103546]: DEBUG nova.compute.manager [req-91ee5cdf-3373-4f5c-a122-b4e32b839070 req-37a5daa6-261f-4512-9305-83d19264b91f service nova] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Received event network-vif-plugged-55287b83-91c5-4c47-8ec5-c0da5bc3290e {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:46:52 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-91ee5cdf-3373-4f5c-a122-b4e32b839070 req-37a5daa6-261f-4512-9305-83d19264b91f service nova] Acquiring lock "fead4119-3ab9-4337-8b48-d3920e1112f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:46:52 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-91ee5cdf-3373-4f5c-a122-b4e32b839070 req-37a5daa6-261f-4512-9305-83d19264b91f service nova] Lock "fead4119-3ab9-4337-8b48-d3920e1112f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:46:52 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-91ee5cdf-3373-4f5c-a122-b4e32b839070 req-37a5daa6-261f-4512-9305-83d19264b91f service nova] Lock "fead4119-3ab9-4337-8b48-d3920e1112f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:46:52 user nova-compute[103546]: DEBUG nova.compute.manager [req-91ee5cdf-3373-4f5c-a122-b4e32b839070 req-37a5daa6-261f-4512-9305-83d19264b91f service nova] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] No waiting events found dispatching network-vif-plugged-55287b83-91c5-4c47-8ec5-c0da5bc3290e {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:46:52 user nova-compute[103546]: WARNING nova.compute.manager [req-91ee5cdf-3373-4f5c-a122-b4e32b839070 req-37a5daa6-261f-4512-9305-83d19264b91f service nova] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Received unexpected event network-vif-plugged-55287b83-91c5-4c47-8ec5-c0da5bc3290e for instance with vm_state building and task_state spawning.
Nov 16 03:46:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:52 user nova-compute[103546]: DEBUG nova.compute.manager [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 03:46:52 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Guest created on hypervisor {{(pid=103546) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 03:46:52 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Instance spawned successfully.
Nov 16 03:46:52 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 03:46:52 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Found default for hw_input_bus of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:46:52 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Found default for hw_pointer_model of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:46:52 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Found default for hw_video_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:46:52 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Found default for hw_vif_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:46:52 user nova-compute[103546]: DEBUG nova.compute.manager [req-6dfb5472-ba0a-4123-9e7c-bfab8a30d201 req-c6bd2eab-2fb1-4008-af8c-85380f517c41 service nova] [instance: 279e2954-d786-4544-903d-8edc63646e2d] Received event network-vif-plugged-e60cc693-67d4-45a3-a97e-40bb5f753c9d {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:46:52 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6dfb5472-ba0a-4123-9e7c-bfab8a30d201 req-c6bd2eab-2fb1-4008-af8c-85380f517c41 service nova] Acquiring lock "279e2954-d786-4544-903d-8edc63646e2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:46:52 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6dfb5472-ba0a-4123-9e7c-bfab8a30d201 req-c6bd2eab-2fb1-4008-af8c-85380f517c41 service nova] Lock "279e2954-d786-4544-903d-8edc63646e2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:46:52 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6dfb5472-ba0a-4123-9e7c-bfab8a30d201 req-c6bd2eab-2fb1-4008-af8c-85380f517c41 service nova] Lock "279e2954-d786-4544-903d-8edc63646e2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:46:52 user nova-compute[103546]: DEBUG nova.compute.manager [req-6dfb5472-ba0a-4123-9e7c-bfab8a30d201 req-c6bd2eab-2fb1-4008-af8c-85380f517c41 service nova] [instance: 279e2954-d786-4544-903d-8edc63646e2d] No waiting events found dispatching network-vif-plugged-e60cc693-67d4-45a3-a97e-40bb5f753c9d {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:46:52 user nova-compute[103546]: WARNING nova.compute.manager [req-6dfb5472-ba0a-4123-9e7c-bfab8a30d201 req-c6bd2eab-2fb1-4008-af8c-85380f517c41 service nova] [instance: 279e2954-d786-4544-903d-8edc63646e2d] Received unexpected event network-vif-plugged-e60cc693-67d4-45a3-a97e-40bb5f753c9d for instance with vm_state active and task_state None.
Nov 16 03:46:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:52 user nova-compute[103546]: INFO nova.compute.manager [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Took 10.83 seconds to spawn the instance on the hypervisor.
Nov 16 03:46:52 user nova-compute[103546]: DEBUG nova.compute.manager [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 03:46:52 user nova-compute[103546]: INFO nova.compute.manager [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Took 12.03 seconds to build instance.
Nov 16 03:46:52 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-62ae71de-f4ef-4c23-a186-454ee1ff901e tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Lock "fead4119-3ab9-4337-8b48-d3920e1112f4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.261s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:46:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:54 user nova-compute[103546]: DEBUG nova.compute.manager [req-dc4bfed9-d8fa-4863-abea-34e9a05cddad req-a4a08865-8237-411e-9d14-db2077d8739b service nova] [instance: 279e2954-d786-4544-903d-8edc63646e2d] Received event network-vif-plugged-e60cc693-67d4-45a3-a97e-40bb5f753c9d {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:46:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-dc4bfed9-d8fa-4863-abea-34e9a05cddad req-a4a08865-8237-411e-9d14-db2077d8739b service nova] Acquiring lock "279e2954-d786-4544-903d-8edc63646e2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:46:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-dc4bfed9-d8fa-4863-abea-34e9a05cddad req-a4a08865-8237-411e-9d14-db2077d8739b service nova] Lock "279e2954-d786-4544-903d-8edc63646e2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:46:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-dc4bfed9-d8fa-4863-abea-34e9a05cddad req-a4a08865-8237-411e-9d14-db2077d8739b service nova] Lock "279e2954-d786-4544-903d-8edc63646e2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:46:54 user nova-compute[103546]: DEBUG nova.compute.manager [req-dc4bfed9-d8fa-4863-abea-34e9a05cddad req-a4a08865-8237-411e-9d14-db2077d8739b service nova] [instance: 279e2954-d786-4544-903d-8edc63646e2d] No waiting events found dispatching network-vif-plugged-e60cc693-67d4-45a3-a97e-40bb5f753c9d {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:46:54 user nova-compute[103546]: WARNING nova.compute.manager [req-dc4bfed9-d8fa-4863-abea-34e9a05cddad req-a4a08865-8237-411e-9d14-db2077d8739b service nova] [instance: 279e2954-d786-4544-903d-8edc63646e2d] Received unexpected event network-vif-plugged-e60cc693-67d4-45a3-a97e-40bb5f753c9d for instance with vm_state active and task_state None.
Nov 16 03:46:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Acquiring lock "ad9b2edb-15d7-4937-9461-15ce61f508a7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:46:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Lock "ad9b2edb-15d7-4937-9461-15ce61f508a7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:46:54 user nova-compute[103546]: DEBUG nova.compute.manager [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Starting instance... {{(pid=103546) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 03:46:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:46:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:46:55 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=103546) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 03:46:55 user nova-compute[103546]: INFO nova.compute.claims [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Claim successful on node user
Nov 16 03:46:55 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:46:55 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:46:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.562s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:46:55 user nova-compute[103546]: DEBUG nova.compute.manager [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Start building networks asynchronously for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 03:46:55 user nova-compute[103546]: DEBUG nova.compute.manager [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Allocating IP information in the background. {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 03:46:55 user nova-compute[103546]: DEBUG nova.network.neutron [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] allocate_for_instance() {{(pid=103546) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 03:46:55 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 03:46:55 user nova-compute[103546]: DEBUG nova.compute.manager [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Start building block device mappings for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 03:46:55 user nova-compute[103546]: DEBUG nova.policy [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '74dc927510f14b7ab10314605e74af64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a4cdf0fe94227a70e9ecc30df0cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103546) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 03:46:55 user nova-compute[103546]: DEBUG nova.compute.manager [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 03:46:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Guest created on hypervisor {{(pid=103546) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 03:46:55 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Instance spawned successfully.
Nov 16 03:46:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 03:46:55 user nova-compute[103546]: DEBUG nova.compute.manager [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Start spawning the instance on the hypervisor. {{(pid=103546) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 03:46:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Creating instance directory {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 03:46:55 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Creating image(s)
Nov 16 03:46:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Acquiring lock "/opt/stack/data/nova/instances/ad9b2edb-15d7-4937-9461-15ce61f508a7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:46:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Lock "/opt/stack/data/nova/instances/ad9b2edb-15d7-4937-9461-15ce61f508a7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:46:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Lock "/opt/stack/data/nova/instances/ad9b2edb-15d7-4937-9461-15ce61f508a7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:46:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:46:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Found default for hw_cdrom_bus of ide {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:46:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Found default for hw_disk_bus of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:46:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Found default for hw_input_bus of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:46:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Found default for hw_pointer_model of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:46:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Found default for hw_video_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:46:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Found default for hw_vif_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:46:56 user nova-compute[103546]: INFO nova.compute.manager [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Took 9.30 seconds to spawn the instance on the hypervisor.
Nov 16 03:46:56 user nova-compute[103546]: DEBUG nova.compute.manager [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 03:46:56 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.215s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:46:56 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Acquiring lock "8c9efafb670bfe5842ba1f4ce398924612164af7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:46:56 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:46:56 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:46:56 user nova-compute[103546]: INFO nova.compute.manager [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Took 10.50 seconds to build instance.
Nov 16 03:46:56 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-3b3d017a-176b-4755-8ce7-e090d2d99cdd tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Lock "549ee3db-0014-440f-bd3a-0d389f5eab88" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.649s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:46:56 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.229s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:46:56 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/ad9b2edb-15d7-4937-9461-15ce61f508a7/disk 1073741824 {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:46:56 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/ad9b2edb-15d7-4937-9461-15ce61f508a7/disk 1073741824" returned: 0 in 0.079s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:46:56 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.318s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:46:56 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:46:56 user nova-compute[103546]: DEBUG nova.network.neutron [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Successfully created port: 0bf5e09d-1b54-48f7-bbbe-f133102ea245 {{(pid=103546) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 03:46:56 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.292s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:46:56 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ad9b2edb-15d7-4937-9461-15ce61f508a7/disk. size=1073741824 {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 03:46:56 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad9b2edb-15d7-4937-9461-15ce61f508a7/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:46:57 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad9b2edb-15d7-4937-9461-15ce61f508a7/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:46:57 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Cannot resize image /opt/stack/data/nova/instances/ad9b2edb-15d7-4937-9461-15ce61f508a7/disk to a smaller size. {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 03:46:57 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Created local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 03:46:57 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Ensure instance console log exists: /opt/stack/data/nova/instances/ad9b2edb-15d7-4937-9461-15ce61f508a7/console.log {{(pid=103546) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 03:46:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:46:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:46:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:46:57 user nova-compute[103546]: DEBUG nova.network.neutron [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Successfully updated port: 0bf5e09d-1b54-48f7-bbbe-f133102ea245 {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 03:46:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Acquiring lock "refresh_cache-ad9b2edb-15d7-4937-9461-15ce61f508a7" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:46:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Acquired lock "refresh_cache-ad9b2edb-15d7-4937-9461-15ce61f508a7" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:46:57 user nova-compute[103546]: DEBUG nova.network.neutron [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 03:46:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:57 user nova-compute[103546]: DEBUG nova.compute.manager [req-24fa8b49-1529-4747-8318-8355fd93976f req-3e89d12b-ca59-4589-8412-2c4ecc75d568 service nova] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Received event network-changed-0bf5e09d-1b54-48f7-bbbe-f133102ea245 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:46:57 user nova-compute[103546]: DEBUG nova.compute.manager [req-24fa8b49-1529-4747-8318-8355fd93976f req-3e89d12b-ca59-4589-8412-2c4ecc75d568 service nova] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Refreshing instance network info cache due to event network-changed-0bf5e09d-1b54-48f7-bbbe-f133102ea245. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:46:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-24fa8b49-1529-4747-8318-8355fd93976f req-3e89d12b-ca59-4589-8412-2c4ecc75d568 service nova] Acquiring lock "refresh_cache-ad9b2edb-15d7-4937-9461-15ce61f508a7" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:46:57 user nova-compute[103546]: DEBUG nova.network.neutron [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 03:46:57 user nova-compute[103546]: DEBUG nova.network.neutron [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Updating instance_info_cache with network_info: [{"id": "0bf5e09d-1b54-48f7-bbbe-f133102ea245", "address": "fa:16:3e:2f:63:83", "network": {"id": "704209e4-4dd9-4e90-bc67-9843ae1d3340", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1483691372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e2a4cdf0fe94227a70e9ecc30df0cf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bf5e09d-1b", "ovs_interfaceid": "0bf5e09d-1b54-48f7-bbbe-f133102ea245", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:46:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Releasing lock "refresh_cache-ad9b2edb-15d7-4937-9461-15ce61f508a7" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:46:57 user nova-compute[103546]: DEBUG nova.compute.manager [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Instance network_info: |[{"id": "0bf5e09d-1b54-48f7-bbbe-f133102ea245", "address": "fa:16:3e:2f:63:83", "network": {"id": "704209e4-4dd9-4e90-bc67-9843ae1d3340", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1483691372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e2a4cdf0fe94227a70e9ecc30df0cf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bf5e09d-1b", "ovs_interfaceid": "0bf5e09d-1b54-48f7-bbbe-f133102ea245", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 03:46:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-24fa8b49-1529-4747-8318-8355fd93976f req-3e89d12b-ca59-4589-8412-2c4ecc75d568 service nova] Acquired lock "refresh_cache-ad9b2edb-15d7-4937-9461-15ce61f508a7" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:46:57 user nova-compute[103546]: DEBUG nova.network.neutron [req-24fa8b49-1529-4747-8318-8355fd93976f req-3e89d12b-ca59-4589-8412-2c4ecc75d568 service nova] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Refreshing network info cache for port 0bf5e09d-1b54-48f7-bbbe-f133102ea245 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:46:57 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Start _get_guest_xml network_info=[{"id": "0bf5e09d-1b54-48f7-bbbe-f133102ea245", "address": "fa:16:3e:2f:63:83", "network": {"id": "704209e4-4dd9-4e90-bc67-9843ae1d3340", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1483691372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e2a4cdf0fe94227a70e9ecc30df0cf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bf5e09d-1b", "ovs_interfaceid": "0bf5e09d-1b54-48f7-bbbe-f133102ea245", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '5c6f539a-01e5-4478-bf8f-a14310b5d7dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 03:46:57 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:46:57 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:46:57 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 03:46:57 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 03:46:57 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 03:46:57 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 03:46:58 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 03:46:58 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 03:46:58 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 03:46:58 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 03:46:58 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 03:46:58 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 03:46:58 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 03:46:58 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 03:46:58 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 03:46:58 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 03:46:58 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 03:46:58 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 03:46:58 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:46:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-510323125',display_name='tempest-VolumesAssistedSnapshotsTest-server-510323125',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-510323125',id=8,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7ukVTEsQrfsx1V/Vv18Aroha3Ou7ipoh9GpWtMg3Zyt/L0IgUsE5cXN6eq+b3dsRGUaZsqSFxSb3zBUO7ATgClFJWXZFAj4/qan0bDxOk0jc+z13iSb6tABsLh5lNy/Q==',key_name='tempest-keypair-698143504',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8e2a4cdf0fe94227a70e9ecc30df0cf6',ramdisk_id='',reservation_id='r-i4qtsd8a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-866417016',owner_user_name='tempest-VolumesAssistedSnapshotsTest-866417016-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:46:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74dc927510f14b7ab10314605e74af64',uuid=ad9b2edb-15d7-4937-9461-15ce61f508a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0bf5e09d-1b54-48f7-bbbe-f133102ea245", "address": "fa:16:3e:2f:63:83", "network": {"id": "704209e4-4dd9-4e90-bc67-9843ae1d3340", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1483691372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e2a4cdf0fe94227a70e9ecc30df0cf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bf5e09d-1b", "ovs_interfaceid": "0bf5e09d-1b54-48f7-bbbe-f133102ea245", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 03:46:58 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Converting VIF {"id": "0bf5e09d-1b54-48f7-bbbe-f133102ea245", "address": "fa:16:3e:2f:63:83", "network": {"id": "704209e4-4dd9-4e90-bc67-9843ae1d3340", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1483691372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e2a4cdf0fe94227a70e9ecc30df0cf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bf5e09d-1b", "ovs_interfaceid": "0bf5e09d-1b54-48f7-bbbe-f133102ea245", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:46:58 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:63:83,bridge_name='br-int',has_traffic_filtering=True,id=0bf5e09d-1b54-48f7-bbbe-f133102ea245,network=Network(704209e4-4dd9-4e90-bc67-9843ae1d3340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bf5e09d-1b') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:46:58 user nova-compute[103546]: DEBUG nova.objects.instance [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Lazy-loading 'pci_devices' on Instance uuid ad9b2edb-15d7-4937-9461-15ce61f508a7 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:46:58 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] End _get_guest_xml xml=<domain type="kvm">
Nov 16 03:46:58 user nova-compute[103546]:   <uuid>ad9b2edb-15d7-4937-9461-15ce61f508a7</uuid>
Nov 16 03:46:58 user nova-compute[103546]:   <name>instance-00000008</name>
Nov 16 03:46:58 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 03:46:58 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 03:46:58 user nova-compute[103546]:   <metadata>
Nov 16 03:46:58 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 03:46:58 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 03:46:58 user nova-compute[103546]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-510323125</nova:name>
Nov 16 03:46:58 user nova-compute[103546]:       <nova:creationTime>2023-11-16 03:46:57</nova:creationTime>
Nov 16 03:46:58 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 03:46:58 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 03:46:58 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 03:46:58 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 03:46:58 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 03:46:58 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 03:46:58 user nova-compute[103546]:       </nova:flavor>
Nov 16 03:46:58 user nova-compute[103546]:       <nova:owner>
Nov 16 03:46:58 user nova-compute[103546]:         <nova:user uuid="74dc927510f14b7ab10314605e74af64">tempest-VolumesAssistedSnapshotsTest-866417016-project-member</nova:user>
Nov 16 03:46:58 user nova-compute[103546]:         <nova:project uuid="8e2a4cdf0fe94227a70e9ecc30df0cf6">tempest-VolumesAssistedSnapshotsTest-866417016</nova:project>
Nov 16 03:46:58 user nova-compute[103546]:       </nova:owner>
Nov 16 03:46:58 user nova-compute[103546]:       <nova:root type="image" uuid="5c6f539a-01e5-4478-bf8f-a14310b5d7dd"/>
Nov 16 03:46:58 user nova-compute[103546]:       <nova:ports>
Nov 16 03:46:58 user nova-compute[103546]:         <nova:port uuid="0bf5e09d-1b54-48f7-bbbe-f133102ea245">
Nov 16 03:46:58 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 03:46:58 user nova-compute[103546]:         </nova:port>
Nov 16 03:46:58 user nova-compute[103546]:       </nova:ports>
Nov 16 03:46:58 user nova-compute[103546]:     </nova:instance>
Nov 16 03:46:58 user nova-compute[103546]:   </metadata>
Nov 16 03:46:58 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 03:46:58 user nova-compute[103546]:     <system>
Nov 16 03:46:58 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 03:46:58 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 03:46:58 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 03:46:58 user nova-compute[103546]:       <entry name="serial">ad9b2edb-15d7-4937-9461-15ce61f508a7</entry>
Nov 16 03:46:58 user nova-compute[103546]:       <entry name="uuid">ad9b2edb-15d7-4937-9461-15ce61f508a7</entry>
Nov 16 03:46:58 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 03:46:58 user nova-compute[103546]:     </system>
Nov 16 03:46:58 user nova-compute[103546]:   </sysinfo>
Nov 16 03:46:58 user nova-compute[103546]:   <os>
Nov 16 03:46:58 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 03:46:58 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 03:46:58 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 03:46:58 user nova-compute[103546]:   </os>
Nov 16 03:46:58 user nova-compute[103546]:   <features>
Nov 16 03:46:58 user nova-compute[103546]:     <acpi/>
Nov 16 03:46:58 user nova-compute[103546]:     <apic/>
Nov 16 03:46:58 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 03:46:58 user nova-compute[103546]:   </features>
Nov 16 03:46:58 user nova-compute[103546]:   <clock offset="utc">
Nov 16 03:46:58 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 03:46:58 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 03:46:58 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 03:46:58 user nova-compute[103546]:   </clock>
Nov 16 03:46:58 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 03:46:58 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 03:46:58 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 03:46:58 user nova-compute[103546]:   </cpu>
Nov 16 03:46:58 user nova-compute[103546]:   <devices>
Nov 16 03:46:58 user nova-compute[103546]:     <disk type="file" device="disk">
Nov 16 03:46:58 user nova-compute[103546]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 03:46:58 user nova-compute[103546]:       <source file="/opt/stack/data/nova/instances/ad9b2edb-15d7-4937-9461-15ce61f508a7/disk"/>
Nov 16 03:46:58 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 03:46:58 user nova-compute[103546]:     </disk>
Nov 16 03:46:58 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 03:46:58 user nova-compute[103546]:       <mac address="fa:16:3e:2f:63:83"/>
Nov 16 03:46:58 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:46:58 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 03:46:58 user nova-compute[103546]:       <target dev="tap0bf5e09d-1b"/>
Nov 16 03:46:58 user nova-compute[103546]:     </interface>
Nov 16 03:46:58 user nova-compute[103546]:     <serial type="pty">
Nov 16 03:46:58 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/ad9b2edb-15d7-4937-9461-15ce61f508a7/console.log" append="off"/>
Nov 16 03:46:58 user nova-compute[103546]:     </serial>
Nov 16 03:46:58 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 03:46:58 user nova-compute[103546]:     <video>
Nov 16 03:46:58 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:46:58 user nova-compute[103546]:     </video>
Nov 16 03:46:58 user nova-compute[103546]:     <rng model="virtio">
Nov 16 03:46:58 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 03:46:58 user nova-compute[103546]:     </rng>
Nov 16 03:46:58 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 03:46:58 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 03:46:58 user nova-compute[103546]:       <stats period="10"/>
Nov 16 03:46:58 user nova-compute[103546]:     </memballoon>
Nov 16 03:46:58 user nova-compute[103546]:   </devices>
Nov 16 03:46:58 user nova-compute[103546]: </domain>
Nov 16 03:46:58 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 03:46:58 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:46:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-510323125',display_name='tempest-VolumesAssistedSnapshotsTest-server-510323125',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-510323125',id=8,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7ukVTEsQrfsx1V/Vv18Aroha3Ou7ipoh9GpWtMg3Zyt/L0IgUsE5cXN6eq+b3dsRGUaZsqSFxSb3zBUO7ATgClFJWXZFAj4/qan0bDxOk0jc+z13iSb6tABsLh5lNy/Q==',key_name='tempest-keypair-698143504',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8e2a4cdf0fe94227a70e9ecc30df0cf6',ramdisk_id='',reservation_id='r-i4qtsd8a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-866417016',owner_user_name='tempest-VolumesAssistedSnapshotsTest-866417016-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:46:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74dc927510f14b7ab10314605e74af64',uuid=ad9b2edb-15d7-4937-9461-15ce61f508a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0bf5e09d-1b54-48f7-bbbe-f133102ea245", "address": "fa:16:3e:2f:63:83", "network": {"id": "704209e4-4dd9-4e90-bc67-9843ae1d3340", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1483691372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e2a4cdf0fe94227a70e9ecc30df0cf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bf5e09d-1b", "ovs_interfaceid": "0bf5e09d-1b54-48f7-bbbe-f133102ea245", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 03:46:58 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Converting VIF {"id": "0bf5e09d-1b54-48f7-bbbe-f133102ea245", "address": "fa:16:3e:2f:63:83", "network": {"id": "704209e4-4dd9-4e90-bc67-9843ae1d3340", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1483691372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e2a4cdf0fe94227a70e9ecc30df0cf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bf5e09d-1b", "ovs_interfaceid": "0bf5e09d-1b54-48f7-bbbe-f133102ea245", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:46:58 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:63:83,bridge_name='br-int',has_traffic_filtering=True,id=0bf5e09d-1b54-48f7-bbbe-f133102ea245,network=Network(704209e4-4dd9-4e90-bc67-9843ae1d3340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bf5e09d-1b') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:46:58 user nova-compute[103546]: DEBUG os_vif [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:63:83,bridge_name='br-int',has_traffic_filtering=True,id=0bf5e09d-1b54-48f7-bbbe-f133102ea245,network=Network(704209e4-4dd9-4e90-bc67-9843ae1d3340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bf5e09d-1b') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 03:46:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:46:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 03:46:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'df5e105b-c77f-5b8c-9e07-ca2e1ae8872c', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:46:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:46:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0bf5e09d-1b, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:46:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0bf5e09d-1b, col_values=(('qos', UUID('6d3c4fc8-2a8e-4dad-a325-63401c8f928e')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:46:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0bf5e09d-1b, col_values=(('external_ids', {'iface-id': '0bf5e09d-1b54-48f7-bbbe-f133102ea245', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:63:83', 'vm-uuid': 'ad9b2edb-15d7-4937-9461-15ce61f508a7'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:46:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:46:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:58 user nova-compute[103546]: INFO os_vif [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:63:83,bridge_name='br-int',has_traffic_filtering=True,id=0bf5e09d-1b54-48f7-bbbe-f133102ea245,network=Network(704209e4-4dd9-4e90-bc67-9843ae1d3340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bf5e09d-1b')
Nov 16 03:46:58 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:46:58 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] No VIF found with MAC fa:16:3e:2f:63:83, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 03:46:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:58 user nova-compute[103546]: DEBUG nova.network.neutron [req-24fa8b49-1529-4747-8318-8355fd93976f req-3e89d12b-ca59-4589-8412-2c4ecc75d568 service nova] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Updated VIF entry in instance network info cache for port 0bf5e09d-1b54-48f7-bbbe-f133102ea245. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 03:46:58 user nova-compute[103546]: DEBUG nova.network.neutron [req-24fa8b49-1529-4747-8318-8355fd93976f req-3e89d12b-ca59-4589-8412-2c4ecc75d568 service nova] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Updating instance_info_cache with network_info: [{"id": "0bf5e09d-1b54-48f7-bbbe-f133102ea245", "address": "fa:16:3e:2f:63:83", "network": {"id": "704209e4-4dd9-4e90-bc67-9843ae1d3340", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1483691372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e2a4cdf0fe94227a70e9ecc30df0cf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bf5e09d-1b", "ovs_interfaceid": "0bf5e09d-1b54-48f7-bbbe-f133102ea245", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:46:58 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-24fa8b49-1529-4747-8318-8355fd93976f req-3e89d12b-ca59-4589-8412-2c4ecc75d568 service nova] Releasing lock "refresh_cache-ad9b2edb-15d7-4937-9461-15ce61f508a7" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:46:59 user nova-compute[103546]: DEBUG nova.compute.manager [req-5106556b-054a-4bfb-9ae2-347c89ec3c4a req-d88a11ff-c22d-491d-bfa8-4c66f8ee2d69 service nova] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Received event network-vif-plugged-e36fae5d-773f-47c0-b79a-5aadf6412cbc {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:46:59 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-5106556b-054a-4bfb-9ae2-347c89ec3c4a req-d88a11ff-c22d-491d-bfa8-4c66f8ee2d69 service nova] Acquiring lock "51554aab-44ec-4161-b926-9c07a3f838a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:46:59 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-5106556b-054a-4bfb-9ae2-347c89ec3c4a req-d88a11ff-c22d-491d-bfa8-4c66f8ee2d69 service nova] Lock "51554aab-44ec-4161-b926-9c07a3f838a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:46:59 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-5106556b-054a-4bfb-9ae2-347c89ec3c4a req-d88a11ff-c22d-491d-bfa8-4c66f8ee2d69 service nova] Lock "51554aab-44ec-4161-b926-9c07a3f838a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:46:59 user nova-compute[103546]: DEBUG nova.compute.manager [req-5106556b-054a-4bfb-9ae2-347c89ec3c4a req-d88a11ff-c22d-491d-bfa8-4c66f8ee2d69 service nova] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] No waiting events found dispatching network-vif-plugged-e36fae5d-773f-47c0-b79a-5aadf6412cbc {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:46:59 user nova-compute[103546]: WARNING nova.compute.manager [req-5106556b-054a-4bfb-9ae2-347c89ec3c4a req-d88a11ff-c22d-491d-bfa8-4c66f8ee2d69 service nova] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Received unexpected event network-vif-plugged-e36fae5d-773f-47c0-b79a-5aadf6412cbc for instance with vm_state active and task_state None.
Nov 16 03:46:59 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:59 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:46:59 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:00 user nova-compute[103546]: DEBUG nova.compute.manager [req-8e799a4d-0ac2-4803-ad6c-a5b37cd8efa1 req-5b459709-1b92-4d2d-8431-81f385b993df service nova] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Received event network-vif-plugged-0bf5e09d-1b54-48f7-bbbe-f133102ea245 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:47:00 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8e799a4d-0ac2-4803-ad6c-a5b37cd8efa1 req-5b459709-1b92-4d2d-8431-81f385b993df service nova] Acquiring lock "ad9b2edb-15d7-4937-9461-15ce61f508a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:47:00 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8e799a4d-0ac2-4803-ad6c-a5b37cd8efa1 req-5b459709-1b92-4d2d-8431-81f385b993df service nova] Lock "ad9b2edb-15d7-4937-9461-15ce61f508a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:47:00 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8e799a4d-0ac2-4803-ad6c-a5b37cd8efa1 req-5b459709-1b92-4d2d-8431-81f385b993df service nova] Lock "ad9b2edb-15d7-4937-9461-15ce61f508a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:47:00 user nova-compute[103546]: DEBUG nova.compute.manager [req-8e799a4d-0ac2-4803-ad6c-a5b37cd8efa1 req-5b459709-1b92-4d2d-8431-81f385b993df service nova] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] No waiting events found dispatching network-vif-plugged-0bf5e09d-1b54-48f7-bbbe-f133102ea245 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:47:00 user nova-compute[103546]: WARNING nova.compute.manager [req-8e799a4d-0ac2-4803-ad6c-a5b37cd8efa1 req-5b459709-1b92-4d2d-8431-81f385b993df service nova] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Received unexpected event network-vif-plugged-0bf5e09d-1b54-48f7-bbbe-f133102ea245 for instance with vm_state building and task_state spawning.
Nov 16 03:47:00 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:00 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:00 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:01 user nova-compute[103546]: DEBUG nova.compute.manager [req-022e763b-04fa-4ec2-b21a-5ca8d82d3fee req-757844a6-891c-4c70-b5ab-29cb58fc8e6f service nova] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Received event network-vif-plugged-e36fae5d-773f-47c0-b79a-5aadf6412cbc {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:47:01 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-022e763b-04fa-4ec2-b21a-5ca8d82d3fee req-757844a6-891c-4c70-b5ab-29cb58fc8e6f service nova] Acquiring lock "51554aab-44ec-4161-b926-9c07a3f838a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:47:01 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-022e763b-04fa-4ec2-b21a-5ca8d82d3fee req-757844a6-891c-4c70-b5ab-29cb58fc8e6f service nova] Lock "51554aab-44ec-4161-b926-9c07a3f838a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:47:01 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-022e763b-04fa-4ec2-b21a-5ca8d82d3fee req-757844a6-891c-4c70-b5ab-29cb58fc8e6f service nova] Lock "51554aab-44ec-4161-b926-9c07a3f838a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:47:01 user nova-compute[103546]: DEBUG nova.compute.manager [req-022e763b-04fa-4ec2-b21a-5ca8d82d3fee req-757844a6-891c-4c70-b5ab-29cb58fc8e6f service nova] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] No waiting events found dispatching network-vif-plugged-e36fae5d-773f-47c0-b79a-5aadf6412cbc {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:47:01 user nova-compute[103546]: WARNING nova.compute.manager [req-022e763b-04fa-4ec2-b21a-5ca8d82d3fee req-757844a6-891c-4c70-b5ab-29cb58fc8e6f service nova] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Received unexpected event network-vif-plugged-e36fae5d-773f-47c0-b79a-5aadf6412cbc for instance with vm_state active and task_state None.
Nov 16 03:47:01 user nova-compute[103546]: DEBUG nova.compute.manager [req-022e763b-04fa-4ec2-b21a-5ca8d82d3fee req-757844a6-891c-4c70-b5ab-29cb58fc8e6f service nova] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Received event network-vif-plugged-48a6af37-c461-4721-b870-432cf404dcf7 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:47:01 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-022e763b-04fa-4ec2-b21a-5ca8d82d3fee req-757844a6-891c-4c70-b5ab-29cb58fc8e6f service nova] Acquiring lock "549ee3db-0014-440f-bd3a-0d389f5eab88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:47:01 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-022e763b-04fa-4ec2-b21a-5ca8d82d3fee req-757844a6-891c-4c70-b5ab-29cb58fc8e6f service nova] Lock "549ee3db-0014-440f-bd3a-0d389f5eab88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:47:01 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-022e763b-04fa-4ec2-b21a-5ca8d82d3fee req-757844a6-891c-4c70-b5ab-29cb58fc8e6f service nova] Lock "549ee3db-0014-440f-bd3a-0d389f5eab88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:47:01 user nova-compute[103546]: DEBUG nova.compute.manager [req-022e763b-04fa-4ec2-b21a-5ca8d82d3fee req-757844a6-891c-4c70-b5ab-29cb58fc8e6f service nova] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] No waiting events found dispatching network-vif-plugged-48a6af37-c461-4721-b870-432cf404dcf7 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:47:01 user nova-compute[103546]: WARNING nova.compute.manager [req-022e763b-04fa-4ec2-b21a-5ca8d82d3fee req-757844a6-891c-4c70-b5ab-29cb58fc8e6f service nova] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Received unexpected event network-vif-plugged-48a6af37-c461-4721-b870-432cf404dcf7 for instance with vm_state active and task_state None.
Nov 16 03:47:01 user nova-compute[103546]: DEBUG nova.compute.manager [req-022e763b-04fa-4ec2-b21a-5ca8d82d3fee req-757844a6-891c-4c70-b5ab-29cb58fc8e6f service nova] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Received event network-vif-plugged-48a6af37-c461-4721-b870-432cf404dcf7 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:47:01 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-022e763b-04fa-4ec2-b21a-5ca8d82d3fee req-757844a6-891c-4c70-b5ab-29cb58fc8e6f service nova] Acquiring lock "549ee3db-0014-440f-bd3a-0d389f5eab88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:47:01 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-022e763b-04fa-4ec2-b21a-5ca8d82d3fee req-757844a6-891c-4c70-b5ab-29cb58fc8e6f service nova] Lock "549ee3db-0014-440f-bd3a-0d389f5eab88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:47:01 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-022e763b-04fa-4ec2-b21a-5ca8d82d3fee req-757844a6-891c-4c70-b5ab-29cb58fc8e6f service nova] Lock "549ee3db-0014-440f-bd3a-0d389f5eab88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:47:01 user nova-compute[103546]: DEBUG nova.compute.manager [req-022e763b-04fa-4ec2-b21a-5ca8d82d3fee req-757844a6-891c-4c70-b5ab-29cb58fc8e6f service nova] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] No waiting events found dispatching network-vif-plugged-48a6af37-c461-4721-b870-432cf404dcf7 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:47:01 user nova-compute[103546]: WARNING nova.compute.manager [req-022e763b-04fa-4ec2-b21a-5ca8d82d3fee req-757844a6-891c-4c70-b5ab-29cb58fc8e6f service nova] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Received unexpected event network-vif-plugged-48a6af37-c461-4721-b870-432cf404dcf7 for instance with vm_state active and task_state None.
Nov 16 03:47:02 user nova-compute[103546]: DEBUG nova.compute.manager [req-ef94bca0-4ea2-4da5-8e8d-a8de1370043b req-72763053-9c48-4fc8-9558-b7e1ea1be022 service nova] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Received event network-vif-plugged-0bf5e09d-1b54-48f7-bbbe-f133102ea245 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:47:02 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ef94bca0-4ea2-4da5-8e8d-a8de1370043b req-72763053-9c48-4fc8-9558-b7e1ea1be022 service nova] Acquiring lock "ad9b2edb-15d7-4937-9461-15ce61f508a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:47:02 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ef94bca0-4ea2-4da5-8e8d-a8de1370043b req-72763053-9c48-4fc8-9558-b7e1ea1be022 service nova] Lock "ad9b2edb-15d7-4937-9461-15ce61f508a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:47:02 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ef94bca0-4ea2-4da5-8e8d-a8de1370043b req-72763053-9c48-4fc8-9558-b7e1ea1be022 service nova] Lock "ad9b2edb-15d7-4937-9461-15ce61f508a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:47:02 user nova-compute[103546]: DEBUG nova.compute.manager [req-ef94bca0-4ea2-4da5-8e8d-a8de1370043b req-72763053-9c48-4fc8-9558-b7e1ea1be022 service nova] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] No waiting events found dispatching network-vif-plugged-0bf5e09d-1b54-48f7-bbbe-f133102ea245 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:47:02 user nova-compute[103546]: WARNING nova.compute.manager [req-ef94bca0-4ea2-4da5-8e8d-a8de1370043b req-72763053-9c48-4fc8-9558-b7e1ea1be022 service nova] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Received unexpected event network-vif-plugged-0bf5e09d-1b54-48f7-bbbe-f133102ea245 for instance with vm_state building and task_state spawning.
Nov 16 03:47:02 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:02 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:47:02 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Cleaning up deleted instances {{(pid=103546) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 03:47:02 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] There are 0 instances to clean {{(pid=103546) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 03:47:02 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:47:02 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Cleaning up deleted instances with incomplete migration  {{(pid=103546) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 03:47:02 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:47:02 user nova-compute[103546]: DEBUG nova.compute.manager [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 03:47:02 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Guest created on hypervisor {{(pid=103546) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 03:47:02 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Instance spawned successfully.
Nov 16 03:47:02 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 03:47:02 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Found default for hw_cdrom_bus of ide {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:47:02 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Found default for hw_disk_bus of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:47:02 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Found default for hw_input_bus of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:47:02 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Found default for hw_pointer_model of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:47:02 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Found default for hw_video_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:47:02 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Found default for hw_vif_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:47:02 user nova-compute[103546]: INFO nova.compute.manager [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Took 7.05 seconds to spawn the instance on the hypervisor.
Nov 16 03:47:02 user nova-compute[103546]: DEBUG nova.compute.manager [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 03:47:03 user nova-compute[103546]: INFO nova.compute.manager [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Took 8.09 seconds to build instance.
Nov 16 03:47:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1b70afff-d7b5-4d50-ab76-ce84b24b490e tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Lock "ad9b2edb-15d7-4937-9461-15ce61f508a7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.225s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:47:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:04 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:47:04 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:47:04 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=103546) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 03:47:05 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:47:06 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:47:06 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:47:06 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Starting heal instance info cache {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 03:47:06 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Rebuilding the list of instances to heal {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 03:47:06 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "refresh_cache-279e2954-d786-4544-903d-8edc63646e2d" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:47:06 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquired lock "refresh_cache-279e2954-d786-4544-903d-8edc63646e2d" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:47:06 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 279e2954-d786-4544-903d-8edc63646e2d] Forcefully refreshing network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 03:47:06 user nova-compute[103546]: DEBUG nova.objects.instance [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lazy-loading 'info_cache' on Instance uuid 279e2954-d786-4544-903d-8edc63646e2d {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:47:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:07 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 279e2954-d786-4544-903d-8edc63646e2d] Updating instance_info_cache with network_info: [{"id": "e60cc693-67d4-45a3-a97e-40bb5f753c9d", "address": "fa:16:3e:44:ef:27", "network": {"id": "56e4e469-bfda-4ab1-9fdd-e3aa1a0655fc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-669383710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f227c815224d55afdb3eba43e68757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape60cc693-67", "ovs_interfaceid": "e60cc693-67d4-45a3-a97e-40bb5f753c9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:47:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Releasing lock "refresh_cache-279e2954-d786-4544-903d-8edc63646e2d" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:47:07 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 279e2954-d786-4544-903d-8edc63646e2d] Updated the network info_cache for instance {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 03:47:07 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:47:07 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:47:07 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:47:07 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager.update_available_resource {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:47:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:47:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:47:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:47:07 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Auditing locally available compute resources for user (node: user) {{(pid=103546) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 03:47:08 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/549ee3db-0014-440f-bd3a-0d389f5eab88/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:08 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/549ee3db-0014-440f-bd3a-0d389f5eab88/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:08 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/549ee3db-0014-440f-bd3a-0d389f5eab88/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:08 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/549ee3db-0014-440f-bd3a-0d389f5eab88/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:08 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c929d5-2f1c-4be4-8864-6ec81625daac/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:08 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c929d5-2f1c-4be4-8864-6ec81625daac/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:08 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c929d5-2f1c-4be4-8864-6ec81625daac/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:08 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c929d5-2f1c-4be4-8864-6ec81625daac/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:08 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad9b2edb-15d7-4937-9461-15ce61f508a7/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad9b2edb-15d7-4937-9461-15ce61f508a7/disk --force-share --output=json" returned: 0 in 0.310s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad9b2edb-15d7-4937-9461-15ce61f508a7/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad9b2edb-15d7-4937-9461-15ce61f508a7/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e2954-d786-4544-903d-8edc63646e2d/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e2954-d786-4544-903d-8edc63646e2d/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e2954-d786-4544-903d-8edc63646e2d/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e2954-d786-4544-903d-8edc63646e2d/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c24a386f-32f5-4095-b2b3-69a70a54ff66/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c24a386f-32f5-4095-b2b3-69a70a54ff66/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c24a386f-32f5-4095-b2b3-69a70a54ff66/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c24a386f-32f5-4095-b2b3-69a70a54ff66/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7862d05d-4293-46a5-98aa-41967a572fe3/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7862d05d-4293-46a5-98aa-41967a572fe3/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7862d05d-4293-46a5-98aa-41967a572fe3/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7862d05d-4293-46a5-98aa-41967a572fe3/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:10 user nova-compute[103546]: DEBUG nova.compute.manager [req-cd5df6ea-d12e-454b-b7c4-d19193b7488a req-0bf856e0-9043-4f7a-b8cb-147cc3f7dd67 service nova] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Received event network-vif-plugged-6283c5fe-57f3-4552-b0cd-5d05b38e983c {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:47:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-cd5df6ea-d12e-454b-b7c4-d19193b7488a req-0bf856e0-9043-4f7a-b8cb-147cc3f7dd67 service nova] Acquiring lock "05c929d5-2f1c-4be4-8864-6ec81625daac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:47:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-cd5df6ea-d12e-454b-b7c4-d19193b7488a req-0bf856e0-9043-4f7a-b8cb-147cc3f7dd67 service nova] Lock "05c929d5-2f1c-4be4-8864-6ec81625daac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:47:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-cd5df6ea-d12e-454b-b7c4-d19193b7488a req-0bf856e0-9043-4f7a-b8cb-147cc3f7dd67 service nova] Lock "05c929d5-2f1c-4be4-8864-6ec81625daac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:47:10 user nova-compute[103546]: DEBUG nova.compute.manager [req-cd5df6ea-d12e-454b-b7c4-d19193b7488a req-0bf856e0-9043-4f7a-b8cb-147cc3f7dd67 service nova] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] No waiting events found dispatching network-vif-plugged-6283c5fe-57f3-4552-b0cd-5d05b38e983c {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:47:10 user nova-compute[103546]: WARNING nova.compute.manager [req-cd5df6ea-d12e-454b-b7c4-d19193b7488a req-0bf856e0-9043-4f7a-b8cb-147cc3f7dd67 service nova] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Received unexpected event network-vif-plugged-6283c5fe-57f3-4552-b0cd-5d05b38e983c for instance with vm_state active and task_state None.
Nov 16 03:47:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51554aab-44ec-4161-b926-9c07a3f838a5/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:11 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51554aab-44ec-4161-b926-9c07a3f838a5/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:11 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51554aab-44ec-4161-b926-9c07a3f838a5/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:11 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51554aab-44ec-4161-b926-9c07a3f838a5/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:11 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fead4119-3ab9-4337-8b48-d3920e1112f4/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:11 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fead4119-3ab9-4337-8b48-d3920e1112f4/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:11 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fead4119-3ab9-4337-8b48-d3920e1112f4/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:11 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fead4119-3ab9-4337-8b48-d3920e1112f4/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:12 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:47:12 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:47:12 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Hypervisor/Node resource view: name=user free_ram=7628MB free_disk=25.6380615234375GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=103546) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 03:47:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:47:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:47:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:12 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 279e2954-d786-4544-903d-8edc63646e2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:47:12 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 51554aab-44ec-4161-b926-9c07a3f838a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:47:12 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 7862d05d-4293-46a5-98aa-41967a572fe3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:47:12 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance c24a386f-32f5-4095-b2b3-69a70a54ff66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:47:12 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 05c929d5-2f1c-4be4-8864-6ec81625daac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:47:12 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance fead4119-3ab9-4337-8b48-d3920e1112f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:47:12 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 549ee3db-0014-440f-bd3a-0d389f5eab88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:47:12 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance ad9b2edb-15d7-4937-9461-15ce61f508a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:47:12 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 03:47:12 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 03:47:12 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Refreshing inventories for resource provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 03:47:12 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Updating ProviderTree inventory for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 03:47:12 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Updating inventory in ProviderTree for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 03:47:12 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Refreshing aggregate associations for resource provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a, aggregates: None {{(pid=103546) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 03:47:12 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Refreshing trait associations for resource provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=103546) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 03:47:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:13 user nova-compute[103546]: DEBUG nova.compute.manager [req-074fbdc9-4877-4473-8eb0-c49015e892b7 req-785067bf-951e-4c40-b026-cdf7fe5364f1 service nova] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Received event network-vif-plugged-6283c5fe-57f3-4552-b0cd-5d05b38e983c {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:47:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-074fbdc9-4877-4473-8eb0-c49015e892b7 req-785067bf-951e-4c40-b026-cdf7fe5364f1 service nova] Acquiring lock "05c929d5-2f1c-4be4-8864-6ec81625daac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:47:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-074fbdc9-4877-4473-8eb0-c49015e892b7 req-785067bf-951e-4c40-b026-cdf7fe5364f1 service nova] Lock "05c929d5-2f1c-4be4-8864-6ec81625daac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:47:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-074fbdc9-4877-4473-8eb0-c49015e892b7 req-785067bf-951e-4c40-b026-cdf7fe5364f1 service nova] Lock "05c929d5-2f1c-4be4-8864-6ec81625daac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:47:13 user nova-compute[103546]: DEBUG nova.compute.manager [req-074fbdc9-4877-4473-8eb0-c49015e892b7 req-785067bf-951e-4c40-b026-cdf7fe5364f1 service nova] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] No waiting events found dispatching network-vif-plugged-6283c5fe-57f3-4552-b0cd-5d05b38e983c {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:47:13 user nova-compute[103546]: WARNING nova.compute.manager [req-074fbdc9-4877-4473-8eb0-c49015e892b7 req-785067bf-951e-4c40-b026-cdf7fe5364f1 service nova] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Received unexpected event network-vif-plugged-6283c5fe-57f3-4552-b0cd-5d05b38e983c for instance with vm_state active and task_state None.
Nov 16 03:47:13 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:47:13 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:47:13 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Compute_service record updated for user:user {{(pid=103546) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 03:47:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.848s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:47:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Acquiring lock "71059a8d-4e89-472c-9463-b38aa8063e33" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:47:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Lock "71059a8d-4e89-472c-9463-b38aa8063e33" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:47:14 user nova-compute[103546]: DEBUG nova.compute.manager [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Starting instance... {{(pid=103546) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 03:47:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:47:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:47:14 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=103546) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 03:47:14 user nova-compute[103546]: INFO nova.compute.claims [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Claim successful on node user
Nov 16 03:47:14 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:47:14 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:47:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.414s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:47:14 user nova-compute[103546]: DEBUG nova.compute.manager [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Start building networks asynchronously for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 03:47:14 user nova-compute[103546]: DEBUG nova.compute.manager [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Allocating IP information in the background. {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 03:47:14 user nova-compute[103546]: DEBUG nova.network.neutron [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] allocate_for_instance() {{(pid=103546) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 03:47:14 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 03:47:15 user nova-compute[103546]: DEBUG nova.compute.manager [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Start building block device mappings for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 03:47:15 user nova-compute[103546]: INFO nova.virt.block_device [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Booting with volume b5221ff7-1f34-47db-a9c6-ce3f8e58e865 at /dev/vda
Nov 16 03:47:15 user nova-compute[103546]: DEBUG nova.policy [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7d9e6b5b41d341e19548640d455eaa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df5ea6e7a24d49bb8f430fb9248934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103546) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 03:47:15 user nova-compute[103546]: DEBUG os_brick.utils [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:47:15 user nova-compute[103546]: INFO oslo.privsep.daemon [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpktms3cwh/privsep.sock']
Nov 16 03:47:15 user sudo[114456]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpktms3cwh/privsep.sock
Nov 16 03:47:15 user sudo[114456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 16 03:47:16 user nova-compute[103546]: DEBUG nova.network.neutron [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Successfully created port: 76b69715-356f-496a-85a3-f5bde976e201 {{(pid=103546) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 03:47:16 user nova-compute[103546]: DEBUG nova.network.neutron [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Successfully created port: 1fb75f05-a4ef-45d5-9eb4-5e8428997947 {{(pid=103546) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 03:47:17 user nova-compute[103546]: DEBUG nova.network.neutron [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Successfully created port: 51e087e4-ff6b-49a8-8190-cfc243436d35 {{(pid=103546) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 03:47:17 user sudo[114456]: pam_unix(sudo:session): session closed for user root
Nov 16 03:47:17 user nova-compute[103546]: INFO oslo.privsep.daemon [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Spawned new privsep daemon via rootwrap
Nov 16 03:47:17 user nova-compute[103546]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 16 03:47:17 user nova-compute[103546]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 16 03:47:17 user nova-compute[103546]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 16 03:47:17 user nova-compute[103546]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 114461
Nov 16 03:47:17 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad8e07f-1198-48e6-972e-312f0072a1fb]: (2,) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:17 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff86699-17fc-478b-9546-1a7b9c37fd01]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af5c39b14ece\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:17 user nova-compute[103546]: WARNING os_brick.initiator.connectors.nvmeof [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 16 03:47:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:17 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[361f7a20-4cdd-476d-970f-360cf2c53d89]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:17 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[070ee6e3-48e9-4f0d-82f6-7c2ec7c96fcb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:17 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[10de37dd-aca5-4a7d-9681-928abc2a3005]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Running cmd (subprocess): nvme version {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] 'nvme version' failed. Not Retrying. {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:47:17 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.nvmeof [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] nvme not present on system {{(pid=103546) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 03:47:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:47:17 user nova-compute[103546]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 03:47:17 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[36062b14-82b4-4981-9ea4-adade2173878]: (4, '') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:17 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=103546) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 03:47:17 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 03:47:17 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] LIGHTOS: no hostnqn found. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 03:47:17 user nova-compute[103546]: DEBUG os_brick.utils [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] <== get_connector_properties: return (2309ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af5c39b14ece', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:47:17 user nova-compute[103546]: DEBUG nova.virt.block_device [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Updating existing volume attachment record: 3823a289-6070-43b7-9b45-a343c08c353b {{(pid=103546) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 03:47:17 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:17 user nova-compute[103546]: DEBUG nova.network.neutron [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Successfully created port: b0f609b8-eb49-4c19-968c-99c95c38b857 {{(pid=103546) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 03:47:18 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Acquiring lock "2cb84f00-0601-4199-ba6e-f09a27add736" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:47:18 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Lock "2cb84f00-0601-4199-ba6e-f09a27add736" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:47:18 user nova-compute[103546]: DEBUG nova.compute.manager [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Starting instance... {{(pid=103546) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 03:47:18 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:18 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:47:18 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:47:18 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=103546) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 03:47:18 user nova-compute[103546]: INFO nova.compute.claims [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Claim successful on node user
Nov 16 03:47:18 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:47:18 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:47:18 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.454s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:47:18 user nova-compute[103546]: DEBUG nova.compute.manager [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Start building networks asynchronously for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 03:47:18 user nova-compute[103546]: DEBUG nova.network.neutron [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Successfully created port: fc03966b-fcbc-4ed7-8ffb-2270a55b4e28 {{(pid=103546) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 03:47:18 user nova-compute[103546]: DEBUG nova.compute.manager [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Allocating IP information in the background. {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 03:47:18 user nova-compute[103546]: DEBUG nova.network.neutron [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] allocate_for_instance() {{(pid=103546) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 03:47:18 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 03:47:18 user nova-compute[103546]: DEBUG nova.compute.manager [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Start building block device mappings for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 03:47:18 user nova-compute[103546]: INFO nova.virt.block_device [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Booting with volume 4dada35b-3508-4544-8fec-013f8b89fd57 at /dev/vda
Nov 16 03:47:18 user nova-compute[103546]: DEBUG os_brick.utils [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:47:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:18 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3577bca-8044-4c1e-a77a-ba67e1cd1043]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af5c39b14ece\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:19 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc881004-fbca-49c4-a1b8-b4aa079e4696]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:19 user nova-compute[103546]: DEBUG nova.policy [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '22747b2af109454c9aa3475c049d39bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b885bd172d45859e0eaa89af06f144', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103546) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 03:47:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:19 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b857a216-8f82-424f-8e20-4eb7b29d585c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:19 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b61b531-4ca4-45b2-adda-6aa0e758c130]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Running cmd (subprocess): nvme version {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] 'nvme version' failed. Not Retrying. {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:47:19 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.nvmeof [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] nvme not present on system {{(pid=103546) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 03:47:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:47:19 user nova-compute[103546]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 03:47:19 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3aee33-7712-4b05-afd6-da1356bfcc20]: (4, '') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:19 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=103546) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 03:47:19 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 03:47:19 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] LIGHTOS: no hostnqn found. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 03:47:19 user nova-compute[103546]: DEBUG os_brick.utils [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af5c39b14ece', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:47:19 user nova-compute[103546]: DEBUG nova.virt.block_device [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Updating existing volume attachment record: 2a2e8c7f-16c4-4865-8a3b-f36189251637 {{(pid=103546) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 03:47:19 user nova-compute[103546]: DEBUG nova.network.neutron [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Successfully updated port: 76b69715-356f-496a-85a3-f5bde976e201 {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 03:47:19 user nova-compute[103546]: DEBUG nova.compute.manager [req-46600b81-cc64-48a4-b36a-8ceb24bf0906 req-1e22cbac-4eba-4735-8120-6768e264b9a0 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received event network-changed-76b69715-356f-496a-85a3-f5bde976e201 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:47:19 user nova-compute[103546]: DEBUG nova.compute.manager [req-46600b81-cc64-48a4-b36a-8ceb24bf0906 req-1e22cbac-4eba-4735-8120-6768e264b9a0 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Refreshing instance network info cache due to event network-changed-76b69715-356f-496a-85a3-f5bde976e201. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:47:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-46600b81-cc64-48a4-b36a-8ceb24bf0906 req-1e22cbac-4eba-4735-8120-6768e264b9a0 service nova] Acquiring lock "refresh_cache-71059a8d-4e89-472c-9463-b38aa8063e33" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:47:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-46600b81-cc64-48a4-b36a-8ceb24bf0906 req-1e22cbac-4eba-4735-8120-6768e264b9a0 service nova] Acquired lock "refresh_cache-71059a8d-4e89-472c-9463-b38aa8063e33" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:47:19 user nova-compute[103546]: DEBUG nova.network.neutron [req-46600b81-cc64-48a4-b36a-8ceb24bf0906 req-1e22cbac-4eba-4735-8120-6768e264b9a0 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Refreshing network info cache for port 76b69715-356f-496a-85a3-f5bde976e201 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:47:19 user nova-compute[103546]: DEBUG nova.network.neutron [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Successfully created port: 2159d4b9-42e0-48d5-bfdf-178ee853063c {{(pid=103546) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 03:47:19 user nova-compute[103546]: DEBUG nova.network.neutron [req-46600b81-cc64-48a4-b36a-8ceb24bf0906 req-1e22cbac-4eba-4735-8120-6768e264b9a0 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 03:47:20 user nova-compute[103546]: DEBUG nova.network.neutron [req-46600b81-cc64-48a4-b36a-8ceb24bf0906 req-1e22cbac-4eba-4735-8120-6768e264b9a0 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:47:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-46600b81-cc64-48a4-b36a-8ceb24bf0906 req-1e22cbac-4eba-4735-8120-6768e264b9a0 service nova] Releasing lock "refresh_cache-71059a8d-4e89-472c-9463-b38aa8063e33" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:47:20 user nova-compute[103546]: DEBUG nova.network.neutron [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Successfully created port: 1b75ba8c-049f-404a-aa82-0323bf51191c {{(pid=103546) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 03:47:21 user nova-compute[103546]: DEBUG nova.network.neutron [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Successfully updated port: 21653257-8a66-44f1-b806-2fae4641e1d2 {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 03:47:21 user nova-compute[103546]: DEBUG nova.network.neutron [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Successfully created port: c2216378-faa5-4bdc-8706-0be8df7807c0 {{(pid=103546) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 03:47:21 user nova-compute[103546]: DEBUG nova.compute.manager [req-691c1bd3-63d9-475d-92cb-a37e869c987b req-bc1ff0c7-3b75-475d-b8b0-73a5c24bd15a service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received event network-changed-21653257-8a66-44f1-b806-2fae4641e1d2 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:47:21 user nova-compute[103546]: DEBUG nova.compute.manager [req-691c1bd3-63d9-475d-92cb-a37e869c987b req-bc1ff0c7-3b75-475d-b8b0-73a5c24bd15a service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Refreshing instance network info cache due to event network-changed-21653257-8a66-44f1-b806-2fae4641e1d2. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:47:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-691c1bd3-63d9-475d-92cb-a37e869c987b req-bc1ff0c7-3b75-475d-b8b0-73a5c24bd15a service nova] Acquiring lock "refresh_cache-71059a8d-4e89-472c-9463-b38aa8063e33" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:47:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-691c1bd3-63d9-475d-92cb-a37e869c987b req-bc1ff0c7-3b75-475d-b8b0-73a5c24bd15a service nova] Acquired lock "refresh_cache-71059a8d-4e89-472c-9463-b38aa8063e33" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:47:21 user nova-compute[103546]: DEBUG nova.network.neutron [req-691c1bd3-63d9-475d-92cb-a37e869c987b req-bc1ff0c7-3b75-475d-b8b0-73a5c24bd15a service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Refreshing network info cache for port 21653257-8a66-44f1-b806-2fae4641e1d2 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:47:21 user nova-compute[103546]: DEBUG nova.network.neutron [req-691c1bd3-63d9-475d-92cb-a37e869c987b req-bc1ff0c7-3b75-475d-b8b0-73a5c24bd15a service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 03:47:22 user nova-compute[103546]: DEBUG nova.network.neutron [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Successfully updated port: 916a3fe8-09df-42a1-9ac0-b81153ed55a1 {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 03:47:22 user nova-compute[103546]: DEBUG nova.network.neutron [req-691c1bd3-63d9-475d-92cb-a37e869c987b req-bc1ff0c7-3b75-475d-b8b0-73a5c24bd15a service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:47:22 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-691c1bd3-63d9-475d-92cb-a37e869c987b req-bc1ff0c7-3b75-475d-b8b0-73a5c24bd15a service nova] Releasing lock "refresh_cache-71059a8d-4e89-472c-9463-b38aa8063e33" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:47:22 user nova-compute[103546]: DEBUG nova.network.neutron [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Successfully created port: 75b2ff49-49cc-4b86-bdc6-6f9f76c06505 {{(pid=103546) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 03:47:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:22 user nova-compute[103546]: DEBUG nova.network.neutron [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Successfully updated port: 1fb75f05-a4ef-45d5-9eb4-5e8428997947 {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 03:47:22 user nova-compute[103546]: DEBUG nova.compute.manager [req-c215216a-d05f-485a-a01b-8cc90be024d7 req-da1c0ccb-6df5-42a4-9049-b0bfea375649 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received event network-changed-1fb75f05-a4ef-45d5-9eb4-5e8428997947 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:47:22 user nova-compute[103546]: DEBUG nova.compute.manager [req-c215216a-d05f-485a-a01b-8cc90be024d7 req-da1c0ccb-6df5-42a4-9049-b0bfea375649 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Refreshing instance network info cache due to event network-changed-1fb75f05-a4ef-45d5-9eb4-5e8428997947. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:47:22 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-c215216a-d05f-485a-a01b-8cc90be024d7 req-da1c0ccb-6df5-42a4-9049-b0bfea375649 service nova] Acquiring lock "refresh_cache-71059a8d-4e89-472c-9463-b38aa8063e33" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:47:22 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-c215216a-d05f-485a-a01b-8cc90be024d7 req-da1c0ccb-6df5-42a4-9049-b0bfea375649 service nova] Acquired lock "refresh_cache-71059a8d-4e89-472c-9463-b38aa8063e33" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:47:22 user nova-compute[103546]: DEBUG nova.network.neutron [req-c215216a-d05f-485a-a01b-8cc90be024d7 req-da1c0ccb-6df5-42a4-9049-b0bfea375649 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Refreshing network info cache for port 1fb75f05-a4ef-45d5-9eb4-5e8428997947 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:47:23 user nova-compute[103546]: DEBUG nova.network.neutron [req-c215216a-d05f-485a-a01b-8cc90be024d7 req-da1c0ccb-6df5-42a4-9049-b0bfea375649 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 03:47:23 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:23 user nova-compute[103546]: DEBUG nova.network.neutron [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Successfully updated port: 51e087e4-ff6b-49a8-8190-cfc243436d35 {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 03:47:23 user nova-compute[103546]: DEBUG nova.network.neutron [req-c215216a-d05f-485a-a01b-8cc90be024d7 req-da1c0ccb-6df5-42a4-9049-b0bfea375649 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:47:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-c215216a-d05f-485a-a01b-8cc90be024d7 req-da1c0ccb-6df5-42a4-9049-b0bfea375649 service nova] Releasing lock "refresh_cache-71059a8d-4e89-472c-9463-b38aa8063e33" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:47:23 user nova-compute[103546]: DEBUG nova.network.neutron [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Successfully created port: 87ab6a10-d50c-460e-b891-ce6439614185 {{(pid=103546) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 03:47:23 user nova-compute[103546]: DEBUG nova.network.neutron [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Successfully updated port: b0f609b8-eb49-4c19-968c-99c95c38b857 {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 03:47:23 user nova-compute[103546]: INFO nova.virt.block_device [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Booting with volume 4391e54b-de96-4437-a37c-077312643d75 at /dev/vdb
Nov 16 03:47:23 user nova-compute[103546]: DEBUG nova.compute.manager [req-66d7b53c-29ed-486e-a28f-58a57782a1dc req-7eda6c92-2820-46fd-81f9-65a72589b62b service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received event network-changed-916a3fe8-09df-42a1-9ac0-b81153ed55a1 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:47:23 user nova-compute[103546]: DEBUG nova.compute.manager [req-66d7b53c-29ed-486e-a28f-58a57782a1dc req-7eda6c92-2820-46fd-81f9-65a72589b62b service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Refreshing instance network info cache due to event network-changed-916a3fe8-09df-42a1-9ac0-b81153ed55a1. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:47:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-66d7b53c-29ed-486e-a28f-58a57782a1dc req-7eda6c92-2820-46fd-81f9-65a72589b62b service nova] Acquiring lock "refresh_cache-71059a8d-4e89-472c-9463-b38aa8063e33" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:47:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-66d7b53c-29ed-486e-a28f-58a57782a1dc req-7eda6c92-2820-46fd-81f9-65a72589b62b service nova] Acquired lock "refresh_cache-71059a8d-4e89-472c-9463-b38aa8063e33" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:47:23 user nova-compute[103546]: DEBUG nova.network.neutron [req-66d7b53c-29ed-486e-a28f-58a57782a1dc req-7eda6c92-2820-46fd-81f9-65a72589b62b service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Refreshing network info cache for port 916a3fe8-09df-42a1-9ac0-b81153ed55a1 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:47:24 user nova-compute[103546]: DEBUG os_brick.utils [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:47:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:24 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3920adb-b9e4-4769-b854-42c92661a64e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af5c39b14ece\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:24 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6c3d46-84e4-412d-92f0-83c77134d664]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:24 user nova-compute[103546]: DEBUG nova.network.neutron [req-66d7b53c-29ed-486e-a28f-58a57782a1dc req-7eda6c92-2820-46fd-81f9-65a72589b62b service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 03:47:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:24 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25635e2-43ce-4ebd-80e3-01b4c2fa252b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:24 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[55560494-25e7-4644-9887-9a6482eecfaa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Running cmd (subprocess): nvme version {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] 'nvme version' failed. Not Retrying. {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:47:24 user nova-compute[103546]: DEBUG nova.network.neutron [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Successfully updated port: 2159d4b9-42e0-48d5-bfdf-178ee853063c {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 03:47:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.nvmeof [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] nvme not present on system {{(pid=103546) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 03:47:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:47:24 user nova-compute[103546]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 03:47:24 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c05107a-39c4-41b1-9e17-70b32285ecff]: (4, '') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=103546) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 03:47:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 03:47:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] LIGHTOS: no hostnqn found. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 03:47:24 user nova-compute[103546]: DEBUG os_brick.utils [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af5c39b14ece', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:47:24 user nova-compute[103546]: DEBUG nova.virt.block_device [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Updating existing volume attachment record: a5d11ad0-3ce9-4866-901c-4e4be90ca8c8 {{(pid=103546) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 03:47:24 user nova-compute[103546]: DEBUG nova.network.neutron [req-66d7b53c-29ed-486e-a28f-58a57782a1dc req-7eda6c92-2820-46fd-81f9-65a72589b62b service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:47:24 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-66d7b53c-29ed-486e-a28f-58a57782a1dc req-7eda6c92-2820-46fd-81f9-65a72589b62b service nova] Releasing lock "refresh_cache-71059a8d-4e89-472c-9463-b38aa8063e33" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:47:24 user nova-compute[103546]: DEBUG nova.network.neutron [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Successfully updated port: fc03966b-fcbc-4ed7-8ffb-2270a55b4e28 {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 03:47:24 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Acquiring lock "refresh_cache-71059a8d-4e89-472c-9463-b38aa8063e33" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:47:24 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Acquired lock "refresh_cache-71059a8d-4e89-472c-9463-b38aa8063e33" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:47:24 user nova-compute[103546]: DEBUG nova.network.neutron [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 03:47:24 user nova-compute[103546]: DEBUG nova.network.neutron [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 03:47:24 user nova-compute[103546]: DEBUG nova.network.neutron [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Successfully updated port: cf751a83-e099-48a1-9219-fb781500b02c {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 03:47:24 user nova-compute[103546]: DEBUG nova.compute.manager [req-c6672615-ea50-4454-8550-ae33b8135ba3 req-a79fcacb-c692-4fc4-bdb5-044ec5b34643 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received event network-changed-51e087e4-ff6b-49a8-8190-cfc243436d35 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:47:24 user nova-compute[103546]: DEBUG nova.compute.manager [req-c6672615-ea50-4454-8550-ae33b8135ba3 req-a79fcacb-c692-4fc4-bdb5-044ec5b34643 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Refreshing instance network info cache due to event network-changed-51e087e4-ff6b-49a8-8190-cfc243436d35. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:47:24 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-c6672615-ea50-4454-8550-ae33b8135ba3 req-a79fcacb-c692-4fc4-bdb5-044ec5b34643 service nova] Acquiring lock "refresh_cache-71059a8d-4e89-472c-9463-b38aa8063e33" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:47:25 user nova-compute[103546]: DEBUG nova.network.neutron [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Successfully updated port: 96e41ba8-e2bd-48d3-a8e0-94c5f76d618a {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 03:47:26 user nova-compute[103546]: DEBUG nova.compute.manager [req-94688dae-8ca8-4652-9c4c-7e897bed643d req-93e36204-16fb-4955-97d8-0a6aecdc271e service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received event network-changed-2159d4b9-42e0-48d5-bfdf-178ee853063c {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:47:26 user nova-compute[103546]: DEBUG nova.compute.manager [req-94688dae-8ca8-4652-9c4c-7e897bed643d req-93e36204-16fb-4955-97d8-0a6aecdc271e service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Refreshing instance network info cache due to event network-changed-2159d4b9-42e0-48d5-bfdf-178ee853063c. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:47:26 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-94688dae-8ca8-4652-9c4c-7e897bed643d req-93e36204-16fb-4955-97d8-0a6aecdc271e service nova] Acquiring lock "refresh_cache-2cb84f00-0601-4199-ba6e-f09a27add736" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:47:26 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-94688dae-8ca8-4652-9c4c-7e897bed643d req-93e36204-16fb-4955-97d8-0a6aecdc271e service nova] Acquired lock "refresh_cache-2cb84f00-0601-4199-ba6e-f09a27add736" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:47:26 user nova-compute[103546]: DEBUG nova.network.neutron [req-94688dae-8ca8-4652-9c4c-7e897bed643d req-93e36204-16fb-4955-97d8-0a6aecdc271e service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Refreshing network info cache for port 2159d4b9-42e0-48d5-bfdf-178ee853063c {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:47:26 user nova-compute[103546]: DEBUG nova.network.neutron [req-94688dae-8ca8-4652-9c4c-7e897bed643d req-93e36204-16fb-4955-97d8-0a6aecdc271e service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 03:47:26 user nova-compute[103546]: DEBUG nova.network.neutron [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Successfully updated port: 1b75ba8c-049f-404a-aa82-0323bf51191c {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 03:47:26 user nova-compute[103546]: DEBUG nova.network.neutron [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Updating instance_info_cache with network_info: [{"id": "76b69715-356f-496a-85a3-f5bde976e201", "address": "fa:16:3e:72:5a:35", "network": {"id": "f84b2b6b-c73a-41d8-a9bb-3e73bb607a42", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1721792603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76b69715-35", "ovs_interfaceid": "76b69715-356f-496a-85a3-f5bde976e201", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "21653257-8a66-44f1-b806-2fae4641e1d2", "address": "fa:16:3e:91:a8:b5", "network": {"id": "4b071e67-eb71-49f5-a24f-cada83cca606", "bridge": "br-int", "label": "tempest-device-tagging-net1-1064540428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21653257-8a", "ovs_interfaceid": "21653257-8a66-44f1-b806-2fae4641e1d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "916a3fe8-09df-42a1-9ac0-b81153ed55a1", "address": "fa:16:3e:00:b7:5f", "network": {"id": "4b071e67-eb71-49f5-a24f-cada83cca606", "bridge": "br-int", "label": "tempest-device-tagging-net1-1064540428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap916a3fe8-09", "ovs_interfaceid": "916a3fe8-09df-42a1-9ac0-b81153ed55a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1fb75f05-a4ef-45d5-9eb4-5e8428997947", "address": "fa:16:3e:e6:68:04", "network": {"id": "4b071e67-eb71-49f5-a24f-cada83cca606", "bridge": "br-int", "label": "tempest-device-tagging-net1-1064540428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fb75f05-a4", "ovs_interfaceid": "1fb75f05-a4ef-45d5-9eb4-5e8428997947", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "51e087e4-ff6b-49a8-8190-cfc243436d35", "address": "fa:16:3e:3f:53:f1", "network": {"id": "4b071e67-eb71-49f5-a24f-cada83cca606", "bridge": "br-int", "label": "tempest-device-tagging-net1-1064540428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51e087e4-ff", "ovs_interfaceid": "51e087e4-ff6b-49a8-8190-cfc243436d35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b0f609b8-eb49-4c19-968c-99c95c38b857", "address": "fa:16:3e:dc:33:a5", "network": {"id": "f9af5267-5cc4-44b4-9226-2da63e754907", "bridge": "br-int", "label": "tempest-device-tagging-net2-640329577", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0f609b8-eb", "ovs_interfaceid": "b0f609b8-eb49-4c19-968c-99c95c38b857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fc03966b-fcbc-4ed7-8ffb-2270a55b4e28", "address": "fa:16:3e:75:5a:4b", "network": {"id": "f9af5267-5cc4-44b4-9226-2da63e754907", "bridge": "br-int", "label": "tempest-device-tagging-net2-640329577", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc03966b-fc", "ovs_interfaceid": "fc03966b-fcbc-4ed7-8ffb-2270a55b4e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:47:26 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Releasing lock "refresh_cache-71059a8d-4e89-472c-9463-b38aa8063e33" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:47:26 user nova-compute[103546]: DEBUG nova.compute.manager [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Instance network_info: |[{"id": "76b69715-356f-496a-85a3-f5bde976e201", "address": "fa:16:3e:72:5a:35", "network": {"id": "f84b2b6b-c73a-41d8-a9bb-3e73bb607a42", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1721792603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76b69715-35", "ovs_interfaceid": "76b69715-356f-496a-85a3-f5bde976e201", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "21653257-8a66-44f1-b806-2fae4641e1d2", "address": "fa:16:3e:91:a8:b5", "network": {"id": "4b071e67-eb71-49f5-a24f-cada83cca606", "bridge": "br-int", "label": "tempest-device-tagging-net1-1064540428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21653257-8a", "ovs_interfaceid": "21653257-8a66-44f1-b806-2fae4641e1d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "916a3fe8-09df-42a1-9ac0-b81153ed55a1", "address": "fa:16:3e:00:b7:5f", "network": {"id": "4b071e67-eb71-49f5-a24f-cada83cca606", "bridge": "br-int", "label": "tempest-device-tagging-net1-1064540428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap916a3fe8-09", "ovs_interfaceid": "916a3fe8-09df-42a1-9ac0-b81153ed55a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1fb75f05-a4ef-45d5-9eb4-5e8428997947", "address": "fa:16:3e:e6:68:04", "network": {"id": "4b071e67-eb71-49f5-a24f-cada83cca606", "bridge": "br-int", "label": "tempest-device-tagging-net1-1064540428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fb75f05-a4", "ovs_interfaceid": "1fb75f05-a4ef-45d5-9eb4-5e8428997947", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "51e087e4-ff6b-49a8-8190-cfc243436d35", "address": "fa:16:3e:3f:53:f1", "network": {"id": "4b071e67-eb71-49f5-a24f-cada83cca606", "bridge": "br-int", "label": "tempest-device-tagging-net1-1064540428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51e087e4-ff", "ovs_interfaceid": "51e087e4-ff6b-49a8-8190-cfc243436d35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b0f609b8-eb49-4c19-968c-99c95c38b857", "address": "fa:16:3e:dc:33:a5", "network": {"id": "f9af5267-5cc4-44b4-9226-2da63e754907", "bridge": "br-int", "label": "tempest-device-tagging-net2-640329577", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0f609b8-eb", "ovs_interfaceid": "b0f609b8-eb49-4c19-968c-99c95c38b857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fc03966b-fcbc-4ed7-8ffb-2270a55b4e28", "address": "fa:16:3e:75:5a:4b", "network": {"id": "f9af5267-5cc4-44b4-9226-2da63e754907", "bridge": "br-int", "label": "tempest-device-tagging-net2-640329577", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc03966b-fc", "ovs_interfaceid": "fc03966b-fcbc-4ed7-8ffb-2270a55b4e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 03:47:26 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-c6672615-ea50-4454-8550-ae33b8135ba3 req-a79fcacb-c692-4fc4-bdb5-044ec5b34643 service nova] Acquired lock "refresh_cache-71059a8d-4e89-472c-9463-b38aa8063e33" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:47:26 user nova-compute[103546]: DEBUG nova.network.neutron [req-c6672615-ea50-4454-8550-ae33b8135ba3 req-a79fcacb-c692-4fc4-bdb5-044ec5b34643 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Refreshing network info cache for port 51e087e4-ff6b-49a8-8190-cfc243436d35 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:47:26 user nova-compute[103546]: DEBUG nova.network.neutron [req-94688dae-8ca8-4652-9c4c-7e897bed643d req-93e36204-16fb-4955-97d8-0a6aecdc271e service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:47:26 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-94688dae-8ca8-4652-9c4c-7e897bed643d req-93e36204-16fb-4955-97d8-0a6aecdc271e service nova] Releasing lock "refresh_cache-2cb84f00-0601-4199-ba6e-f09a27add736" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:47:26 user nova-compute[103546]: DEBUG nova.compute.manager [req-94688dae-8ca8-4652-9c4c-7e897bed643d req-93e36204-16fb-4955-97d8-0a6aecdc271e service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received event network-changed-cf751a83-e099-48a1-9219-fb781500b02c {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:47:26 user nova-compute[103546]: DEBUG nova.compute.manager [req-94688dae-8ca8-4652-9c4c-7e897bed643d req-93e36204-16fb-4955-97d8-0a6aecdc271e service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Refreshing instance network info cache due to event network-changed-cf751a83-e099-48a1-9219-fb781500b02c. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:47:26 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-94688dae-8ca8-4652-9c4c-7e897bed643d req-93e36204-16fb-4955-97d8-0a6aecdc271e service nova] Acquiring lock "refresh_cache-2cb84f00-0601-4199-ba6e-f09a27add736" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:47:26 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-94688dae-8ca8-4652-9c4c-7e897bed643d req-93e36204-16fb-4955-97d8-0a6aecdc271e service nova] Acquired lock "refresh_cache-2cb84f00-0601-4199-ba6e-f09a27add736" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:47:26 user nova-compute[103546]: DEBUG nova.network.neutron [req-94688dae-8ca8-4652-9c4c-7e897bed643d req-93e36204-16fb-4955-97d8-0a6aecdc271e service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Refreshing network info cache for port cf751a83-e099-48a1-9219-fb781500b02c {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:47:26 user nova-compute[103546]: DEBUG nova.network.neutron [req-94688dae-8ca8-4652-9c4c-7e897bed643d req-93e36204-16fb-4955-97d8-0a6aecdc271e service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 03:47:26 user nova-compute[103546]: DEBUG nova.network.neutron [req-94688dae-8ca8-4652-9c4c-7e897bed643d req-93e36204-16fb-4955-97d8-0a6aecdc271e service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:47:26 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-94688dae-8ca8-4652-9c4c-7e897bed643d req-93e36204-16fb-4955-97d8-0a6aecdc271e service nova] Releasing lock "refresh_cache-2cb84f00-0601-4199-ba6e-f09a27add736" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:47:26 user nova-compute[103546]: DEBUG nova.compute.manager [req-94688dae-8ca8-4652-9c4c-7e897bed643d req-93e36204-16fb-4955-97d8-0a6aecdc271e service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received event network-changed-96e41ba8-e2bd-48d3-a8e0-94c5f76d618a {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:47:26 user nova-compute[103546]: DEBUG nova.compute.manager [req-94688dae-8ca8-4652-9c4c-7e897bed643d req-93e36204-16fb-4955-97d8-0a6aecdc271e service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Refreshing instance network info cache due to event network-changed-96e41ba8-e2bd-48d3-a8e0-94c5f76d618a. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:47:26 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-94688dae-8ca8-4652-9c4c-7e897bed643d req-93e36204-16fb-4955-97d8-0a6aecdc271e service nova] Acquiring lock "refresh_cache-2cb84f00-0601-4199-ba6e-f09a27add736" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:47:26 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-94688dae-8ca8-4652-9c4c-7e897bed643d req-93e36204-16fb-4955-97d8-0a6aecdc271e service nova] Acquired lock "refresh_cache-2cb84f00-0601-4199-ba6e-f09a27add736" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:47:26 user nova-compute[103546]: DEBUG nova.network.neutron [req-94688dae-8ca8-4652-9c4c-7e897bed643d req-93e36204-16fb-4955-97d8-0a6aecdc271e service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Refreshing network info cache for port 96e41ba8-e2bd-48d3-a8e0-94c5f76d618a {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:47:26 user nova-compute[103546]: DEBUG nova.network.neutron [req-c6672615-ea50-4454-8550-ae33b8135ba3 req-a79fcacb-c692-4fc4-bdb5-044ec5b34643 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Updated VIF entry in instance network info cache for port 51e087e4-ff6b-49a8-8190-cfc243436d35. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 03:47:26 user nova-compute[103546]: DEBUG nova.network.neutron [req-c6672615-ea50-4454-8550-ae33b8135ba3 req-a79fcacb-c692-4fc4-bdb5-044ec5b34643 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Updating instance_info_cache with network_info: [{"id": "76b69715-356f-496a-85a3-f5bde976e201", "address": "fa:16:3e:72:5a:35", "network": {"id": "f84b2b6b-c73a-41d8-a9bb-3e73bb607a42", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1721792603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76b69715-35", "ovs_interfaceid": "76b69715-356f-496a-85a3-f5bde976e201", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "21653257-8a66-44f1-b806-2fae4641e1d2", "address": "fa:16:3e:91:a8:b5", "network": {"id": "4b071e67-eb71-49f5-a24f-cada83cca606", "bridge": "br-int", "label": "tempest-device-tagging-net1-1064540428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21653257-8a", "ovs_interfaceid": "21653257-8a66-44f1-b806-2fae4641e1d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "916a3fe8-09df-42a1-9ac0-b81153ed55a1", "address": "fa:16:3e:00:b7:5f", "network": {"id": "4b071e67-eb71-49f5-a24f-cada83cca606", "bridge": "br-int", "label": "tempest-device-tagging-net1-1064540428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap916a3fe8-09", "ovs_interfaceid": "916a3fe8-09df-42a1-9ac0-b81153ed55a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1fb75f05-a4ef-45d5-9eb4-5e8428997947", "address": "fa:16:3e:e6:68:04", "network": {"id": "4b071e67-eb71-49f5-a24f-cada83cca606", "bridge": "br-int", "label": "tempest-device-tagging-net1-1064540428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fb75f05-a4", "ovs_interfaceid": "1fb75f05-a4ef-45d5-9eb4-5e8428997947", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "51e087e4-ff6b-49a8-8190-cfc243436d35", "address": "fa:16:3e:3f:53:f1", "network": {"id": "4b071e67-eb71-49f5-a24f-cada83cca606", "bridge": "br-int", "label": "tempest-device-tagging-net1-1064540428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51e087e4-ff", "ovs_interfaceid": "51e087e4-ff6b-49a8-8190-cfc243436d35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b0f609b8-eb49-4c19-968c-99c95c38b857", "address": "fa:16:3e:dc:33:a5", "network": {"id": "f9af5267-5cc4-44b4-9226-2da63e754907", "bridge": "br-int", "label": "tempest-device-tagging-net2-640329577", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0f609b8-eb", "ovs_interfaceid": "b0f609b8-eb49-4c19-968c-99c95c38b857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fc03966b-fcbc-4ed7-8ffb-2270a55b4e28", "address": "fa:16:3e:75:5a:4b", "network": {"id": "f9af5267-5cc4-44b4-9226-2da63e754907", "bridge": "br-int", "label": "tempest-device-tagging-net2-640329577", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc03966b-fc", "ovs_interfaceid": "fc03966b-fcbc-4ed7-8ffb-2270a55b4e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:47:26 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-c6672615-ea50-4454-8550-ae33b8135ba3 req-a79fcacb-c692-4fc4-bdb5-044ec5b34643 service nova] Releasing lock "refresh_cache-71059a8d-4e89-472c-9463-b38aa8063e33" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:47:26 user nova-compute[103546]: DEBUG nova.compute.manager [req-c6672615-ea50-4454-8550-ae33b8135ba3 req-a79fcacb-c692-4fc4-bdb5-044ec5b34643 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received event network-changed-b0f609b8-eb49-4c19-968c-99c95c38b857 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:47:26 user nova-compute[103546]: DEBUG nova.compute.manager [req-c6672615-ea50-4454-8550-ae33b8135ba3 req-a79fcacb-c692-4fc4-bdb5-044ec5b34643 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Refreshing instance network info cache due to event network-changed-b0f609b8-eb49-4c19-968c-99c95c38b857. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:47:26 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-c6672615-ea50-4454-8550-ae33b8135ba3 req-a79fcacb-c692-4fc4-bdb5-044ec5b34643 service nova] Acquiring lock "refresh_cache-71059a8d-4e89-472c-9463-b38aa8063e33" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:47:26 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-c6672615-ea50-4454-8550-ae33b8135ba3 req-a79fcacb-c692-4fc4-bdb5-044ec5b34643 service nova] Acquired lock "refresh_cache-71059a8d-4e89-472c-9463-b38aa8063e33" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:47:26 user nova-compute[103546]: DEBUG nova.network.neutron [req-c6672615-ea50-4454-8550-ae33b8135ba3 req-a79fcacb-c692-4fc4-bdb5-044ec5b34643 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Refreshing network info cache for port b0f609b8-eb49-4c19-968c-99c95c38b857 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:47:26 user nova-compute[103546]: DEBUG nova.network.neutron [req-94688dae-8ca8-4652-9c4c-7e897bed643d req-93e36204-16fb-4955-97d8-0a6aecdc271e service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 03:47:27 user nova-compute[103546]: DEBUG nova.network.neutron [req-94688dae-8ca8-4652-9c4c-7e897bed643d req-93e36204-16fb-4955-97d8-0a6aecdc271e service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:47:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-94688dae-8ca8-4652-9c4c-7e897bed643d req-93e36204-16fb-4955-97d8-0a6aecdc271e service nova] Releasing lock "refresh_cache-2cb84f00-0601-4199-ba6e-f09a27add736" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:47:27 user nova-compute[103546]: DEBUG nova.network.neutron [req-c6672615-ea50-4454-8550-ae33b8135ba3 req-a79fcacb-c692-4fc4-bdb5-044ec5b34643 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Updated VIF entry in instance network info cache for port b0f609b8-eb49-4c19-968c-99c95c38b857. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 03:47:27 user nova-compute[103546]: DEBUG nova.network.neutron [req-c6672615-ea50-4454-8550-ae33b8135ba3 req-a79fcacb-c692-4fc4-bdb5-044ec5b34643 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Updating instance_info_cache with network_info: [{"id": "76b69715-356f-496a-85a3-f5bde976e201", "address": "fa:16:3e:72:5a:35", "network": {"id": "f84b2b6b-c73a-41d8-a9bb-3e73bb607a42", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1721792603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76b69715-35", "ovs_interfaceid": "76b69715-356f-496a-85a3-f5bde976e201", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "21653257-8a66-44f1-b806-2fae4641e1d2", "address": "fa:16:3e:91:a8:b5", "network": {"id": "4b071e67-eb71-49f5-a24f-cada83cca606", "bridge": "br-int", "label": "tempest-device-tagging-net1-1064540428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21653257-8a", "ovs_interfaceid": "21653257-8a66-44f1-b806-2fae4641e1d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "916a3fe8-09df-42a1-9ac0-b81153ed55a1", "address": "fa:16:3e:00:b7:5f", "network": {"id": "4b071e67-eb71-49f5-a24f-cada83cca606", "bridge": "br-int", "label": "tempest-device-tagging-net1-1064540428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap916a3fe8-09", "ovs_interfaceid": "916a3fe8-09df-42a1-9ac0-b81153ed55a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1fb75f05-a4ef-45d5-9eb4-5e8428997947", "address": "fa:16:3e:e6:68:04", "network": {"id": "4b071e67-eb71-49f5-a24f-cada83cca606", "bridge": "br-int", "label": "tempest-device-tagging-net1-1064540428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fb75f05-a4", "ovs_interfaceid": "1fb75f05-a4ef-45d5-9eb4-5e8428997947", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "51e087e4-ff6b-49a8-8190-cfc243436d35", "address": "fa:16:3e:3f:53:f1", "network": {"id": "4b071e67-eb71-49f5-a24f-cada83cca606", "bridge": "br-int", "label": "tempest-device-tagging-net1-1064540428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51e087e4-ff", "ovs_interfaceid": "51e087e4-ff6b-49a8-8190-cfc243436d35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b0f609b8-eb49-4c19-968c-99c95c38b857", "address": "fa:16:3e:dc:33:a5", "network": {"id": "f9af5267-5cc4-44b4-9226-2da63e754907", "bridge": "br-int", "label": "tempest-device-tagging-net2-640329577", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0f609b8-eb", "ovs_interfaceid": "b0f609b8-eb49-4c19-968c-99c95c38b857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fc03966b-fcbc-4ed7-8ffb-2270a55b4e28", "address": "fa:16:3e:75:5a:4b", "network": {"id": "f9af5267-5cc4-44b4-9226-2da63e754907", "bridge": "br-int", "label": "tempest-device-tagging-net2-640329577", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc03966b-fc", "ovs_interfaceid": "fc03966b-fcbc-4ed7-8ffb-2270a55b4e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:47:27 user nova-compute[103546]: DEBUG nova.network.neutron [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Successfully updated port: c2216378-faa5-4bdc-8706-0be8df7807c0 {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 03:47:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-c6672615-ea50-4454-8550-ae33b8135ba3 req-a79fcacb-c692-4fc4-bdb5-044ec5b34643 service nova] Releasing lock "refresh_cache-71059a8d-4e89-472c-9463-b38aa8063e33" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:47:27 user nova-compute[103546]: DEBUG nova.compute.manager [req-c6672615-ea50-4454-8550-ae33b8135ba3 req-a79fcacb-c692-4fc4-bdb5-044ec5b34643 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received event network-changed-fc03966b-fcbc-4ed7-8ffb-2270a55b4e28 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:47:27 user nova-compute[103546]: DEBUG nova.compute.manager [req-c6672615-ea50-4454-8550-ae33b8135ba3 req-a79fcacb-c692-4fc4-bdb5-044ec5b34643 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Refreshing instance network info cache due to event network-changed-fc03966b-fcbc-4ed7-8ffb-2270a55b4e28. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:47:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-c6672615-ea50-4454-8550-ae33b8135ba3 req-a79fcacb-c692-4fc4-bdb5-044ec5b34643 service nova] Acquiring lock "refresh_cache-71059a8d-4e89-472c-9463-b38aa8063e33" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:47:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-c6672615-ea50-4454-8550-ae33b8135ba3 req-a79fcacb-c692-4fc4-bdb5-044ec5b34643 service nova] Acquired lock "refresh_cache-71059a8d-4e89-472c-9463-b38aa8063e33" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:47:27 user nova-compute[103546]: DEBUG nova.network.neutron [req-c6672615-ea50-4454-8550-ae33b8135ba3 req-a79fcacb-c692-4fc4-bdb5-044ec5b34643 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Refreshing network info cache for port fc03966b-fcbc-4ed7-8ffb-2270a55b4e28 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:47:27 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:27 user nova-compute[103546]: DEBUG nova.network.neutron [req-c6672615-ea50-4454-8550-ae33b8135ba3 req-a79fcacb-c692-4fc4-bdb5-044ec5b34643 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Updated VIF entry in instance network info cache for port fc03966b-fcbc-4ed7-8ffb-2270a55b4e28. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 03:47:27 user nova-compute[103546]: DEBUG nova.network.neutron [req-c6672615-ea50-4454-8550-ae33b8135ba3 req-a79fcacb-c692-4fc4-bdb5-044ec5b34643 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Updating instance_info_cache with network_info: [{"id": "76b69715-356f-496a-85a3-f5bde976e201", "address": "fa:16:3e:72:5a:35", "network": {"id": "f84b2b6b-c73a-41d8-a9bb-3e73bb607a42", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1721792603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76b69715-35", "ovs_interfaceid": "76b69715-356f-496a-85a3-f5bde976e201", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "21653257-8a66-44f1-b806-2fae4641e1d2", "address": "fa:16:3e:91:a8:b5", "network": {"id": "4b071e67-eb71-49f5-a24f-cada83cca606", "bridge": "br-int", "label": "tempest-device-tagging-net1-1064540428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21653257-8a", "ovs_interfaceid": "21653257-8a66-44f1-b806-2fae4641e1d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "916a3fe8-09df-42a1-9ac0-b81153ed55a1", "address": "fa:16:3e:00:b7:5f", "network": {"id": "4b071e67-eb71-49f5-a24f-cada83cca606", "bridge": "br-int", "label": "tempest-device-tagging-net1-1064540428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap916a3fe8-09", "ovs_interfaceid": "916a3fe8-09df-42a1-9ac0-b81153ed55a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1fb75f05-a4ef-45d5-9eb4-5e8428997947", "address": "fa:16:3e:e6:68:04", "network": {"id": "4b071e67-eb71-49f5-a24f-cada83cca606", "bridge": "br-int", "label": "tempest-device-tagging-net1-1064540428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fb75f05-a4", "ovs_interfaceid": "1fb75f05-a4ef-45d5-9eb4-5e8428997947", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "51e087e4-ff6b-49a8-8190-cfc243436d35", "address": "fa:16:3e:3f:53:f1", "network": {"id": "4b071e67-eb71-49f5-a24f-cada83cca606", "bridge": "br-int", "label": "tempest-device-tagging-net1-1064540428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51e087e4-ff", "ovs_interfaceid": "51e087e4-ff6b-49a8-8190-cfc243436d35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b0f609b8-eb49-4c19-968c-99c95c38b857", "address": "fa:16:3e:dc:33:a5", "network": {"id": "f9af5267-5cc4-44b4-9226-2da63e754907", "bridge": "br-int", "label": "tempest-device-tagging-net2-640329577", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0f609b8-eb", "ovs_interfaceid": "b0f609b8-eb49-4c19-968c-99c95c38b857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fc03966b-fcbc-4ed7-8ffb-2270a55b4e28", "address": "fa:16:3e:75:5a:4b", "network": {"id": "f9af5267-5cc4-44b4-9226-2da63e754907", "bridge": "br-int", "label": "tempest-device-tagging-net2-640329577", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc03966b-fc", "ovs_interfaceid": "fc03966b-fcbc-4ed7-8ffb-2270a55b4e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:47:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-c6672615-ea50-4454-8550-ae33b8135ba3 req-a79fcacb-c692-4fc4-bdb5-044ec5b34643 service nova] Releasing lock "refresh_cache-71059a8d-4e89-472c-9463-b38aa8063e33" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:47:28 user nova-compute[103546]: DEBUG nova.compute.manager [req-6c9d15cd-7b95-40ff-8dc3-65c41503a8bc req-37685034-35c9-496a-bef9-e0107b5b0626 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received event network-changed-1b75ba8c-049f-404a-aa82-0323bf51191c {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:47:28 user nova-compute[103546]: DEBUG nova.compute.manager [req-6c9d15cd-7b95-40ff-8dc3-65c41503a8bc req-37685034-35c9-496a-bef9-e0107b5b0626 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Refreshing instance network info cache due to event network-changed-1b75ba8c-049f-404a-aa82-0323bf51191c. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:47:28 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6c9d15cd-7b95-40ff-8dc3-65c41503a8bc req-37685034-35c9-496a-bef9-e0107b5b0626 service nova] Acquiring lock "refresh_cache-2cb84f00-0601-4199-ba6e-f09a27add736" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:47:28 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6c9d15cd-7b95-40ff-8dc3-65c41503a8bc req-37685034-35c9-496a-bef9-e0107b5b0626 service nova] Acquired lock "refresh_cache-2cb84f00-0601-4199-ba6e-f09a27add736" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:47:28 user nova-compute[103546]: DEBUG nova.network.neutron [req-6c9d15cd-7b95-40ff-8dc3-65c41503a8bc req-37685034-35c9-496a-bef9-e0107b5b0626 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Refreshing network info cache for port 1b75ba8c-049f-404a-aa82-0323bf51191c {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:47:28 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:28 user nova-compute[103546]: DEBUG nova.network.neutron [req-6c9d15cd-7b95-40ff-8dc3-65c41503a8bc req-37685034-35c9-496a-bef9-e0107b5b0626 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 03:47:28 user nova-compute[103546]: DEBUG nova.network.neutron [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Successfully updated port: 75b2ff49-49cc-4b86-bdc6-6f9f76c06505 {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 03:47:28 user nova-compute[103546]: DEBUG nova.network.neutron [req-6c9d15cd-7b95-40ff-8dc3-65c41503a8bc req-37685034-35c9-496a-bef9-e0107b5b0626 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:47:28 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6c9d15cd-7b95-40ff-8dc3-65c41503a8bc req-37685034-35c9-496a-bef9-e0107b5b0626 service nova] Releasing lock "refresh_cache-2cb84f00-0601-4199-ba6e-f09a27add736" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:47:28 user nova-compute[103546]: DEBUG nova.compute.manager [req-6c9d15cd-7b95-40ff-8dc3-65c41503a8bc req-37685034-35c9-496a-bef9-e0107b5b0626 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received event network-changed-c2216378-faa5-4bdc-8706-0be8df7807c0 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:47:28 user nova-compute[103546]: DEBUG nova.compute.manager [req-6c9d15cd-7b95-40ff-8dc3-65c41503a8bc req-37685034-35c9-496a-bef9-e0107b5b0626 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Refreshing instance network info cache due to event network-changed-c2216378-faa5-4bdc-8706-0be8df7807c0. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:47:28 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6c9d15cd-7b95-40ff-8dc3-65c41503a8bc req-37685034-35c9-496a-bef9-e0107b5b0626 service nova] Acquiring lock "refresh_cache-2cb84f00-0601-4199-ba6e-f09a27add736" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:47:28 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6c9d15cd-7b95-40ff-8dc3-65c41503a8bc req-37685034-35c9-496a-bef9-e0107b5b0626 service nova] Acquired lock "refresh_cache-2cb84f00-0601-4199-ba6e-f09a27add736" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:47:28 user nova-compute[103546]: DEBUG nova.network.neutron [req-6c9d15cd-7b95-40ff-8dc3-65c41503a8bc req-37685034-35c9-496a-bef9-e0107b5b0626 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Refreshing network info cache for port c2216378-faa5-4bdc-8706-0be8df7807c0 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:47:28 user nova-compute[103546]: DEBUG nova.network.neutron [req-6c9d15cd-7b95-40ff-8dc3-65c41503a8bc req-37685034-35c9-496a-bef9-e0107b5b0626 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 03:47:28 user nova-compute[103546]: DEBUG nova.network.neutron [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Successfully updated port: 87ab6a10-d50c-460e-b891-ce6439614185 {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 03:47:28 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Acquiring lock "refresh_cache-2cb84f00-0601-4199-ba6e-f09a27add736" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:47:28 user nova-compute[103546]: DEBUG nova.network.neutron [req-6c9d15cd-7b95-40ff-8dc3-65c41503a8bc req-37685034-35c9-496a-bef9-e0107b5b0626 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:47:28 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6c9d15cd-7b95-40ff-8dc3-65c41503a8bc req-37685034-35c9-496a-bef9-e0107b5b0626 service nova] Releasing lock "refresh_cache-2cb84f00-0601-4199-ba6e-f09a27add736" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:47:28 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Acquired lock "refresh_cache-2cb84f00-0601-4199-ba6e-f09a27add736" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:47:28 user nova-compute[103546]: DEBUG nova.network.neutron [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 03:47:29 user nova-compute[103546]: DEBUG nova.network.neutron [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 03:47:29 user nova-compute[103546]: INFO nova.virt.block_device [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Booting with volume cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 at /dev/vdb
Nov 16 03:47:29 user nova-compute[103546]: DEBUG os_brick.utils [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:47:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:29 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79f0bf0-ca3b-4ab3-abf3-9e6b95c7bd80]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af5c39b14ece\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:29 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[847725fa-19a2-4cf0-9122-7809b36945dd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:29 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb53b358-d215-4c4d-8525-7dbd3298488e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:29 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5066c7b3-f00e-404d-8f2a-05ab2d32b940]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Running cmd (subprocess): nvme version {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] 'nvme version' failed. Not Retrying. {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:47:29 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.nvmeof [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] nvme not present on system {{(pid=103546) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 03:47:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:47:29 user nova-compute[103546]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 03:47:29 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[99dd594b-50d0-4fab-a342-20e6408653c7]: (4, '') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:29 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=103546) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 03:47:29 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 03:47:29 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] LIGHTOS: no hostnqn found. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 03:47:29 user nova-compute[103546]: DEBUG os_brick.utils [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af5c39b14ece', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:47:29 user nova-compute[103546]: DEBUG nova.virt.block_device [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Updating existing volume attachment record: 9df5c485-b307-4431-a8a4-9f73ce9d9f8b {{(pid=103546) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 03:47:29 user nova-compute[103546]: INFO nova.virt.block_device [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Booting with volume 2056c0fd-acb4-436c-a1ae-f2e316b94d41 at /dev/vdc
Nov 16 03:47:29 user nova-compute[103546]: DEBUG os_brick.utils [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:47:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:29 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44eb746-da71-4c37-ab85-b57533faf71b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af5c39b14ece\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:29 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[065cc35b-90f1-47b0-9794-caed27c95140]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:29 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d0c1ea-539a-422a-89f4-27581978a4de]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:29 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f05e8ca-a8c0-47b0-9b52-5cf15649bf3f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Running cmd (subprocess): nvme version {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] 'nvme version' failed. Not Retrying. {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:47:29 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.nvmeof [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] nvme not present on system {{(pid=103546) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 03:47:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:47:29 user nova-compute[103546]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 03:47:29 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[55917b3b-30e7-43d8-ba42-6708baa75d0d]: (4, '') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:29 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=103546) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 03:47:29 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 03:47:29 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] LIGHTOS: no hostnqn found. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 03:47:29 user nova-compute[103546]: DEBUG os_brick.utils [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af5c39b14ece', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:47:29 user nova-compute[103546]: DEBUG nova.virt.block_device [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Updating existing volume attachment record: d11033ac-4d6a-4cee-aebb-0f4eeb4934e9 {{(pid=103546) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 03:47:30 user nova-compute[103546]: DEBUG nova.compute.manager [req-3ede3b16-6c9d-4fc6-b1ad-425f474f7844 req-0d9fb53e-afa0-4a4a-bab2-8e048bad8f62 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received event network-changed-75b2ff49-49cc-4b86-bdc6-6f9f76c06505 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:47:30 user nova-compute[103546]: DEBUG nova.compute.manager [req-3ede3b16-6c9d-4fc6-b1ad-425f474f7844 req-0d9fb53e-afa0-4a4a-bab2-8e048bad8f62 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Refreshing instance network info cache due to event network-changed-75b2ff49-49cc-4b86-bdc6-6f9f76c06505. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:47:30 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3ede3b16-6c9d-4fc6-b1ad-425f474f7844 req-0d9fb53e-afa0-4a4a-bab2-8e048bad8f62 service nova] Acquiring lock "refresh_cache-2cb84f00-0601-4199-ba6e-f09a27add736" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:47:30 user nova-compute[103546]: DEBUG nova.network.neutron [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Updating instance_info_cache with network_info: [{"id": "2159d4b9-42e0-48d5-bfdf-178ee853063c", "address": "fa:16:3e:5f:ff:36", "network": {"id": "a8bb0411-7c42-419f-9bc2-ea6219b732f8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1141379058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2159d4b9-42", "ovs_interfaceid": "2159d4b9-42e0-48d5-bfdf-178ee853063c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cf751a83-e099-48a1-9219-fb781500b02c", "address": "fa:16:3e:3b:05:73", "network": {"id": "049ff849-6358-448d-9530-ae2102396888", "bridge": "br-int", "label": "tempest-device-tagging-net1-926406277", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf751a83-e0", "ovs_interfaceid": "cf751a83-e099-48a1-9219-fb781500b02c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "96e41ba8-e2bd-48d3-a8e0-94c5f76d618a", "address": "fa:16:3e:e1:ce:8a", "network": {"id": "049ff849-6358-448d-9530-ae2102396888", "bridge": "br-int", "label": "tempest-device-tagging-net1-926406277", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96e41ba8-e2", "ovs_interfaceid": "96e41ba8-e2bd-48d3-a8e0-94c5f76d618a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1b75ba8c-049f-404a-aa82-0323bf51191c", "address": "fa:16:3e:51:e9:22", "network": {"id": "049ff849-6358-448d-9530-ae2102396888", "bridge": "br-int", "label": "tempest-device-tagging-net1-926406277", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b75ba8c-04", "ovs_interfaceid": "1b75ba8c-049f-404a-aa82-0323bf51191c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2216378-faa5-4bdc-8706-0be8df7807c0", "address": "fa:16:3e:aa:93:87", "network": {"id": "049ff849-6358-448d-9530-ae2102396888", "bridge": "br-int", "label": "tempest-device-tagging-net1-926406277", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2216378-fa", "ovs_interfaceid": "c2216378-faa5-4bdc-8706-0be8df7807c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "75b2ff49-49cc-4b86-bdc6-6f9f76c06505", "address": "fa:16:3e:95:e9:f8", "network": {"id": "4a2b26f4-65df-49c9-8832-77cb9c321787", "bridge": "br-int", "label": "tempest-device-tagging-net2-1336305364", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75b2ff49-49", "ovs_interfaceid": "75b2ff49-49cc-4b86-bdc6-6f9f76c06505", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "87ab6a10-d50c-460e-b891-ce6439614185", "address": "fa:16:3e:c4:5b:b6", "network": {"id": "4a2b26f4-65df-49c9-8832-77cb9c321787", "bridge": "br-int", "label": "tempest-device-tagging-net2-1336305364", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87ab6a10-d5", "ovs_interfaceid": "87ab6a10-d50c-460e-b891-ce6439614185", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:47:30 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Releasing lock "refresh_cache-2cb84f00-0601-4199-ba6e-f09a27add736" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:47:30 user nova-compute[103546]: DEBUG nova.compute.manager [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Instance network_info: |[{"id": "2159d4b9-42e0-48d5-bfdf-178ee853063c", "address": "fa:16:3e:5f:ff:36", "network": {"id": "a8bb0411-7c42-419f-9bc2-ea6219b732f8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1141379058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2159d4b9-42", "ovs_interfaceid": "2159d4b9-42e0-48d5-bfdf-178ee853063c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cf751a83-e099-48a1-9219-fb781500b02c", "address": "fa:16:3e:3b:05:73", "network": {"id": "049ff849-6358-448d-9530-ae2102396888", "bridge": "br-int", "label": "tempest-device-tagging-net1-926406277", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf751a83-e0", "ovs_interfaceid": "cf751a83-e099-48a1-9219-fb781500b02c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "96e41ba8-e2bd-48d3-a8e0-94c5f76d618a", "address": "fa:16:3e:e1:ce:8a", "network": {"id": "049ff849-6358-448d-9530-ae2102396888", "bridge": "br-int", "label": "tempest-device-tagging-net1-926406277", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96e41ba8-e2", "ovs_interfaceid": "96e41ba8-e2bd-48d3-a8e0-94c5f76d618a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1b75ba8c-049f-404a-aa82-0323bf51191c", "address": "fa:16:3e:51:e9:22", "network": {"id": "049ff849-6358-448d-9530-ae2102396888", "bridge": "br-int", "label": "tempest-device-tagging-net1-926406277", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b75ba8c-04", "ovs_interfaceid": "1b75ba8c-049f-404a-aa82-0323bf51191c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2216378-faa5-4bdc-8706-0be8df7807c0", "address": "fa:16:3e:aa:93:87", "network": {"id": "049ff849-6358-448d-9530-ae2102396888", "bridge": "br-int", "label": "tempest-device-tagging-net1-926406277", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2216378-fa", "ovs_interfaceid": "c2216378-faa5-4bdc-8706-0be8df7807c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "75b2ff49-49cc-4b86-bdc6-6f9f76c06505", "address": "fa:16:3e:95:e9:f8", "network": {"id": "4a2b26f4-65df-49c9-8832-77cb9c321787", "bridge": "br-int", "label": "tempest-device-tagging-net2-1336305364", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75b2ff49-49", "ovs_interfaceid": "75b2ff49-49cc-4b86-bdc6-6f9f76c06505", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "87ab6a10-d50c-460e-b891-ce6439614185", "address": "fa:16:3e:c4:5b:b6", "network": {"id": "4a2b26f4-65df-49c9-8832-77cb9c321787", "bridge": "br-int", "label": "tempest-device-tagging-net2-1336305364", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87ab6a10-d5", "ovs_interfaceid": "87ab6a10-d50c-460e-b891-ce6439614185", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 03:47:30 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3ede3b16-6c9d-4fc6-b1ad-425f474f7844 req-0d9fb53e-afa0-4a4a-bab2-8e048bad8f62 service nova] Acquired lock "refresh_cache-2cb84f00-0601-4199-ba6e-f09a27add736" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:47:30 user nova-compute[103546]: DEBUG nova.network.neutron [req-3ede3b16-6c9d-4fc6-b1ad-425f474f7844 req-0d9fb53e-afa0-4a4a-bab2-8e048bad8f62 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Refreshing network info cache for port 75b2ff49-49cc-4b86-bdc6-6f9f76c06505 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:47:31 user nova-compute[103546]: DEBUG nova.network.neutron [req-3ede3b16-6c9d-4fc6-b1ad-425f474f7844 req-0d9fb53e-afa0-4a4a-bab2-8e048bad8f62 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Updated VIF entry in instance network info cache for port 75b2ff49-49cc-4b86-bdc6-6f9f76c06505. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 03:47:31 user nova-compute[103546]: DEBUG nova.network.neutron [req-3ede3b16-6c9d-4fc6-b1ad-425f474f7844 req-0d9fb53e-afa0-4a4a-bab2-8e048bad8f62 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Updating instance_info_cache with network_info: [{"id": "2159d4b9-42e0-48d5-bfdf-178ee853063c", "address": "fa:16:3e:5f:ff:36", "network": {"id": "a8bb0411-7c42-419f-9bc2-ea6219b732f8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1141379058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2159d4b9-42", "ovs_interfaceid": "2159d4b9-42e0-48d5-bfdf-178ee853063c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cf751a83-e099-48a1-9219-fb781500b02c", "address": "fa:16:3e:3b:05:73", "network": {"id": "049ff849-6358-448d-9530-ae2102396888", "bridge": "br-int", "label": "tempest-device-tagging-net1-926406277", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf751a83-e0", "ovs_interfaceid": "cf751a83-e099-48a1-9219-fb781500b02c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "96e41ba8-e2bd-48d3-a8e0-94c5f76d618a", "address": "fa:16:3e:e1:ce:8a", "network": {"id": "049ff849-6358-448d-9530-ae2102396888", "bridge": "br-int", "label": "tempest-device-tagging-net1-926406277", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96e41ba8-e2", "ovs_interfaceid": "96e41ba8-e2bd-48d3-a8e0-94c5f76d618a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1b75ba8c-049f-404a-aa82-0323bf51191c", "address": "fa:16:3e:51:e9:22", "network": {"id": "049ff849-6358-448d-9530-ae2102396888", "bridge": "br-int", "label": "tempest-device-tagging-net1-926406277", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b75ba8c-04", "ovs_interfaceid": "1b75ba8c-049f-404a-aa82-0323bf51191c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2216378-faa5-4bdc-8706-0be8df7807c0", "address": "fa:16:3e:aa:93:87", "network": {"id": "049ff849-6358-448d-9530-ae2102396888", "bridge": "br-int", "label": "tempest-device-tagging-net1-926406277", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2216378-fa", "ovs_interfaceid": "c2216378-faa5-4bdc-8706-0be8df7807c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "75b2ff49-49cc-4b86-bdc6-6f9f76c06505", "address": "fa:16:3e:95:e9:f8", "network": {"id": "4a2b26f4-65df-49c9-8832-77cb9c321787", "bridge": "br-int", "label": "tempest-device-tagging-net2-1336305364", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75b2ff49-49", "ovs_interfaceid": "75b2ff49-49cc-4b86-bdc6-6f9f76c06505", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "87ab6a10-d50c-460e-b891-ce6439614185", "address": "fa:16:3e:c4:5b:b6", "network": {"id": "4a2b26f4-65df-49c9-8832-77cb9c321787", "bridge": "br-int", "label": "tempest-device-tagging-net2-1336305364", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87ab6a10-d5", "ovs_interfaceid": "87ab6a10-d50c-460e-b891-ce6439614185", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:47:31 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3ede3b16-6c9d-4fc6-b1ad-425f474f7844 req-0d9fb53e-afa0-4a4a-bab2-8e048bad8f62 service nova] Releasing lock "refresh_cache-2cb84f00-0601-4199-ba6e-f09a27add736" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:47:31 user nova-compute[103546]: DEBUG nova.compute.manager [req-3ede3b16-6c9d-4fc6-b1ad-425f474f7844 req-0d9fb53e-afa0-4a4a-bab2-8e048bad8f62 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received event network-changed-87ab6a10-d50c-460e-b891-ce6439614185 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:47:31 user nova-compute[103546]: DEBUG nova.compute.manager [req-3ede3b16-6c9d-4fc6-b1ad-425f474f7844 req-0d9fb53e-afa0-4a4a-bab2-8e048bad8f62 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Refreshing instance network info cache due to event network-changed-87ab6a10-d50c-460e-b891-ce6439614185. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:47:31 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3ede3b16-6c9d-4fc6-b1ad-425f474f7844 req-0d9fb53e-afa0-4a4a-bab2-8e048bad8f62 service nova] Acquiring lock "refresh_cache-2cb84f00-0601-4199-ba6e-f09a27add736" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:47:31 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3ede3b16-6c9d-4fc6-b1ad-425f474f7844 req-0d9fb53e-afa0-4a4a-bab2-8e048bad8f62 service nova] Acquired lock "refresh_cache-2cb84f00-0601-4199-ba6e-f09a27add736" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:47:31 user nova-compute[103546]: DEBUG nova.network.neutron [req-3ede3b16-6c9d-4fc6-b1ad-425f474f7844 req-0d9fb53e-afa0-4a4a-bab2-8e048bad8f62 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Refreshing network info cache for port 87ab6a10-d50c-460e-b891-ce6439614185 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:47:31 user nova-compute[103546]: DEBUG nova.network.neutron [req-3ede3b16-6c9d-4fc6-b1ad-425f474f7844 req-0d9fb53e-afa0-4a4a-bab2-8e048bad8f62 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Updated VIF entry in instance network info cache for port 87ab6a10-d50c-460e-b891-ce6439614185. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 03:47:31 user nova-compute[103546]: DEBUG nova.network.neutron [req-3ede3b16-6c9d-4fc6-b1ad-425f474f7844 req-0d9fb53e-afa0-4a4a-bab2-8e048bad8f62 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Updating instance_info_cache with network_info: [{"id": "2159d4b9-42e0-48d5-bfdf-178ee853063c", "address": "fa:16:3e:5f:ff:36", "network": {"id": "a8bb0411-7c42-419f-9bc2-ea6219b732f8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1141379058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2159d4b9-42", "ovs_interfaceid": "2159d4b9-42e0-48d5-bfdf-178ee853063c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cf751a83-e099-48a1-9219-fb781500b02c", "address": "fa:16:3e:3b:05:73", "network": {"id": "049ff849-6358-448d-9530-ae2102396888", "bridge": "br-int", "label": "tempest-device-tagging-net1-926406277", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf751a83-e0", "ovs_interfaceid": "cf751a83-e099-48a1-9219-fb781500b02c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "96e41ba8-e2bd-48d3-a8e0-94c5f76d618a", "address": "fa:16:3e:e1:ce:8a", "network": {"id": "049ff849-6358-448d-9530-ae2102396888", "bridge": "br-int", "label": "tempest-device-tagging-net1-926406277", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96e41ba8-e2", "ovs_interfaceid": "96e41ba8-e2bd-48d3-a8e0-94c5f76d618a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1b75ba8c-049f-404a-aa82-0323bf51191c", "address": "fa:16:3e:51:e9:22", "network": {"id": "049ff849-6358-448d-9530-ae2102396888", "bridge": "br-int", "label": "tempest-device-tagging-net1-926406277", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b75ba8c-04", "ovs_interfaceid": "1b75ba8c-049f-404a-aa82-0323bf51191c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2216378-faa5-4bdc-8706-0be8df7807c0", "address": "fa:16:3e:aa:93:87", "network": {"id": "049ff849-6358-448d-9530-ae2102396888", "bridge": "br-int", "label": "tempest-device-tagging-net1-926406277", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2216378-fa", "ovs_interfaceid": "c2216378-faa5-4bdc-8706-0be8df7807c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "75b2ff49-49cc-4b86-bdc6-6f9f76c06505", "address": "fa:16:3e:95:e9:f8", "network": {"id": "4a2b26f4-65df-49c9-8832-77cb9c321787", "bridge": "br-int", "label": "tempest-device-tagging-net2-1336305364", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75b2ff49-49", "ovs_interfaceid": "75b2ff49-49cc-4b86-bdc6-6f9f76c06505", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "87ab6a10-d50c-460e-b891-ce6439614185", "address": "fa:16:3e:c4:5b:b6", "network": {"id": "4a2b26f4-65df-49c9-8832-77cb9c321787", "bridge": "br-int", "label": "tempest-device-tagging-net2-1336305364", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87ab6a10-d5", "ovs_interfaceid": "87ab6a10-d50c-460e-b891-ce6439614185", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:47:31 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3ede3b16-6c9d-4fc6-b1ad-425f474f7844 req-0d9fb53e-afa0-4a4a-bab2-8e048bad8f62 service nova] Releasing lock "refresh_cache-2cb84f00-0601-4199-ba6e-f09a27add736" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:47:32 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:38 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:39 user nova-compute[103546]: INFO nova.virt.block_device [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Booting with volume 3be95c74-7c8d-48bc-8e7a-68b67513280b at /dev/vdc
Nov 16 03:47:39 user nova-compute[103546]: DEBUG os_brick.utils [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4440bfe-667b-4fd5-9f76-d29d16cd492f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af5c39b14ece\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG nova.compute.manager [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Start spawning the instance on the hypervisor. {{(pid=103546) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Creating instance directory {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 03:47:39 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Creating image(s)
Nov 16 03:47:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Did not create local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Ensure instance console log exists: /opt/stack/data/nova/instances/2cb84f00-0601-4199-ba6e-f09a27add736/console.log {{(pid=103546) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Start _get_guest_xml network_info=[{"id": "2159d4b9-42e0-48d5-bfdf-178ee853063c", "address": "fa:16:3e:5f:ff:36", "network": {"id": "a8bb0411-7c42-419f-9bc2-ea6219b732f8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1141379058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2159d4b9-42", "ovs_interfaceid": "2159d4b9-42e0-48d5-bfdf-178ee853063c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cf751a83-e099-48a1-9219-fb781500b02c", "address": "fa:16:3e:3b:05:73", "network": {"id": "049ff849-6358-448d-9530-ae2102396888", "bridge": "br-int", "label": "tempest-device-tagging-net1-926406277", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf751a83-e0", "ovs_interfaceid": "cf751a83-e099-48a1-9219-fb781500b02c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "96e41ba8-e2bd-48d3-a8e0-94c5f76d618a", "address": "fa:16:3e:e1:ce:8a", "network": {"id": "049ff849-6358-448d-9530-ae2102396888", "bridge": "br-int", "label": "tempest-device-tagging-net1-926406277", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96e41ba8-e2", "ovs_interfaceid": "96e41ba8-e2bd-48d3-a8e0-94c5f76d618a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1b75ba8c-049f-404a-aa82-0323bf51191c", "address": "fa:16:3e:51:e9:22", "network": {"id": "049ff849-6358-448d-9530-ae2102396888", "bridge": "br-int", "label": "tempest-device-tagging-net1-926406277", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b75ba8c-04", "ovs_interfaceid": "1b75ba8c-049f-404a-aa82-0323bf51191c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2216378-faa5-4bdc-8706-0be8df7807c0", "address": "fa:16:3e:aa:93:87", "network": {"id": "049ff849-6358-448d-9530-ae2102396888", "bridge": "br-int", "label": "tempest-device-tagging-net1-926406277", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2216378-fa", "ovs_interfaceid": "c2216378-faa5-4bdc-8706-0be8df7807c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "75b2ff49-49cc-4b86-bdc6-6f9f76c06505", "address": "fa:16:3e:95:e9:f8", "network": {"id": "4a2b26f4-65df-49c9-8832-77cb9c321787", "bridge": "br-int", "label": "tempest-device-tagging-net2-1336305364", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75b2ff49-49", "ovs_interfaceid": "75b2ff49-49cc-4b86-bdc6-6f9f76c06505", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "87ab6a10-d50c-460e-b891-ce6439614185", "address": "fa:16:3e:c4:5b:b6", "network": {"id": "4a2b26f4-65df-49c9-8832-77cb9c321787", "bridge": "br-int", "label": "tempest-device-tagging-net2-1336305364", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87ab6a10-d5", "ovs_interfaceid": "87ab6a10-d50c-460e-b891-ce6439614185", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JeMtFvRk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2cb84f00-0601-4199-ba6e-f09a27add736', 'attached_at': '', 'detached_at': '', 'volume_id': '4dada35b-3508-4544-8fec-013f8b89fd57', 'serial': '4dada35b-3508-4544-8fec-013f8b89fd57'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': '2a2e8c7f-16c4-4865-8a3b-f36189251637', 'guest_format': None, 'device_type': 'disk', 'volume_type': None}, {'delete_on_termination': False, 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GUvFluYm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2cb84f00-0601-4199-ba6e-f09a27add736', 'attached_at': '', 'detached_at': '', 'volume_id': '4391e54b-de96-4437-a37c-077312643d75', 'serial': '4391e54b-de96-4437-a37c-077312643d75'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'attachment_id': 'a5d11ad0-3ce9-4866-901c-4e4be90ca8c8', 'guest_format': None, 'device_type': 'disk', 'volume_type': None}, {'delete_on_termination': False, 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nYvPcsCQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2cb84f00-0601-4199-ba6e-f09a27add736', 'attached_at': '', 'detached_at': '', 'volume_id': '2056c0fd-acb4-436c-a1ae-f2e316b94d41', 'serial': '2056c0fd-acb4-436c-a1ae-f2e316b94d41'}, 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'attachment_id': 'd11033ac-4d6a-4cee-aebb-0f4eeb4934e9', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40def20-95d1-45c7-8cec-83fb4d457822]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:39 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:47:39 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:47:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG os_brick.initiator.connector [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Factory for ISCSI on None {{(pid=103546) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.006s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JeMtFvRk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:47:39 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:47:39 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:47:39 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:47:39 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:47:39 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 03:47:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[751965c3-84ae-40f1-9a3e-be6b5b817867]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a0fff6-3e2d-4f39-b27e-401f200e9c32]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Running cmd (subprocess): nvme version {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] 'nvme version' failed. Not Retrying. {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa34f9ec-3828-4d10-ad53-1daebba264bf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.nvmeof [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] nvme not present on system {{(pid=103546) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 03:47:39 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 -p 172.16.0.220:3260 --interface default --op new {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:47:39 user nova-compute[103546]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 03:47:39 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[161d0ee0-6a34-42c5-b4a2-36e0b2f02883]: (4, '') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=103546) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] LIGHTOS: no hostnqn found. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG os_brick.utils [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] <== get_connector_properties: return (198ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af5c39b14ece', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG nova.virt.block_device [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Updating existing volume attachment record: 516f350d-0dab-474f-b6d3-912189234ced {{(pid=103546) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ffc6182-4e7a-400f-83cf-371294c3a235]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57] added\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57] added
Nov 16 03:47:39 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f2136f-6256-4768-bc0a-e24951a8c051]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[7609d2ce-94b3-4fbe-a640-204a818c1466]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JeMtFvRk {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JeMtFvRk" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d56aa7a-afd4-4b4e-a65b-8978202b4dee]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JeMtFvRk'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e338ab1e-c2a0-484e-9160-fecf75a4ff5a]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4739ce-995f-432d-a319-8296e8c49662]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 03:47:39 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 03:47:39 user nova-compute[103546]:  {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:47:39 user nova-compute[103546]: WARNING os_brick.initiator.connectors.iscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 03:47:39 user nova-compute[103546]: 
Nov 16 03:47:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 -p 172.16.0.220:3260 --login {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d619e49-892d-4973-93fd-37faacf16527]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57, portal: 172.16.0.220,3260]
Nov 16 03:47:39 user nova-compute[103546]: Login to [iface: default, target: iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57, portal: 172.16.0.220,3260] successful.
Nov 16 03:47:39 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[55353542-b3c1-442c-91d1-9edfac5d0f88]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38b762f-e579-4e37-8475-36897565cf23]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:47:39 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:47:39 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bceda74-f27e-4136-96ab-e9f128c0c3ae]: (4, ('- - 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:39 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: None {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 03:47:40 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 03:47:40 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JeMtFvRk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 03:47:40 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:47:40 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '26239336430343438', 'path': '/dev/sdb'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:47:40 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26239336430343438', 'path': '/dev/sdb'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 03:47:40 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 03:47:40 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GUvFluYm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:47:40 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:47:40 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:47:40 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:47:40 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:47:40 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:47:40 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:47:40 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 03:47:40 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:40 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:40 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d2406e-2878-4ee7-b9ad-65d963ed67df]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:40 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 03:47:40 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:47:40 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 -p 172.16.0.220:3260 --interface default --op new {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:40 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:40 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1893ef-536a-44cf-aa07-27365e0e1699]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75] added\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:40 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75] added
Nov 16 03:47:40 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:47:40 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:40 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:40 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a778071-98e6-4d6f-b637-4a7cdb5325b0]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:40 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:47:40 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:40 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:40 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ae8a72-7d85-4419-8752-b39b8d6eb331]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:40 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:47:40 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GUvFluYm {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:40 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GUvFluYm" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:40 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[45114de5-4489-4a5d-9261-a6459f169897]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:40 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GUvFluYm'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:47:40 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:40 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:40 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[441435a3-d2b8-42ca-b92e-2bf61f3be5e8]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:40 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:47:40 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:40 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:40 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[9043d54f-5938-4194-a0b4-9d4775b95d7c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:40 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:47:40 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:47:40 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:47:40 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:47:40 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 -p 172.16.0.220:3260 --login {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:40 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:40 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:40 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5ccfde-f7d3-44d6-b888-8c7c1a9003ff]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:40 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75, portal: 172.16.0.220,3260]
Nov 16 03:47:40 user nova-compute[103546]: Login to [iface: default, target: iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75, portal: 172.16.0.220,3260] successful.
Nov 16 03:47:40 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:47:40 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:40 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:40 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b988a6c-e28e-4d62-9e9a-531153a44828]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:40 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:47:40 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:40 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:40 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3725b90-c6c6-49b0-9625-0765d69dadf7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:40 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:47:40 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:47:40 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:47:40 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:47:40 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:47:40 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:47:40 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:47:40 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 03:47:40 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 03:47:40 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 03:47:40 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:41 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:41 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[60870408-86e6-4322-ae9a-eb96e3c1a9f0]: (4, ('- - 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:41 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: None {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 03:47:42 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 03:47:42 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GUvFluYm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 03:47:42 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:47:42 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23033633733393161', 'path': '/dev/sdc'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:47:42 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033633733393161', 'path': '/dev/sdc'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 03:47:42 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 03:47:42 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nYvPcsCQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:47:42 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:47:42 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:47:42 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:47:42 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:47:42 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:47:42 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:47:42 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 03:47:42 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:42 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:42 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[528ab1ca-7f2e-44a5-98d5-398defcae623]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:42 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 03:47:42 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:47:42 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 -p 172.16.0.220:3260 --interface default --op new {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:42 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:42 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e219df-078e-4b85-8537-c7518bc4082a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41] added\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:42 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41] added
Nov 16 03:47:42 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:47:42 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:42 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:42 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b664fa-272a-4460-a323-c51e8d31e440]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:42 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:47:42 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:42 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:42 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda89008-e3b2-465f-80ea-14cab0cfda61]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:42 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:47:42 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nYvPcsCQ {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:42 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nYvPcsCQ" returned: 0 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:42 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d75774-dc1d-4800-b9a2-de4b0c2b2c61]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:42 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nYvPcsCQ'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:47:42 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:42 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:42 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[622688df-b734-47e3-9b4f-be412b395a1f]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:42 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:47:42 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:42 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:42 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[347abf98-b329-4c61-ae52-4398aac77b7c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:42 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:47:42 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:47:42 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:47:42 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:47:42 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:47:42 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:47:42 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 -p 172.16.0.220:3260 --login {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:42 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:42 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f16a23-441a-4e02-a1de-0ca7200124f1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:42 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41, portal: 172.16.0.220,3260]
Nov 16 03:47:42 user nova-compute[103546]: Login to [iface: default, target: iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41, portal: 172.16.0.220,3260] successful.
Nov 16 03:47:42 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:47:42 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:42 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:42 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a32f1f-afa7-4bdf-bae8-196eff671e4a]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:42 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:47:42 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:42 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:42 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1154915-669e-451f-af86-0607ca51b271]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:42 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:47:42 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:47:42 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:47:42 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:47:42 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:47:42 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:47:42 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:47:42 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:47:42 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:47:42 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 03:47:42 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 03:47:42 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 03:47:42 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:42 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:42 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df63aba-544a-4eb9-952e-91a1f7c712fc]: (4, ('- - 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:42 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 03:47:42 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nYvPcsCQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 03:47:42 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:42 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '26665306135623466', 'path': '/dev/sdd'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665306135623466', 'path': '/dev/sdd'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T03:47:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-766470017',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-766470017',id=10,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcOUIcHQE+PuNmY75VAQVSRnTba8AjrUsVmfAjG7EHCeVn8jzeyhEYtg2/jiz2Zl4NEr0BAFFwp5JFj1aYk8M4uENNWNNlYcDY92FwqpHASm1hjkK06mxwFNPN/w/A1RQ==',key_name='tempest-keypair-1790126314',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83b885bd172d45859e0eaa89af06f144',ramdisk_id='',reservation_id='r-06z2rapd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-629950856',owner_user_name='tempest-TaggedBootDevicesTest-629950856-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:47:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22747b2af109454c9aa3475c049d39bd',uuid=2cb84f00-0601-4199-ba6e-f09a27add736,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2159d4b9-42e0-48d5-bfdf-178ee853063c", "address": "fa:16:3e:5f:ff:36", "network": {"id": "a8bb0411-7c42-419f-9bc2-ea6219b732f8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1141379058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2159d4b9-42", "ovs_interfaceid": "2159d4b9-42e0-48d5-bfdf-178ee853063c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Converting VIF {"id": "2159d4b9-42e0-48d5-bfdf-178ee853063c", "address": "fa:16:3e:5f:ff:36", "network": {"id": "a8bb0411-7c42-419f-9bc2-ea6219b732f8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1141379058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2159d4b9-42", "ovs_interfaceid": "2159d4b9-42e0-48d5-bfdf-178ee853063c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:ff:36,bridge_name='br-int',has_traffic_filtering=True,id=2159d4b9-42e0-48d5-bfdf-178ee853063c,network=Network(a8bb0411-7c42-419f-9bc2-ea6219b732f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2159d4b9-42') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T03:47:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-766470017',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-766470017',id=10,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcOUIcHQE+PuNmY75VAQVSRnTba8AjrUsVmfAjG7EHCeVn8jzeyhEYtg2/jiz2Zl4NEr0BAFFwp5JFj1aYk8M4uENNWNNlYcDY92FwqpHASm1hjkK06mxwFNPN/w/A1RQ==',key_name='tempest-keypair-1790126314',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83b885bd172d45859e0eaa89af06f144',ramdisk_id='',reservation_id='r-06z2rapd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-629950856',owner_user_name='tempest-TaggedBootDevicesTest-629950856-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:47:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22747b2af109454c9aa3475c049d39bd',uuid=2cb84f00-0601-4199-ba6e-f09a27add736,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf751a83-e099-48a1-9219-fb781500b02c", "address": "fa:16:3e:3b:05:73", "network": {"id": "049ff849-6358-448d-9530-ae2102396888", "bridge": "br-int", "label": "tempest-device-tagging-net1-926406277", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf751a83-e0", "ovs_interfaceid": "cf751a83-e099-48a1-9219-fb781500b02c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Converting VIF {"id": "cf751a83-e099-48a1-9219-fb781500b02c", "address": "fa:16:3e:3b:05:73", "network": {"id": "049ff849-6358-448d-9530-ae2102396888", "bridge": "br-int", "label": "tempest-device-tagging-net1-926406277", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf751a83-e0", "ovs_interfaceid": "cf751a83-e099-48a1-9219-fb781500b02c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:05:73,bridge_name='br-int',has_traffic_filtering=True,id=cf751a83-e099-48a1-9219-fb781500b02c,network=Network(049ff849-6358-448d-9530-ae2102396888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcf751a83-e0') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T03:47:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-766470017',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-766470017',id=10,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcOUIcHQE+PuNmY75VAQVSRnTba8AjrUsVmfAjG7EHCeVn8jzeyhEYtg2/jiz2Zl4NEr0BAFFwp5JFj1aYk8M4uENNWNNlYcDY92FwqpHASm1hjkK06mxwFNPN/w/A1RQ==',key_name='tempest-keypair-1790126314',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83b885bd172d45859e0eaa89af06f144',ramdisk_id='',reservation_id='r-06z2rapd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-629950856',owner_user_name='tempest-TaggedBootDevicesTest-629950856-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:47:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22747b2af109454c9aa3475c049d39bd',uuid=2cb84f00-0601-4199-ba6e-f09a27add736,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96e41ba8-e2bd-48d3-a8e0-94c5f76d618a", "address": "fa:16:3e:e1:ce:8a", "network": {"id": "049ff849-6358-448d-9530-ae2102396888", "bridge": "br-int", "label": "tempest-device-tagging-net1-926406277", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96e41ba8-e2", "ovs_interfaceid": "96e41ba8-e2bd-48d3-a8e0-94c5f76d618a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Converting VIF {"id": "96e41ba8-e2bd-48d3-a8e0-94c5f76d618a", "address": "fa:16:3e:e1:ce:8a", "network": {"id": "049ff849-6358-448d-9530-ae2102396888", "bridge": "br-int", "label": "tempest-device-tagging-net1-926406277", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96e41ba8-e2", "ovs_interfaceid": "96e41ba8-e2bd-48d3-a8e0-94c5f76d618a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:ce:8a,bridge_name='br-int',has_traffic_filtering=True,id=96e41ba8-e2bd-48d3-a8e0-94c5f76d618a,network=Network(049ff849-6358-448d-9530-ae2102396888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap96e41ba8-e2') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T03:47:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-766470017',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-766470017',id=10,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcOUIcHQE+PuNmY75VAQVSRnTba8AjrUsVmfAjG7EHCeVn8jzeyhEYtg2/jiz2Zl4NEr0BAFFwp5JFj1aYk8M4uENNWNNlYcDY92FwqpHASm1hjkK06mxwFNPN/w/A1RQ==',key_name='tempest-keypair-1790126314',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83b885bd172d45859e0eaa89af06f144',ramdisk_id='',reservation_id='r-06z2rapd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-629950856',owner_user_name='tempest-TaggedBootDevicesTest-629950856-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:47:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22747b2af109454c9aa3475c049d39bd',uuid=2cb84f00-0601-4199-ba6e-f09a27add736,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b75ba8c-049f-404a-aa82-0323bf51191c", "address": "fa:16:3e:51:e9:22", "network": {"id": "049ff849-6358-448d-9530-ae2102396888", "bridge": "br-int", "label": "tempest-device-tagging-net1-926406277", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b75ba8c-04", "ovs_interfaceid": "1b75ba8c-049f-404a-aa82-0323bf51191c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Converting VIF {"id": "1b75ba8c-049f-404a-aa82-0323bf51191c", "address": "fa:16:3e:51:e9:22", "network": {"id": "049ff849-6358-448d-9530-ae2102396888", "bridge": "br-int", "label": "tempest-device-tagging-net1-926406277", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b75ba8c-04", "ovs_interfaceid": "1b75ba8c-049f-404a-aa82-0323bf51191c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:e9:22,bridge_name='br-int',has_traffic_filtering=True,id=1b75ba8c-049f-404a-aa82-0323bf51191c,network=Network(049ff849-6358-448d-9530-ae2102396888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b75ba8c-04') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T03:47:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-766470017',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-766470017',id=10,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcOUIcHQE+PuNmY75VAQVSRnTba8AjrUsVmfAjG7EHCeVn8jzeyhEYtg2/jiz2Zl4NEr0BAFFwp5JFj1aYk8M4uENNWNNlYcDY92FwqpHASm1hjkK06mxwFNPN/w/A1RQ==',key_name='tempest-keypair-1790126314',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83b885bd172d45859e0eaa89af06f144',ramdisk_id='',reservation_id='r-06z2rapd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-629950856',owner_user_name='tempest-TaggedBootDevicesTest-629950856-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:47:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22747b2af109454c9aa3475c049d39bd',uuid=2cb84f00-0601-4199-ba6e-f09a27add736,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2216378-faa5-4bdc-8706-0be8df7807c0", "address": "fa:16:3e:aa:93:87", "network": {"id": "049ff849-6358-448d-9530-ae2102396888", "bridge": "br-int", "label": "tempest-device-tagging-net1-926406277", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2216378-fa", "ovs_interfaceid": "c2216378-faa5-4bdc-8706-0be8df7807c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Converting VIF {"id": "c2216378-faa5-4bdc-8706-0be8df7807c0", "address": "fa:16:3e:aa:93:87", "network": {"id": "049ff849-6358-448d-9530-ae2102396888", "bridge": "br-int", "label": "tempest-device-tagging-net1-926406277", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2216378-fa", "ovs_interfaceid": "c2216378-faa5-4bdc-8706-0be8df7807c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:93:87,bridge_name='br-int',has_traffic_filtering=True,id=c2216378-faa5-4bdc-8706-0be8df7807c0,network=Network(049ff849-6358-448d-9530-ae2102396888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2216378-fa') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T03:47:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-766470017',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-766470017',id=10,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcOUIcHQE+PuNmY75VAQVSRnTba8AjrUsVmfAjG7EHCeVn8jzeyhEYtg2/jiz2Zl4NEr0BAFFwp5JFj1aYk8M4uENNWNNlYcDY92FwqpHASm1hjkK06mxwFNPN/w/A1RQ==',key_name='tempest-keypair-1790126314',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83b885bd172d45859e0eaa89af06f144',ramdisk_id='',reservation_id='r-06z2rapd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-629950856',owner_user_name='tempest-TaggedBootDevicesTest-629950856-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:47:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22747b2af109454c9aa3475c049d39bd',uuid=2cb84f00-0601-4199-ba6e-f09a27add736,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75b2ff49-49cc-4b86-bdc6-6f9f76c06505", "address": "fa:16:3e:95:e9:f8", "network": {"id": "4a2b26f4-65df-49c9-8832-77cb9c321787", "bridge": "br-int", "label": "tempest-device-tagging-net2-1336305364", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75b2ff49-49", "ovs_interfaceid": "75b2ff49-49cc-4b86-bdc6-6f9f76c06505", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Converting VIF {"id": "75b2ff49-49cc-4b86-bdc6-6f9f76c06505", "address": "fa:16:3e:95:e9:f8", "network": {"id": "4a2b26f4-65df-49c9-8832-77cb9c321787", "bridge": "br-int", "label": "tempest-device-tagging-net2-1336305364", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75b2ff49-49", "ovs_interfaceid": "75b2ff49-49cc-4b86-bdc6-6f9f76c06505", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:e9:f8,bridge_name='br-int',has_traffic_filtering=True,id=75b2ff49-49cc-4b86-bdc6-6f9f76c06505,network=Network(4a2b26f4-65df-49c9-8832-77cb9c321787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75b2ff49-49') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T03:47:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-766470017',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-766470017',id=10,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcOUIcHQE+PuNmY75VAQVSRnTba8AjrUsVmfAjG7EHCeVn8jzeyhEYtg2/jiz2Zl4NEr0BAFFwp5JFj1aYk8M4uENNWNNlYcDY92FwqpHASm1hjkK06mxwFNPN/w/A1RQ==',key_name='tempest-keypair-1790126314',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83b885bd172d45859e0eaa89af06f144',ramdisk_id='',reservation_id='r-06z2rapd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-629950856',owner_user_name='tempest-TaggedBootDevicesTest-629950856-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:47:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22747b2af109454c9aa3475c049d39bd',uuid=2cb84f00-0601-4199-ba6e-f09a27add736,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87ab6a10-d50c-460e-b891-ce6439614185", "address": "fa:16:3e:c4:5b:b6", "network": {"id": "4a2b26f4-65df-49c9-8832-77cb9c321787", "bridge": "br-int", "label": "tempest-device-tagging-net2-1336305364", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87ab6a10-d5", "ovs_interfaceid": "87ab6a10-d50c-460e-b891-ce6439614185", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Converting VIF {"id": "87ab6a10-d50c-460e-b891-ce6439614185", "address": "fa:16:3e:c4:5b:b6", "network": {"id": "4a2b26f4-65df-49c9-8832-77cb9c321787", "bridge": "br-int", "label": "tempest-device-tagging-net2-1336305364", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87ab6a10-d5", "ovs_interfaceid": "87ab6a10-d50c-460e-b891-ce6439614185", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:5b:b6,bridge_name='br-int',has_traffic_filtering=True,id=87ab6a10-d50c-460e-b891-ce6439614185,network=Network(4a2b26f4-65df-49c9-8832-77cb9c321787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87ab6a10-d5') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG nova.objects.instance [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Lazy-loading 'pci_devices' on Instance uuid 2cb84f00-0601-4199-ba6e-f09a27add736 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] End _get_guest_xml xml=<domain type="kvm">
Nov 16 03:47:43 user nova-compute[103546]:   <uuid>2cb84f00-0601-4199-ba6e-f09a27add736</uuid>
Nov 16 03:47:43 user nova-compute[103546]:   <name>instance-0000000a</name>
Nov 16 03:47:43 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 03:47:43 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 03:47:43 user nova-compute[103546]:   <metadata>
Nov 16 03:47:43 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 03:47:43 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 03:47:43 user nova-compute[103546]:       <nova:name>tempest-device-tagging-server-766470017</nova:name>
Nov 16 03:47:43 user nova-compute[103546]:       <nova:creationTime>2023-11-16 03:47:39</nova:creationTime>
Nov 16 03:47:43 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 03:47:43 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 03:47:43 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 03:47:43 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 03:47:43 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 03:47:43 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 03:47:43 user nova-compute[103546]:       </nova:flavor>
Nov 16 03:47:43 user nova-compute[103546]:       <nova:owner>
Nov 16 03:47:43 user nova-compute[103546]:         <nova:user uuid="22747b2af109454c9aa3475c049d39bd">tempest-TaggedBootDevicesTest-629950856-project-member</nova:user>
Nov 16 03:47:43 user nova-compute[103546]:         <nova:project uuid="83b885bd172d45859e0eaa89af06f144">tempest-TaggedBootDevicesTest-629950856</nova:project>
Nov 16 03:47:43 user nova-compute[103546]:       </nova:owner>
Nov 16 03:47:43 user nova-compute[103546]:       <nova:root type="image" uuid="5c6f539a-01e5-4478-bf8f-a14310b5d7dd"/>
Nov 16 03:47:43 user nova-compute[103546]:       <nova:ports>
Nov 16 03:47:43 user nova-compute[103546]:         <nova:port uuid="2159d4b9-42e0-48d5-bfdf-178ee853063c">
Nov 16 03:47:43 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 16 03:47:43 user nova-compute[103546]:         </nova:port>
Nov 16 03:47:43 user nova-compute[103546]:         <nova:port uuid="cf751a83-e099-48a1-9219-fb781500b02c">
Nov 16 03:47:43 user nova-compute[103546]:           <nova:ip type="fixed" address="10.1.1.14" ipVersion="4"/>
Nov 16 03:47:43 user nova-compute[103546]:         </nova:port>
Nov 16 03:47:43 user nova-compute[103546]:         <nova:port uuid="96e41ba8-e2bd-48d3-a8e0-94c5f76d618a">
Nov 16 03:47:43 user nova-compute[103546]:           <nova:ip type="fixed" address="10.1.1.4" ipVersion="4"/>
Nov 16 03:47:43 user nova-compute[103546]:         </nova:port>
Nov 16 03:47:43 user nova-compute[103546]:         <nova:port uuid="1b75ba8c-049f-404a-aa82-0323bf51191c">
Nov 16 03:47:43 user nova-compute[103546]:           <nova:ip type="fixed" address="10.1.1.5" ipVersion="4"/>
Nov 16 03:47:43 user nova-compute[103546]:         </nova:port>
Nov 16 03:47:43 user nova-compute[103546]:         <nova:port uuid="c2216378-faa5-4bdc-8706-0be8df7807c0">
Nov 16 03:47:43 user nova-compute[103546]:           <nova:ip type="fixed" address="10.1.1.163" ipVersion="4"/>
Nov 16 03:47:43 user nova-compute[103546]:         </nova:port>
Nov 16 03:47:43 user nova-compute[103546]:         <nova:port uuid="75b2ff49-49cc-4b86-bdc6-6f9f76c06505">
Nov 16 03:47:43 user nova-compute[103546]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 16 03:47:43 user nova-compute[103546]:         </nova:port>
Nov 16 03:47:43 user nova-compute[103546]:         <nova:port uuid="87ab6a10-d50c-460e-b891-ce6439614185">
Nov 16 03:47:43 user nova-compute[103546]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 16 03:47:43 user nova-compute[103546]:         </nova:port>
Nov 16 03:47:43 user nova-compute[103546]:       </nova:ports>
Nov 16 03:47:43 user nova-compute[103546]:     </nova:instance>
Nov 16 03:47:43 user nova-compute[103546]:   </metadata>
Nov 16 03:47:43 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 03:47:43 user nova-compute[103546]:     <system>
Nov 16 03:47:43 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 03:47:43 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 03:47:43 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 03:47:43 user nova-compute[103546]:       <entry name="serial">2cb84f00-0601-4199-ba6e-f09a27add736</entry>
Nov 16 03:47:43 user nova-compute[103546]:       <entry name="uuid">2cb84f00-0601-4199-ba6e-f09a27add736</entry>
Nov 16 03:47:43 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 03:47:43 user nova-compute[103546]:     </system>
Nov 16 03:47:43 user nova-compute[103546]:   </sysinfo>
Nov 16 03:47:43 user nova-compute[103546]:   <os>
Nov 16 03:47:43 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 03:47:43 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 03:47:43 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 03:47:43 user nova-compute[103546]:   </os>
Nov 16 03:47:43 user nova-compute[103546]:   <features>
Nov 16 03:47:43 user nova-compute[103546]:     <acpi/>
Nov 16 03:47:43 user nova-compute[103546]:     <apic/>
Nov 16 03:47:43 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 03:47:43 user nova-compute[103546]:   </features>
Nov 16 03:47:43 user nova-compute[103546]:   <clock offset="utc">
Nov 16 03:47:43 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 03:47:43 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 03:47:43 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 03:47:43 user nova-compute[103546]:   </clock>
Nov 16 03:47:43 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 03:47:43 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 03:47:43 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 03:47:43 user nova-compute[103546]:   </cpu>
Nov 16 03:47:43 user nova-compute[103546]:   <devices>
Nov 16 03:47:43 user nova-compute[103546]:     <disk type="file" device="cdrom">
Nov 16 03:47:43 user nova-compute[103546]:       <driver name="qemu" type="raw" cache="none"/>
Nov 16 03:47:43 user nova-compute[103546]:       <source file="/opt/stack/data/nova/instances/2cb84f00-0601-4199-ba6e-f09a27add736/disk.config"/>
Nov 16 03:47:43 user nova-compute[103546]:       <target dev="hda" bus="ide"/>
Nov 16 03:47:43 user nova-compute[103546]:     </disk>
Nov 16 03:47:43 user nova-compute[103546]:     <disk type="block" device="disk">
Nov 16 03:47:43 user nova-compute[103546]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 03:47:43 user nova-compute[103546]:       <source dev="/dev/sdb"/>
Nov 16 03:47:43 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 03:47:43 user nova-compute[103546]:       <serial>4dada35b-3508-4544-8fec-013f8b89fd57</serial>
Nov 16 03:47:43 user nova-compute[103546]:     </disk>
Nov 16 03:47:43 user nova-compute[103546]:     <disk type="block" device="disk">
Nov 16 03:47:43 user nova-compute[103546]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 03:47:43 user nova-compute[103546]:       <source dev="/dev/sdc"/>
Nov 16 03:47:43 user nova-compute[103546]:       <target dev="vdb" bus="virtio"/>
Nov 16 03:47:43 user nova-compute[103546]:       <serial>4391e54b-de96-4437-a37c-077312643d75</serial>
Nov 16 03:47:43 user nova-compute[103546]:     </disk>
Nov 16 03:47:43 user nova-compute[103546]:     <disk type="block" device="disk">
Nov 16 03:47:43 user nova-compute[103546]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 03:47:43 user nova-compute[103546]:       <source dev="/dev/sdd"/>
Nov 16 03:47:43 user nova-compute[103546]:       <target dev="vdc" bus="virtio"/>
Nov 16 03:47:43 user nova-compute[103546]:       <serial>2056c0fd-acb4-436c-a1ae-f2e316b94d41</serial>
Nov 16 03:47:43 user nova-compute[103546]:     </disk>
Nov 16 03:47:43 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 03:47:43 user nova-compute[103546]:       <mac address="fa:16:3e:5f:ff:36"/>
Nov 16 03:47:43 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:47:43 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 03:47:43 user nova-compute[103546]:       <target dev="tap2159d4b9-42"/>
Nov 16 03:47:43 user nova-compute[103546]:     </interface>
Nov 16 03:47:43 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 03:47:43 user nova-compute[103546]:       <mac address="fa:16:3e:3b:05:73"/>
Nov 16 03:47:43 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:47:43 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 03:47:43 user nova-compute[103546]:       <target dev="tapcf751a83-e0"/>
Nov 16 03:47:43 user nova-compute[103546]:     </interface>
Nov 16 03:47:43 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 03:47:43 user nova-compute[103546]:       <mac address="fa:16:3e:e1:ce:8a"/>
Nov 16 03:47:43 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:47:43 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 03:47:43 user nova-compute[103546]:       <target dev="tap96e41ba8-e2"/>
Nov 16 03:47:43 user nova-compute[103546]:     </interface>
Nov 16 03:47:43 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 03:47:43 user nova-compute[103546]:       <mac address="fa:16:3e:51:e9:22"/>
Nov 16 03:47:43 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:47:43 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 03:47:43 user nova-compute[103546]:       <target dev="tap1b75ba8c-04"/>
Nov 16 03:47:43 user nova-compute[103546]:     </interface>
Nov 16 03:47:43 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 03:47:43 user nova-compute[103546]:       <mac address="fa:16:3e:aa:93:87"/>
Nov 16 03:47:43 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:47:43 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 03:47:43 user nova-compute[103546]:       <target dev="tapc2216378-fa"/>
Nov 16 03:47:43 user nova-compute[103546]:     </interface>
Nov 16 03:47:43 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 03:47:43 user nova-compute[103546]:       <mac address="fa:16:3e:95:e9:f8"/>
Nov 16 03:47:43 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:47:43 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 03:47:43 user nova-compute[103546]:       <target dev="tap75b2ff49-49"/>
Nov 16 03:47:43 user nova-compute[103546]:     </interface>
Nov 16 03:47:43 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 03:47:43 user nova-compute[103546]:       <mac address="fa:16:3e:c4:5b:b6"/>
Nov 16 03:47:43 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:47:43 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 03:47:43 user nova-compute[103546]:       <target dev="tap87ab6a10-d5"/>
Nov 16 03:47:43 user nova-compute[103546]:     </interface>
Nov 16 03:47:43 user nova-compute[103546]:     <serial type="pty">
Nov 16 03:47:43 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/2cb84f00-0601-4199-ba6e-f09a27add736/console.log" append="off"/>
Nov 16 03:47:43 user nova-compute[103546]:     </serial>
Nov 16 03:47:43 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 03:47:43 user nova-compute[103546]:     <video>
Nov 16 03:47:43 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:47:43 user nova-compute[103546]:     </video>
Nov 16 03:47:43 user nova-compute[103546]:     <rng model="virtio">
Nov 16 03:47:43 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 03:47:43 user nova-compute[103546]:     </rng>
Nov 16 03:47:43 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 03:47:43 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 03:47:43 user nova-compute[103546]:       <stats period="10"/>
Nov 16 03:47:43 user nova-compute[103546]:     </memballoon>
Nov 16 03:47:43 user nova-compute[103546]:   </devices>
Nov 16 03:47:43 user nova-compute[103546]: </domain>
Nov 16 03:47:43 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T03:47:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-766470017',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-766470017',id=10,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcOUIcHQE+PuNmY75VAQVSRnTba8AjrUsVmfAjG7EHCeVn8jzeyhEYtg2/jiz2Zl4NEr0BAFFwp5JFj1aYk8M4uENNWNNlYcDY92FwqpHASm1hjkK06mxwFNPN/w/A1RQ==',key_name='tempest-keypair-1790126314',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83b885bd172d45859e0eaa89af06f144',ramdisk_id='',reservation_id='r-06z2rapd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-629950856',owner_user_name='tempest-TaggedBootDevicesTest-629950856-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:47:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22747b2af109454c9aa3475c049d39bd',uuid=2cb84f00-0601-4199-ba6e-f09a27add736,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2159d4b9-42e0-48d5-bfdf-178ee853063c", "address": "fa:16:3e:5f:ff:36", "network": {"id": "a8bb0411-7c42-419f-9bc2-ea6219b732f8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1141379058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2159d4b9-42", "ovs_interfaceid": "2159d4b9-42e0-48d5-bfdf-178ee853063c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Converting VIF {"id": "2159d4b9-42e0-48d5-bfdf-178ee853063c", "address": "fa:16:3e:5f:ff:36", "network": {"id": "a8bb0411-7c42-419f-9bc2-ea6219b732f8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1141379058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2159d4b9-42", "ovs_interfaceid": "2159d4b9-42e0-48d5-bfdf-178ee853063c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:ff:36,bridge_name='br-int',has_traffic_filtering=True,id=2159d4b9-42e0-48d5-bfdf-178ee853063c,network=Network(a8bb0411-7c42-419f-9bc2-ea6219b732f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2159d4b9-42') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG os_vif [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:ff:36,bridge_name='br-int',has_traffic_filtering=True,id=2159d4b9-42e0-48d5-bfdf-178ee853063c,network=Network(a8bb0411-7c42-419f-9bc2-ea6219b732f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2159d4b9-42') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '901a5ed5-3780-59cc-bf74-b779fad18ec7', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2159d4b9-42, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2159d4b9-42, col_values=(('qos', UUID('9cd08ca6-fa34-4f9e-9960-b67da3cc9f1c')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2159d4b9-42, col_values=(('external_ids', {'iface-id': '2159d4b9-42e0-48d5-bfdf-178ee853063c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:ff:36', 'vm-uuid': '2cb84f00-0601-4199-ba6e-f09a27add736'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:43 user nova-compute[103546]: INFO os_vif [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:ff:36,bridge_name='br-int',has_traffic_filtering=True,id=2159d4b9-42e0-48d5-bfdf-178ee853063c,network=Network(a8bb0411-7c42-419f-9bc2-ea6219b732f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2159d4b9-42')
Nov 16 03:47:43 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T03:47:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-766470017',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-766470017',id=10,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcOUIcHQE+PuNmY75VAQVSRnTba8AjrUsVmfAjG7EHCeVn8jzeyhEYtg2/jiz2Zl4NEr0BAFFwp5JFj1aYk8M4uENNWNNlYcDY92FwqpHASm1hjkK06mxwFNPN/w/A1RQ==',key_name='tempest-keypair-1790126314',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83b885bd172d45859e0eaa89af06f144',ramdisk_id='',reservation_id='r-06z2rapd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-629950856',owner_user_name='tempest-TaggedBootDevicesTest-629950856-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:47:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22747b2af109454c9aa3475c049d39bd',uuid=2cb84f00-0601-4199-ba6e-f09a27add736,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf751a83-e099-48a1-9219-fb781500b02c", "address": "fa:16:3e:3b:05:73", "network": {"id": "049ff849-6358-448d-9530-ae2102396888", "bridge": "br-int", "label": "tempest-device-tagging-net1-926406277", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf751a83-e0", "ovs_interfaceid": "cf751a83-e099-48a1-9219-fb781500b02c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Converting VIF {"id": "cf751a83-e099-48a1-9219-fb781500b02c", "address": "fa:16:3e:3b:05:73", "network": {"id": "049ff849-6358-448d-9530-ae2102396888", "bridge": "br-int", "label": "tempest-device-tagging-net1-926406277", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf751a83-e0", "ovs_interfaceid": "cf751a83-e099-48a1-9219-fb781500b02c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:05:73,bridge_name='br-int',has_traffic_filtering=True,id=cf751a83-e099-48a1-9219-fb781500b02c,network=Network(049ff849-6358-448d-9530-ae2102396888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcf751a83-e0') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG os_vif [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:05:73,bridge_name='br-int',has_traffic_filtering=True,id=cf751a83-e099-48a1-9219-fb781500b02c,network=Network(049ff849-6358-448d-9530-ae2102396888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcf751a83-e0') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '00a02e56-b139-5933-8a30-1fe92d7c3424', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcf751a83-e0, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcf751a83-e0, col_values=(('qos', UUID('969977d6-0883-44a0-82ee-06ea68b7419a')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcf751a83-e0, col_values=(('external_ids', {'iface-id': 'cf751a83-e099-48a1-9219-fb781500b02c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:05:73', 'vm-uuid': '2cb84f00-0601-4199-ba6e-f09a27add736'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:43 user nova-compute[103546]: INFO os_vif [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:05:73,bridge_name='br-int',has_traffic_filtering=True,id=cf751a83-e099-48a1-9219-fb781500b02c,network=Network(049ff849-6358-448d-9530-ae2102396888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcf751a83-e0')
Nov 16 03:47:43 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T03:47:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-766470017',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-766470017',id=10,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcOUIcHQE+PuNmY75VAQVSRnTba8AjrUsVmfAjG7EHCeVn8jzeyhEYtg2/jiz2Zl4NEr0BAFFwp5JFj1aYk8M4uENNWNNlYcDY92FwqpHASm1hjkK06mxwFNPN/w/A1RQ==',key_name='tempest-keypair-1790126314',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83b885bd172d45859e0eaa89af06f144',ramdisk_id='',reservation_id='r-06z2rapd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-629950856',owner_user_name='tempest-TaggedBootDevicesTest-629950856-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:47:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22747b2af109454c9aa3475c049d39bd',uuid=2cb84f00-0601-4199-ba6e-f09a27add736,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96e41ba8-e2bd-48d3-a8e0-94c5f76d618a", "address": "fa:16:3e:e1:ce:8a", "network": {"id": "049ff849-6358-448d-9530-ae2102396888", "bridge": "br-int", "label": "tempest-device-tagging-net1-926406277", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96e41ba8-e2", "ovs_interfaceid": "96e41ba8-e2bd-48d3-a8e0-94c5f76d618a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Converting VIF {"id": "96e41ba8-e2bd-48d3-a8e0-94c5f76d618a", "address": "fa:16:3e:e1:ce:8a", "network": {"id": "049ff849-6358-448d-9530-ae2102396888", "bridge": "br-int", "label": "tempest-device-tagging-net1-926406277", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96e41ba8-e2", "ovs_interfaceid": "96e41ba8-e2bd-48d3-a8e0-94c5f76d618a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:ce:8a,bridge_name='br-int',has_traffic_filtering=True,id=96e41ba8-e2bd-48d3-a8e0-94c5f76d618a,network=Network(049ff849-6358-448d-9530-ae2102396888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap96e41ba8-e2') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG os_vif [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:ce:8a,bridge_name='br-int',has_traffic_filtering=True,id=96e41ba8-e2bd-48d3-a8e0-94c5f76d618a,network=Network(049ff849-6358-448d-9530-ae2102396888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap96e41ba8-e2') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '92191924-f613-5f87-b1bb-ce9e93127f40', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96e41ba8-e2, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap96e41ba8-e2, col_values=(('qos', UUID('18669e98-fa38-45e6-b5ee-be6531aa93ba')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap96e41ba8-e2, col_values=(('external_ids', {'iface-id': '96e41ba8-e2bd-48d3-a8e0-94c5f76d618a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:ce:8a', 'vm-uuid': '2cb84f00-0601-4199-ba6e-f09a27add736'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:43 user nova-compute[103546]: INFO os_vif [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:ce:8a,bridge_name='br-int',has_traffic_filtering=True,id=96e41ba8-e2bd-48d3-a8e0-94c5f76d618a,network=Network(049ff849-6358-448d-9530-ae2102396888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap96e41ba8-e2')
Nov 16 03:47:43 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T03:47:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-766470017',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-766470017',id=10,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcOUIcHQE+PuNmY75VAQVSRnTba8AjrUsVmfAjG7EHCeVn8jzeyhEYtg2/jiz2Zl4NEr0BAFFwp5JFj1aYk8M4uENNWNNlYcDY92FwqpHASm1hjkK06mxwFNPN/w/A1RQ==',key_name='tempest-keypair-1790126314',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83b885bd172d45859e0eaa89af06f144',ramdisk_id='',reservation_id='r-06z2rapd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-629950856',owner_user_name='tempest-TaggedBootDevicesTest-629950856-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:47:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22747b2af109454c9aa3475c049d39bd',uuid=2cb84f00-0601-4199-ba6e-f09a27add736,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b75ba8c-049f-404a-aa82-0323bf51191c", "address": "fa:16:3e:51:e9:22", "network": {"id": "049ff849-6358-448d-9530-ae2102396888", "bridge": "br-int", "label": "tempest-device-tagging-net1-926406277", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b75ba8c-04", "ovs_interfaceid": "1b75ba8c-049f-404a-aa82-0323bf51191c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Converting VIF {"id": "1b75ba8c-049f-404a-aa82-0323bf51191c", "address": "fa:16:3e:51:e9:22", "network": {"id": "049ff849-6358-448d-9530-ae2102396888", "bridge": "br-int", "label": "tempest-device-tagging-net1-926406277", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b75ba8c-04", "ovs_interfaceid": "1b75ba8c-049f-404a-aa82-0323bf51191c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:e9:22,bridge_name='br-int',has_traffic_filtering=True,id=1b75ba8c-049f-404a-aa82-0323bf51191c,network=Network(049ff849-6358-448d-9530-ae2102396888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b75ba8c-04') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG os_vif [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:e9:22,bridge_name='br-int',has_traffic_filtering=True,id=1b75ba8c-049f-404a-aa82-0323bf51191c,network=Network(049ff849-6358-448d-9530-ae2102396888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b75ba8c-04') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4acda2f6-4302-54e5-86c7-1ca2e64a23c2', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1b75ba8c-04, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1b75ba8c-04, col_values=(('qos', UUID('1eed384e-fbd2-4c91-8e84-cb9c42af19ab')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1b75ba8c-04, col_values=(('external_ids', {'iface-id': '1b75ba8c-049f-404a-aa82-0323bf51191c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:e9:22', 'vm-uuid': '2cb84f00-0601-4199-ba6e-f09a27add736'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:43 user nova-compute[103546]: INFO os_vif [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:e9:22,bridge_name='br-int',has_traffic_filtering=True,id=1b75ba8c-049f-404a-aa82-0323bf51191c,network=Network(049ff849-6358-448d-9530-ae2102396888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b75ba8c-04')
Nov 16 03:47:43 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T03:47:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-766470017',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-766470017',id=10,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcOUIcHQE+PuNmY75VAQVSRnTba8AjrUsVmfAjG7EHCeVn8jzeyhEYtg2/jiz2Zl4NEr0BAFFwp5JFj1aYk8M4uENNWNNlYcDY92FwqpHASm1hjkK06mxwFNPN/w/A1RQ==',key_name='tempest-keypair-1790126314',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83b885bd172d45859e0eaa89af06f144',ramdisk_id='',reservation_id='r-06z2rapd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-629950856',owner_user_name='tempest-TaggedBootDevicesTest-629950856-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:47:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22747b2af109454c9aa3475c049d39bd',uuid=2cb84f00-0601-4199-ba6e-f09a27add736,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2216378-faa5-4bdc-8706-0be8df7807c0", "address": "fa:16:3e:aa:93:87", "network": {"id": "049ff849-6358-448d-9530-ae2102396888", "bridge": "br-int", "label": "tempest-device-tagging-net1-926406277", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2216378-fa", "ovs_interfaceid": "c2216378-faa5-4bdc-8706-0be8df7807c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Converting VIF {"id": "c2216378-faa5-4bdc-8706-0be8df7807c0", "address": "fa:16:3e:aa:93:87", "network": {"id": "049ff849-6358-448d-9530-ae2102396888", "bridge": "br-int", "label": "tempest-device-tagging-net1-926406277", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2216378-fa", "ovs_interfaceid": "c2216378-faa5-4bdc-8706-0be8df7807c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:93:87,bridge_name='br-int',has_traffic_filtering=True,id=c2216378-faa5-4bdc-8706-0be8df7807c0,network=Network(049ff849-6358-448d-9530-ae2102396888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2216378-fa') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG os_vif [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:93:87,bridge_name='br-int',has_traffic_filtering=True,id=c2216378-faa5-4bdc-8706-0be8df7807c0,network=Network(049ff849-6358-448d-9530-ae2102396888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2216378-fa') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e4d5cbd9-f293-580a-b424-531662cbd712', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc2216378-fa, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc2216378-fa, col_values=(('qos', UUID('1d186975-1edd-4765-ac77-b89eb8575da3')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc2216378-fa, col_values=(('external_ids', {'iface-id': 'c2216378-faa5-4bdc-8706-0be8df7807c0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:93:87', 'vm-uuid': '2cb84f00-0601-4199-ba6e-f09a27add736'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:43 user nova-compute[103546]: INFO os_vif [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:93:87,bridge_name='br-int',has_traffic_filtering=True,id=c2216378-faa5-4bdc-8706-0be8df7807c0,network=Network(049ff849-6358-448d-9530-ae2102396888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2216378-fa')
Nov 16 03:47:43 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T03:47:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-766470017',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-766470017',id=10,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcOUIcHQE+PuNmY75VAQVSRnTba8AjrUsVmfAjG7EHCeVn8jzeyhEYtg2/jiz2Zl4NEr0BAFFwp5JFj1aYk8M4uENNWNNlYcDY92FwqpHASm1hjkK06mxwFNPN/w/A1RQ==',key_name='tempest-keypair-1790126314',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83b885bd172d45859e0eaa89af06f144',ramdisk_id='',reservation_id='r-06z2rapd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-629950856',owner_user_name='tempest-TaggedBootDevicesTest-629950856-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:47:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22747b2af109454c9aa3475c049d39bd',uuid=2cb84f00-0601-4199-ba6e-f09a27add736,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75b2ff49-49cc-4b86-bdc6-6f9f76c06505", "address": "fa:16:3e:95:e9:f8", "network": {"id": "4a2b26f4-65df-49c9-8832-77cb9c321787", "bridge": "br-int", "label": "tempest-device-tagging-net2-1336305364", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75b2ff49-49", "ovs_interfaceid": "75b2ff49-49cc-4b86-bdc6-6f9f76c06505", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Converting VIF {"id": "75b2ff49-49cc-4b86-bdc6-6f9f76c06505", "address": "fa:16:3e:95:e9:f8", "network": {"id": "4a2b26f4-65df-49c9-8832-77cb9c321787", "bridge": "br-int", "label": "tempest-device-tagging-net2-1336305364", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75b2ff49-49", "ovs_interfaceid": "75b2ff49-49cc-4b86-bdc6-6f9f76c06505", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:e9:f8,bridge_name='br-int',has_traffic_filtering=True,id=75b2ff49-49cc-4b86-bdc6-6f9f76c06505,network=Network(4a2b26f4-65df-49c9-8832-77cb9c321787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75b2ff49-49') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG os_vif [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:e9:f8,bridge_name='br-int',has_traffic_filtering=True,id=75b2ff49-49cc-4b86-bdc6-6f9f76c06505,network=Network(4a2b26f4-65df-49c9-8832-77cb9c321787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75b2ff49-49') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5d018b60-956c-55cf-a5fa-5a46d5cd283e', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap75b2ff49-49, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap75b2ff49-49, col_values=(('qos', UUID('654b4bee-0cc8-4acd-aab1-b0360d287a12')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap75b2ff49-49, col_values=(('external_ids', {'iface-id': '75b2ff49-49cc-4b86-bdc6-6f9f76c06505', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:e9:f8', 'vm-uuid': '2cb84f00-0601-4199-ba6e-f09a27add736'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:43 user nova-compute[103546]: INFO os_vif [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:e9:f8,bridge_name='br-int',has_traffic_filtering=True,id=75b2ff49-49cc-4b86-bdc6-6f9f76c06505,network=Network(4a2b26f4-65df-49c9-8832-77cb9c321787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75b2ff49-49')
Nov 16 03:47:43 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T03:47:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-766470017',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-766470017',id=10,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcOUIcHQE+PuNmY75VAQVSRnTba8AjrUsVmfAjG7EHCeVn8jzeyhEYtg2/jiz2Zl4NEr0BAFFwp5JFj1aYk8M4uENNWNNlYcDY92FwqpHASm1hjkK06mxwFNPN/w/A1RQ==',key_name='tempest-keypair-1790126314',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83b885bd172d45859e0eaa89af06f144',ramdisk_id='',reservation_id='r-06z2rapd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-629950856',owner_user_name='tempest-TaggedBootDevicesTest-629950856-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:47:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22747b2af109454c9aa3475c049d39bd',uuid=2cb84f00-0601-4199-ba6e-f09a27add736,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87ab6a10-d50c-460e-b891-ce6439614185", "address": "fa:16:3e:c4:5b:b6", "network": {"id": "4a2b26f4-65df-49c9-8832-77cb9c321787", "bridge": "br-int", "label": "tempest-device-tagging-net2-1336305364", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87ab6a10-d5", "ovs_interfaceid": "87ab6a10-d50c-460e-b891-ce6439614185", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Converting VIF {"id": "87ab6a10-d50c-460e-b891-ce6439614185", "address": "fa:16:3e:c4:5b:b6", "network": {"id": "4a2b26f4-65df-49c9-8832-77cb9c321787", "bridge": "br-int", "label": "tempest-device-tagging-net2-1336305364", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87ab6a10-d5", "ovs_interfaceid": "87ab6a10-d50c-460e-b891-ce6439614185", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:5b:b6,bridge_name='br-int',has_traffic_filtering=True,id=87ab6a10-d50c-460e-b891-ce6439614185,network=Network(4a2b26f4-65df-49c9-8832-77cb9c321787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87ab6a10-d5') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG os_vif [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:5b:b6,bridge_name='br-int',has_traffic_filtering=True,id=87ab6a10-d50c-460e-b891-ce6439614185,network=Network(4a2b26f4-65df-49c9-8832-77cb9c321787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87ab6a10-d5') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9990391d-6155-50b4-8837-cc7bfbf10e2e', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap87ab6a10-d5, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap87ab6a10-d5, col_values=(('qos', UUID('170efddd-3fe9-4f0b-bf53-6be3b3b3f63a')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap87ab6a10-d5, col_values=(('external_ids', {'iface-id': '87ab6a10-d50c-460e-b891-ce6439614185', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:5b:b6', 'vm-uuid': '2cb84f00-0601-4199-ba6e-f09a27add736'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:47:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:43 user nova-compute[103546]: INFO os_vif [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:5b:b6,bridge_name='br-int',has_traffic_filtering=True,id=87ab6a10-d50c-460e-b891-ce6439614185,network=Network(4a2b26f4-65df-49c9-8832-77cb9c321787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87ab6a10-d5')
Nov 16 03:47:44 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] No BDM found with device name hda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:47:44 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] No BDM found with device name vdc, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:47:44 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] No VIF found with MAC fa:16:3e:5f:ff:36, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 03:47:44 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] No VIF found with MAC fa:16:3e:aa:93:87, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 03:47:44 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Using config drive
Nov 16 03:47:44 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Creating config drive at /opt/stack/data/nova/instances/2cb84f00-0601-4199-ba6e-f09a27add736/disk.config
Nov 16 03:47:44 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2cb84f00-0601-4199-ba6e-f09a27add736/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpckc3arpw {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:44 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2cb84f00-0601-4199-ba6e-f09a27add736/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpckc3arpw" returned: 0 in 0.056s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:44 user nova-compute[103546]: DEBUG nova.compute.manager [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Start spawning the instance on the hypervisor. {{(pid=103546) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 03:47:44 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Creating instance directory {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 03:47:44 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Creating image(s)
Nov 16 03:47:44 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Did not create local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 03:47:44 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Ensure instance console log exists: /opt/stack/data/nova/instances/71059a8d-4e89-472c-9463-b38aa8063e33/console.log {{(pid=103546) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 03:47:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:47:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:47:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:47:44 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Start _get_guest_xml network_info=[{"id": "76b69715-356f-496a-85a3-f5bde976e201", "address": "fa:16:3e:72:5a:35", "network": {"id": "f84b2b6b-c73a-41d8-a9bb-3e73bb607a42", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1721792603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76b69715-35", "ovs_interfaceid": "76b69715-356f-496a-85a3-f5bde976e201", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "21653257-8a66-44f1-b806-2fae4641e1d2", "address": "fa:16:3e:91:a8:b5", "network": {"id": "4b071e67-eb71-49f5-a24f-cada83cca606", "bridge": "br-int", "label": "tempest-device-tagging-net1-1064540428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21653257-8a", "ovs_interfaceid": "21653257-8a66-44f1-b806-2fae4641e1d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "916a3fe8-09df-42a1-9ac0-b81153ed55a1", "address": "fa:16:3e:00:b7:5f", "network": {"id": "4b071e67-eb71-49f5-a24f-cada83cca606", "bridge": "br-int", "label": "tempest-device-tagging-net1-1064540428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap916a3fe8-09", "ovs_interfaceid": "916a3fe8-09df-42a1-9ac0-b81153ed55a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1fb75f05-a4ef-45d5-9eb4-5e8428997947", "address": "fa:16:3e:e6:68:04", "network": {"id": "4b071e67-eb71-49f5-a24f-cada83cca606", "bridge": "br-int", "label": "tempest-device-tagging-net1-1064540428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fb75f05-a4", "ovs_interfaceid": "1fb75f05-a4ef-45d5-9eb4-5e8428997947", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "51e087e4-ff6b-49a8-8190-cfc243436d35", "address": "fa:16:3e:3f:53:f1", "network": {"id": "4b071e67-eb71-49f5-a24f-cada83cca606", "bridge": "br-int", "label": "tempest-device-tagging-net1-1064540428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51e087e4-ff", "ovs_interfaceid": "51e087e4-ff6b-49a8-8190-cfc243436d35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b0f609b8-eb49-4c19-968c-99c95c38b857", "address": "fa:16:3e:dc:33:a5", "network": {"id": "f9af5267-5cc4-44b4-9226-2da63e754907", "bridge": "br-int", "label": "tempest-device-tagging-net2-640329577", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0f609b8-eb", "ovs_interfaceid": "b0f609b8-eb49-4c19-968c-99c95c38b857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fc03966b-fcbc-4ed7-8ffb-2270a55b4e28", "address": "fa:16:3e:75:5a:4b", "network": {"id": "f9af5267-5cc4-44b4-9226-2da63e754907", "bridge": "br-int", "label": "tempest-device-tagging-net2-640329577", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc03966b-fc", "ovs_interfaceid": "fc03966b-fcbc-4ed7-8ffb-2270a55b4e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mKMStNlq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '71059a8d-4e89-472c-9463-b38aa8063e33', 'attached_at': '', 'detached_at': '', 'volume_id': 'b5221ff7-1f34-47db-a9c6-ce3f8e58e865', 'serial': 'b5221ff7-1f34-47db-a9c6-ce3f8e58e865'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': '3823a289-6070-43b7-9b45-a343c08c353b', 'guest_format': None, 'device_type': 'disk', 'volume_type': None}, {'delete_on_termination': False, 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nGCSWKyY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '71059a8d-4e89-472c-9463-b38aa8063e33', 'attached_at': '', 'detached_at': '', 'volume_id': 'cbd5ba3f-7069-4f25-bc49-017b07ac2ca7', 'serial': 'cbd5ba3f-7069-4f25-bc49-017b07ac2ca7'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'attachment_id': '9df5c485-b307-4431-a8a4-9f73ce9d9f8b', 'guest_format': None, 'device_type': 'disk', 'volume_type': None}, {'delete_on_termination': False, 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QtBJqjuH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '71059a8d-4e89-472c-9463-b38aa8063e33', 'attached_at': '', 'detached_at': '', 'volume_id': '3be95c74-7c8d-48bc-8e7a-68b67513280b', 'serial': '3be95c74-7c8d-48bc-8e7a-68b67513280b'}, 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'attachment_id': '516f350d-0dab-474f-b6d3-912189234ced', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 03:47:44 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:47:44 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:47:44 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 03:47:44 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 03:47:44 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 03:47:44 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 03:47:44 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 03:47:44 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 03:47:44 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 03:47:44 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 03:47:44 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 03:47:44 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 03:47:44 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 03:47:44 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 03:47:44 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 03:47:44 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 03:47:44 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 03:47:44 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 03:47:44 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 03:47:44 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mKMStNlq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:47:44 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:47:44 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:47:44 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:47:44 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:47:44 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:47:44 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:47:44 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 03:47:44 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:45 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cdc06e1-b51f-47cc-a693-55692efae841]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:45 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 03:47:45 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:47:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 -p 172.16.0.220:3260 --interface default --op new {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:45 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[64631ba0-4890-40d6-adea-000a57715862]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865] added\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:45 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865] added
Nov 16 03:47:45 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:47:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:45 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[89257ca3-f9b2-4d81-a458-32284fd9d4b1]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:45 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:47:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:45 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[745baa2c-7cc4-4975-8479-d92cef90a1ef]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:45 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:47:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mKMStNlq {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mKMStNlq" returned: 0 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:45 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a78dcaf-ff06-4590-8235-0bdb06e083ea]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:45 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mKMStNlq'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:47:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:45 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[2277a6cb-697e-49dd-860d-d326f9c3daad]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:45 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:47:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:45 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d544b2bc-cb53-42f5-8073-c4fbf7aedf2d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:45 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:47:45 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:47:45 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:47:45 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:47:45 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:47:45 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:47:45 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:47:45 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:47:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 -p 172.16.0.220:3260 --login {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:45 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b969667a-5978-43f7-ad4e-db1ffcdeeed7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:45 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865, portal: 172.16.0.220,3260]
Nov 16 03:47:45 user nova-compute[103546]: Login to [iface: default, target: iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865, portal: 172.16.0.220,3260] successful.
Nov 16 03:47:45 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:47:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:45 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[77652bb1-a2a7-476c-a1ff-90a7cdfcc64e]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:45 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:47:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:45 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[94948d14-9919-42bb-b34f-5958552dc3fe]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:45 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:47:45 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:47:45 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:47:45 user nova-compute[103546]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)
Nov 16 03:47:45 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:47:45 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:47:45 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:47:45 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:47:45 user nova-compute[103546]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)
Nov 16 03:47:45 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:47:45 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:47:45 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 03:47:45 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 03:47:45 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 03:47:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:45 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f9a609-e9b0-405d-af63-30ef38ba7af1]: (4, ('- - 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:45 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: None {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 03:47:45 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:45 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:45 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG nova.compute.manager [req-90e4a55b-9375-457a-83a0-3bb1b697f1c5 req-9275fbc1-93e5-4c52-9514-87cf2322c890 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received event network-vif-plugged-2159d4b9-42e0-48d5-bfdf-178ee853063c {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-90e4a55b-9375-457a-83a0-3bb1b697f1c5 req-9275fbc1-93e5-4c52-9514-87cf2322c890 service nova] Acquiring lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-90e4a55b-9375-457a-83a0-3bb1b697f1c5 req-9275fbc1-93e5-4c52-9514-87cf2322c890 service nova] Lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-90e4a55b-9375-457a-83a0-3bb1b697f1c5 req-9275fbc1-93e5-4c52-9514-87cf2322c890 service nova] Lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG nova.compute.manager [req-90e4a55b-9375-457a-83a0-3bb1b697f1c5 req-9275fbc1-93e5-4c52-9514-87cf2322c890 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] No waiting events found dispatching network-vif-plugged-2159d4b9-42e0-48d5-bfdf-178ee853063c {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:47:46 user nova-compute[103546]: WARNING nova.compute.manager [req-90e4a55b-9375-457a-83a0-3bb1b697f1c5 req-9275fbc1-93e5-4c52-9514-87cf2322c890 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received unexpected event network-vif-plugged-2159d4b9-42e0-48d5-bfdf-178ee853063c for instance with vm_state building and task_state spawning.
Nov 16 03:47:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mKMStNlq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '23633613066633533', 'path': '/dev/sde'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633613066633533', 'path': '/dev/sde'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nGCSWKyY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:47:46 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:47:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:47:46 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:47:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:47:46 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 03:47:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG nova.compute.manager [req-cdc25d77-b233-4da8-827e-441122cfd680 req-2591650f-073d-43d7-9ff3-b03cf0d613ee service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received event network-vif-plugged-cf751a83-e099-48a1-9219-fb781500b02c {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-cdc25d77-b233-4da8-827e-441122cfd680 req-2591650f-073d-43d7-9ff3-b03cf0d613ee service nova] Acquiring lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-cdc25d77-b233-4da8-827e-441122cfd680 req-2591650f-073d-43d7-9ff3-b03cf0d613ee service nova] Lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-cdc25d77-b233-4da8-827e-441122cfd680 req-2591650f-073d-43d7-9ff3-b03cf0d613ee service nova] Lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG nova.compute.manager [req-cdc25d77-b233-4da8-827e-441122cfd680 req-2591650f-073d-43d7-9ff3-b03cf0d613ee service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] No waiting events found dispatching network-vif-plugged-cf751a83-e099-48a1-9219-fb781500b02c {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:47:46 user nova-compute[103546]: WARNING nova.compute.manager [req-cdc25d77-b233-4da8-827e-441122cfd680 req-2591650f-073d-43d7-9ff3-b03cf0d613ee service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received unexpected event network-vif-plugged-cf751a83-e099-48a1-9219-fb781500b02c for instance with vm_state building and task_state spawning.
Nov 16 03:47:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[925aa5fa-af33-478b-b4b9-76ae190ec8d6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 03:47:46 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 -p 172.16.0.220:3260 --interface default --op new {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42e2240-5d10-4c3e-80c5-0a5cb04c823b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7] added\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7] added
Nov 16 03:47:46 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b5acf7-9f71-49e9-bed1-4084e179d844]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b368cffb-7579-4ceb-8807-2ebcb96d05ca]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nGCSWKyY {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nGCSWKyY" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1cc08d-8b50-4289-afe6-53b2539033a2]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nGCSWKyY'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f09a57b-5324-4299-a494-e13b12a2c0d8]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6d7596-a421-45ba-aeca-3b9e16e47a51]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:47:46 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:47:46 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:47:46 user nova-compute[103546]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)
Nov 16 03:47:46 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:47:46 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:47:46 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:47:46 user nova-compute[103546]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)
Nov 16 03:47:46 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 -p 172.16.0.220:3260 --login {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb13e65-e907-4c27-b8e5-1c8a7b81e8af]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7, portal: 172.16.0.220,3260]
Nov 16 03:47:46 user nova-compute[103546]: Login to [iface: default, target: iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7, portal: 172.16.0.220,3260] successful.
Nov 16 03:47:46 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[451dc606-ee4b-41a1-82ac-42e295fb7726]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.047s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c12ede7-4440-4a77-909b-d01b681400f6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:47:46 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:47:46 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:47:46 user nova-compute[103546]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)
Nov 16 03:47:46 user nova-compute[103546]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)
Nov 16 03:47:46 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:47:46 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:47:46 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:47:46 user nova-compute[103546]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)
Nov 16 03:47:46 user nova-compute[103546]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)
Nov 16 03:47:46 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.038s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d114a016-2902-4110-9ce0-48317f90cc58]: (4, ('- - 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nGCSWKyY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 03:47:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:47 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Acquiring lock "63b95121-b211-42c3-831e-0392d4abd09a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:47:47 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "63b95121-b211-42c3-831e-0392d4abd09a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:47:47 user nova-compute[103546]: DEBUG nova.compute.manager [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Starting instance... {{(pid=103546) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 03:47:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:47 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:47:47 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:47:47 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=103546) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 03:47:47 user nova-compute[103546]: INFO nova.compute.claims [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Claim successful on node user
Nov 16 03:47:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:47 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.416s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:47:47 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] <== connect_volume: return (1418ms) {'type': 'block', 'scsi_wwn': '26266626138386165', 'path': '/dev/sdf'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:47:47 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266626138386165', 'path': '/dev/sdf'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 03:47:47 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 03:47:47 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QtBJqjuH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:47:47 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:47:47 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:47:47 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:47:47 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:47:47 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:47:47 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:47:47 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 03:47:47 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:47 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:47 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d6fe30-32f8-4022-9e6a-304e14b53265]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:47 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 03:47:47 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:47:47 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b -p 172.16.0.220:3260 --interface default --op new {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:47 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:47:47 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:47 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[56be3e4e-c804-4d52-87c7-b389c9e5cccc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b] added\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:47 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b] added
Nov 16 03:47:47 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:47:47 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:47 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:47:47 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:47 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d222276b-c757-4714-bdca-a3a38a596f0c]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:47 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:47:47 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:47 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.462s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:47:47 user nova-compute[103546]: DEBUG nova.compute.manager [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Start building networks asynchronously for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 03:47:47 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:47 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[551055a3-b0d0-47bd-86e4-a31d1063b306]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:47 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:47:47 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QtBJqjuH {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:47 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QtBJqjuH" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:47 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[07aef6dd-03bb-44d3-9b36-aa823f979b7a]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:47 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QtBJqjuH'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:47:47 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a09d7f-0811-47e5-9ab2-2d24f4629340]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG nova.compute.manager [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Allocating IP information in the background. {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG nova.network.neutron [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] allocate_for_instance() {{(pid=103546) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:48 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 03:47:48 user nova-compute[103546]: DEBUG nova.compute.manager [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Start building block device mappings for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3539e9ac-2720-4fc2-950f-2c83365469a4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:47:48 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:47:48 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:47:48 user nova-compute[103546]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)
Nov 16 03:47:48 user nova-compute[103546]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)
Nov 16 03:47:48 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:47:48 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:47:48 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:47:48 user nova-compute[103546]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)
Nov 16 03:47:48 user nova-compute[103546]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)
Nov 16 03:47:48 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b -p 172.16.0.220:3260 --login {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG nova.policy [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6867c00b4e574b09b3d1174d19b52ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae61d862fd974779a8caf830313a724a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103546) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG nova.compute.manager [req-08fea975-fed8-4b6d-8040-cc92b45a7ec7 req-5e96002f-c880-4130-ad1e-9efc6d77d102 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received event network-vif-plugged-2159d4b9-42e0-48d5-bfdf-178ee853063c {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-08fea975-fed8-4b6d-8040-cc92b45a7ec7 req-5e96002f-c880-4130-ad1e-9efc6d77d102 service nova] Acquiring lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-08fea975-fed8-4b6d-8040-cc92b45a7ec7 req-5e96002f-c880-4130-ad1e-9efc6d77d102 service nova] Lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-08fea975-fed8-4b6d-8040-cc92b45a7ec7 req-5e96002f-c880-4130-ad1e-9efc6d77d102 service nova] Lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG nova.compute.manager [req-08fea975-fed8-4b6d-8040-cc92b45a7ec7 req-5e96002f-c880-4130-ad1e-9efc6d77d102 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] No waiting events found dispatching network-vif-plugged-2159d4b9-42e0-48d5-bfdf-178ee853063c {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:47:48 user nova-compute[103546]: WARNING nova.compute.manager [req-08fea975-fed8-4b6d-8040-cc92b45a7ec7 req-5e96002f-c880-4130-ad1e-9efc6d77d102 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received unexpected event network-vif-plugged-2159d4b9-42e0-48d5-bfdf-178ee853063c for instance with vm_state building and task_state spawning.
Nov 16 03:47:48 user nova-compute[103546]: DEBUG nova.compute.manager [req-08fea975-fed8-4b6d-8040-cc92b45a7ec7 req-5e96002f-c880-4130-ad1e-9efc6d77d102 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received event network-vif-plugged-1b75ba8c-049f-404a-aa82-0323bf51191c {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-08fea975-fed8-4b6d-8040-cc92b45a7ec7 req-5e96002f-c880-4130-ad1e-9efc6d77d102 service nova] Acquiring lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-08fea975-fed8-4b6d-8040-cc92b45a7ec7 req-5e96002f-c880-4130-ad1e-9efc6d77d102 service nova] Lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-08fea975-fed8-4b6d-8040-cc92b45a7ec7 req-5e96002f-c880-4130-ad1e-9efc6d77d102 service nova] Lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG nova.compute.manager [req-08fea975-fed8-4b6d-8040-cc92b45a7ec7 req-5e96002f-c880-4130-ad1e-9efc6d77d102 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] No waiting events found dispatching network-vif-plugged-1b75ba8c-049f-404a-aa82-0323bf51191c {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:47:48 user nova-compute[103546]: WARNING nova.compute.manager [req-08fea975-fed8-4b6d-8040-cc92b45a7ec7 req-5e96002f-c880-4130-ad1e-9efc6d77d102 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received unexpected event network-vif-plugged-1b75ba8c-049f-404a-aa82-0323bf51191c for instance with vm_state building and task_state spawning.
Nov 16 03:47:48 user nova-compute[103546]: DEBUG nova.compute.manager [req-08fea975-fed8-4b6d-8040-cc92b45a7ec7 req-5e96002f-c880-4130-ad1e-9efc6d77d102 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received event network-vif-plugged-1b75ba8c-049f-404a-aa82-0323bf51191c {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-08fea975-fed8-4b6d-8040-cc92b45a7ec7 req-5e96002f-c880-4130-ad1e-9efc6d77d102 service nova] Acquiring lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-08fea975-fed8-4b6d-8040-cc92b45a7ec7 req-5e96002f-c880-4130-ad1e-9efc6d77d102 service nova] Lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-08fea975-fed8-4b6d-8040-cc92b45a7ec7 req-5e96002f-c880-4130-ad1e-9efc6d77d102 service nova] Lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG nova.compute.manager [req-08fea975-fed8-4b6d-8040-cc92b45a7ec7 req-5e96002f-c880-4130-ad1e-9efc6d77d102 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] No waiting events found dispatching network-vif-plugged-1b75ba8c-049f-404a-aa82-0323bf51191c {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:47:48 user nova-compute[103546]: WARNING nova.compute.manager [req-08fea975-fed8-4b6d-8040-cc92b45a7ec7 req-5e96002f-c880-4130-ad1e-9efc6d77d102 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received unexpected event network-vif-plugged-1b75ba8c-049f-404a-aa82-0323bf51191c for instance with vm_state building and task_state spawning.
Nov 16 03:47:48 user nova-compute[103546]: DEBUG nova.compute.manager [req-08fea975-fed8-4b6d-8040-cc92b45a7ec7 req-5e96002f-c880-4130-ad1e-9efc6d77d102 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received event network-vif-plugged-c2216378-faa5-4bdc-8706-0be8df7807c0 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-08fea975-fed8-4b6d-8040-cc92b45a7ec7 req-5e96002f-c880-4130-ad1e-9efc6d77d102 service nova] Acquiring lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-08fea975-fed8-4b6d-8040-cc92b45a7ec7 req-5e96002f-c880-4130-ad1e-9efc6d77d102 service nova] Lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-08fea975-fed8-4b6d-8040-cc92b45a7ec7 req-5e96002f-c880-4130-ad1e-9efc6d77d102 service nova] Lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG nova.compute.manager [req-08fea975-fed8-4b6d-8040-cc92b45a7ec7 req-5e96002f-c880-4130-ad1e-9efc6d77d102 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] No waiting events found dispatching network-vif-plugged-c2216378-faa5-4bdc-8706-0be8df7807c0 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:47:48 user nova-compute[103546]: WARNING nova.compute.manager [req-08fea975-fed8-4b6d-8040-cc92b45a7ec7 req-5e96002f-c880-4130-ad1e-9efc6d77d102 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received unexpected event network-vif-plugged-c2216378-faa5-4bdc-8706-0be8df7807c0 for instance with vm_state building and task_state spawning.
Nov 16 03:47:48 user nova-compute[103546]: DEBUG nova.compute.manager [req-08fea975-fed8-4b6d-8040-cc92b45a7ec7 req-5e96002f-c880-4130-ad1e-9efc6d77d102 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received event network-vif-plugged-c2216378-faa5-4bdc-8706-0be8df7807c0 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-08fea975-fed8-4b6d-8040-cc92b45a7ec7 req-5e96002f-c880-4130-ad1e-9efc6d77d102 service nova] Acquiring lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-08fea975-fed8-4b6d-8040-cc92b45a7ec7 req-5e96002f-c880-4130-ad1e-9efc6d77d102 service nova] Lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-08fea975-fed8-4b6d-8040-cc92b45a7ec7 req-5e96002f-c880-4130-ad1e-9efc6d77d102 service nova] Lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG nova.compute.manager [req-08fea975-fed8-4b6d-8040-cc92b45a7ec7 req-5e96002f-c880-4130-ad1e-9efc6d77d102 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] No waiting events found dispatching network-vif-plugged-c2216378-faa5-4bdc-8706-0be8df7807c0 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:47:48 user nova-compute[103546]: WARNING nova.compute.manager [req-08fea975-fed8-4b6d-8040-cc92b45a7ec7 req-5e96002f-c880-4130-ad1e-9efc6d77d102 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received unexpected event network-vif-plugged-c2216378-faa5-4bdc-8706-0be8df7807c0 for instance with vm_state building and task_state spawning.
Nov 16 03:47:48 user nova-compute[103546]: DEBUG nova.compute.manager [req-08fea975-fed8-4b6d-8040-cc92b45a7ec7 req-5e96002f-c880-4130-ad1e-9efc6d77d102 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received event network-vif-plugged-87ab6a10-d50c-460e-b891-ce6439614185 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-08fea975-fed8-4b6d-8040-cc92b45a7ec7 req-5e96002f-c880-4130-ad1e-9efc6d77d102 service nova] Acquiring lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-08fea975-fed8-4b6d-8040-cc92b45a7ec7 req-5e96002f-c880-4130-ad1e-9efc6d77d102 service nova] Lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-08fea975-fed8-4b6d-8040-cc92b45a7ec7 req-5e96002f-c880-4130-ad1e-9efc6d77d102 service nova] Lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG nova.compute.manager [req-08fea975-fed8-4b6d-8040-cc92b45a7ec7 req-5e96002f-c880-4130-ad1e-9efc6d77d102 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] No waiting events found dispatching network-vif-plugged-87ab6a10-d50c-460e-b891-ce6439614185 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:47:48 user nova-compute[103546]: WARNING nova.compute.manager [req-08fea975-fed8-4b6d-8040-cc92b45a7ec7 req-5e96002f-c880-4130-ad1e-9efc6d77d102 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received unexpected event network-vif-plugged-87ab6a10-d50c-460e-b891-ce6439614185 for instance with vm_state building and task_state spawning.
Nov 16 03:47:48 user nova-compute[103546]: DEBUG nova.compute.manager [req-08fea975-fed8-4b6d-8040-cc92b45a7ec7 req-5e96002f-c880-4130-ad1e-9efc6d77d102 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received event network-vif-plugged-87ab6a10-d50c-460e-b891-ce6439614185 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-08fea975-fed8-4b6d-8040-cc92b45a7ec7 req-5e96002f-c880-4130-ad1e-9efc6d77d102 service nova] Acquiring lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-08fea975-fed8-4b6d-8040-cc92b45a7ec7 req-5e96002f-c880-4130-ad1e-9efc6d77d102 service nova] Lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-08fea975-fed8-4b6d-8040-cc92b45a7ec7 req-5e96002f-c880-4130-ad1e-9efc6d77d102 service nova] Lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG nova.compute.manager [req-08fea975-fed8-4b6d-8040-cc92b45a7ec7 req-5e96002f-c880-4130-ad1e-9efc6d77d102 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] No waiting events found dispatching network-vif-plugged-87ab6a10-d50c-460e-b891-ce6439614185 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:47:48 user nova-compute[103546]: WARNING nova.compute.manager [req-08fea975-fed8-4b6d-8040-cc92b45a7ec7 req-5e96002f-c880-4130-ad1e-9efc6d77d102 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received unexpected event network-vif-plugged-87ab6a10-d50c-460e-b891-ce6439614185 for instance with vm_state building and task_state spawning.
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ddb865-f7d5-4f24-b005-f286226badb0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b, portal: 172.16.0.220,3260]
Nov 16 03:47:48 user nova-compute[103546]: Login to [iface: default, target: iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b, portal: 172.16.0.220,3260] successful.
Nov 16 03:47:48 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG nova.compute.manager [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Start spawning the instance on the hypervisor. {{(pid=103546) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Creating instance directory {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 03:47:48 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Creating image(s)
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Acquiring lock "/opt/stack/data/nova/instances/63b95121-b211-42c3-831e-0392d4abd09a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "/opt/stack/data/nova/instances/63b95121-b211-42c3-831e-0392d4abd09a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "/opt/stack/data/nova/instances/63b95121-b211-42c3-831e-0392d4abd09a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a42a966-410c-4009-a5e2-8af0c1548fcc]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63b6885-acad-4597-ad9d-448b37a07e92]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:47:48 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:47:48 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:47:48 user nova-compute[103546]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)
Nov 16 03:47:48 user nova-compute[103546]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)
Nov 16 03:47:48 user nova-compute[103546]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)
Nov 16 03:47:48 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:47:48 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:47:48 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:47:48 user nova-compute[103546]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)
Nov 16 03:47:48 user nova-compute[103546]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)
Nov 16 03:47:48 user nova-compute[103546]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)
Nov 16 03:47:48 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.388s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d44caf-4135-466a-8813-3213532ff5d8]: (4, ('- - 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QtBJqjuH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.190s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Acquiring lock "8c9efafb670bfe5842ba1f4ce398924612164af7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.007s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG nova.compute.manager [req-16522fb0-8817-4818-9094-5d6b87279357 req-4d60a184-dd2f-4cbc-8462-d1175e337b23 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received event network-vif-plugged-cf751a83-e099-48a1-9219-fb781500b02c {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-16522fb0-8817-4818-9094-5d6b87279357 req-4d60a184-dd2f-4cbc-8462-d1175e337b23 service nova] Acquiring lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-16522fb0-8817-4818-9094-5d6b87279357 req-4d60a184-dd2f-4cbc-8462-d1175e337b23 service nova] Lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-16522fb0-8817-4818-9094-5d6b87279357 req-4d60a184-dd2f-4cbc-8462-d1175e337b23 service nova] Lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG nova.compute.manager [req-16522fb0-8817-4818-9094-5d6b87279357 req-4d60a184-dd2f-4cbc-8462-d1175e337b23 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] No waiting events found dispatching network-vif-plugged-cf751a83-e099-48a1-9219-fb781500b02c {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:47:48 user nova-compute[103546]: WARNING nova.compute.manager [req-16522fb0-8817-4818-9094-5d6b87279357 req-4d60a184-dd2f-4cbc-8462-d1175e337b23 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received unexpected event network-vif-plugged-cf751a83-e099-48a1-9219-fb781500b02c for instance with vm_state building and task_state spawning.
Nov 16 03:47:48 user nova-compute[103546]: DEBUG nova.compute.manager [req-16522fb0-8817-4818-9094-5d6b87279357 req-4d60a184-dd2f-4cbc-8462-d1175e337b23 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received event network-vif-plugged-96e41ba8-e2bd-48d3-a8e0-94c5f76d618a {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-16522fb0-8817-4818-9094-5d6b87279357 req-4d60a184-dd2f-4cbc-8462-d1175e337b23 service nova] Acquiring lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-16522fb0-8817-4818-9094-5d6b87279357 req-4d60a184-dd2f-4cbc-8462-d1175e337b23 service nova] Lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-16522fb0-8817-4818-9094-5d6b87279357 req-4d60a184-dd2f-4cbc-8462-d1175e337b23 service nova] Lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG nova.compute.manager [req-16522fb0-8817-4818-9094-5d6b87279357 req-4d60a184-dd2f-4cbc-8462-d1175e337b23 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] No waiting events found dispatching network-vif-plugged-96e41ba8-e2bd-48d3-a8e0-94c5f76d618a {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:47:48 user nova-compute[103546]: WARNING nova.compute.manager [req-16522fb0-8817-4818-9094-5d6b87279357 req-4d60a184-dd2f-4cbc-8462-d1175e337b23 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received unexpected event network-vif-plugged-96e41ba8-e2bd-48d3-a8e0-94c5f76d618a for instance with vm_state building and task_state spawning.
Nov 16 03:47:48 user nova-compute[103546]: DEBUG nova.compute.manager [req-16522fb0-8817-4818-9094-5d6b87279357 req-4d60a184-dd2f-4cbc-8462-d1175e337b23 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received event network-vif-plugged-96e41ba8-e2bd-48d3-a8e0-94c5f76d618a {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-16522fb0-8817-4818-9094-5d6b87279357 req-4d60a184-dd2f-4cbc-8462-d1175e337b23 service nova] Acquiring lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-16522fb0-8817-4818-9094-5d6b87279357 req-4d60a184-dd2f-4cbc-8462-d1175e337b23 service nova] Lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-16522fb0-8817-4818-9094-5d6b87279357 req-4d60a184-dd2f-4cbc-8462-d1175e337b23 service nova] Lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG nova.compute.manager [req-16522fb0-8817-4818-9094-5d6b87279357 req-4d60a184-dd2f-4cbc-8462-d1175e337b23 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] No waiting events found dispatching network-vif-plugged-96e41ba8-e2bd-48d3-a8e0-94c5f76d618a {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:47:48 user nova-compute[103546]: WARNING nova.compute.manager [req-16522fb0-8817-4818-9094-5d6b87279357 req-4d60a184-dd2f-4cbc-8462-d1175e337b23 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received unexpected event network-vif-plugged-96e41ba8-e2bd-48d3-a8e0-94c5f76d618a for instance with vm_state building and task_state spawning.
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.174s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/63b95121-b211-42c3-831e-0392d4abd09a/disk 1073741824 {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/63b95121-b211-42c3-831e-0392d4abd09a/disk 1073741824" returned: 0 in 0.047s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG nova.compute.manager [req-fd75a323-66e9-498e-b165-453d1325a273 req-a5547277-7a00-4371-9b2f-89fd621c7df9 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received event network-vif-plugged-75b2ff49-49cc-4b86-bdc6-6f9f76c06505 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-fd75a323-66e9-498e-b165-453d1325a273 req-a5547277-7a00-4371-9b2f-89fd621c7df9 service nova] Acquiring lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-fd75a323-66e9-498e-b165-453d1325a273 req-a5547277-7a00-4371-9b2f-89fd621c7df9 service nova] Lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-fd75a323-66e9-498e-b165-453d1325a273 req-a5547277-7a00-4371-9b2f-89fd621c7df9 service nova] Lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG nova.compute.manager [req-fd75a323-66e9-498e-b165-453d1325a273 req-a5547277-7a00-4371-9b2f-89fd621c7df9 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] No waiting events found dispatching network-vif-plugged-75b2ff49-49cc-4b86-bdc6-6f9f76c06505 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:47:48 user nova-compute[103546]: WARNING nova.compute.manager [req-fd75a323-66e9-498e-b165-453d1325a273 req-a5547277-7a00-4371-9b2f-89fd621c7df9 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received unexpected event network-vif-plugged-75b2ff49-49cc-4b86-bdc6-6f9f76c06505 for instance with vm_state building and task_state spawning.
Nov 16 03:47:48 user nova-compute[103546]: DEBUG nova.network.neutron [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Successfully created port: 1d1c7496-0480-45a7-8490-bc581314a4b5 {{(pid=103546) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.186s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Checking if we can resize image /opt/stack/data/nova/instances/63b95121-b211-42c3-831e-0392d4abd09a/disk. size=1073741824 {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63b95121-b211-42c3-831e-0392d4abd09a/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63b95121-b211-42c3-831e-0392d4abd09a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Cannot resize image /opt/stack/data/nova/instances/63b95121-b211-42c3-831e-0392d4abd09a/disk to a smaller size. {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Created local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Ensure instance console log exists: /opt/stack/data/nova/instances/63b95121-b211-42c3-831e-0392d4abd09a/console.log {{(pid=103546) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:47:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.network.neutron [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Successfully updated port: 1d1c7496-0480-45a7-8490-bc581314a4b5 {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.430s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] <== connect_volume: return (1431ms) {'type': 'block', 'scsi_wwn': '23661393731373762', 'path': '/dev/sdg'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661393731373762', 'path': '/dev/sdg'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Acquiring lock "refresh_cache-63b95121-b211-42c3-831e-0392d4abd09a" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Acquired lock "refresh_cache-63b95121-b211-42c3-831e-0392d4abd09a" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.network.neutron [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T03:47:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-979087498',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-979087498',id=9,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJG5mUAddSpdXo5xKbrCCUDaorTLl+JXOZykC25X5m5JZ0Q8xHTJFntian9eeJtJJoBz5bNafVu8oRPVVoo6ppzucGvYFRw2h3YmPV1yz/S+0Xyvp0oF5B9x4ridLbkfA==',key_name='tempest-keypair-1167953100',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54df5ea6e7a24d49bb8f430fb9248934',ramdisk_id='',reservation_id='r-dhhzqrat',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1024082213',owner_user_name='tempest-TaggedBootDevicesTest_v242-1024082213-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:47:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d9e6b5b41d341e19548640d455eaa0f',uuid=71059a8d-4e89-472c-9463-b38aa8063e33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76b69715-356f-496a-85a3-f5bde976e201", "address": "fa:16:3e:72:5a:35", "network": {"id": "f84b2b6b-c73a-41d8-a9bb-3e73bb607a42", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1721792603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76b69715-35", "ovs_interfaceid": "76b69715-356f-496a-85a3-f5bde976e201", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Converting VIF {"id": "76b69715-356f-496a-85a3-f5bde976e201", "address": "fa:16:3e:72:5a:35", "network": {"id": "f84b2b6b-c73a-41d8-a9bb-3e73bb607a42", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1721792603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76b69715-35", "ovs_interfaceid": "76b69715-356f-496a-85a3-f5bde976e201", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:5a:35,bridge_name='br-int',has_traffic_filtering=True,id=76b69715-356f-496a-85a3-f5bde976e201,network=Network(f84b2b6b-c73a-41d8-a9bb-3e73bb607a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76b69715-35') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T03:47:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-979087498',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-979087498',id=9,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJG5mUAddSpdXo5xKbrCCUDaorTLl+JXOZykC25X5m5JZ0Q8xHTJFntian9eeJtJJoBz5bNafVu8oRPVVoo6ppzucGvYFRw2h3YmPV1yz/S+0Xyvp0oF5B9x4ridLbkfA==',key_name='tempest-keypair-1167953100',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54df5ea6e7a24d49bb8f430fb9248934',ramdisk_id='',reservation_id='r-dhhzqrat',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1024082213',owner_user_name='tempest-TaggedBootDevicesTest_v242-1024082213-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:47:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d9e6b5b41d341e19548640d455eaa0f',uuid=71059a8d-4e89-472c-9463-b38aa8063e33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21653257-8a66-44f1-b806-2fae4641e1d2", "address": "fa:16:3e:91:a8:b5", "network": {"id": "4b071e67-eb71-49f5-a24f-cada83cca606", "bridge": "br-int", "label": "tempest-device-tagging-net1-1064540428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21653257-8a", "ovs_interfaceid": "21653257-8a66-44f1-b806-2fae4641e1d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Converting VIF {"id": "21653257-8a66-44f1-b806-2fae4641e1d2", "address": "fa:16:3e:91:a8:b5", "network": {"id": "4b071e67-eb71-49f5-a24f-cada83cca606", "bridge": "br-int", "label": "tempest-device-tagging-net1-1064540428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21653257-8a", "ovs_interfaceid": "21653257-8a66-44f1-b806-2fae4641e1d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:a8:b5,bridge_name='br-int',has_traffic_filtering=True,id=21653257-8a66-44f1-b806-2fae4641e1d2,network=Network(4b071e67-eb71-49f5-a24f-cada83cca606),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap21653257-8a') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T03:47:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-979087498',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-979087498',id=9,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJG5mUAddSpdXo5xKbrCCUDaorTLl+JXOZykC25X5m5JZ0Q8xHTJFntian9eeJtJJoBz5bNafVu8oRPVVoo6ppzucGvYFRw2h3YmPV1yz/S+0Xyvp0oF5B9x4ridLbkfA==',key_name='tempest-keypair-1167953100',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54df5ea6e7a24d49bb8f430fb9248934',ramdisk_id='',reservation_id='r-dhhzqrat',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1024082213',owner_user_name='tempest-TaggedBootDevicesTest_v242-1024082213-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:47:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d9e6b5b41d341e19548640d455eaa0f',uuid=71059a8d-4e89-472c-9463-b38aa8063e33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "916a3fe8-09df-42a1-9ac0-b81153ed55a1", "address": "fa:16:3e:00:b7:5f", "network": {"id": "4b071e67-eb71-49f5-a24f-cada83cca606", "bridge": "br-int", "label": "tempest-device-tagging-net1-1064540428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap916a3fe8-09", "ovs_interfaceid": "916a3fe8-09df-42a1-9ac0-b81153ed55a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Converting VIF {"id": "916a3fe8-09df-42a1-9ac0-b81153ed55a1", "address": "fa:16:3e:00:b7:5f", "network": {"id": "4b071e67-eb71-49f5-a24f-cada83cca606", "bridge": "br-int", "label": "tempest-device-tagging-net1-1064540428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap916a3fe8-09", "ovs_interfaceid": "916a3fe8-09df-42a1-9ac0-b81153ed55a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:b7:5f,bridge_name='br-int',has_traffic_filtering=True,id=916a3fe8-09df-42a1-9ac0-b81153ed55a1,network=Network(4b071e67-eb71-49f5-a24f-cada83cca606),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap916a3fe8-09') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T03:47:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-979087498',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-979087498',id=9,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJG5mUAddSpdXo5xKbrCCUDaorTLl+JXOZykC25X5m5JZ0Q8xHTJFntian9eeJtJJoBz5bNafVu8oRPVVoo6ppzucGvYFRw2h3YmPV1yz/S+0Xyvp0oF5B9x4ridLbkfA==',key_name='tempest-keypair-1167953100',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54df5ea6e7a24d49bb8f430fb9248934',ramdisk_id='',reservation_id='r-dhhzqrat',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1024082213',owner_user_name='tempest-TaggedBootDevicesTest_v242-1024082213-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:47:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d9e6b5b41d341e19548640d455eaa0f',uuid=71059a8d-4e89-472c-9463-b38aa8063e33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1fb75f05-a4ef-45d5-9eb4-5e8428997947", "address": "fa:16:3e:e6:68:04", "network": {"id": "4b071e67-eb71-49f5-a24f-cada83cca606", "bridge": "br-int", "label": "tempest-device-tagging-net1-1064540428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fb75f05-a4", "ovs_interfaceid": "1fb75f05-a4ef-45d5-9eb4-5e8428997947", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Converting VIF {"id": "1fb75f05-a4ef-45d5-9eb4-5e8428997947", "address": "fa:16:3e:e6:68:04", "network": {"id": "4b071e67-eb71-49f5-a24f-cada83cca606", "bridge": "br-int", "label": "tempest-device-tagging-net1-1064540428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fb75f05-a4", "ovs_interfaceid": "1fb75f05-a4ef-45d5-9eb4-5e8428997947", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:68:04,bridge_name='br-int',has_traffic_filtering=True,id=1fb75f05-a4ef-45d5-9eb4-5e8428997947,network=Network(4b071e67-eb71-49f5-a24f-cada83cca606),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fb75f05-a4') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T03:47:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-979087498',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-979087498',id=9,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJG5mUAddSpdXo5xKbrCCUDaorTLl+JXOZykC25X5m5JZ0Q8xHTJFntian9eeJtJJoBz5bNafVu8oRPVVoo6ppzucGvYFRw2h3YmPV1yz/S+0Xyvp0oF5B9x4ridLbkfA==',key_name='tempest-keypair-1167953100',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54df5ea6e7a24d49bb8f430fb9248934',ramdisk_id='',reservation_id='r-dhhzqrat',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1024082213',owner_user_name='tempest-TaggedBootDevicesTest_v242-1024082213-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:47:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d9e6b5b41d341e19548640d455eaa0f',uuid=71059a8d-4e89-472c-9463-b38aa8063e33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51e087e4-ff6b-49a8-8190-cfc243436d35", "address": "fa:16:3e:3f:53:f1", "network": {"id": "4b071e67-eb71-49f5-a24f-cada83cca606", "bridge": "br-int", "label": "tempest-device-tagging-net1-1064540428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51e087e4-ff", "ovs_interfaceid": "51e087e4-ff6b-49a8-8190-cfc243436d35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Converting VIF {"id": "51e087e4-ff6b-49a8-8190-cfc243436d35", "address": "fa:16:3e:3f:53:f1", "network": {"id": "4b071e67-eb71-49f5-a24f-cada83cca606", "bridge": "br-int", "label": "tempest-device-tagging-net1-1064540428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51e087e4-ff", "ovs_interfaceid": "51e087e4-ff6b-49a8-8190-cfc243436d35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:53:f1,bridge_name='br-int',has_traffic_filtering=True,id=51e087e4-ff6b-49a8-8190-cfc243436d35,network=Network(4b071e67-eb71-49f5-a24f-cada83cca606),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51e087e4-ff') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T03:47:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-979087498',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-979087498',id=9,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJG5mUAddSpdXo5xKbrCCUDaorTLl+JXOZykC25X5m5JZ0Q8xHTJFntian9eeJtJJoBz5bNafVu8oRPVVoo6ppzucGvYFRw2h3YmPV1yz/S+0Xyvp0oF5B9x4ridLbkfA==',key_name='tempest-keypair-1167953100',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54df5ea6e7a24d49bb8f430fb9248934',ramdisk_id='',reservation_id='r-dhhzqrat',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1024082213',owner_user_name='tempest-TaggedBootDevicesTest_v242-1024082213-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:47:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d9e6b5b41d341e19548640d455eaa0f',uuid=71059a8d-4e89-472c-9463-b38aa8063e33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0f609b8-eb49-4c19-968c-99c95c38b857", "address": "fa:16:3e:dc:33:a5", "network": {"id": "f9af5267-5cc4-44b4-9226-2da63e754907", "bridge": "br-int", "label": "tempest-device-tagging-net2-640329577", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0f609b8-eb", "ovs_interfaceid": "b0f609b8-eb49-4c19-968c-99c95c38b857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Converting VIF {"id": "b0f609b8-eb49-4c19-968c-99c95c38b857", "address": "fa:16:3e:dc:33:a5", "network": {"id": "f9af5267-5cc4-44b4-9226-2da63e754907", "bridge": "br-int", "label": "tempest-device-tagging-net2-640329577", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0f609b8-eb", "ovs_interfaceid": "b0f609b8-eb49-4c19-968c-99c95c38b857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:33:a5,bridge_name='br-int',has_traffic_filtering=True,id=b0f609b8-eb49-4c19-968c-99c95c38b857,network=Network(f9af5267-5cc4-44b4-9226-2da63e754907),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0f609b8-eb') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T03:47:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-979087498',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-979087498',id=9,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJG5mUAddSpdXo5xKbrCCUDaorTLl+JXOZykC25X5m5JZ0Q8xHTJFntian9eeJtJJoBz5bNafVu8oRPVVoo6ppzucGvYFRw2h3YmPV1yz/S+0Xyvp0oF5B9x4ridLbkfA==',key_name='tempest-keypair-1167953100',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54df5ea6e7a24d49bb8f430fb9248934',ramdisk_id='',reservation_id='r-dhhzqrat',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1024082213',owner_user_name='tempest-TaggedBootDevicesTest_v242-1024082213-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:47:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d9e6b5b41d341e19548640d455eaa0f',uuid=71059a8d-4e89-472c-9463-b38aa8063e33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc03966b-fcbc-4ed7-8ffb-2270a55b4e28", "address": "fa:16:3e:75:5a:4b", "network": {"id": "f9af5267-5cc4-44b4-9226-2da63e754907", "bridge": "br-int", "label": "tempest-device-tagging-net2-640329577", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc03966b-fc", "ovs_interfaceid": "fc03966b-fcbc-4ed7-8ffb-2270a55b4e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Converting VIF {"id": "fc03966b-fcbc-4ed7-8ffb-2270a55b4e28", "address": "fa:16:3e:75:5a:4b", "network": {"id": "f9af5267-5cc4-44b4-9226-2da63e754907", "bridge": "br-int", "label": "tempest-device-tagging-net2-640329577", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc03966b-fc", "ovs_interfaceid": "fc03966b-fcbc-4ed7-8ffb-2270a55b4e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:5a:4b,bridge_name='br-int',has_traffic_filtering=True,id=fc03966b-fcbc-4ed7-8ffb-2270a55b4e28,network=Network(f9af5267-5cc4-44b4-9226-2da63e754907),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc03966b-fc') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.objects.instance [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Lazy-loading 'pci_devices' on Instance uuid 71059a8d-4e89-472c-9463-b38aa8063e33 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] End _get_guest_xml xml=<domain type="kvm">
Nov 16 03:47:49 user nova-compute[103546]:   <uuid>71059a8d-4e89-472c-9463-b38aa8063e33</uuid>
Nov 16 03:47:49 user nova-compute[103546]:   <name>instance-00000009</name>
Nov 16 03:47:49 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 03:47:49 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 03:47:49 user nova-compute[103546]:   <metadata>
Nov 16 03:47:49 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 03:47:49 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 03:47:49 user nova-compute[103546]:       <nova:name>tempest-device-tagging-server-979087498</nova:name>
Nov 16 03:47:49 user nova-compute[103546]:       <nova:creationTime>2023-11-16 03:47:44</nova:creationTime>
Nov 16 03:47:49 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 03:47:49 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 03:47:49 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 03:47:49 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 03:47:49 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 03:47:49 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 03:47:49 user nova-compute[103546]:       </nova:flavor>
Nov 16 03:47:49 user nova-compute[103546]:       <nova:owner>
Nov 16 03:47:49 user nova-compute[103546]:         <nova:user uuid="7d9e6b5b41d341e19548640d455eaa0f">tempest-TaggedBootDevicesTest_v242-1024082213-project-member</nova:user>
Nov 16 03:47:49 user nova-compute[103546]:         <nova:project uuid="54df5ea6e7a24d49bb8f430fb9248934">tempest-TaggedBootDevicesTest_v242-1024082213</nova:project>
Nov 16 03:47:49 user nova-compute[103546]:       </nova:owner>
Nov 16 03:47:49 user nova-compute[103546]:       <nova:root type="image" uuid="5c6f539a-01e5-4478-bf8f-a14310b5d7dd"/>
Nov 16 03:47:49 user nova-compute[103546]:       <nova:ports>
Nov 16 03:47:49 user nova-compute[103546]:         <nova:port uuid="76b69715-356f-496a-85a3-f5bde976e201">
Nov 16 03:47:49 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 16 03:47:49 user nova-compute[103546]:         </nova:port>
Nov 16 03:47:49 user nova-compute[103546]:         <nova:port uuid="21653257-8a66-44f1-b806-2fae4641e1d2">
Nov 16 03:47:49 user nova-compute[103546]:           <nova:ip type="fixed" address="10.1.1.32" ipVersion="4"/>
Nov 16 03:47:49 user nova-compute[103546]:         </nova:port>
Nov 16 03:47:49 user nova-compute[103546]:         <nova:port uuid="916a3fe8-09df-42a1-9ac0-b81153ed55a1">
Nov 16 03:47:49 user nova-compute[103546]:           <nova:ip type="fixed" address="10.1.1.213" ipVersion="4"/>
Nov 16 03:47:49 user nova-compute[103546]:         </nova:port>
Nov 16 03:47:49 user nova-compute[103546]:         <nova:port uuid="1fb75f05-a4ef-45d5-9eb4-5e8428997947">
Nov 16 03:47:49 user nova-compute[103546]:           <nova:ip type="fixed" address="10.1.1.133" ipVersion="4"/>
Nov 16 03:47:49 user nova-compute[103546]:         </nova:port>
Nov 16 03:47:49 user nova-compute[103546]:         <nova:port uuid="51e087e4-ff6b-49a8-8190-cfc243436d35">
Nov 16 03:47:49 user nova-compute[103546]:           <nova:ip type="fixed" address="10.1.1.165" ipVersion="4"/>
Nov 16 03:47:49 user nova-compute[103546]:         </nova:port>
Nov 16 03:47:49 user nova-compute[103546]:         <nova:port uuid="b0f609b8-eb49-4c19-968c-99c95c38b857">
Nov 16 03:47:49 user nova-compute[103546]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 16 03:47:49 user nova-compute[103546]:         </nova:port>
Nov 16 03:47:49 user nova-compute[103546]:         <nova:port uuid="fc03966b-fcbc-4ed7-8ffb-2270a55b4e28">
Nov 16 03:47:49 user nova-compute[103546]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 16 03:47:49 user nova-compute[103546]:         </nova:port>
Nov 16 03:47:49 user nova-compute[103546]:       </nova:ports>
Nov 16 03:47:49 user nova-compute[103546]:     </nova:instance>
Nov 16 03:47:49 user nova-compute[103546]:   </metadata>
Nov 16 03:47:49 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 03:47:49 user nova-compute[103546]:     <system>
Nov 16 03:47:49 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 03:47:49 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 03:47:49 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 03:47:49 user nova-compute[103546]:       <entry name="serial">71059a8d-4e89-472c-9463-b38aa8063e33</entry>
Nov 16 03:47:49 user nova-compute[103546]:       <entry name="uuid">71059a8d-4e89-472c-9463-b38aa8063e33</entry>
Nov 16 03:47:49 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 03:47:49 user nova-compute[103546]:     </system>
Nov 16 03:47:49 user nova-compute[103546]:   </sysinfo>
Nov 16 03:47:49 user nova-compute[103546]:   <os>
Nov 16 03:47:49 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 03:47:49 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 03:47:49 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 03:47:49 user nova-compute[103546]:   </os>
Nov 16 03:47:49 user nova-compute[103546]:   <features>
Nov 16 03:47:49 user nova-compute[103546]:     <acpi/>
Nov 16 03:47:49 user nova-compute[103546]:     <apic/>
Nov 16 03:47:49 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 03:47:49 user nova-compute[103546]:   </features>
Nov 16 03:47:49 user nova-compute[103546]:   <clock offset="utc">
Nov 16 03:47:49 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 03:47:49 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 03:47:49 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 03:47:49 user nova-compute[103546]:   </clock>
Nov 16 03:47:49 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 03:47:49 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 03:47:49 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 03:47:49 user nova-compute[103546]:   </cpu>
Nov 16 03:47:49 user nova-compute[103546]:   <devices>
Nov 16 03:47:49 user nova-compute[103546]:     <disk type="file" device="cdrom">
Nov 16 03:47:49 user nova-compute[103546]:       <driver name="qemu" type="raw" cache="none"/>
Nov 16 03:47:49 user nova-compute[103546]:       <source file="/opt/stack/data/nova/instances/71059a8d-4e89-472c-9463-b38aa8063e33/disk.config"/>
Nov 16 03:47:49 user nova-compute[103546]:       <target dev="hda" bus="ide"/>
Nov 16 03:47:49 user nova-compute[103546]:     </disk>
Nov 16 03:47:49 user nova-compute[103546]:     <disk type="block" device="disk">
Nov 16 03:47:49 user nova-compute[103546]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 03:47:49 user nova-compute[103546]:       <source dev="/dev/sde"/>
Nov 16 03:47:49 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 03:47:49 user nova-compute[103546]:       <serial>b5221ff7-1f34-47db-a9c6-ce3f8e58e865</serial>
Nov 16 03:47:49 user nova-compute[103546]:     </disk>
Nov 16 03:47:49 user nova-compute[103546]:     <disk type="block" device="disk">
Nov 16 03:47:49 user nova-compute[103546]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 03:47:49 user nova-compute[103546]:       <source dev="/dev/sdf"/>
Nov 16 03:47:49 user nova-compute[103546]:       <target dev="vdb" bus="virtio"/>
Nov 16 03:47:49 user nova-compute[103546]:       <serial>cbd5ba3f-7069-4f25-bc49-017b07ac2ca7</serial>
Nov 16 03:47:49 user nova-compute[103546]:     </disk>
Nov 16 03:47:49 user nova-compute[103546]:     <disk type="block" device="disk">
Nov 16 03:47:49 user nova-compute[103546]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 03:47:49 user nova-compute[103546]:       <source dev="/dev/sdg"/>
Nov 16 03:47:49 user nova-compute[103546]:       <target dev="vdc" bus="virtio"/>
Nov 16 03:47:49 user nova-compute[103546]:       <serial>3be95c74-7c8d-48bc-8e7a-68b67513280b</serial>
Nov 16 03:47:49 user nova-compute[103546]:     </disk>
Nov 16 03:47:49 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 03:47:49 user nova-compute[103546]:       <mac address="fa:16:3e:72:5a:35"/>
Nov 16 03:47:49 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:47:49 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 03:47:49 user nova-compute[103546]:       <target dev="tap76b69715-35"/>
Nov 16 03:47:49 user nova-compute[103546]:     </interface>
Nov 16 03:47:49 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 03:47:49 user nova-compute[103546]:       <mac address="fa:16:3e:91:a8:b5"/>
Nov 16 03:47:49 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:47:49 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 03:47:49 user nova-compute[103546]:       <target dev="tap21653257-8a"/>
Nov 16 03:47:49 user nova-compute[103546]:     </interface>
Nov 16 03:47:49 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 03:47:49 user nova-compute[103546]:       <mac address="fa:16:3e:00:b7:5f"/>
Nov 16 03:47:49 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:47:49 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 03:47:49 user nova-compute[103546]:       <target dev="tap916a3fe8-09"/>
Nov 16 03:47:49 user nova-compute[103546]:     </interface>
Nov 16 03:47:49 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 03:47:49 user nova-compute[103546]:       <mac address="fa:16:3e:e6:68:04"/>
Nov 16 03:47:49 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:47:49 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 03:47:49 user nova-compute[103546]:       <target dev="tap1fb75f05-a4"/>
Nov 16 03:47:49 user nova-compute[103546]:     </interface>
Nov 16 03:47:49 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 03:47:49 user nova-compute[103546]:       <mac address="fa:16:3e:3f:53:f1"/>
Nov 16 03:47:49 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:47:49 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 03:47:49 user nova-compute[103546]:       <target dev="tap51e087e4-ff"/>
Nov 16 03:47:49 user nova-compute[103546]:     </interface>
Nov 16 03:47:49 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 03:47:49 user nova-compute[103546]:       <mac address="fa:16:3e:dc:33:a5"/>
Nov 16 03:47:49 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:47:49 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 03:47:49 user nova-compute[103546]:       <target dev="tapb0f609b8-eb"/>
Nov 16 03:47:49 user nova-compute[103546]:     </interface>
Nov 16 03:47:49 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 03:47:49 user nova-compute[103546]:       <mac address="fa:16:3e:75:5a:4b"/>
Nov 16 03:47:49 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:47:49 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 03:47:49 user nova-compute[103546]:       <target dev="tapfc03966b-fc"/>
Nov 16 03:47:49 user nova-compute[103546]:     </interface>
Nov 16 03:47:49 user nova-compute[103546]:     <serial type="pty">
Nov 16 03:47:49 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/71059a8d-4e89-472c-9463-b38aa8063e33/console.log" append="off"/>
Nov 16 03:47:49 user nova-compute[103546]:     </serial>
Nov 16 03:47:49 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 03:47:49 user nova-compute[103546]:     <video>
Nov 16 03:47:49 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:47:49 user nova-compute[103546]:     </video>
Nov 16 03:47:49 user nova-compute[103546]:     <rng model="virtio">
Nov 16 03:47:49 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 03:47:49 user nova-compute[103546]:     </rng>
Nov 16 03:47:49 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 03:47:49 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 03:47:49 user nova-compute[103546]:       <stats period="10"/>
Nov 16 03:47:49 user nova-compute[103546]:     </memballoon>
Nov 16 03:47:49 user nova-compute[103546]:   </devices>
Nov 16 03:47:49 user nova-compute[103546]: </domain>
Nov 16 03:47:49 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T03:47:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-979087498',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-979087498',id=9,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJG5mUAddSpdXo5xKbrCCUDaorTLl+JXOZykC25X5m5JZ0Q8xHTJFntian9eeJtJJoBz5bNafVu8oRPVVoo6ppzucGvYFRw2h3YmPV1yz/S+0Xyvp0oF5B9x4ridLbkfA==',key_name='tempest-keypair-1167953100',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54df5ea6e7a24d49bb8f430fb9248934',ramdisk_id='',reservation_id='r-dhhzqrat',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1024082213',owner_user_name='tempest-TaggedBootDevicesTest_v242-1024082213-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:47:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d9e6b5b41d341e19548640d455eaa0f',uuid=71059a8d-4e89-472c-9463-b38aa8063e33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76b69715-356f-496a-85a3-f5bde976e201", "address": "fa:16:3e:72:5a:35", "network": {"id": "f84b2b6b-c73a-41d8-a9bb-3e73bb607a42", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1721792603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76b69715-35", "ovs_interfaceid": "76b69715-356f-496a-85a3-f5bde976e201", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Converting VIF {"id": "76b69715-356f-496a-85a3-f5bde976e201", "address": "fa:16:3e:72:5a:35", "network": {"id": "f84b2b6b-c73a-41d8-a9bb-3e73bb607a42", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1721792603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76b69715-35", "ovs_interfaceid": "76b69715-356f-496a-85a3-f5bde976e201", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:5a:35,bridge_name='br-int',has_traffic_filtering=True,id=76b69715-356f-496a-85a3-f5bde976e201,network=Network(f84b2b6b-c73a-41d8-a9bb-3e73bb607a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76b69715-35') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG os_vif [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:5a:35,bridge_name='br-int',has_traffic_filtering=True,id=76b69715-356f-496a-85a3-f5bde976e201,network=Network(f84b2b6b-c73a-41d8-a9bb-3e73bb607a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76b69715-35') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7ea2e0e0-133f-5339-9088-1010200d0f00', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.network.neutron [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap76b69715-35, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap76b69715-35, col_values=(('qos', UUID('b69a4766-0799-454d-8ce1-ac6d8b132af0')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap76b69715-35, col_values=(('external_ids', {'iface-id': '76b69715-356f-496a-85a3-f5bde976e201', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:5a:35', 'vm-uuid': '71059a8d-4e89-472c-9463-b38aa8063e33'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:49 user nova-compute[103546]: INFO os_vif [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:5a:35,bridge_name='br-int',has_traffic_filtering=True,id=76b69715-356f-496a-85a3-f5bde976e201,network=Network(f84b2b6b-c73a-41d8-a9bb-3e73bb607a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76b69715-35')
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T03:47:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-979087498',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-979087498',id=9,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJG5mUAddSpdXo5xKbrCCUDaorTLl+JXOZykC25X5m5JZ0Q8xHTJFntian9eeJtJJoBz5bNafVu8oRPVVoo6ppzucGvYFRw2h3YmPV1yz/S+0Xyvp0oF5B9x4ridLbkfA==',key_name='tempest-keypair-1167953100',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54df5ea6e7a24d49bb8f430fb9248934',ramdisk_id='',reservation_id='r-dhhzqrat',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1024082213',owner_user_name='tempest-TaggedBootDevicesTest_v242-1024082213-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:47:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d9e6b5b41d341e19548640d455eaa0f',uuid=71059a8d-4e89-472c-9463-b38aa8063e33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21653257-8a66-44f1-b806-2fae4641e1d2", "address": "fa:16:3e:91:a8:b5", "network": {"id": "4b071e67-eb71-49f5-a24f-cada83cca606", "bridge": "br-int", "label": "tempest-device-tagging-net1-1064540428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21653257-8a", "ovs_interfaceid": "21653257-8a66-44f1-b806-2fae4641e1d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Converting VIF {"id": "21653257-8a66-44f1-b806-2fae4641e1d2", "address": "fa:16:3e:91:a8:b5", "network": {"id": "4b071e67-eb71-49f5-a24f-cada83cca606", "bridge": "br-int", "label": "tempest-device-tagging-net1-1064540428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21653257-8a", "ovs_interfaceid": "21653257-8a66-44f1-b806-2fae4641e1d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:a8:b5,bridge_name='br-int',has_traffic_filtering=True,id=21653257-8a66-44f1-b806-2fae4641e1d2,network=Network(4b071e67-eb71-49f5-a24f-cada83cca606),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap21653257-8a') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG os_vif [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:a8:b5,bridge_name='br-int',has_traffic_filtering=True,id=21653257-8a66-44f1-b806-2fae4641e1d2,network=Network(4b071e67-eb71-49f5-a24f-cada83cca606),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap21653257-8a') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b0b74795-a900-5293-b6fa-371dab946525', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap21653257-8a, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap21653257-8a, col_values=(('qos', UUID('c95f48aa-c18b-4413-a308-41bcfe0673e1')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap21653257-8a, col_values=(('external_ids', {'iface-id': '21653257-8a66-44f1-b806-2fae4641e1d2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:a8:b5', 'vm-uuid': '71059a8d-4e89-472c-9463-b38aa8063e33'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:49 user nova-compute[103546]: INFO os_vif [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:a8:b5,bridge_name='br-int',has_traffic_filtering=True,id=21653257-8a66-44f1-b806-2fae4641e1d2,network=Network(4b071e67-eb71-49f5-a24f-cada83cca606),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap21653257-8a')
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T03:47:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-979087498',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-979087498',id=9,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJG5mUAddSpdXo5xKbrCCUDaorTLl+JXOZykC25X5m5JZ0Q8xHTJFntian9eeJtJJoBz5bNafVu8oRPVVoo6ppzucGvYFRw2h3YmPV1yz/S+0Xyvp0oF5B9x4ridLbkfA==',key_name='tempest-keypair-1167953100',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54df5ea6e7a24d49bb8f430fb9248934',ramdisk_id='',reservation_id='r-dhhzqrat',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1024082213',owner_user_name='tempest-TaggedBootDevicesTest_v242-1024082213-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:47:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d9e6b5b41d341e19548640d455eaa0f',uuid=71059a8d-4e89-472c-9463-b38aa8063e33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "916a3fe8-09df-42a1-9ac0-b81153ed55a1", "address": "fa:16:3e:00:b7:5f", "network": {"id": "4b071e67-eb71-49f5-a24f-cada83cca606", "bridge": "br-int", "label": "tempest-device-tagging-net1-1064540428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap916a3fe8-09", "ovs_interfaceid": "916a3fe8-09df-42a1-9ac0-b81153ed55a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Converting VIF {"id": "916a3fe8-09df-42a1-9ac0-b81153ed55a1", "address": "fa:16:3e:00:b7:5f", "network": {"id": "4b071e67-eb71-49f5-a24f-cada83cca606", "bridge": "br-int", "label": "tempest-device-tagging-net1-1064540428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap916a3fe8-09", "ovs_interfaceid": "916a3fe8-09df-42a1-9ac0-b81153ed55a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:b7:5f,bridge_name='br-int',has_traffic_filtering=True,id=916a3fe8-09df-42a1-9ac0-b81153ed55a1,network=Network(4b071e67-eb71-49f5-a24f-cada83cca606),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap916a3fe8-09') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG os_vif [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:b7:5f,bridge_name='br-int',has_traffic_filtering=True,id=916a3fe8-09df-42a1-9ac0-b81153ed55a1,network=Network(4b071e67-eb71-49f5-a24f-cada83cca606),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap916a3fe8-09') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3d755677-6569-5cef-9d7c-66da363381d3', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap916a3fe8-09, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap916a3fe8-09, col_values=(('qos', UUID('475f9b93-58f7-4cc5-83f8-dbfb5ba76e80')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap916a3fe8-09, col_values=(('external_ids', {'iface-id': '916a3fe8-09df-42a1-9ac0-b81153ed55a1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:b7:5f', 'vm-uuid': '71059a8d-4e89-472c-9463-b38aa8063e33'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:49 user nova-compute[103546]: INFO os_vif [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:b7:5f,bridge_name='br-int',has_traffic_filtering=True,id=916a3fe8-09df-42a1-9ac0-b81153ed55a1,network=Network(4b071e67-eb71-49f5-a24f-cada83cca606),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap916a3fe8-09')
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T03:47:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-979087498',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-979087498',id=9,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJG5mUAddSpdXo5xKbrCCUDaorTLl+JXOZykC25X5m5JZ0Q8xHTJFntian9eeJtJJoBz5bNafVu8oRPVVoo6ppzucGvYFRw2h3YmPV1yz/S+0Xyvp0oF5B9x4ridLbkfA==',key_name='tempest-keypair-1167953100',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54df5ea6e7a24d49bb8f430fb9248934',ramdisk_id='',reservation_id='r-dhhzqrat',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1024082213',owner_user_name='tempest-TaggedBootDevicesTest_v242-1024082213-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:47:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d9e6b5b41d341e19548640d455eaa0f',uuid=71059a8d-4e89-472c-9463-b38aa8063e33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1fb75f05-a4ef-45d5-9eb4-5e8428997947", "address": "fa:16:3e:e6:68:04", "network": {"id": "4b071e67-eb71-49f5-a24f-cada83cca606", "bridge": "br-int", "label": "tempest-device-tagging-net1-1064540428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fb75f05-a4", "ovs_interfaceid": "1fb75f05-a4ef-45d5-9eb4-5e8428997947", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Converting VIF {"id": "1fb75f05-a4ef-45d5-9eb4-5e8428997947", "address": "fa:16:3e:e6:68:04", "network": {"id": "4b071e67-eb71-49f5-a24f-cada83cca606", "bridge": "br-int", "label": "tempest-device-tagging-net1-1064540428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fb75f05-a4", "ovs_interfaceid": "1fb75f05-a4ef-45d5-9eb4-5e8428997947", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:68:04,bridge_name='br-int',has_traffic_filtering=True,id=1fb75f05-a4ef-45d5-9eb4-5e8428997947,network=Network(4b071e67-eb71-49f5-a24f-cada83cca606),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fb75f05-a4') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG os_vif [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:68:04,bridge_name='br-int',has_traffic_filtering=True,id=1fb75f05-a4ef-45d5-9eb4-5e8428997947,network=Network(4b071e67-eb71-49f5-a24f-cada83cca606),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fb75f05-a4') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1229c3d6-ef2f-5e4f-bdc4-416f2f2bc54d', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1fb75f05-a4, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1fb75f05-a4, col_values=(('qos', UUID('b9936475-c18f-495d-aef3-3e3da5a698cf')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1fb75f05-a4, col_values=(('external_ids', {'iface-id': '1fb75f05-a4ef-45d5-9eb4-5e8428997947', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:68:04', 'vm-uuid': '71059a8d-4e89-472c-9463-b38aa8063e33'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.network.neutron [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Updating instance_info_cache with network_info: [{"id": "1d1c7496-0480-45a7-8490-bc581314a4b5", "address": "fa:16:3e:d0:5b:e1", "network": {"id": "532683c8-74f9-43bb-a60f-7240b52da4d7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-747146599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae61d862fd974779a8caf830313a724a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d1c7496-04", "ovs_interfaceid": "1d1c7496-0480-45a7-8490-bc581314a4b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:49 user nova-compute[103546]: INFO os_vif [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:68:04,bridge_name='br-int',has_traffic_filtering=True,id=1fb75f05-a4ef-45d5-9eb4-5e8428997947,network=Network(4b071e67-eb71-49f5-a24f-cada83cca606),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fb75f05-a4')
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T03:47:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-979087498',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-979087498',id=9,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJG5mUAddSpdXo5xKbrCCUDaorTLl+JXOZykC25X5m5JZ0Q8xHTJFntian9eeJtJJoBz5bNafVu8oRPVVoo6ppzucGvYFRw2h3YmPV1yz/S+0Xyvp0oF5B9x4ridLbkfA==',key_name='tempest-keypair-1167953100',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54df5ea6e7a24d49bb8f430fb9248934',ramdisk_id='',reservation_id='r-dhhzqrat',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1024082213',owner_user_name='tempest-TaggedBootDevicesTest_v242-1024082213-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:47:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d9e6b5b41d341e19548640d455eaa0f',uuid=71059a8d-4e89-472c-9463-b38aa8063e33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51e087e4-ff6b-49a8-8190-cfc243436d35", "address": "fa:16:3e:3f:53:f1", "network": {"id": "4b071e67-eb71-49f5-a24f-cada83cca606", "bridge": "br-int", "label": "tempest-device-tagging-net1-1064540428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51e087e4-ff", "ovs_interfaceid": "51e087e4-ff6b-49a8-8190-cfc243436d35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Converting VIF {"id": "51e087e4-ff6b-49a8-8190-cfc243436d35", "address": "fa:16:3e:3f:53:f1", "network": {"id": "4b071e67-eb71-49f5-a24f-cada83cca606", "bridge": "br-int", "label": "tempest-device-tagging-net1-1064540428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51e087e4-ff", "ovs_interfaceid": "51e087e4-ff6b-49a8-8190-cfc243436d35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:53:f1,bridge_name='br-int',has_traffic_filtering=True,id=51e087e4-ff6b-49a8-8190-cfc243436d35,network=Network(4b071e67-eb71-49f5-a24f-cada83cca606),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51e087e4-ff') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG os_vif [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:53:f1,bridge_name='br-int',has_traffic_filtering=True,id=51e087e4-ff6b-49a8-8190-cfc243436d35,network=Network(4b071e67-eb71-49f5-a24f-cada83cca606),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51e087e4-ff') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1cb0794e-9f8f-50cd-abce-6524d9ee99a4', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Releasing lock "refresh_cache-63b95121-b211-42c3-831e-0392d4abd09a" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.compute.manager [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Instance network_info: |[{"id": "1d1c7496-0480-45a7-8490-bc581314a4b5", "address": "fa:16:3e:d0:5b:e1", "network": {"id": "532683c8-74f9-43bb-a60f-7240b52da4d7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-747146599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae61d862fd974779a8caf830313a724a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d1c7496-04", "ovs_interfaceid": "1d1c7496-0480-45a7-8490-bc581314a4b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Start _get_guest_xml network_info=[{"id": "1d1c7496-0480-45a7-8490-bc581314a4b5", "address": "fa:16:3e:d0:5b:e1", "network": {"id": "532683c8-74f9-43bb-a60f-7240b52da4d7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-747146599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae61d862fd974779a8caf830313a724a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d1c7496-04", "ovs_interfaceid": "1d1c7496-0480-45a7-8490-bc581314a4b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '5c6f539a-01e5-4478-bf8f-a14310b5d7dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 03:47:49 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:47:49 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:47:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1693518474',display_name='tempest-SnapshotDataIntegrityTests-server-1693518474',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1693518474',id=11,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBStc3SwhKriifb6Lf+wfleymdqv1HlD3cx17KRGI6YfZHuY3k/9b9YKDECdgiHY/Mo+bLSHsX34vv8MNK0zWVPsPqr0zxVWc36FyNVh2wu5bSUV/wGEn1LoJhZRQ546xA==',key_name='tempest-keypair-1255664858',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae61d862fd974779a8caf830313a724a',ramdisk_id='',reservation_id='r-9z7lvyq8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-459500828',owner_user_name='tempest-SnapshotDataIntegrityTests-459500828-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:47:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6867c00b4e574b09b3d1174d19b52ff5',uuid=63b95121-b211-42c3-831e-0392d4abd09a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d1c7496-0480-45a7-8490-bc581314a4b5", "address": "fa:16:3e:d0:5b:e1", "network": {"id": "532683c8-74f9-43bb-a60f-7240b52da4d7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-747146599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae61d862fd974779a8caf830313a724a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d1c7496-04", "ovs_interfaceid": "1d1c7496-0480-45a7-8490-bc581314a4b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Converting VIF {"id": "1d1c7496-0480-45a7-8490-bc581314a4b5", "address": "fa:16:3e:d0:5b:e1", "network": {"id": "532683c8-74f9-43bb-a60f-7240b52da4d7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-747146599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae61d862fd974779a8caf830313a724a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d1c7496-04", "ovs_interfaceid": "1d1c7496-0480-45a7-8490-bc581314a4b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:5b:e1,bridge_name='br-int',has_traffic_filtering=True,id=1d1c7496-0480-45a7-8490-bc581314a4b5,network=Network(532683c8-74f9-43bb-a60f-7240b52da4d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d1c7496-04') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.objects.instance [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lazy-loading 'pci_devices' on Instance uuid 63b95121-b211-42c3-831e-0392d4abd09a {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap51e087e4-ff, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap51e087e4-ff, col_values=(('qos', UUID('f4334eda-575f-45cd-a7c3-d19d83014923')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap51e087e4-ff, col_values=(('external_ids', {'iface-id': '51e087e4-ff6b-49a8-8190-cfc243436d35', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:53:f1', 'vm-uuid': '71059a8d-4e89-472c-9463-b38aa8063e33'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] End _get_guest_xml xml=<domain type="kvm">
Nov 16 03:47:49 user nova-compute[103546]:   <uuid>63b95121-b211-42c3-831e-0392d4abd09a</uuid>
Nov 16 03:47:49 user nova-compute[103546]:   <name>instance-0000000b</name>
Nov 16 03:47:49 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 03:47:49 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 03:47:49 user nova-compute[103546]:   <metadata>
Nov 16 03:47:49 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 03:47:49 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 03:47:49 user nova-compute[103546]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1693518474</nova:name>
Nov 16 03:47:49 user nova-compute[103546]:       <nova:creationTime>2023-11-16 03:47:49</nova:creationTime>
Nov 16 03:47:49 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 03:47:49 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 03:47:49 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 03:47:49 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 03:47:49 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 03:47:49 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 03:47:49 user nova-compute[103546]:       </nova:flavor>
Nov 16 03:47:49 user nova-compute[103546]:       <nova:owner>
Nov 16 03:47:49 user nova-compute[103546]:         <nova:user uuid="6867c00b4e574b09b3d1174d19b52ff5">tempest-SnapshotDataIntegrityTests-459500828-project-member</nova:user>
Nov 16 03:47:49 user nova-compute[103546]:         <nova:project uuid="ae61d862fd974779a8caf830313a724a">tempest-SnapshotDataIntegrityTests-459500828</nova:project>
Nov 16 03:47:49 user nova-compute[103546]:       </nova:owner>
Nov 16 03:47:49 user nova-compute[103546]:       <nova:root type="image" uuid="5c6f539a-01e5-4478-bf8f-a14310b5d7dd"/>
Nov 16 03:47:49 user nova-compute[103546]:       <nova:ports>
Nov 16 03:47:49 user nova-compute[103546]:         <nova:port uuid="1d1c7496-0480-45a7-8490-bc581314a4b5">
Nov 16 03:47:49 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 16 03:47:49 user nova-compute[103546]:         </nova:port>
Nov 16 03:47:49 user nova-compute[103546]:       </nova:ports>
Nov 16 03:47:49 user nova-compute[103546]:     </nova:instance>
Nov 16 03:47:49 user nova-compute[103546]:   </metadata>
Nov 16 03:47:49 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 03:47:49 user nova-compute[103546]:     <system>
Nov 16 03:47:49 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 03:47:49 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 03:47:49 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 03:47:49 user nova-compute[103546]:       <entry name="serial">63b95121-b211-42c3-831e-0392d4abd09a</entry>
Nov 16 03:47:49 user nova-compute[103546]:       <entry name="uuid">63b95121-b211-42c3-831e-0392d4abd09a</entry>
Nov 16 03:47:49 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 03:47:49 user nova-compute[103546]:     </system>
Nov 16 03:47:49 user nova-compute[103546]:   </sysinfo>
Nov 16 03:47:49 user nova-compute[103546]:   <os>
Nov 16 03:47:49 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 03:47:49 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 03:47:49 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 03:47:49 user nova-compute[103546]:   </os>
Nov 16 03:47:49 user nova-compute[103546]:   <features>
Nov 16 03:47:49 user nova-compute[103546]:     <acpi/>
Nov 16 03:47:49 user nova-compute[103546]:     <apic/>
Nov 16 03:47:49 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 03:47:49 user nova-compute[103546]:   </features>
Nov 16 03:47:49 user nova-compute[103546]:   <clock offset="utc">
Nov 16 03:47:49 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 03:47:49 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 03:47:49 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 03:47:49 user nova-compute[103546]:   </clock>
Nov 16 03:47:49 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 03:47:49 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 03:47:49 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 03:47:49 user nova-compute[103546]:   </cpu>
Nov 16 03:47:49 user nova-compute[103546]:   <devices>
Nov 16 03:47:49 user nova-compute[103546]:     <disk type="file" device="disk">
Nov 16 03:47:49 user nova-compute[103546]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 03:47:49 user nova-compute[103546]:       <source file="/opt/stack/data/nova/instances/63b95121-b211-42c3-831e-0392d4abd09a/disk"/>
Nov 16 03:47:49 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 03:47:49 user nova-compute[103546]:     </disk>
Nov 16 03:47:49 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 03:47:49 user nova-compute[103546]:       <mac address="fa:16:3e:d0:5b:e1"/>
Nov 16 03:47:49 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:47:49 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 03:47:49 user nova-compute[103546]:       <target dev="tap1d1c7496-04"/>
Nov 16 03:47:49 user nova-compute[103546]:     </interface>
Nov 16 03:47:49 user nova-compute[103546]:     <serial type="pty">
Nov 16 03:47:49 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/63b95121-b211-42c3-831e-0392d4abd09a/console.log" append="off"/>
Nov 16 03:47:49 user nova-compute[103546]:     </serial>
Nov 16 03:47:49 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 03:47:49 user nova-compute[103546]:     <video>
Nov 16 03:47:49 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:47:49 user nova-compute[103546]:     </video>
Nov 16 03:47:49 user nova-compute[103546]:     <rng model="virtio">
Nov 16 03:47:49 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 03:47:49 user nova-compute[103546]:     </rng>
Nov 16 03:47:49 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 03:47:49 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 03:47:49 user nova-compute[103546]:       <stats period="10"/>
Nov 16 03:47:49 user nova-compute[103546]:     </memballoon>
Nov 16 03:47:49 user nova-compute[103546]:   </devices>
Nov 16 03:47:49 user nova-compute[103546]: </domain>
Nov 16 03:47:49 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:47:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1693518474',display_name='tempest-SnapshotDataIntegrityTests-server-1693518474',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1693518474',id=11,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBStc3SwhKriifb6Lf+wfleymdqv1HlD3cx17KRGI6YfZHuY3k/9b9YKDECdgiHY/Mo+bLSHsX34vv8MNK0zWVPsPqr0zxVWc36FyNVh2wu5bSUV/wGEn1LoJhZRQ546xA==',key_name='tempest-keypair-1255664858',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae61d862fd974779a8caf830313a724a',ramdisk_id='',reservation_id='r-9z7lvyq8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-459500828',owner_user_name='tempest-SnapshotDataIntegrityTests-459500828-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:47:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6867c00b4e574b09b3d1174d19b52ff5',uuid=63b95121-b211-42c3-831e-0392d4abd09a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d1c7496-0480-45a7-8490-bc581314a4b5", "address": "fa:16:3e:d0:5b:e1", "network": {"id": "532683c8-74f9-43bb-a60f-7240b52da4d7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-747146599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae61d862fd974779a8caf830313a724a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d1c7496-04", "ovs_interfaceid": "1d1c7496-0480-45a7-8490-bc581314a4b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Converting VIF {"id": "1d1c7496-0480-45a7-8490-bc581314a4b5", "address": "fa:16:3e:d0:5b:e1", "network": {"id": "532683c8-74f9-43bb-a60f-7240b52da4d7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-747146599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae61d862fd974779a8caf830313a724a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d1c7496-04", "ovs_interfaceid": "1d1c7496-0480-45a7-8490-bc581314a4b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:5b:e1,bridge_name='br-int',has_traffic_filtering=True,id=1d1c7496-0480-45a7-8490-bc581314a4b5,network=Network(532683c8-74f9-43bb-a60f-7240b52da4d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d1c7496-04') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG os_vif [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:5b:e1,bridge_name='br-int',has_traffic_filtering=True,id=1d1c7496-0480-45a7-8490-bc581314a4b5,network=Network(532683c8-74f9-43bb-a60f-7240b52da4d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d1c7496-04') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:49 user nova-compute[103546]: INFO os_vif [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:53:f1,bridge_name='br-int',has_traffic_filtering=True,id=51e087e4-ff6b-49a8-8190-cfc243436d35,network=Network(4b071e67-eb71-49f5-a24f-cada83cca606),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51e087e4-ff')
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T03:47:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-979087498',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-979087498',id=9,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJG5mUAddSpdXo5xKbrCCUDaorTLl+JXOZykC25X5m5JZ0Q8xHTJFntian9eeJtJJoBz5bNafVu8oRPVVoo6ppzucGvYFRw2h3YmPV1yz/S+0Xyvp0oF5B9x4ridLbkfA==',key_name='tempest-keypair-1167953100',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54df5ea6e7a24d49bb8f430fb9248934',ramdisk_id='',reservation_id='r-dhhzqrat',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1024082213',owner_user_name='tempest-TaggedBootDevicesTest_v242-1024082213-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:47:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d9e6b5b41d341e19548640d455eaa0f',uuid=71059a8d-4e89-472c-9463-b38aa8063e33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0f609b8-eb49-4c19-968c-99c95c38b857", "address": "fa:16:3e:dc:33:a5", "network": {"id": "f9af5267-5cc4-44b4-9226-2da63e754907", "bridge": "br-int", "label": "tempest-device-tagging-net2-640329577", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0f609b8-eb", "ovs_interfaceid": "b0f609b8-eb49-4c19-968c-99c95c38b857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Converting VIF {"id": "b0f609b8-eb49-4c19-968c-99c95c38b857", "address": "fa:16:3e:dc:33:a5", "network": {"id": "f9af5267-5cc4-44b4-9226-2da63e754907", "bridge": "br-int", "label": "tempest-device-tagging-net2-640329577", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0f609b8-eb", "ovs_interfaceid": "b0f609b8-eb49-4c19-968c-99c95c38b857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:33:a5,bridge_name='br-int',has_traffic_filtering=True,id=b0f609b8-eb49-4c19-968c-99c95c38b857,network=Network(f9af5267-5cc4-44b4-9226-2da63e754907),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0f609b8-eb') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG os_vif [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:33:a5,bridge_name='br-int',has_traffic_filtering=True,id=b0f609b8-eb49-4c19-968c-99c95c38b857,network=Network(f9af5267-5cc4-44b4-9226-2da63e754907),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0f609b8-eb') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '27f91ece-a010-5e77-9a6c-82479a24ebed', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c42d596a-e78a-5a70-a944-595c228ac07b', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1d1c7496-04, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1d1c7496-04, col_values=(('qos', UUID('38ac57f9-3adf-4b83-8606-2afcc5ebc10a')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1d1c7496-04, col_values=(('external_ids', {'iface-id': '1d1c7496-0480-45a7-8490-bc581314a4b5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:5b:e1', 'vm-uuid': '63b95121-b211-42c3-831e-0392d4abd09a'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.compute.manager [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Guest created on hypervisor {{(pid=103546) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 03:47:49 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Instance spawned successfully.
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Found default for hw_cdrom_bus of ide {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Found default for hw_disk_bus of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Found default for hw_input_bus of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Found default for hw_pointer_model of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Found default for hw_video_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Found default for hw_vif_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:49 user nova-compute[103546]: INFO os_vif [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:5b:e1,bridge_name='br-int',has_traffic_filtering=True,id=1d1c7496-0480-45a7-8490-bc581314a4b5,network=Network(532683c8-74f9-43bb-a60f-7240b52da4d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d1c7496-04')
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb0f609b8-eb, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb0f609b8-eb, col_values=(('qos', UUID('27c588fd-92f0-4530-a650-7d7025f9ffbf')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb0f609b8-eb, col_values=(('external_ids', {'iface-id': 'b0f609b8-eb49-4c19-968c-99c95c38b857', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:33:a5', 'vm-uuid': '71059a8d-4e89-472c-9463-b38aa8063e33'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] No VIF found with MAC fa:16:3e:d0:5b:e1, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 03:47:49 user nova-compute[103546]: INFO nova.compute.manager [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Took 10.73 seconds to spawn the instance on the hypervisor.
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.compute.manager [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:49 user nova-compute[103546]: INFO os_vif [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:33:a5,bridge_name='br-int',has_traffic_filtering=True,id=b0f609b8-eb49-4c19-968c-99c95c38b857,network=Network(f9af5267-5cc4-44b4-9226-2da63e754907),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0f609b8-eb')
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T03:47:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-979087498',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-979087498',id=9,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJG5mUAddSpdXo5xKbrCCUDaorTLl+JXOZykC25X5m5JZ0Q8xHTJFntian9eeJtJJoBz5bNafVu8oRPVVoo6ppzucGvYFRw2h3YmPV1yz/S+0Xyvp0oF5B9x4ridLbkfA==',key_name='tempest-keypair-1167953100',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54df5ea6e7a24d49bb8f430fb9248934',ramdisk_id='',reservation_id='r-dhhzqrat',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1024082213',owner_user_name='tempest-TaggedBootDevicesTest_v242-1024082213-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:47:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d9e6b5b41d341e19548640d455eaa0f',uuid=71059a8d-4e89-472c-9463-b38aa8063e33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc03966b-fcbc-4ed7-8ffb-2270a55b4e28", "address": "fa:16:3e:75:5a:4b", "network": {"id": "f9af5267-5cc4-44b4-9226-2da63e754907", "bridge": "br-int", "label": "tempest-device-tagging-net2-640329577", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc03966b-fc", "ovs_interfaceid": "fc03966b-fcbc-4ed7-8ffb-2270a55b4e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Converting VIF {"id": "fc03966b-fcbc-4ed7-8ffb-2270a55b4e28", "address": "fa:16:3e:75:5a:4b", "network": {"id": "f9af5267-5cc4-44b4-9226-2da63e754907", "bridge": "br-int", "label": "tempest-device-tagging-net2-640329577", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc03966b-fc", "ovs_interfaceid": "fc03966b-fcbc-4ed7-8ffb-2270a55b4e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:5a:4b,bridge_name='br-int',has_traffic_filtering=True,id=fc03966b-fcbc-4ed7-8ffb-2270a55b4e28,network=Network(f9af5267-5cc4-44b4-9226-2da63e754907),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc03966b-fc') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG os_vif [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:5a:4b,bridge_name='br-int',has_traffic_filtering=True,id=fc03966b-fcbc-4ed7-8ffb-2270a55b4e28,network=Network(f9af5267-5cc4-44b4-9226-2da63e754907),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc03966b-fc') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b3b1d444-126d-5cc0-a490-89000993b996', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:47:50 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:50 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:50 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfc03966b-fc, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:50 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfc03966b-fc, col_values=(('qos', UUID('94dd72c8-1c0b-4213-be85-2aeb97ecb8fc')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:50 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfc03966b-fc, col_values=(('external_ids', {'iface-id': 'fc03966b-fcbc-4ed7-8ffb-2270a55b4e28', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:5a:4b', 'vm-uuid': '71059a8d-4e89-472c-9463-b38aa8063e33'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:47:50 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:50 user nova-compute[103546]: INFO nova.compute.manager [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Took 31.87 seconds to build instance.
Nov 16 03:47:50 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:47:50 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-09760cc6-15ea-4662-ac5b-03d5fa99a34b tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Lock "2cb84f00-0601-4199-ba6e-f09a27add736" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 31.977s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:47:50 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:50 user nova-compute[103546]: INFO os_vif [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:5a:4b,bridge_name='br-int',has_traffic_filtering=True,id=fc03966b-fcbc-4ed7-8ffb-2270a55b4e28,network=Network(f9af5267-5cc4-44b4-9226-2da63e754907),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc03966b-fc')
Nov 16 03:47:50 user nova-compute[103546]: DEBUG nova.compute.manager [req-1e8e6d61-346a-4625-a6cd-8173358732cc req-2b9e7471-4f96-4d89-9c02-3b3adb962fc3 service nova] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Received event network-changed-1d1c7496-0480-45a7-8490-bc581314a4b5 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:47:50 user nova-compute[103546]: DEBUG nova.compute.manager [req-1e8e6d61-346a-4625-a6cd-8173358732cc req-2b9e7471-4f96-4d89-9c02-3b3adb962fc3 service nova] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Refreshing instance network info cache due to event network-changed-1d1c7496-0480-45a7-8490-bc581314a4b5. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:47:50 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-1e8e6d61-346a-4625-a6cd-8173358732cc req-2b9e7471-4f96-4d89-9c02-3b3adb962fc3 service nova] Acquiring lock "refresh_cache-63b95121-b211-42c3-831e-0392d4abd09a" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:47:50 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-1e8e6d61-346a-4625-a6cd-8173358732cc req-2b9e7471-4f96-4d89-9c02-3b3adb962fc3 service nova] Acquired lock "refresh_cache-63b95121-b211-42c3-831e-0392d4abd09a" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:47:50 user nova-compute[103546]: DEBUG nova.network.neutron [req-1e8e6d61-346a-4625-a6cd-8173358732cc req-2b9e7471-4f96-4d89-9c02-3b3adb962fc3 service nova] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Refreshing network info cache for port 1d1c7496-0480-45a7-8490-bc581314a4b5 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:47:50 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] No BDM found with device name hda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:47:50 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] No BDM found with device name vdc, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:47:50 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] No VIF found with MAC fa:16:3e:72:5a:35, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 03:47:50 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] No VIF found with MAC fa:16:3e:3f:53:f1, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 03:47:50 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Using config drive
Nov 16 03:47:50 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Creating config drive at /opt/stack/data/nova/instances/71059a8d-4e89-472c-9463-b38aa8063e33/disk.config
Nov 16 03:47:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/71059a8d-4e89-472c-9463-b38aa8063e33/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp1tk68bor {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:47:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/71059a8d-4e89-472c-9463-b38aa8063e33/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp1tk68bor" returned: 0 in 0.054s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:47:50 user nova-compute[103546]: DEBUG nova.network.neutron [req-1e8e6d61-346a-4625-a6cd-8173358732cc req-2b9e7471-4f96-4d89-9c02-3b3adb962fc3 service nova] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Updated VIF entry in instance network info cache for port 1d1c7496-0480-45a7-8490-bc581314a4b5. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 03:47:50 user nova-compute[103546]: DEBUG nova.network.neutron [req-1e8e6d61-346a-4625-a6cd-8173358732cc req-2b9e7471-4f96-4d89-9c02-3b3adb962fc3 service nova] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Updating instance_info_cache with network_info: [{"id": "1d1c7496-0480-45a7-8490-bc581314a4b5", "address": "fa:16:3e:d0:5b:e1", "network": {"id": "532683c8-74f9-43bb-a60f-7240b52da4d7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-747146599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae61d862fd974779a8caf830313a724a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d1c7496-04", "ovs_interfaceid": "1d1c7496-0480-45a7-8490-bc581314a4b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:47:50 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-1e8e6d61-346a-4625-a6cd-8173358732cc req-2b9e7471-4f96-4d89-9c02-3b3adb962fc3 service nova] Releasing lock "refresh_cache-63b95121-b211-42c3-831e-0392d4abd09a" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:47:50 user nova-compute[103546]: DEBUG nova.compute.manager [req-c083c9fe-7540-438c-9789-34e93d4ad2d7 req-d72b30d6-b6f1-4e4a-aa4d-f0b041083386 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received event network-vif-plugged-75b2ff49-49cc-4b86-bdc6-6f9f76c06505 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:47:50 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-c083c9fe-7540-438c-9789-34e93d4ad2d7 req-d72b30d6-b6f1-4e4a-aa4d-f0b041083386 service nova] Acquiring lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:47:50 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-c083c9fe-7540-438c-9789-34e93d4ad2d7 req-d72b30d6-b6f1-4e4a-aa4d-f0b041083386 service nova] Lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:47:50 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-c083c9fe-7540-438c-9789-34e93d4ad2d7 req-d72b30d6-b6f1-4e4a-aa4d-f0b041083386 service nova] Lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:47:50 user nova-compute[103546]: DEBUG nova.compute.manager [req-c083c9fe-7540-438c-9789-34e93d4ad2d7 req-d72b30d6-b6f1-4e4a-aa4d-f0b041083386 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] No waiting events found dispatching network-vif-plugged-75b2ff49-49cc-4b86-bdc6-6f9f76c06505 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:47:50 user nova-compute[103546]: WARNING nova.compute.manager [req-c083c9fe-7540-438c-9789-34e93d4ad2d7 req-d72b30d6-b6f1-4e4a-aa4d-f0b041083386 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received unexpected event network-vif-plugged-75b2ff49-49cc-4b86-bdc6-6f9f76c06505 for instance with vm_state active and task_state None.
Nov 16 03:47:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:52 user nova-compute[103546]: DEBUG nova.compute.manager [req-fc134808-5878-40b9-96ec-08e2c8712d4f req-1f73062a-223d-48d3-823d-08c099785d6b service nova] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Received event network-vif-plugged-1d1c7496-0480-45a7-8490-bc581314a4b5 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:47:52 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-fc134808-5878-40b9-96ec-08e2c8712d4f req-1f73062a-223d-48d3-823d-08c099785d6b service nova] Acquiring lock "63b95121-b211-42c3-831e-0392d4abd09a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:47:52 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-fc134808-5878-40b9-96ec-08e2c8712d4f req-1f73062a-223d-48d3-823d-08c099785d6b service nova] Lock "63b95121-b211-42c3-831e-0392d4abd09a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:47:52 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-fc134808-5878-40b9-96ec-08e2c8712d4f req-1f73062a-223d-48d3-823d-08c099785d6b service nova] Lock "63b95121-b211-42c3-831e-0392d4abd09a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:47:52 user nova-compute[103546]: DEBUG nova.compute.manager [req-fc134808-5878-40b9-96ec-08e2c8712d4f req-1f73062a-223d-48d3-823d-08c099785d6b service nova] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] No waiting events found dispatching network-vif-plugged-1d1c7496-0480-45a7-8490-bc581314a4b5 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:47:52 user nova-compute[103546]: WARNING nova.compute.manager [req-fc134808-5878-40b9-96ec-08e2c8712d4f req-1f73062a-223d-48d3-823d-08c099785d6b service nova] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Received unexpected event network-vif-plugged-1d1c7496-0480-45a7-8490-bc581314a4b5 for instance with vm_state building and task_state spawning.
Nov 16 03:47:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:52 user nova-compute[103546]: DEBUG nova.compute.manager [req-6c123eae-6fa5-4e47-ad63-f9c17c06dc1c req-d6464b9c-11fa-4d49-8793-f60d90501aaf service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received event network-vif-plugged-76b69715-356f-496a-85a3-f5bde976e201 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:47:52 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6c123eae-6fa5-4e47-ad63-f9c17c06dc1c req-d6464b9c-11fa-4d49-8793-f60d90501aaf service nova] Acquiring lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:47:52 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6c123eae-6fa5-4e47-ad63-f9c17c06dc1c req-d6464b9c-11fa-4d49-8793-f60d90501aaf service nova] Lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:47:52 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6c123eae-6fa5-4e47-ad63-f9c17c06dc1c req-d6464b9c-11fa-4d49-8793-f60d90501aaf service nova] Lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:47:52 user nova-compute[103546]: DEBUG nova.compute.manager [req-6c123eae-6fa5-4e47-ad63-f9c17c06dc1c req-d6464b9c-11fa-4d49-8793-f60d90501aaf service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] No waiting events found dispatching network-vif-plugged-76b69715-356f-496a-85a3-f5bde976e201 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:47:52 user nova-compute[103546]: WARNING nova.compute.manager [req-6c123eae-6fa5-4e47-ad63-f9c17c06dc1c req-d6464b9c-11fa-4d49-8793-f60d90501aaf service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received unexpected event network-vif-plugged-76b69715-356f-496a-85a3-f5bde976e201 for instance with vm_state building and task_state spawning.
Nov 16 03:47:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:53 user nova-compute[103546]: DEBUG nova.compute.manager [req-eaf6ec6e-878b-4390-a997-0b625e748229 req-cefd9b71-6aec-4c0e-b6bd-83c92feb3a14 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received event network-vif-plugged-21653257-8a66-44f1-b806-2fae4641e1d2 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:47:53 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-eaf6ec6e-878b-4390-a997-0b625e748229 req-cefd9b71-6aec-4c0e-b6bd-83c92feb3a14 service nova] Acquiring lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:47:53 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-eaf6ec6e-878b-4390-a997-0b625e748229 req-cefd9b71-6aec-4c0e-b6bd-83c92feb3a14 service nova] Lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:47:53 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-eaf6ec6e-878b-4390-a997-0b625e748229 req-cefd9b71-6aec-4c0e-b6bd-83c92feb3a14 service nova] Lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:47:53 user nova-compute[103546]: DEBUG nova.compute.manager [req-eaf6ec6e-878b-4390-a997-0b625e748229 req-cefd9b71-6aec-4c0e-b6bd-83c92feb3a14 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] No waiting events found dispatching network-vif-plugged-21653257-8a66-44f1-b806-2fae4641e1d2 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:47:53 user nova-compute[103546]: WARNING nova.compute.manager [req-eaf6ec6e-878b-4390-a997-0b625e748229 req-cefd9b71-6aec-4c0e-b6bd-83c92feb3a14 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received unexpected event network-vif-plugged-21653257-8a66-44f1-b806-2fae4641e1d2 for instance with vm_state building and task_state spawning.
Nov 16 03:47:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:54 user nova-compute[103546]: DEBUG nova.compute.manager [req-9dc09ccc-caff-40b6-923a-2f7e1dccc083 req-92006e09-41dd-4b80-b31f-86ab8db830ce service nova] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Received event network-vif-plugged-1d1c7496-0480-45a7-8490-bc581314a4b5 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:47:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-9dc09ccc-caff-40b6-923a-2f7e1dccc083 req-92006e09-41dd-4b80-b31f-86ab8db830ce service nova] Acquiring lock "63b95121-b211-42c3-831e-0392d4abd09a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:47:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-9dc09ccc-caff-40b6-923a-2f7e1dccc083 req-92006e09-41dd-4b80-b31f-86ab8db830ce service nova] Lock "63b95121-b211-42c3-831e-0392d4abd09a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:47:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-9dc09ccc-caff-40b6-923a-2f7e1dccc083 req-92006e09-41dd-4b80-b31f-86ab8db830ce service nova] Lock "63b95121-b211-42c3-831e-0392d4abd09a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:47:54 user nova-compute[103546]: DEBUG nova.compute.manager [req-9dc09ccc-caff-40b6-923a-2f7e1dccc083 req-92006e09-41dd-4b80-b31f-86ab8db830ce service nova] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] No waiting events found dispatching network-vif-plugged-1d1c7496-0480-45a7-8490-bc581314a4b5 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:47:54 user nova-compute[103546]: WARNING nova.compute.manager [req-9dc09ccc-caff-40b6-923a-2f7e1dccc083 req-92006e09-41dd-4b80-b31f-86ab8db830ce service nova] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Received unexpected event network-vif-plugged-1d1c7496-0480-45a7-8490-bc581314a4b5 for instance with vm_state building and task_state spawning.
Nov 16 03:47:54 user nova-compute[103546]: DEBUG nova.compute.manager [req-9dc09ccc-caff-40b6-923a-2f7e1dccc083 req-92006e09-41dd-4b80-b31f-86ab8db830ce service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received event network-vif-plugged-1fb75f05-a4ef-45d5-9eb4-5e8428997947 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:47:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-9dc09ccc-caff-40b6-923a-2f7e1dccc083 req-92006e09-41dd-4b80-b31f-86ab8db830ce service nova] Acquiring lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:47:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-9dc09ccc-caff-40b6-923a-2f7e1dccc083 req-92006e09-41dd-4b80-b31f-86ab8db830ce service nova] Lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:47:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-9dc09ccc-caff-40b6-923a-2f7e1dccc083 req-92006e09-41dd-4b80-b31f-86ab8db830ce service nova] Lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:47:54 user nova-compute[103546]: DEBUG nova.compute.manager [req-9dc09ccc-caff-40b6-923a-2f7e1dccc083 req-92006e09-41dd-4b80-b31f-86ab8db830ce service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] No waiting events found dispatching network-vif-plugged-1fb75f05-a4ef-45d5-9eb4-5e8428997947 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:47:54 user nova-compute[103546]: WARNING nova.compute.manager [req-9dc09ccc-caff-40b6-923a-2f7e1dccc083 req-92006e09-41dd-4b80-b31f-86ab8db830ce service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received unexpected event network-vif-plugged-1fb75f05-a4ef-45d5-9eb4-5e8428997947 for instance with vm_state building and task_state spawning.
Nov 16 03:47:54 user nova-compute[103546]: DEBUG nova.compute.manager [req-9dc09ccc-caff-40b6-923a-2f7e1dccc083 req-92006e09-41dd-4b80-b31f-86ab8db830ce service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received event network-vif-plugged-1fb75f05-a4ef-45d5-9eb4-5e8428997947 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:47:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-9dc09ccc-caff-40b6-923a-2f7e1dccc083 req-92006e09-41dd-4b80-b31f-86ab8db830ce service nova] Acquiring lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:47:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-9dc09ccc-caff-40b6-923a-2f7e1dccc083 req-92006e09-41dd-4b80-b31f-86ab8db830ce service nova] Lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:47:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-9dc09ccc-caff-40b6-923a-2f7e1dccc083 req-92006e09-41dd-4b80-b31f-86ab8db830ce service nova] Lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:47:54 user nova-compute[103546]: DEBUG nova.compute.manager [req-9dc09ccc-caff-40b6-923a-2f7e1dccc083 req-92006e09-41dd-4b80-b31f-86ab8db830ce service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] No waiting events found dispatching network-vif-plugged-1fb75f05-a4ef-45d5-9eb4-5e8428997947 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:47:54 user nova-compute[103546]: WARNING nova.compute.manager [req-9dc09ccc-caff-40b6-923a-2f7e1dccc083 req-92006e09-41dd-4b80-b31f-86ab8db830ce service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received unexpected event network-vif-plugged-1fb75f05-a4ef-45d5-9eb4-5e8428997947 for instance with vm_state building and task_state spawning.
Nov 16 03:47:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:54 user nova-compute[103546]: DEBUG nova.compute.manager [req-ee579a05-6656-44bf-ac94-652cd3ad15ff req-3ab17a64-3985-4657-babd-793c81e6a9ad service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received event network-vif-plugged-76b69715-356f-496a-85a3-f5bde976e201 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:47:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ee579a05-6656-44bf-ac94-652cd3ad15ff req-3ab17a64-3985-4657-babd-793c81e6a9ad service nova] Acquiring lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:47:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ee579a05-6656-44bf-ac94-652cd3ad15ff req-3ab17a64-3985-4657-babd-793c81e6a9ad service nova] Lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:47:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ee579a05-6656-44bf-ac94-652cd3ad15ff req-3ab17a64-3985-4657-babd-793c81e6a9ad service nova] Lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:47:54 user nova-compute[103546]: DEBUG nova.compute.manager [req-ee579a05-6656-44bf-ac94-652cd3ad15ff req-3ab17a64-3985-4657-babd-793c81e6a9ad service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] No waiting events found dispatching network-vif-plugged-76b69715-356f-496a-85a3-f5bde976e201 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:47:54 user nova-compute[103546]: WARNING nova.compute.manager [req-ee579a05-6656-44bf-ac94-652cd3ad15ff req-3ab17a64-3985-4657-babd-793c81e6a9ad service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received unexpected event network-vif-plugged-76b69715-356f-496a-85a3-f5bde976e201 for instance with vm_state building and task_state spawning.
Nov 16 03:47:54 user nova-compute[103546]: DEBUG nova.compute.manager [req-ee579a05-6656-44bf-ac94-652cd3ad15ff req-3ab17a64-3985-4657-babd-793c81e6a9ad service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received event network-vif-plugged-51e087e4-ff6b-49a8-8190-cfc243436d35 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:47:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ee579a05-6656-44bf-ac94-652cd3ad15ff req-3ab17a64-3985-4657-babd-793c81e6a9ad service nova] Acquiring lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:47:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ee579a05-6656-44bf-ac94-652cd3ad15ff req-3ab17a64-3985-4657-babd-793c81e6a9ad service nova] Lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:47:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ee579a05-6656-44bf-ac94-652cd3ad15ff req-3ab17a64-3985-4657-babd-793c81e6a9ad service nova] Lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:47:54 user nova-compute[103546]: DEBUG nova.compute.manager [req-ee579a05-6656-44bf-ac94-652cd3ad15ff req-3ab17a64-3985-4657-babd-793c81e6a9ad service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] No waiting events found dispatching network-vif-plugged-51e087e4-ff6b-49a8-8190-cfc243436d35 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:47:54 user nova-compute[103546]: WARNING nova.compute.manager [req-ee579a05-6656-44bf-ac94-652cd3ad15ff req-3ab17a64-3985-4657-babd-793c81e6a9ad service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received unexpected event network-vif-plugged-51e087e4-ff6b-49a8-8190-cfc243436d35 for instance with vm_state building and task_state spawning.
Nov 16 03:47:54 user nova-compute[103546]: DEBUG nova.compute.manager [req-ee579a05-6656-44bf-ac94-652cd3ad15ff req-3ab17a64-3985-4657-babd-793c81e6a9ad service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received event network-vif-plugged-51e087e4-ff6b-49a8-8190-cfc243436d35 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:47:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ee579a05-6656-44bf-ac94-652cd3ad15ff req-3ab17a64-3985-4657-babd-793c81e6a9ad service nova] Acquiring lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:47:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ee579a05-6656-44bf-ac94-652cd3ad15ff req-3ab17a64-3985-4657-babd-793c81e6a9ad service nova] Lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:47:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ee579a05-6656-44bf-ac94-652cd3ad15ff req-3ab17a64-3985-4657-babd-793c81e6a9ad service nova] Lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:47:54 user nova-compute[103546]: DEBUG nova.compute.manager [req-ee579a05-6656-44bf-ac94-652cd3ad15ff req-3ab17a64-3985-4657-babd-793c81e6a9ad service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] No waiting events found dispatching network-vif-plugged-51e087e4-ff6b-49a8-8190-cfc243436d35 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:47:54 user nova-compute[103546]: WARNING nova.compute.manager [req-ee579a05-6656-44bf-ac94-652cd3ad15ff req-3ab17a64-3985-4657-babd-793c81e6a9ad service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received unexpected event network-vif-plugged-51e087e4-ff6b-49a8-8190-cfc243436d35 for instance with vm_state building and task_state spawning.
Nov 16 03:47:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:55 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:55 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:55 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:55 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:55 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:55 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:55 user nova-compute[103546]: DEBUG nova.compute.manager [req-8ce64437-f4d5-4fec-b7a1-0de838ab8a5d req-a6d2cf19-bf76-4d8a-9262-f83c5bff7a1f service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received event network-vif-plugged-21653257-8a66-44f1-b806-2fae4641e1d2 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:47:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8ce64437-f4d5-4fec-b7a1-0de838ab8a5d req-a6d2cf19-bf76-4d8a-9262-f83c5bff7a1f service nova] Acquiring lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:47:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8ce64437-f4d5-4fec-b7a1-0de838ab8a5d req-a6d2cf19-bf76-4d8a-9262-f83c5bff7a1f service nova] Lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:47:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8ce64437-f4d5-4fec-b7a1-0de838ab8a5d req-a6d2cf19-bf76-4d8a-9262-f83c5bff7a1f service nova] Lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:47:55 user nova-compute[103546]: DEBUG nova.compute.manager [req-8ce64437-f4d5-4fec-b7a1-0de838ab8a5d req-a6d2cf19-bf76-4d8a-9262-f83c5bff7a1f service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] No waiting events found dispatching network-vif-plugged-21653257-8a66-44f1-b806-2fae4641e1d2 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:47:55 user nova-compute[103546]: WARNING nova.compute.manager [req-8ce64437-f4d5-4fec-b7a1-0de838ab8a5d req-a6d2cf19-bf76-4d8a-9262-f83c5bff7a1f service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received unexpected event network-vif-plugged-21653257-8a66-44f1-b806-2fae4641e1d2 for instance with vm_state building and task_state spawning.
Nov 16 03:47:55 user nova-compute[103546]: DEBUG nova.compute.manager [req-8ce64437-f4d5-4fec-b7a1-0de838ab8a5d req-a6d2cf19-bf76-4d8a-9262-f83c5bff7a1f service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received event network-vif-plugged-916a3fe8-09df-42a1-9ac0-b81153ed55a1 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:47:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8ce64437-f4d5-4fec-b7a1-0de838ab8a5d req-a6d2cf19-bf76-4d8a-9262-f83c5bff7a1f service nova] Acquiring lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:47:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8ce64437-f4d5-4fec-b7a1-0de838ab8a5d req-a6d2cf19-bf76-4d8a-9262-f83c5bff7a1f service nova] Lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:47:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8ce64437-f4d5-4fec-b7a1-0de838ab8a5d req-a6d2cf19-bf76-4d8a-9262-f83c5bff7a1f service nova] Lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:47:55 user nova-compute[103546]: DEBUG nova.compute.manager [req-8ce64437-f4d5-4fec-b7a1-0de838ab8a5d req-a6d2cf19-bf76-4d8a-9262-f83c5bff7a1f service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] No waiting events found dispatching network-vif-plugged-916a3fe8-09df-42a1-9ac0-b81153ed55a1 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:47:55 user nova-compute[103546]: WARNING nova.compute.manager [req-8ce64437-f4d5-4fec-b7a1-0de838ab8a5d req-a6d2cf19-bf76-4d8a-9262-f83c5bff7a1f service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received unexpected event network-vif-plugged-916a3fe8-09df-42a1-9ac0-b81153ed55a1 for instance with vm_state building and task_state spawning.
Nov 16 03:47:55 user nova-compute[103546]: DEBUG nova.compute.manager [req-8ce64437-f4d5-4fec-b7a1-0de838ab8a5d req-a6d2cf19-bf76-4d8a-9262-f83c5bff7a1f service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received event network-vif-plugged-916a3fe8-09df-42a1-9ac0-b81153ed55a1 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:47:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8ce64437-f4d5-4fec-b7a1-0de838ab8a5d req-a6d2cf19-bf76-4d8a-9262-f83c5bff7a1f service nova] Acquiring lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:47:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8ce64437-f4d5-4fec-b7a1-0de838ab8a5d req-a6d2cf19-bf76-4d8a-9262-f83c5bff7a1f service nova] Lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:47:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8ce64437-f4d5-4fec-b7a1-0de838ab8a5d req-a6d2cf19-bf76-4d8a-9262-f83c5bff7a1f service nova] Lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:47:55 user nova-compute[103546]: DEBUG nova.compute.manager [req-8ce64437-f4d5-4fec-b7a1-0de838ab8a5d req-a6d2cf19-bf76-4d8a-9262-f83c5bff7a1f service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] No waiting events found dispatching network-vif-plugged-916a3fe8-09df-42a1-9ac0-b81153ed55a1 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:47:55 user nova-compute[103546]: WARNING nova.compute.manager [req-8ce64437-f4d5-4fec-b7a1-0de838ab8a5d req-a6d2cf19-bf76-4d8a-9262-f83c5bff7a1f service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received unexpected event network-vif-plugged-916a3fe8-09df-42a1-9ac0-b81153ed55a1 for instance with vm_state building and task_state spawning.
Nov 16 03:47:55 user nova-compute[103546]: DEBUG nova.compute.manager [req-8ce64437-f4d5-4fec-b7a1-0de838ab8a5d req-a6d2cf19-bf76-4d8a-9262-f83c5bff7a1f service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received event network-vif-plugged-b0f609b8-eb49-4c19-968c-99c95c38b857 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:47:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8ce64437-f4d5-4fec-b7a1-0de838ab8a5d req-a6d2cf19-bf76-4d8a-9262-f83c5bff7a1f service nova] Acquiring lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:47:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8ce64437-f4d5-4fec-b7a1-0de838ab8a5d req-a6d2cf19-bf76-4d8a-9262-f83c5bff7a1f service nova] Lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:47:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8ce64437-f4d5-4fec-b7a1-0de838ab8a5d req-a6d2cf19-bf76-4d8a-9262-f83c5bff7a1f service nova] Lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:47:55 user nova-compute[103546]: DEBUG nova.compute.manager [req-8ce64437-f4d5-4fec-b7a1-0de838ab8a5d req-a6d2cf19-bf76-4d8a-9262-f83c5bff7a1f service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] No waiting events found dispatching network-vif-plugged-b0f609b8-eb49-4c19-968c-99c95c38b857 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:47:55 user nova-compute[103546]: WARNING nova.compute.manager [req-8ce64437-f4d5-4fec-b7a1-0de838ab8a5d req-a6d2cf19-bf76-4d8a-9262-f83c5bff7a1f service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received unexpected event network-vif-plugged-b0f609b8-eb49-4c19-968c-99c95c38b857 for instance with vm_state building and task_state spawning.
Nov 16 03:47:55 user nova-compute[103546]: DEBUG nova.compute.manager [req-8ce64437-f4d5-4fec-b7a1-0de838ab8a5d req-a6d2cf19-bf76-4d8a-9262-f83c5bff7a1f service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received event network-vif-plugged-b0f609b8-eb49-4c19-968c-99c95c38b857 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:47:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8ce64437-f4d5-4fec-b7a1-0de838ab8a5d req-a6d2cf19-bf76-4d8a-9262-f83c5bff7a1f service nova] Acquiring lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:47:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8ce64437-f4d5-4fec-b7a1-0de838ab8a5d req-a6d2cf19-bf76-4d8a-9262-f83c5bff7a1f service nova] Lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:47:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8ce64437-f4d5-4fec-b7a1-0de838ab8a5d req-a6d2cf19-bf76-4d8a-9262-f83c5bff7a1f service nova] Lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:47:55 user nova-compute[103546]: DEBUG nova.compute.manager [req-8ce64437-f4d5-4fec-b7a1-0de838ab8a5d req-a6d2cf19-bf76-4d8a-9262-f83c5bff7a1f service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] No waiting events found dispatching network-vif-plugged-b0f609b8-eb49-4c19-968c-99c95c38b857 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:47:55 user nova-compute[103546]: WARNING nova.compute.manager [req-8ce64437-f4d5-4fec-b7a1-0de838ab8a5d req-a6d2cf19-bf76-4d8a-9262-f83c5bff7a1f service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received unexpected event network-vif-plugged-b0f609b8-eb49-4c19-968c-99c95c38b857 for instance with vm_state building and task_state spawning.
Nov 16 03:47:55 user nova-compute[103546]: DEBUG nova.compute.manager [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 03:47:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Guest created on hypervisor {{(pid=103546) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 03:47:55 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Instance spawned successfully.
Nov 16 03:47:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 03:47:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Found default for hw_cdrom_bus of ide {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:47:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Found default for hw_disk_bus of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:47:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Found default for hw_input_bus of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:47:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Found default for hw_pointer_model of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:47:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Found default for hw_video_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:47:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Found default for hw_vif_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:47:55 user nova-compute[103546]: INFO nova.compute.manager [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Took 7.73 seconds to spawn the instance on the hypervisor.
Nov 16 03:47:55 user nova-compute[103546]: DEBUG nova.compute.manager [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 03:47:55 user nova-compute[103546]: INFO nova.compute.manager [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Took 8.54 seconds to build instance.
Nov 16 03:47:56 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-00542a02-1f4e-4484-8d64-ff9aca0a1073 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "63b95121-b211-42c3-831e-0392d4abd09a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.671s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:47:56 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:56 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:56 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:56 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:47:56 user nova-compute[103546]: DEBUG nova.compute.manager [req-848a8db6-a69f-4f6f-984e-481fb4876ded req-f0023336-4f2f-4150-b36a-3929c2b95fd0 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received event network-vif-plugged-fc03966b-fcbc-4ed7-8ffb-2270a55b4e28 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:47:56 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-848a8db6-a69f-4f6f-984e-481fb4876ded req-f0023336-4f2f-4150-b36a-3929c2b95fd0 service nova] Acquiring lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:47:56 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-848a8db6-a69f-4f6f-984e-481fb4876ded req-f0023336-4f2f-4150-b36a-3929c2b95fd0 service nova] Lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:47:56 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-848a8db6-a69f-4f6f-984e-481fb4876ded req-f0023336-4f2f-4150-b36a-3929c2b95fd0 service nova] Lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:47:56 user nova-compute[103546]: DEBUG nova.compute.manager [req-848a8db6-a69f-4f6f-984e-481fb4876ded req-f0023336-4f2f-4150-b36a-3929c2b95fd0 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] No waiting events found dispatching network-vif-plugged-fc03966b-fcbc-4ed7-8ffb-2270a55b4e28 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:47:56 user nova-compute[103546]: WARNING nova.compute.manager [req-848a8db6-a69f-4f6f-984e-481fb4876ded req-f0023336-4f2f-4150-b36a-3929c2b95fd0 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received unexpected event network-vif-plugged-fc03966b-fcbc-4ed7-8ffb-2270a55b4e28 for instance with vm_state building and task_state spawning.
Nov 16 03:47:56 user nova-compute[103546]: DEBUG nova.compute.manager [req-848a8db6-a69f-4f6f-984e-481fb4876ded req-f0023336-4f2f-4150-b36a-3929c2b95fd0 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received event network-vif-plugged-fc03966b-fcbc-4ed7-8ffb-2270a55b4e28 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:47:56 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-848a8db6-a69f-4f6f-984e-481fb4876ded req-f0023336-4f2f-4150-b36a-3929c2b95fd0 service nova] Acquiring lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:47:56 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-848a8db6-a69f-4f6f-984e-481fb4876ded req-f0023336-4f2f-4150-b36a-3929c2b95fd0 service nova] Lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:47:56 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-848a8db6-a69f-4f6f-984e-481fb4876ded req-f0023336-4f2f-4150-b36a-3929c2b95fd0 service nova] Lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:47:56 user nova-compute[103546]: DEBUG nova.compute.manager [req-848a8db6-a69f-4f6f-984e-481fb4876ded req-f0023336-4f2f-4150-b36a-3929c2b95fd0 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] No waiting events found dispatching network-vif-plugged-fc03966b-fcbc-4ed7-8ffb-2270a55b4e28 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:47:56 user nova-compute[103546]: WARNING nova.compute.manager [req-848a8db6-a69f-4f6f-984e-481fb4876ded req-f0023336-4f2f-4150-b36a-3929c2b95fd0 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received unexpected event network-vif-plugged-fc03966b-fcbc-4ed7-8ffb-2270a55b4e28 for instance with vm_state building and task_state spawning.
Nov 16 03:47:57 user nova-compute[103546]: DEBUG nova.compute.manager [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 03:47:57 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Guest created on hypervisor {{(pid=103546) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 03:47:57 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Instance spawned successfully.
Nov 16 03:47:57 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 03:47:57 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Found default for hw_cdrom_bus of ide {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:47:57 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Found default for hw_disk_bus of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:47:57 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Found default for hw_input_bus of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:47:57 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Found default for hw_pointer_model of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:47:57 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Found default for hw_video_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:47:57 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Found default for hw_vif_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:47:57 user nova-compute[103546]: INFO nova.compute.manager [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Took 12.35 seconds to spawn the instance on the hypervisor.
Nov 16 03:47:57 user nova-compute[103546]: DEBUG nova.compute.manager [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 03:47:57 user nova-compute[103546]: INFO nova.compute.manager [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Took 42.93 seconds to build instance.
Nov 16 03:47:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-83fa8ce9-1f9b-41c6-a40e-cfdbd0536b2d tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Lock "71059a8d-4e89-472c-9463-b38aa8063e33" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 43.152s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:47:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:48:00 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:48:02 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:48:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Acquiring lock "7e347e48-0b4e-4ce6-a677-5d1dc099ac6c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:48:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Lock "7e347e48-0b4e-4ce6-a677-5d1dc099ac6c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:48:05 user nova-compute[103546]: DEBUG nova.compute.manager [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c] Starting instance... {{(pid=103546) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 03:48:05 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:48:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:48:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:48:05 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=103546) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 03:48:05 user nova-compute[103546]: INFO nova.compute.claims [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c] Claim successful on node user
Nov 16 03:48:05 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:48:05 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:48:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.490s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:48:05 user nova-compute[103546]: DEBUG nova.compute.manager [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c] Start building networks asynchronously for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 03:48:05 user nova-compute[103546]: DEBUG nova.compute.manager [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c] Allocating IP information in the background. {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 03:48:05 user nova-compute[103546]: DEBUG nova.network.neutron [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c] allocate_for_instance() {{(pid=103546) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 03:48:05 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 03:48:05 user nova-compute[103546]: DEBUG nova.compute.manager [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c] Start building block device mappings for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 03:48:05 user nova-compute[103546]: DEBUG nova.policy [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fe3fb261884b45b0bdc984b79bc1dc96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f227c815224d55afdb3eba43e68757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103546) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 03:48:05 user nova-compute[103546]: DEBUG nova.compute.manager [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c] Start spawning the instance on the hypervisor. {{(pid=103546) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 03:48:05 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c] Creating instance directory {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 03:48:05 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c] Creating image(s)
Nov 16 03:48:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Acquiring lock "/opt/stack/data/nova/instances/7e347e48-0b4e-4ce6-a677-5d1dc099ac6c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:48:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Lock "/opt/stack/data/nova/instances/7e347e48-0b4e-4ce6-a677-5d1dc099ac6c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:48:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Lock "/opt/stack/data/nova/instances/7e347e48-0b4e-4ce6-a677-5d1dc099ac6c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:48:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:06 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.276s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:06 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Acquiring lock "8c9efafb670bfe5842ba1f4ce398924612164af7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:48:06 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:48:06 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:06 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.223s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:06 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/7e347e48-0b4e-4ce6-a677-5d1dc099ac6c/disk 1073741824 {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:06 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/7e347e48-0b4e-4ce6-a677-5d1dc099ac6c/disk 1073741824" returned: 0 in 0.050s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:06 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:48:06 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:06 user nova-compute[103546]: DEBUG nova.network.neutron [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c] Successfully created port: b74c6e68-89ec-4fe2-abf4-7acf17214657 {{(pid=103546) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 03:48:06 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.231s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:06 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7e347e48-0b4e-4ce6-a677-5d1dc099ac6c/disk. size=1073741824 {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 03:48:06 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e347e48-0b4e-4ce6-a677-5d1dc099ac6c/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:06 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e347e48-0b4e-4ce6-a677-5d1dc099ac6c/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:06 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Cannot resize image /opt/stack/data/nova/instances/7e347e48-0b4e-4ce6-a677-5d1dc099ac6c/disk to a smaller size. {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 03:48:06 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c] Created local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 03:48:06 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c] Ensure instance console log exists: /opt/stack/data/nova/instances/7e347e48-0b4e-4ce6-a677-5d1dc099ac6c/console.log {{(pid=103546) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 03:48:06 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:48:06 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:48:06 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:48:06 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:48:07 user nova-compute[103546]: DEBUG nova.network.neutron [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c] Successfully updated port: b74c6e68-89ec-4fe2-abf4-7acf17214657 {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 03:48:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Acquiring lock "refresh_cache-7e347e48-0b4e-4ce6-a677-5d1dc099ac6c" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:48:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Acquired lock "refresh_cache-7e347e48-0b4e-4ce6-a677-5d1dc099ac6c" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:48:07 user nova-compute[103546]: DEBUG nova.network.neutron [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 03:48:07 user nova-compute[103546]: DEBUG nova.compute.manager [req-eacec950-08b2-4afa-88e6-9153b6b490cf req-5ee4d76a-83ad-423b-9a91-d7aa9b72ff17 service nova] [instance: 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c] Received event network-changed-b74c6e68-89ec-4fe2-abf4-7acf17214657 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:48:07 user nova-compute[103546]: DEBUG nova.compute.manager [req-eacec950-08b2-4afa-88e6-9153b6b490cf req-5ee4d76a-83ad-423b-9a91-d7aa9b72ff17 service nova] [instance: 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c] Refreshing instance network info cache due to event network-changed-b74c6e68-89ec-4fe2-abf4-7acf17214657. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:48:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-eacec950-08b2-4afa-88e6-9153b6b490cf req-5ee4d76a-83ad-423b-9a91-d7aa9b72ff17 service nova] Acquiring lock "refresh_cache-7e347e48-0b4e-4ce6-a677-5d1dc099ac6c" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:48:07 user nova-compute[103546]: DEBUG nova.network.neutron [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 03:48:07 user nova-compute[103546]: DEBUG nova.network.neutron [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c] Updating instance_info_cache with network_info: [{"id": "b74c6e68-89ec-4fe2-abf4-7acf17214657", "address": "fa:16:3e:fc:09:2f", "network": {"id": "56e4e469-bfda-4ab1-9fdd-e3aa1a0655fc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-669383710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f227c815224d55afdb3eba43e68757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb74c6e68-89", "ovs_interfaceid": "b74c6e68-89ec-4fe2-abf4-7acf17214657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:48:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Releasing lock "refresh_cache-7e347e48-0b4e-4ce6-a677-5d1dc099ac6c" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:48:07 user nova-compute[103546]: DEBUG nova.compute.manager [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c] Instance network_info: |[{"id": "b74c6e68-89ec-4fe2-abf4-7acf17214657", "address": "fa:16:3e:fc:09:2f", "network": {"id": "56e4e469-bfda-4ab1-9fdd-e3aa1a0655fc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-669383710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f227c815224d55afdb3eba43e68757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb74c6e68-89", "ovs_interfaceid": "b74c6e68-89ec-4fe2-abf4-7acf17214657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 03:48:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-eacec950-08b2-4afa-88e6-9153b6b490cf req-5ee4d76a-83ad-423b-9a91-d7aa9b72ff17 service nova] Acquired lock "refresh_cache-7e347e48-0b4e-4ce6-a677-5d1dc099ac6c" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:48:07 user nova-compute[103546]: DEBUG nova.network.neutron [req-eacec950-08b2-4afa-88e6-9153b6b490cf req-5ee4d76a-83ad-423b-9a91-d7aa9b72ff17 service nova] [instance: 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c] Refreshing network info cache for port b74c6e68-89ec-4fe2-abf4-7acf17214657 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:48:07 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c] Start _get_guest_xml network_info=[{"id": "b74c6e68-89ec-4fe2-abf4-7acf17214657", "address": "fa:16:3e:fc:09:2f", "network": {"id": "56e4e469-bfda-4ab1-9fdd-e3aa1a0655fc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-669383710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f227c815224d55afdb3eba43e68757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb74c6e68-89", "ovs_interfaceid": "b74c6e68-89ec-4fe2-abf4-7acf17214657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '5c6f539a-01e5-4478-bf8f-a14310b5d7dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 03:48:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:48:07 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:48:07 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:48:07 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 03:48:07 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 03:48:07 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 03:48:07 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 03:48:07 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 03:48:07 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 03:48:07 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 03:48:07 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 03:48:07 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 03:48:07 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 03:48:07 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 03:48:07 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 03:48:07 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 03:48:07 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 03:48:07 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 03:48:07 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 03:48:07 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:48:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-248890376',display_name='tempest-ServersNegativeTestJSON-server-248890376',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-248890376',id=12,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c3f227c815224d55afdb3eba43e68757',ramdisk_id='',reservation_id='r-2a0425q3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-740287726',owner_user_name='tempest-ServersNegativeTestJSON-740287726-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:48:06Z,user_data=None,user_id='fe3fb261884b45b0bdc984b79bc1dc96',uuid=7e347e48-0b4e-4ce6-a677-5d1dc099ac6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b74c6e68-89ec-4fe2-abf4-7acf17214657", "address": "fa:16:3e:fc:09:2f", "network": {"id": "56e4e469-bfda-4ab1-9fdd-e3aa1a0655fc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-669383710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f227c815224d55afdb3eba43e68757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb74c6e68-89", "ovs_interfaceid": "b74c6e68-89ec-4fe2-abf4-7acf17214657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 03:48:07 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Converting VIF {"id": "b74c6e68-89ec-4fe2-abf4-7acf17214657", "address": "fa:16:3e:fc:09:2f", "network": {"id": "56e4e469-bfda-4ab1-9fdd-e3aa1a0655fc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-669383710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f227c815224d55afdb3eba43e68757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb74c6e68-89", "ovs_interfaceid": "b74c6e68-89ec-4fe2-abf4-7acf17214657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:48:07 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:09:2f,bridge_name='br-int',has_traffic_filtering=True,id=b74c6e68-89ec-4fe2-abf4-7acf17214657,network=Network(56e4e469-bfda-4ab1-9fdd-e3aa1a0655fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb74c6e68-89') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:48:07 user nova-compute[103546]: DEBUG nova.objects.instance [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Lazy-loading 'pci_devices' on Instance uuid 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:48:07 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c] End _get_guest_xml xml=<domain type="kvm">
Nov 16 03:48:07 user nova-compute[103546]:   <uuid>7e347e48-0b4e-4ce6-a677-5d1dc099ac6c</uuid>
Nov 16 03:48:07 user nova-compute[103546]:   <name>instance-0000000c</name>
Nov 16 03:48:07 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 03:48:07 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 03:48:07 user nova-compute[103546]:   <metadata>
Nov 16 03:48:07 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 03:48:07 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 03:48:07 user nova-compute[103546]:       <nova:name>tempest-ServersNegativeTestJSON-server-248890376</nova:name>
Nov 16 03:48:07 user nova-compute[103546]:       <nova:creationTime>2023-11-16 03:48:07</nova:creationTime>
Nov 16 03:48:07 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 03:48:07 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 03:48:07 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 03:48:07 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 03:48:07 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 03:48:07 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 03:48:07 user nova-compute[103546]:       </nova:flavor>
Nov 16 03:48:07 user nova-compute[103546]:       <nova:owner>
Nov 16 03:48:07 user nova-compute[103546]:         <nova:user uuid="fe3fb261884b45b0bdc984b79bc1dc96">tempest-ServersNegativeTestJSON-740287726-project-member</nova:user>
Nov 16 03:48:07 user nova-compute[103546]:         <nova:project uuid="c3f227c815224d55afdb3eba43e68757">tempest-ServersNegativeTestJSON-740287726</nova:project>
Nov 16 03:48:07 user nova-compute[103546]:       </nova:owner>
Nov 16 03:48:07 user nova-compute[103546]:       <nova:root type="image" uuid="5c6f539a-01e5-4478-bf8f-a14310b5d7dd"/>
Nov 16 03:48:07 user nova-compute[103546]:       <nova:ports>
Nov 16 03:48:07 user nova-compute[103546]:         <nova:port uuid="b74c6e68-89ec-4fe2-abf4-7acf17214657">
Nov 16 03:48:07 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 16 03:48:07 user nova-compute[103546]:         </nova:port>
Nov 16 03:48:07 user nova-compute[103546]:       </nova:ports>
Nov 16 03:48:07 user nova-compute[103546]:     </nova:instance>
Nov 16 03:48:07 user nova-compute[103546]:   </metadata>
Nov 16 03:48:07 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 03:48:07 user nova-compute[103546]:     <system>
Nov 16 03:48:07 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 03:48:07 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 03:48:07 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 03:48:07 user nova-compute[103546]:       <entry name="serial">7e347e48-0b4e-4ce6-a677-5d1dc099ac6c</entry>
Nov 16 03:48:07 user nova-compute[103546]:       <entry name="uuid">7e347e48-0b4e-4ce6-a677-5d1dc099ac6c</entry>
Nov 16 03:48:07 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 03:48:07 user nova-compute[103546]:     </system>
Nov 16 03:48:07 user nova-compute[103546]:   </sysinfo>
Nov 16 03:48:07 user nova-compute[103546]:   <os>
Nov 16 03:48:07 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 03:48:07 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 03:48:07 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 03:48:07 user nova-compute[103546]:   </os>
Nov 16 03:48:07 user nova-compute[103546]:   <features>
Nov 16 03:48:07 user nova-compute[103546]:     <acpi/>
Nov 16 03:48:07 user nova-compute[103546]:     <apic/>
Nov 16 03:48:07 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 03:48:07 user nova-compute[103546]:   </features>
Nov 16 03:48:07 user nova-compute[103546]:   <clock offset="utc">
Nov 16 03:48:07 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 03:48:07 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 03:48:07 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 03:48:07 user nova-compute[103546]:   </clock>
Nov 16 03:48:07 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 03:48:07 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 03:48:07 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 03:48:07 user nova-compute[103546]:   </cpu>
Nov 16 03:48:07 user nova-compute[103546]:   <devices>
Nov 16 03:48:07 user nova-compute[103546]:     <disk type="file" device="disk">
Nov 16 03:48:07 user nova-compute[103546]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 03:48:07 user nova-compute[103546]:       <source file="/opt/stack/data/nova/instances/7e347e48-0b4e-4ce6-a677-5d1dc099ac6c/disk"/>
Nov 16 03:48:07 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 03:48:07 user nova-compute[103546]:     </disk>
Nov 16 03:48:07 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 03:48:07 user nova-compute[103546]:       <mac address="fa:16:3e:fc:09:2f"/>
Nov 16 03:48:07 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:48:07 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 03:48:07 user nova-compute[103546]:       <target dev="tapb74c6e68-89"/>
Nov 16 03:48:07 user nova-compute[103546]:     </interface>
Nov 16 03:48:07 user nova-compute[103546]:     <serial type="pty">
Nov 16 03:48:07 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/7e347e48-0b4e-4ce6-a677-5d1dc099ac6c/console.log" append="off"/>
Nov 16 03:48:07 user nova-compute[103546]:     </serial>
Nov 16 03:48:07 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 03:48:07 user nova-compute[103546]:     <video>
Nov 16 03:48:07 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:48:07 user nova-compute[103546]:     </video>
Nov 16 03:48:07 user nova-compute[103546]:     <rng model="virtio">
Nov 16 03:48:07 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 03:48:07 user nova-compute[103546]:     </rng>
Nov 16 03:48:07 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 03:48:07 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 03:48:07 user nova-compute[103546]:       <stats period="10"/>
Nov 16 03:48:07 user nova-compute[103546]:     </memballoon>
Nov 16 03:48:07 user nova-compute[103546]:   </devices>
Nov 16 03:48:07 user nova-compute[103546]: </domain>
Nov 16 03:48:07 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 03:48:07 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:48:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-248890376',display_name='tempest-ServersNegativeTestJSON-server-248890376',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-248890376',id=12,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c3f227c815224d55afdb3eba43e68757',ramdisk_id='',reservation_id='r-2a0425q3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-740287726',owner_user_name='tempest-ServersNegativeTestJSON-740287726-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:48:06Z,user_data=None,user_id='fe3fb261884b45b0bdc984b79bc1dc96',uuid=7e347e48-0b4e-4ce6-a677-5d1dc099ac6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b74c6e68-89ec-4fe2-abf4-7acf17214657", "address": "fa:16:3e:fc:09:2f", "network": {"id": "56e4e469-bfda-4ab1-9fdd-e3aa1a0655fc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-669383710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f227c815224d55afdb3eba43e68757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb74c6e68-89", "ovs_interfaceid": "b74c6e68-89ec-4fe2-abf4-7acf17214657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 03:48:07 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Converting VIF {"id": "b74c6e68-89ec-4fe2-abf4-7acf17214657", "address": "fa:16:3e:fc:09:2f", "network": {"id": "56e4e469-bfda-4ab1-9fdd-e3aa1a0655fc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-669383710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f227c815224d55afdb3eba43e68757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb74c6e68-89", "ovs_interfaceid": "b74c6e68-89ec-4fe2-abf4-7acf17214657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:48:07 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:09:2f,bridge_name='br-int',has_traffic_filtering=True,id=b74c6e68-89ec-4fe2-abf4-7acf17214657,network=Network(56e4e469-bfda-4ab1-9fdd-e3aa1a0655fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb74c6e68-89') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:48:07 user nova-compute[103546]: DEBUG os_vif [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:09:2f,bridge_name='br-int',has_traffic_filtering=True,id=b74c6e68-89ec-4fe2-abf4-7acf17214657,network=Network(56e4e469-bfda-4ab1-9fdd-e3aa1a0655fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb74c6e68-89') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 03:48:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:48:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:48:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 03:48:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:48:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a87f641a-0447-577a-8432-ddba8a922804', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:48:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:48:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:48:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:48:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb74c6e68-89, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:48:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb74c6e68-89, col_values=(('qos', UUID('dde30abc-7345-4e96-a604-ac063858d5b6')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:48:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb74c6e68-89, col_values=(('external_ids', {'iface-id': 'b74c6e68-89ec-4fe2-abf4-7acf17214657', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:09:2f', 'vm-uuid': '7e347e48-0b4e-4ce6-a677-5d1dc099ac6c'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:48:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:48:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:48:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:48:07 user nova-compute[103546]: INFO os_vif [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:09:2f,bridge_name='br-int',has_traffic_filtering=True,id=b74c6e68-89ec-4fe2-abf4-7acf17214657,network=Network(56e4e469-bfda-4ab1-9fdd-e3aa1a0655fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb74c6e68-89')
Nov 16 03:48:07 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:48:07 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] No VIF found with MAC fa:16:3e:fc:09:2f, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 03:48:08 user nova-compute[103546]: DEBUG nova.network.neutron [req-eacec950-08b2-4afa-88e6-9153b6b490cf req-5ee4d76a-83ad-423b-9a91-d7aa9b72ff17 service nova] [instance: 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c] Updated VIF entry in instance network info cache for port b74c6e68-89ec-4fe2-abf4-7acf17214657. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 03:48:08 user nova-compute[103546]: DEBUG nova.network.neutron [req-eacec950-08b2-4afa-88e6-9153b6b490cf req-5ee4d76a-83ad-423b-9a91-d7aa9b72ff17 service nova] [instance: 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c] Updating instance_info_cache with network_info: [{"id": "b74c6e68-89ec-4fe2-abf4-7acf17214657", "address": "fa:16:3e:fc:09:2f", "network": {"id": "56e4e469-bfda-4ab1-9fdd-e3aa1a0655fc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-669383710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f227c815224d55afdb3eba43e68757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb74c6e68-89", "ovs_interfaceid": "b74c6e68-89ec-4fe2-abf4-7acf17214657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:48:08 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-eacec950-08b2-4afa-88e6-9153b6b490cf req-5ee4d76a-83ad-423b-9a91-d7aa9b72ff17 service nova] Releasing lock "refresh_cache-7e347e48-0b4e-4ce6-a677-5d1dc099ac6c" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:48:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:48:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:48:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:48:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:48:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:48:09 user nova-compute[103546]: DEBUG nova.compute.manager [req-b0dcc706-b292-40a4-b611-8d6e67cd1bef req-6252537e-7176-467d-9fc8-6ba80f67649e service nova] [instance: 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c] Received event network-vif-plugged-b74c6e68-89ec-4fe2-abf4-7acf17214657 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:48:09 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-b0dcc706-b292-40a4-b611-8d6e67cd1bef req-6252537e-7176-467d-9fc8-6ba80f67649e service nova] Acquiring lock "7e347e48-0b4e-4ce6-a677-5d1dc099ac6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:48:09 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-b0dcc706-b292-40a4-b611-8d6e67cd1bef req-6252537e-7176-467d-9fc8-6ba80f67649e service nova] Lock "7e347e48-0b4e-4ce6-a677-5d1dc099ac6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:48:09 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-b0dcc706-b292-40a4-b611-8d6e67cd1bef req-6252537e-7176-467d-9fc8-6ba80f67649e service nova] Lock "7e347e48-0b4e-4ce6-a677-5d1dc099ac6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:48:09 user nova-compute[103546]: DEBUG nova.compute.manager [req-b0dcc706-b292-40a4-b611-8d6e67cd1bef req-6252537e-7176-467d-9fc8-6ba80f67649e service nova] [instance: 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c] No waiting events found dispatching network-vif-plugged-b74c6e68-89ec-4fe2-abf4-7acf17214657 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:48:09 user nova-compute[103546]: WARNING nova.compute.manager [req-b0dcc706-b292-40a4-b611-8d6e67cd1bef req-6252537e-7176-467d-9fc8-6ba80f67649e service nova] [instance: 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c] Received unexpected event network-vif-plugged-b74c6e68-89ec-4fe2-abf4-7acf17214657 for instance with vm_state building and task_state spawning.
Nov 16 03:48:11 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:48:11 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:48:11 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:48:11 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Starting heal instance info cache {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 03:48:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "refresh_cache-51554aab-44ec-4161-b926-9c07a3f838a5" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:48:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquired lock "refresh_cache-51554aab-44ec-4161-b926-9c07a3f838a5" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:48:11 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Forcefully refreshing network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 03:48:11 user nova-compute[103546]: DEBUG nova.compute.manager [req-0fb3cd99-88c3-427c-b998-fdec680b504b req-9ad3aa69-f9ce-4b9c-90f6-3795a0d8241a service nova] [instance: 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c] Received event network-vif-plugged-b74c6e68-89ec-4fe2-abf4-7acf17214657 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:48:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-0fb3cd99-88c3-427c-b998-fdec680b504b req-9ad3aa69-f9ce-4b9c-90f6-3795a0d8241a service nova] Acquiring lock "7e347e48-0b4e-4ce6-a677-5d1dc099ac6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:48:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-0fb3cd99-88c3-427c-b998-fdec680b504b req-9ad3aa69-f9ce-4b9c-90f6-3795a0d8241a service nova] Lock "7e347e48-0b4e-4ce6-a677-5d1dc099ac6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:48:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-0fb3cd99-88c3-427c-b998-fdec680b504b req-9ad3aa69-f9ce-4b9c-90f6-3795a0d8241a service nova] Lock "7e347e48-0b4e-4ce6-a677-5d1dc099ac6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:48:11 user nova-compute[103546]: DEBUG nova.compute.manager [req-0fb3cd99-88c3-427c-b998-fdec680b504b req-9ad3aa69-f9ce-4b9c-90f6-3795a0d8241a service nova] [instance: 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c] No waiting events found dispatching network-vif-plugged-b74c6e68-89ec-4fe2-abf4-7acf17214657 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:48:11 user nova-compute[103546]: WARNING nova.compute.manager [req-0fb3cd99-88c3-427c-b998-fdec680b504b req-9ad3aa69-f9ce-4b9c-90f6-3795a0d8241a service nova] [instance: 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c] Received unexpected event network-vif-plugged-b74c6e68-89ec-4fe2-abf4-7acf17214657 for instance with vm_state building and task_state spawning.
Nov 16 03:48:11 user nova-compute[103546]: DEBUG nova.compute.manager [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 03:48:11 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c] Guest created on hypervisor {{(pid=103546) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 03:48:11 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c] Instance spawned successfully.
Nov 16 03:48:11 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 03:48:11 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c] Found default for hw_cdrom_bus of ide {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:48:11 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c] Found default for hw_disk_bus of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:48:11 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c] Found default for hw_input_bus of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:48:11 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c] Found default for hw_pointer_model of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:48:11 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c] Found default for hw_video_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:48:11 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c] Found default for hw_vif_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:48:11 user nova-compute[103546]: INFO nova.compute.manager [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c] Took 6.10 seconds to spawn the instance on the hypervisor.
Nov 16 03:48:11 user nova-compute[103546]: DEBUG nova.compute.manager [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 03:48:12 user nova-compute[103546]: INFO nova.compute.manager [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c] Took 6.93 seconds to build instance.
Nov 16 03:48:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-02f7d234-96ad-4536-b5ba-dc2ea49be6ce tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Lock "7e347e48-0b4e-4ce6-a677-5d1dc099ac6c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.041s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:48:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:48:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:48:12 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Updating instance_info_cache with network_info: [{"id": "e36fae5d-773f-47c0-b79a-5aadf6412cbc", "address": "fa:16:3e:9a:45:d0", "network": {"id": "ef471a6e-7bd1-4a61-aa01-fd7557bfae1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-865941926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76ca2da0c584a7382040eb113da4c2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape36fae5d-77", "ovs_interfaceid": "e36fae5d-773f-47c0-b79a-5aadf6412cbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:48:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Releasing lock "refresh_cache-51554aab-44ec-4161-b926-9c07a3f838a5" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:48:12 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Updated the network info_cache for instance {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 03:48:12 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:48:12 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:48:12 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:48:12 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:48:12 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:48:12 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:48:12 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=103546) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 03:48:12 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager.update_available_resource {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:48:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:48:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:48:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:48:13 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Auditing locally available compute resources for user (node: user) {{(pid=103546) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 03:48:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63b95121-b211-42c3-831e-0392d4abd09a/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63b95121-b211-42c3-831e-0392d4abd09a/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63b95121-b211-42c3-831e-0392d4abd09a/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63b95121-b211-42c3-831e-0392d4abd09a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/549ee3db-0014-440f-bd3a-0d389f5eab88/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:13 user nova-compute[103546]: DEBUG nova.compute.manager [req-8a22599f-40cd-4392-8071-a9281b0be9f9 req-eb392548-caaf-4b74-be8b-9244d92e5e30 service nova] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Received event network-changed-e36fae5d-773f-47c0-b79a-5aadf6412cbc {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:48:13 user nova-compute[103546]: DEBUG nova.compute.manager [req-8a22599f-40cd-4392-8071-a9281b0be9f9 req-eb392548-caaf-4b74-be8b-9244d92e5e30 service nova] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Refreshing instance network info cache due to event network-changed-e36fae5d-773f-47c0-b79a-5aadf6412cbc. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:48:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8a22599f-40cd-4392-8071-a9281b0be9f9 req-eb392548-caaf-4b74-be8b-9244d92e5e30 service nova] Acquiring lock "refresh_cache-51554aab-44ec-4161-b926-9c07a3f838a5" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:48:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8a22599f-40cd-4392-8071-a9281b0be9f9 req-eb392548-caaf-4b74-be8b-9244d92e5e30 service nova] Acquired lock "refresh_cache-51554aab-44ec-4161-b926-9c07a3f838a5" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:48:13 user nova-compute[103546]: DEBUG nova.network.neutron [req-8a22599f-40cd-4392-8071-a9281b0be9f9 req-eb392548-caaf-4b74-be8b-9244d92e5e30 service nova] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Refreshing network info cache for port e36fae5d-773f-47c0-b79a-5aadf6412cbc {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:48:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/549ee3db-0014-440f-bd3a-0d389f5eab88/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/549ee3db-0014-440f-bd3a-0d389f5eab88/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/549ee3db-0014-440f-bd3a-0d389f5eab88/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c929d5-2f1c-4be4-8864-6ec81625daac/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:14 user nova-compute[103546]: DEBUG nova.network.neutron [req-8a22599f-40cd-4392-8071-a9281b0be9f9 req-eb392548-caaf-4b74-be8b-9244d92e5e30 service nova] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Updated VIF entry in instance network info cache for port e36fae5d-773f-47c0-b79a-5aadf6412cbc. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 03:48:14 user nova-compute[103546]: DEBUG nova.network.neutron [req-8a22599f-40cd-4392-8071-a9281b0be9f9 req-eb392548-caaf-4b74-be8b-9244d92e5e30 service nova] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Updating instance_info_cache with network_info: [{"id": "e36fae5d-773f-47c0-b79a-5aadf6412cbc", "address": "fa:16:3e:9a:45:d0", "network": {"id": "ef471a6e-7bd1-4a61-aa01-fd7557bfae1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-865941926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76ca2da0c584a7382040eb113da4c2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape36fae5d-77", "ovs_interfaceid": "e36fae5d-773f-47c0-b79a-5aadf6412cbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:48:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8a22599f-40cd-4392-8071-a9281b0be9f9 req-eb392548-caaf-4b74-be8b-9244d92e5e30 service nova] Releasing lock "refresh_cache-51554aab-44ec-4161-b926-9c07a3f838a5" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:48:14 user nova-compute[103546]: DEBUG nova.compute.manager [req-8a22599f-40cd-4392-8071-a9281b0be9f9 req-eb392548-caaf-4b74-be8b-9244d92e5e30 service nova] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Received event network-changed-26fd759d-5cb8-4798-ab59-c7f5cb7773e8 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:48:14 user nova-compute[103546]: DEBUG nova.compute.manager [req-8a22599f-40cd-4392-8071-a9281b0be9f9 req-eb392548-caaf-4b74-be8b-9244d92e5e30 service nova] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Refreshing instance network info cache due to event network-changed-26fd759d-5cb8-4798-ab59-c7f5cb7773e8. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:48:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8a22599f-40cd-4392-8071-a9281b0be9f9 req-eb392548-caaf-4b74-be8b-9244d92e5e30 service nova] Acquiring lock "refresh_cache-7862d05d-4293-46a5-98aa-41967a572fe3" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:48:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8a22599f-40cd-4392-8071-a9281b0be9f9 req-eb392548-caaf-4b74-be8b-9244d92e5e30 service nova] Acquired lock "refresh_cache-7862d05d-4293-46a5-98aa-41967a572fe3" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:48:14 user nova-compute[103546]: DEBUG nova.network.neutron [req-8a22599f-40cd-4392-8071-a9281b0be9f9 req-eb392548-caaf-4b74-be8b-9244d92e5e30 service nova] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Refreshing network info cache for port 26fd759d-5cb8-4798-ab59-c7f5cb7773e8 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:48:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c929d5-2f1c-4be4-8864-6ec81625daac/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c929d5-2f1c-4be4-8864-6ec81625daac/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c929d5-2f1c-4be4-8864-6ec81625daac/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad9b2edb-15d7-4937-9461-15ce61f508a7/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad9b2edb-15d7-4937-9461-15ce61f508a7/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad9b2edb-15d7-4937-9461-15ce61f508a7/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:14 user nova-compute[103546]: DEBUG nova.network.neutron [req-8a22599f-40cd-4392-8071-a9281b0be9f9 req-eb392548-caaf-4b74-be8b-9244d92e5e30 service nova] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Updated VIF entry in instance network info cache for port 26fd759d-5cb8-4798-ab59-c7f5cb7773e8. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 03:48:14 user nova-compute[103546]: DEBUG nova.network.neutron [req-8a22599f-40cd-4392-8071-a9281b0be9f9 req-eb392548-caaf-4b74-be8b-9244d92e5e30 service nova] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Updating instance_info_cache with network_info: [{"id": "26fd759d-5cb8-4798-ab59-c7f5cb7773e8", "address": "fa:16:3e:a0:1a:6c", "network": {"id": "b2fca984-f1e9-4c86-a3a5-b8d5b9950555", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-172535633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63722fdf17e4408299de8c215c133812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26fd759d-5c", "ovs_interfaceid": "26fd759d-5cb8-4798-ab59-c7f5cb7773e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:48:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8a22599f-40cd-4392-8071-a9281b0be9f9 req-eb392548-caaf-4b74-be8b-9244d92e5e30 service nova] Releasing lock "refresh_cache-7862d05d-4293-46a5-98aa-41967a572fe3" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:48:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad9b2edb-15d7-4937-9461-15ce61f508a7/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e2954-d786-4544-903d-8edc63646e2d/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e2954-d786-4544-903d-8edc63646e2d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e2954-d786-4544-903d-8edc63646e2d/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e2954-d786-4544-903d-8edc63646e2d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c24a386f-32f5-4095-b2b3-69a70a54ff66/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c24a386f-32f5-4095-b2b3-69a70a54ff66/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c24a386f-32f5-4095-b2b3-69a70a54ff66/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c24a386f-32f5-4095-b2b3-69a70a54ff66/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7862d05d-4293-46a5-98aa-41967a572fe3/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7862d05d-4293-46a5-98aa-41967a572fe3/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7862d05d-4293-46a5-98aa-41967a572fe3/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7862d05d-4293-46a5-98aa-41967a572fe3/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51554aab-44ec-4161-b926-9c07a3f838a5/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51554aab-44ec-4161-b926-9c07a3f838a5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51554aab-44ec-4161-b926-9c07a3f838a5/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51554aab-44ec-4161-b926-9c07a3f838a5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:16 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 03:48:16 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 03:48:16 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 03:48:16 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 03:48:16 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 03:48:16 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 03:48:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fead4119-3ab9-4337-8b48-d3920e1112f4/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fead4119-3ab9-4337-8b48-d3920e1112f4/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fead4119-3ab9-4337-8b48-d3920e1112f4/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-727a234e-db10-40dd-8c6c-220aad8d1eb0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Acquiring lock "7862d05d-4293-46a5-98aa-41967a572fe3" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:48:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-727a234e-db10-40dd-8c6c-220aad8d1eb0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "7862d05d-4293-46a5-98aa-41967a572fe3" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:48:16 user nova-compute[103546]: INFO nova.compute.manager [None req-727a234e-db10-40dd-8c6c-220aad8d1eb0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Shelving
Nov 16 03:48:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fead4119-3ab9-4337-8b48-d3920e1112f4/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e347e48-0b4e-4ce6-a677-5d1dc099ac6c/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:17 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:48:17 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:48:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e347e48-0b4e-4ce6-a677-5d1dc099ac6c/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e347e48-0b4e-4ce6-a677-5d1dc099ac6c/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:17 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:48:17 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:48:17 user nova-compute[103546]: DEBUG nova.compute.manager [req-c9b88cc3-9fdf-4466-8c5c-4a588e335c61 req-5a852271-655d-4995-b9ba-52233ff1a4c5 service nova] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Received event network-vif-unplugged-26fd759d-5cb8-4798-ab59-c7f5cb7773e8 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:48:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-c9b88cc3-9fdf-4466-8c5c-4a588e335c61 req-5a852271-655d-4995-b9ba-52233ff1a4c5 service nova] Acquiring lock "7862d05d-4293-46a5-98aa-41967a572fe3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:48:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-c9b88cc3-9fdf-4466-8c5c-4a588e335c61 req-5a852271-655d-4995-b9ba-52233ff1a4c5 service nova] Lock "7862d05d-4293-46a5-98aa-41967a572fe3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:48:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-c9b88cc3-9fdf-4466-8c5c-4a588e335c61 req-5a852271-655d-4995-b9ba-52233ff1a4c5 service nova] Lock "7862d05d-4293-46a5-98aa-41967a572fe3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:48:17 user nova-compute[103546]: DEBUG nova.compute.manager [req-c9b88cc3-9fdf-4466-8c5c-4a588e335c61 req-5a852271-655d-4995-b9ba-52233ff1a4c5 service nova] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] No waiting events found dispatching network-vif-unplugged-26fd759d-5cb8-4798-ab59-c7f5cb7773e8 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:48:17 user nova-compute[103546]: WARNING nova.compute.manager [req-c9b88cc3-9fdf-4466-8c5c-4a588e335c61 req-5a852271-655d-4995-b9ba-52233ff1a4c5 service nova] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Received unexpected event network-vif-unplugged-26fd759d-5cb8-4798-ab59-c7f5cb7773e8 for instance with vm_state active and task_state shelving.
Nov 16 03:48:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e347e48-0b4e-4ce6-a677-5d1dc099ac6c/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:18 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:48:18 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:48:18 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:48:18 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Hypervisor/Node resource view: name=user free_ram=6832MB free_disk=25.49814224243164GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=103546) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 03:48:18 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:48:18 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:48:18 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Instance destroyed successfully.
Nov 16 03:48:18 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-727a234e-db10-40dd-8c6c-220aad8d1eb0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Beginning cold snapshot process
Nov 16 03:48:18 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 279e2954-d786-4544-903d-8edc63646e2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:48:18 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 51554aab-44ec-4161-b926-9c07a3f838a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:48:18 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 7862d05d-4293-46a5-98aa-41967a572fe3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:48:18 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance c24a386f-32f5-4095-b2b3-69a70a54ff66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:48:18 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 05c929d5-2f1c-4be4-8864-6ec81625daac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:48:18 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance fead4119-3ab9-4337-8b48-d3920e1112f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:48:18 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 549ee3db-0014-440f-bd3a-0d389f5eab88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:48:18 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance ad9b2edb-15d7-4937-9461-15ce61f508a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:48:18 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 71059a8d-4e89-472c-9463-b38aa8063e33 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:48:18 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 2cb84f00-0601-4199-ba6e-f09a27add736 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:48:18 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 63b95121-b211-42c3-831e-0392d4abd09a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:48:18 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:48:18 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 03:48:18 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 03:48:18 user nova-compute[103546]: DEBUG nova.privsep.utils [None req-727a234e-db10-40dd-8c6c-220aad8d1eb0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=103546) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 03:48:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-727a234e-db10-40dd-8c6c-220aad8d1eb0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/7862d05d-4293-46a5-98aa-41967a572fe3/disk /opt/stack/data/nova/instances/snapshots/tmprow5ipql/f98a45fd6e5b4c1cacfe4f7a0d3ce9c1 {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:18 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:48:19 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:48:19 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Compute_service record updated for user:user {{(pid=103546) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 03:48:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.775s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:48:19 user nova-compute[103546]: DEBUG nova.compute.manager [req-89c4b947-61ca-44f5-8f65-3d8ff5b55a7e req-b1f0c9ba-8796-4fb6-ac35-8a0de1b3279f service nova] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Received event network-vif-plugged-26fd759d-5cb8-4798-ab59-c7f5cb7773e8 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:48:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-89c4b947-61ca-44f5-8f65-3d8ff5b55a7e req-b1f0c9ba-8796-4fb6-ac35-8a0de1b3279f service nova] Acquiring lock "7862d05d-4293-46a5-98aa-41967a572fe3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:48:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-89c4b947-61ca-44f5-8f65-3d8ff5b55a7e req-b1f0c9ba-8796-4fb6-ac35-8a0de1b3279f service nova] Lock "7862d05d-4293-46a5-98aa-41967a572fe3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:48:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-89c4b947-61ca-44f5-8f65-3d8ff5b55a7e req-b1f0c9ba-8796-4fb6-ac35-8a0de1b3279f service nova] Lock "7862d05d-4293-46a5-98aa-41967a572fe3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:48:19 user nova-compute[103546]: DEBUG nova.compute.manager [req-89c4b947-61ca-44f5-8f65-3d8ff5b55a7e req-b1f0c9ba-8796-4fb6-ac35-8a0de1b3279f service nova] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] No waiting events found dispatching network-vif-plugged-26fd759d-5cb8-4798-ab59-c7f5cb7773e8 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:48:19 user nova-compute[103546]: WARNING nova.compute.manager [req-89c4b947-61ca-44f5-8f65-3d8ff5b55a7e req-b1f0c9ba-8796-4fb6-ac35-8a0de1b3279f service nova] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Received unexpected event network-vif-plugged-26fd759d-5cb8-4798-ab59-c7f5cb7773e8 for instance with vm_state active and task_state shelving_image_pending_upload.
Nov 16 03:48:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-727a234e-db10-40dd-8c6c-220aad8d1eb0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/7862d05d-4293-46a5-98aa-41967a572fe3/disk /opt/stack/data/nova/instances/snapshots/tmprow5ipql/f98a45fd6e5b4c1cacfe4f7a0d3ce9c1" returned: 0 in 0.947s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:19 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-727a234e-db10-40dd-8c6c-220aad8d1eb0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Snapshot extracted, beginning image upload
Nov 16 03:48:22 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-727a234e-db10-40dd-8c6c-220aad8d1eb0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Snapshot image upload complete
Nov 16 03:48:22 user nova-compute[103546]: DEBUG nova.compute.manager [None req-727a234e-db10-40dd-8c6c-220aad8d1eb0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 03:48:22 user nova-compute[103546]: INFO nova.compute.manager [None req-727a234e-db10-40dd-8c6c-220aad8d1eb0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Shelve offloading
Nov 16 03:48:22 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Instance destroyed successfully.
Nov 16 03:48:22 user nova-compute[103546]: DEBUG nova.compute.manager [None req-727a234e-db10-40dd-8c6c-220aad8d1eb0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 03:48:22 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-727a234e-db10-40dd-8c6c-220aad8d1eb0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Acquiring lock "refresh_cache-7862d05d-4293-46a5-98aa-41967a572fe3" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:48:22 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-727a234e-db10-40dd-8c6c-220aad8d1eb0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Acquired lock "refresh_cache-7862d05d-4293-46a5-98aa-41967a572fe3" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:48:22 user nova-compute[103546]: DEBUG nova.network.neutron [None req-727a234e-db10-40dd-8c6c-220aad8d1eb0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 03:48:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:48:22 user nova-compute[103546]: DEBUG nova.network.neutron [None req-727a234e-db10-40dd-8c6c-220aad8d1eb0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Updating instance_info_cache with network_info: [{"id": "26fd759d-5cb8-4798-ab59-c7f5cb7773e8", "address": "fa:16:3e:a0:1a:6c", "network": {"id": "b2fca984-f1e9-4c86-a3a5-b8d5b9950555", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-172535633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63722fdf17e4408299de8c215c133812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26fd759d-5c", "ovs_interfaceid": "26fd759d-5cb8-4798-ab59-c7f5cb7773e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:48:22 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-727a234e-db10-40dd-8c6c-220aad8d1eb0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Releasing lock "refresh_cache-7862d05d-4293-46a5-98aa-41967a572fe3" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:48:23 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:48:23 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Instance destroyed successfully.
Nov 16 03:48:23 user nova-compute[103546]: DEBUG nova.objects.instance [None req-727a234e-db10-40dd-8c6c-220aad8d1eb0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lazy-loading 'resources' on Instance uuid 7862d05d-4293-46a5-98aa-41967a572fe3 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:48:23 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-727a234e-db10-40dd-8c6c-220aad8d1eb0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:46:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1027244547',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1027244547',id=3,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIFxV00qDStRyM0aDchwn6O7nlyPBZ3FOeBCFyiv8nQiisuU4RVmz5Isxf+3jZU4Uk5uvGKisEupEEQry1rV9qqNWz0A/tXtKp7pERmtHb5Hdrh+a6bO5Ag2wMW0itUDaA==',key_name='tempest-keypair-494888',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:46:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='63722fdf17e4408299de8c215c133812',ramdisk_id='',reservation_id='r-l9s12mms',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1382373405',owner_user_name='tempest-AttachVolumeShelveTestJSON-1382373405-project-member',shelved_at='2023-11-16T03:48:22.217158',shelved_host='user',shelved_image_id='10327314-f1c6-4bb6-b137-cf23d91a2e92'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T03:48:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21d4e9052a614968bda331f028920ca7',uuid=7862d05d-4293-46a5-98aa-41967a572fe3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "26fd759d-5cb8-4798-ab59-c7f5cb7773e8", "address": "fa:16:3e:a0:1a:6c", "network": {"id": "b2fca984-f1e9-4c86-a3a5-b8d5b9950555", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-172535633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63722fdf17e4408299de8c215c133812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26fd759d-5c", "ovs_interfaceid": "26fd759d-5cb8-4798-ab59-c7f5cb7773e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 03:48:23 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-727a234e-db10-40dd-8c6c-220aad8d1eb0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Converting VIF {"id": "26fd759d-5cb8-4798-ab59-c7f5cb7773e8", "address": "fa:16:3e:a0:1a:6c", "network": {"id": "b2fca984-f1e9-4c86-a3a5-b8d5b9950555", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-172535633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63722fdf17e4408299de8c215c133812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26fd759d-5c", "ovs_interfaceid": "26fd759d-5cb8-4798-ab59-c7f5cb7773e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:48:23 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-727a234e-db10-40dd-8c6c-220aad8d1eb0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:1a:6c,bridge_name='br-int',has_traffic_filtering=True,id=26fd759d-5cb8-4798-ab59-c7f5cb7773e8,network=Network(b2fca984-f1e9-4c86-a3a5-b8d5b9950555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26fd759d-5c') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:48:23 user nova-compute[103546]: DEBUG os_vif [None req-727a234e-db10-40dd-8c6c-220aad8d1eb0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:1a:6c,bridge_name='br-int',has_traffic_filtering=True,id=26fd759d-5cb8-4798-ab59-c7f5cb7773e8,network=Network(b2fca984-f1e9-4c86-a3a5-b8d5b9950555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26fd759d-5c') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 03:48:23 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:48:23 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26fd759d-5c, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:48:23 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:48:23 user nova-compute[103546]: DEBUG nova.compute.manager [req-d47dab66-aff6-4a1b-ac83-7f1f53b47f28 req-a3d07954-1004-44ad-96f6-1d9071e5ee79 service nova] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Received event network-changed-26fd759d-5cb8-4798-ab59-c7f5cb7773e8 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:48:23 user nova-compute[103546]: DEBUG nova.compute.manager [req-d47dab66-aff6-4a1b-ac83-7f1f53b47f28 req-a3d07954-1004-44ad-96f6-1d9071e5ee79 service nova] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Refreshing instance network info cache due to event network-changed-26fd759d-5cb8-4798-ab59-c7f5cb7773e8. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:48:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d47dab66-aff6-4a1b-ac83-7f1f53b47f28 req-a3d07954-1004-44ad-96f6-1d9071e5ee79 service nova] Acquiring lock "refresh_cache-7862d05d-4293-46a5-98aa-41967a572fe3" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:48:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d47dab66-aff6-4a1b-ac83-7f1f53b47f28 req-a3d07954-1004-44ad-96f6-1d9071e5ee79 service nova] Acquired lock "refresh_cache-7862d05d-4293-46a5-98aa-41967a572fe3" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:48:23 user nova-compute[103546]: DEBUG nova.network.neutron [req-d47dab66-aff6-4a1b-ac83-7f1f53b47f28 req-a3d07954-1004-44ad-96f6-1d9071e5ee79 service nova] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Refreshing network info cache for port 26fd759d-5cb8-4798-ab59-c7f5cb7773e8 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:48:23 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:48:23 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:48:23 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d35a2752-a729-4836-afca-3a1a8ac338bf) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:48:23 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:48:23 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:48:23 user nova-compute[103546]: INFO os_vif [None req-727a234e-db10-40dd-8c6c-220aad8d1eb0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:1a:6c,bridge_name='br-int',has_traffic_filtering=True,id=26fd759d-5cb8-4798-ab59-c7f5cb7773e8,network=Network(b2fca984-f1e9-4c86-a3a5-b8d5b9950555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26fd759d-5c')
Nov 16 03:48:23 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-727a234e-db10-40dd-8c6c-220aad8d1eb0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Deleting instance files /opt/stack/data/nova/instances/7862d05d-4293-46a5-98aa-41967a572fe3_del
Nov 16 03:48:23 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-727a234e-db10-40dd-8c6c-220aad8d1eb0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Deletion of /opt/stack/data/nova/instances/7862d05d-4293-46a5-98aa-41967a572fe3_del complete
Nov 16 03:48:23 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-727a234e-db10-40dd-8c6c-220aad8d1eb0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Checking UEFI support for host arch (x86_64) {{(pid=103546) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 16 03:48:23 user nova-compute[103546]: INFO nova.virt.libvirt.host [None req-727a234e-db10-40dd-8c6c-220aad8d1eb0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] UEFI support detected
Nov 16 03:48:23 user nova-compute[103546]: INFO nova.scheduler.client.report [None req-727a234e-db10-40dd-8c6c-220aad8d1eb0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Deleted allocations for instance 7862d05d-4293-46a5-98aa-41967a572fe3
Nov 16 03:48:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-727a234e-db10-40dd-8c6c-220aad8d1eb0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:48:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-727a234e-db10-40dd-8c6c-220aad8d1eb0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:48:23 user nova-compute[103546]: DEBUG nova.objects.instance [None req-727a234e-db10-40dd-8c6c-220aad8d1eb0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lazy-loading 'numa_topology' on Instance uuid 7862d05d-4293-46a5-98aa-41967a572fe3 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:48:23 user nova-compute[103546]: DEBUG nova.objects.base [None req-727a234e-db10-40dd-8c6c-220aad8d1eb0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Object Instance<7862d05d-4293-46a5-98aa-41967a572fe3> lazy-loaded attributes: resources,numa_topology {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 03:48:23 user nova-compute[103546]: DEBUG nova.network.neutron [req-d47dab66-aff6-4a1b-ac83-7f1f53b47f28 req-a3d07954-1004-44ad-96f6-1d9071e5ee79 service nova] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Updated VIF entry in instance network info cache for port 26fd759d-5cb8-4798-ab59-c7f5cb7773e8. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 03:48:23 user nova-compute[103546]: DEBUG nova.network.neutron [req-d47dab66-aff6-4a1b-ac83-7f1f53b47f28 req-a3d07954-1004-44ad-96f6-1d9071e5ee79 service nova] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Updating instance_info_cache with network_info: [{"id": "26fd759d-5cb8-4798-ab59-c7f5cb7773e8", "address": "fa:16:3e:a0:1a:6c", "network": {"id": "b2fca984-f1e9-4c86-a3a5-b8d5b9950555", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-172535633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63722fdf17e4408299de8c215c133812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap26fd759d-5c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:48:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d47dab66-aff6-4a1b-ac83-7f1f53b47f28 req-a3d07954-1004-44ad-96f6-1d9071e5ee79 service nova] Releasing lock "refresh_cache-7862d05d-4293-46a5-98aa-41967a572fe3" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:48:23 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-727a234e-db10-40dd-8c6c-220aad8d1eb0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:48:23 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-727a234e-db10-40dd-8c6c-220aad8d1eb0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:48:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-727a234e-db10-40dd-8c6c-220aad8d1eb0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.395s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:48:24 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-727a234e-db10-40dd-8c6c-220aad8d1eb0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "7862d05d-4293-46a5-98aa-41967a572fe3" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.062s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:48:27 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:48:27 user nova-compute[103546]: DEBUG nova.compute.manager [req-a0972fba-5805-4c1c-a360-a089039aea91 req-4b2494d3-7e39-411c-9029-edcc4f33aebb service nova] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Received event network-changed-38395643-bb34-441c-ab0e-c9201f35ec04 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:48:27 user nova-compute[103546]: DEBUG nova.compute.manager [req-a0972fba-5805-4c1c-a360-a089039aea91 req-4b2494d3-7e39-411c-9029-edcc4f33aebb service nova] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Refreshing instance network info cache due to event network-changed-38395643-bb34-441c-ab0e-c9201f35ec04. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:48:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a0972fba-5805-4c1c-a360-a089039aea91 req-4b2494d3-7e39-411c-9029-edcc4f33aebb service nova] Acquiring lock "refresh_cache-c24a386f-32f5-4095-b2b3-69a70a54ff66" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:48:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a0972fba-5805-4c1c-a360-a089039aea91 req-4b2494d3-7e39-411c-9029-edcc4f33aebb service nova] Acquired lock "refresh_cache-c24a386f-32f5-4095-b2b3-69a70a54ff66" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:48:27 user nova-compute[103546]: DEBUG nova.network.neutron [req-a0972fba-5805-4c1c-a360-a089039aea91 req-4b2494d3-7e39-411c-9029-edcc4f33aebb service nova] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Refreshing network info cache for port 38395643-bb34-441c-ab0e-c9201f35ec04 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:48:28 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1ac8fd2e-09d2-4fc4-ba32-f9bea3bc65b6 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Acquiring lock "c24a386f-32f5-4095-b2b3-69a70a54ff66" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:48:28 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1ac8fd2e-09d2-4fc4-ba32-f9bea3bc65b6 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Lock "c24a386f-32f5-4095-b2b3-69a70a54ff66" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:48:28 user nova-compute[103546]: DEBUG nova.objects.instance [None req-1ac8fd2e-09d2-4fc4-ba32-f9bea3bc65b6 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Lazy-loading 'flavor' on Instance uuid c24a386f-32f5-4095-b2b3-69a70a54ff66 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:48:28 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1ac8fd2e-09d2-4fc4-ba32-f9bea3bc65b6 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Lock "c24a386f-32f5-4095-b2b3-69a70a54ff66" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:48:28 user nova-compute[103546]: DEBUG nova.network.neutron [req-a0972fba-5805-4c1c-a360-a089039aea91 req-4b2494d3-7e39-411c-9029-edcc4f33aebb service nova] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Updated VIF entry in instance network info cache for port 38395643-bb34-441c-ab0e-c9201f35ec04. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 03:48:28 user nova-compute[103546]: DEBUG nova.network.neutron [req-a0972fba-5805-4c1c-a360-a089039aea91 req-4b2494d3-7e39-411c-9029-edcc4f33aebb service nova] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Updating instance_info_cache with network_info: [{"id": "38395643-bb34-441c-ab0e-c9201f35ec04", "address": "fa:16:3e:2e:8e:90", "network": {"id": "32de335d-6f62-41f6-8520-1cc09523ef83", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1595594660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24d430f3bdd040ed87450fa998e0a8b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38395643-bb", "ovs_interfaceid": "38395643-bb34-441c-ab0e-c9201f35ec04", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:48:28 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a0972fba-5805-4c1c-a360-a089039aea91 req-4b2494d3-7e39-411c-9029-edcc4f33aebb service nova] Releasing lock "refresh_cache-c24a386f-32f5-4095-b2b3-69a70a54ff66" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:48:28 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:48:28 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1ac8fd2e-09d2-4fc4-ba32-f9bea3bc65b6 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Acquiring lock "c24a386f-32f5-4095-b2b3-69a70a54ff66" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:48:28 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1ac8fd2e-09d2-4fc4-ba32-f9bea3bc65b6 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Lock "c24a386f-32f5-4095-b2b3-69a70a54ff66" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:48:28 user nova-compute[103546]: INFO nova.compute.manager [None req-1ac8fd2e-09d2-4fc4-ba32-f9bea3bc65b6 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Attaching volume 34b3df15-2d1d-4474-839a-465db0816beb to /dev/vdb
Nov 16 03:48:28 user nova-compute[103546]: DEBUG os_brick.utils [None req-1ac8fd2e-09d2-4fc4-ba32-f9bea3bc65b6 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:48:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:28 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[038a44f8-4de7-4517-9e49-0a45c13c72c1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af5c39b14ece\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:28 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d22977-2cf3-4df1-9356-d8a337770c45]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:28 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2bbf75-cd9b-4fcf-8764-f4624213e209]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:28 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f66d31-2147-4961-889e-399e7939a691]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-1ac8fd2e-09d2-4fc4-ba32-f9bea3bc65b6 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Running cmd (subprocess): nvme version {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-1ac8fd2e-09d2-4fc4-ba32-f9bea3bc65b6 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] 'nvme version' failed. Not Retrying. {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:48:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1ac8fd2e-09d2-4fc4-ba32-f9bea3bc65b6 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] nvme not present on system {{(pid=103546) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 03:48:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:48:28 user nova-compute[103546]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 03:48:28 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4020022-b62e-44fa-ac61-c7108e7a9d5b]: (4, '') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-1ac8fd2e-09d2-4fc4-ba32-f9bea3bc65b6 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=103546) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 03:48:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-1ac8fd2e-09d2-4fc4-ba32-f9bea3bc65b6 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 03:48:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-1ac8fd2e-09d2-4fc4-ba32-f9bea3bc65b6 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] LIGHTOS: no hostnqn found. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 03:48:28 user nova-compute[103546]: DEBUG os_brick.utils [None req-1ac8fd2e-09d2-4fc4-ba32-f9bea3bc65b6 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af5c39b14ece', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:48:28 user nova-compute[103546]: DEBUG nova.virt.block_device [None req-1ac8fd2e-09d2-4fc4-ba32-f9bea3bc65b6 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Updating existing volume attachment record: c86c1b4e-3e8e-45f2-9962-3c3df2125335 {{(pid=103546) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 03:48:29 user nova-compute[103546]: DEBUG nova.compute.manager [req-d569a581-6acc-455e-b64d-c13552c3ea83 req-358580a3-60f0-4888-acee-3d46a7baee66 service nova] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Received event network-changed-6283c5fe-57f3-4552-b0cd-5d05b38e983c {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:48:29 user nova-compute[103546]: DEBUG nova.compute.manager [req-d569a581-6acc-455e-b64d-c13552c3ea83 req-358580a3-60f0-4888-acee-3d46a7baee66 service nova] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Refreshing instance network info cache due to event network-changed-6283c5fe-57f3-4552-b0cd-5d05b38e983c. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:48:29 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d569a581-6acc-455e-b64d-c13552c3ea83 req-358580a3-60f0-4888-acee-3d46a7baee66 service nova] Acquiring lock "refresh_cache-05c929d5-2f1c-4be4-8864-6ec81625daac" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:48:29 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d569a581-6acc-455e-b64d-c13552c3ea83 req-358580a3-60f0-4888-acee-3d46a7baee66 service nova] Acquired lock "refresh_cache-05c929d5-2f1c-4be4-8864-6ec81625daac" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:48:29 user nova-compute[103546]: DEBUG nova.network.neutron [req-d569a581-6acc-455e-b64d-c13552c3ea83 req-358580a3-60f0-4888-acee-3d46a7baee66 service nova] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Refreshing network info cache for port 6283c5fe-57f3-4552-b0cd-5d05b38e983c {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:48:29 user nova-compute[103546]: DEBUG nova.network.neutron [req-d569a581-6acc-455e-b64d-c13552c3ea83 req-358580a3-60f0-4888-acee-3d46a7baee66 service nova] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Updated VIF entry in instance network info cache for port 6283c5fe-57f3-4552-b0cd-5d05b38e983c. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 03:48:29 user nova-compute[103546]: DEBUG nova.network.neutron [req-d569a581-6acc-455e-b64d-c13552c3ea83 req-358580a3-60f0-4888-acee-3d46a7baee66 service nova] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Updating instance_info_cache with network_info: [{"id": "6283c5fe-57f3-4552-b0cd-5d05b38e983c", "address": "fa:16:3e:4d:ec:83", "network": {"id": "1a48a5d8-8046-4baf-9b30-4505213d862a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1526890096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998b2147e8194af3a15fce90bc7063b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6283c5fe-57", "ovs_interfaceid": "6283c5fe-57f3-4552-b0cd-5d05b38e983c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:48:29 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d569a581-6acc-455e-b64d-c13552c3ea83 req-358580a3-60f0-4888-acee-3d46a7baee66 service nova] Releasing lock "refresh_cache-05c929d5-2f1c-4be4-8864-6ec81625daac" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:48:30 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-68e1700d-7e77-4cef-85fd-e170adbc20f9 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Acquiring lock "05c929d5-2f1c-4be4-8864-6ec81625daac" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:48:30 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-68e1700d-7e77-4cef-85fd-e170adbc20f9 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Lock "05c929d5-2f1c-4be4-8864-6ec81625daac" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:48:30 user nova-compute[103546]: DEBUG nova.objects.instance [None req-68e1700d-7e77-4cef-85fd-e170adbc20f9 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Lazy-loading 'flavor' on Instance uuid 05c929d5-2f1c-4be4-8864-6ec81625daac {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:48:30 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-68e1700d-7e77-4cef-85fd-e170adbc20f9 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Lock "05c929d5-2f1c-4be4-8864-6ec81625daac" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.098s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:48:31 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-68e1700d-7e77-4cef-85fd-e170adbc20f9 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Acquiring lock "05c929d5-2f1c-4be4-8864-6ec81625daac" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:48:31 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-68e1700d-7e77-4cef-85fd-e170adbc20f9 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Lock "05c929d5-2f1c-4be4-8864-6ec81625daac" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:48:31 user nova-compute[103546]: INFO nova.compute.manager [None req-68e1700d-7e77-4cef-85fd-e170adbc20f9 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Attaching volume 289d7bf6-d933-4c8c-8601-9b6dd76de7c4 to /dev/vdb
Nov 16 03:48:31 user nova-compute[103546]: DEBUG os_brick.utils [None req-68e1700d-7e77-4cef-85fd-e170adbc20f9 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:48:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:31 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33b799b-fbfa-48ea-8685-0da89d5c1fdd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af5c39b14ece\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:31 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d36db17-2e12-458b-b4e9-f3c1cf84d888]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:31 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd2cd56-2ba0-4b21-afc8-bb65401fd4bc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:31 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e29949-90ee-484b-b791-1ff880f21fbe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-68e1700d-7e77-4cef-85fd-e170adbc20f9 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Running cmd (subprocess): nvme version {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-68e1700d-7e77-4cef-85fd-e170adbc20f9 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] 'nvme version' failed. Not Retrying. {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:48:31 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.nvmeof [None req-68e1700d-7e77-4cef-85fd-e170adbc20f9 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] nvme not present on system {{(pid=103546) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 03:48:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:48:31 user nova-compute[103546]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 03:48:31 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[21690578-7dbe-4369-8aab-091ae343e285]: (4, '') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:31 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-68e1700d-7e77-4cef-85fd-e170adbc20f9 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=103546) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 03:48:31 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-68e1700d-7e77-4cef-85fd-e170adbc20f9 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 03:48:31 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-68e1700d-7e77-4cef-85fd-e170adbc20f9 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] LIGHTOS: no hostnqn found. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 03:48:31 user nova-compute[103546]: DEBUG os_brick.utils [None req-68e1700d-7e77-4cef-85fd-e170adbc20f9 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af5c39b14ece', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:48:31 user nova-compute[103546]: DEBUG nova.virt.block_device [None req-68e1700d-7e77-4cef-85fd-e170adbc20f9 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Updating existing volume attachment record: 5d6e2f2e-6258-4bf7-ab1d-c628115fd339 {{(pid=103546) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 03:48:32 user nova-compute[103546]: DEBUG nova.compute.manager [req-f2d70335-fd76-455f-8723-c5835954a1c3 req-1778db7d-5e06-406c-9eb7-6ff04aa97729 service nova] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Received event network-changed-55287b83-91c5-4c47-8ec5-c0da5bc3290e {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:48:32 user nova-compute[103546]: DEBUG nova.compute.manager [req-f2d70335-fd76-455f-8723-c5835954a1c3 req-1778db7d-5e06-406c-9eb7-6ff04aa97729 service nova] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Refreshing instance network info cache due to event network-changed-55287b83-91c5-4c47-8ec5-c0da5bc3290e. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:48:32 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-f2d70335-fd76-455f-8723-c5835954a1c3 req-1778db7d-5e06-406c-9eb7-6ff04aa97729 service nova] Acquiring lock "refresh_cache-fead4119-3ab9-4337-8b48-d3920e1112f4" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:48:32 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-f2d70335-fd76-455f-8723-c5835954a1c3 req-1778db7d-5e06-406c-9eb7-6ff04aa97729 service nova] Acquired lock "refresh_cache-fead4119-3ab9-4337-8b48-d3920e1112f4" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:48:32 user nova-compute[103546]: DEBUG nova.network.neutron [req-f2d70335-fd76-455f-8723-c5835954a1c3 req-1778db7d-5e06-406c-9eb7-6ff04aa97729 service nova] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Refreshing network info cache for port 55287b83-91c5-4c47-8ec5-c0da5bc3290e {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:48:32 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:48:32 user nova-compute[103546]: DEBUG nova.network.neutron [req-f2d70335-fd76-455f-8723-c5835954a1c3 req-1778db7d-5e06-406c-9eb7-6ff04aa97729 service nova] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Updated VIF entry in instance network info cache for port 55287b83-91c5-4c47-8ec5-c0da5bc3290e. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 03:48:32 user nova-compute[103546]: DEBUG nova.network.neutron [req-f2d70335-fd76-455f-8723-c5835954a1c3 req-1778db7d-5e06-406c-9eb7-6ff04aa97729 service nova] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Updating instance_info_cache with network_info: [{"id": "55287b83-91c5-4c47-8ec5-c0da5bc3290e", "address": "fa:16:3e:63:86:8e", "network": {"id": "d67be416-4ca1-4f91-9991-95aee2e04c4a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1248186454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "459bf831cfa74f74abcb5625afbafa27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55287b83-91", "ovs_interfaceid": "55287b83-91c5-4c47-8ec5-c0da5bc3290e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:48:32 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-f2d70335-fd76-455f-8723-c5835954a1c3 req-1778db7d-5e06-406c-9eb7-6ff04aa97729 service nova] Releasing lock "refresh_cache-fead4119-3ab9-4337-8b48-d3920e1112f4" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:48:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:48:34 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ac8fd2e-09d2-4fc4-ba32-f9bea3bc65b6 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 03:48:34 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ac8fd2e-09d2-4fc4-ba32-f9bea3bc65b6 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DfTzSXUe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:48:34 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-1ac8fd2e-09d2-4fc4-ba32-f9bea3bc65b6 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:48:34 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-1ac8fd2e-09d2-4fc4-ba32-f9bea3bc65b6 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:48:34 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-1ac8fd2e-09d2-4fc4-ba32-f9bea3bc65b6 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:48:34 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-1ac8fd2e-09d2-4fc4-ba32-f9bea3bc65b6 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:48:34 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-1ac8fd2e-09d2-4fc4-ba32-f9bea3bc65b6 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:48:34 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-1ac8fd2e-09d2-4fc4-ba32-f9bea3bc65b6 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:48:34 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-1ac8fd2e-09d2-4fc4-ba32-f9bea3bc65b6 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 03:48:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:34 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[2261ecd5-4166-4e48-8f91-67258fbefd9d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:34 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ac8fd2e-09d2-4fc4-ba32-f9bea3bc65b6 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 03:48:34 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:48:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb -p 172.16.0.220:3260 --interface default --op new {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:34 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2a0570-4aad-4848-bc9a-e6de401ba3d8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb] added\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:34 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ac8fd2e-09d2-4fc4-ba32-f9bea3bc65b6 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb] added
Nov 16 03:48:34 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:48:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:34 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[96410cd0-f8e3-4d2c-9dda-90b7ac4f001d]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:34 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ac8fd2e-09d2-4fc4-ba32-f9bea3bc65b6 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:48:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:34 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f19792c-95b8-4ce9-9c57-b7fd21b62658]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:34 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ac8fd2e-09d2-4fc4-ba32-f9bea3bc65b6 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:48:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DfTzSXUe {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DfTzSXUe" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:34 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5ac1c7-0468-4296-ad11-2f1cd82b3fc0]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:34 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ac8fd2e-09d2-4fc4-ba32-f9bea3bc65b6 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DfTzSXUe'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:48:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:34 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0dd4c6-ba4a-45b4-9772-92e59c39518e]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:34 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ac8fd2e-09d2-4fc4-ba32-f9bea3bc65b6 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:48:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:34 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d6d70b-6d5c-4e2f-b4c1-e6a6bdcde784]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:34 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ac8fd2e-09d2-4fc4-ba32-f9bea3bc65b6 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:48:34 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:48:34 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:48:34 user nova-compute[103546]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)
Nov 16 03:48:34 user nova-compute[103546]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)
Nov 16 03:48:34 user nova-compute[103546]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)
Nov 16 03:48:34 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:48:34 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ac8fd2e-09d2-4fc4-ba32-f9bea3bc65b6 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:48:34 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:48:34 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:48:34 user nova-compute[103546]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)
Nov 16 03:48:34 user nova-compute[103546]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)
Nov 16 03:48:34 user nova-compute[103546]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)
Nov 16 03:48:34 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:48:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb -p 172.16.0.220:3260 --login {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:34 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db0f601-f8ed-4da1-aa7f-b374a82aabc6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:34 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ac8fd2e-09d2-4fc4-ba32-f9bea3bc65b6 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb, portal: 172.16.0.220,3260]
Nov 16 03:48:34 user nova-compute[103546]: Login to [iface: default, target: iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb, portal: 172.16.0.220,3260] successful.
Nov 16 03:48:34 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:48:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:34 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bec3722-f27d-4966-9ccf-76863c3b4b65]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:34 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ac8fd2e-09d2-4fc4-ba32-f9bea3bc65b6 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:48:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:34 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7433e4-94f7-4473-a824-9526af37c676]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:34 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ac8fd2e-09d2-4fc4-ba32-f9bea3bc65b6 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:48:34 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:48:34 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:48:34 user nova-compute[103546]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)
Nov 16 03:48:34 user nova-compute[103546]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)
Nov 16 03:48:34 user nova-compute[103546]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)
Nov 16 03:48:34 user nova-compute[103546]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)
Nov 16 03:48:34 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:48:34 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ac8fd2e-09d2-4fc4-ba32-f9bea3bc65b6 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:48:34 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:48:34 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:48:34 user nova-compute[103546]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)
Nov 16 03:48:34 user nova-compute[103546]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)
Nov 16 03:48:34 user nova-compute[103546]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)
Nov 16 03:48:34 user nova-compute[103546]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)
Nov 16 03:48:34 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:48:34 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-1ac8fd2e-09d2-4fc4-ba32-f9bea3bc65b6 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:48:34 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ac8fd2e-09d2-4fc4-ba32-f9bea3bc65b6 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 03:48:34 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-1ac8fd2e-09d2-4fc4-ba32-f9bea3bc65b6 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 03:48:34 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-1ac8fd2e-09d2-4fc4-ba32-f9bea3bc65b6 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 03:48:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:34 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce742e9-faaa-479b-b233-1d704eb6a2b5]: (4, ('- - 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:34 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-1ac8fd2e-09d2-4fc4-ba32-f9bea3bc65b6 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 03:48:34 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ac8fd2e-09d2-4fc4-ba32-f9bea3bc65b6 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DfTzSXUe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 03:48:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-aa3da806-8e98-4335-9206-aa0334223876 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Acquiring lock "fead4119-3ab9-4337-8b48-d3920e1112f4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:48:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-aa3da806-8e98-4335-9206-aa0334223876 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Lock "fead4119-3ab9-4337-8b48-d3920e1112f4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:48:35 user nova-compute[103546]: DEBUG nova.objects.instance [None req-aa3da806-8e98-4335-9206-aa0334223876 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Lazy-loading 'flavor' on Instance uuid fead4119-3ab9-4337-8b48-d3920e1112f4 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:48:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-aa3da806-8e98-4335-9206-aa0334223876 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Lock "fead4119-3ab9-4337-8b48-d3920e1112f4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:48:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-aa3da806-8e98-4335-9206-aa0334223876 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Acquiring lock "fead4119-3ab9-4337-8b48-d3920e1112f4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:48:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-aa3da806-8e98-4335-9206-aa0334223876 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Lock "fead4119-3ab9-4337-8b48-d3920e1112f4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:48:35 user nova-compute[103546]: INFO nova.compute.manager [None req-aa3da806-8e98-4335-9206-aa0334223876 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Attaching volume 67611f41-96e1-49ec-a7e0-590702437c7a to /dev/sdc
Nov 16 03:48:35 user nova-compute[103546]: DEBUG os_brick.utils [None req-aa3da806-8e98-4335-9206-aa0334223876 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:48:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:35 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f80aa0-1a20-43af-b8a4-ea914358c49d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af5c39b14ece\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:35 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b696f1-c46e-47b6-b3b5-f351ed14f0bf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:35 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b02f535-68b9-4571-8b75-88e3bac03895]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:35 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4715c4b-dfc2-479e-b9d6-f9d762fb1c27]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-aa3da806-8e98-4335-9206-aa0334223876 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Running cmd (subprocess): nvme version {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-aa3da806-8e98-4335-9206-aa0334223876 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] 'nvme version' failed. Not Retrying. {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:48:35 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-1ac8fd2e-09d2-4fc4-ba32-f9bea3bc65b6 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:48:35 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ac8fd2e-09d2-4fc4-ba32-f9bea3bc65b6 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] <== connect_volume: return (1385ms) {'type': 'block', 'scsi_wwn': '26335383139323861', 'path': '/dev/sdh'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:48:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ac8fd2e-09d2-4fc4-ba32-f9bea3bc65b6 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335383139323861', 'path': '/dev/sdh'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 03:48:35 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aa3da806-8e98-4335-9206-aa0334223876 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] nvme not present on system {{(pid=103546) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 03:48:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:35 user nova-compute[103546]: DEBUG nova.objects.instance [None req-1ac8fd2e-09d2-4fc4-ba32-f9bea3bc65b6 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Lazy-loading 'flavor' on Instance uuid c24a386f-32f5-4095-b2b3-69a70a54ff66 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:48:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:48:35 user nova-compute[103546]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 03:48:35 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[276359c3-3345-44f0-978f-ea2f7033e963]: (4, '') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:35 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-aa3da806-8e98-4335-9206-aa0334223876 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=103546) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 03:48:35 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-aa3da806-8e98-4335-9206-aa0334223876 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 03:48:35 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-aa3da806-8e98-4335-9206-aa0334223876 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] LIGHTOS: no hostnqn found. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 03:48:35 user nova-compute[103546]: DEBUG os_brick.utils [None req-aa3da806-8e98-4335-9206-aa0334223876 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af5c39b14ece', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:48:35 user nova-compute[103546]: DEBUG nova.virt.block_device [None req-aa3da806-8e98-4335-9206-aa0334223876 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Updating existing volume attachment record: 7f5516a4-1392-483f-a993-77da1a04502d {{(pid=103546) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 03:48:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-1ac8fd2e-09d2-4fc4-ba32-f9bea3bc65b6 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 03:48:35 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 03:48:35 user nova-compute[103546]:   <source dev="/dev/sdh"/>
Nov 16 03:48:35 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 03:48:35 user nova-compute[103546]:   <serial>34b3df15-2d1d-4474-839a-465db0816beb</serial>
Nov 16 03:48:35 user nova-compute[103546]: </disk>
Nov 16 03:48:35 user nova-compute[103546]:  {{(pid=103546) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 03:48:36 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1ac8fd2e-09d2-4fc4-ba32-f9bea3bc65b6 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:48:36 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1ac8fd2e-09d2-4fc4-ba32-f9bea3bc65b6 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] No BDM found with device name vdb, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:48:36 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1ac8fd2e-09d2-4fc4-ba32-f9bea3bc65b6 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] No VIF found with MAC fa:16:3e:2e:8e:90, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 03:48:36 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1ac8fd2e-09d2-4fc4-ba32-f9bea3bc65b6 tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Lock "c24a386f-32f5-4095-b2b3-69a70a54ff66" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.762s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:48:36 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68e1700d-7e77-4cef-85fd-e170adbc20f9 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 03:48:36 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e1700d-7e77-4cef-85fd-e170adbc20f9 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yYEefaIU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:48:36 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-68e1700d-7e77-4cef-85fd-e170adbc20f9 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:48:36 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-68e1700d-7e77-4cef-85fd-e170adbc20f9 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:48:36 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-68e1700d-7e77-4cef-85fd-e170adbc20f9 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:48:36 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-68e1700d-7e77-4cef-85fd-e170adbc20f9 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:48:36 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-68e1700d-7e77-4cef-85fd-e170adbc20f9 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:48:36 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-68e1700d-7e77-4cef-85fd-e170adbc20f9 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:48:36 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-68e1700d-7e77-4cef-85fd-e170adbc20f9 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 03:48:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4 -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:36 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[450e569b-9360-4cda-be09-6b323ca33e7b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:36 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e1700d-7e77-4cef-85fd-e170adbc20f9 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 03:48:36 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:48:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4 -p 172.16.0.220:3260 --interface default --op new {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:36 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[8deda66d-8293-41e2-bdb6-08bc35c8d3b9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4] added\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:36 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e1700d-7e77-4cef-85fd-e170adbc20f9 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4] added
Nov 16 03:48:36 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:48:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:36 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31c21f7-87fe-44c4-95e8-aceceec9b0f3]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:36 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e1700d-7e77-4cef-85fd-e170adbc20f9 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:48:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:36 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[072b0b76-660c-42e0-978d-4c0f946a5b7d]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:36 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e1700d-7e77-4cef-85fd-e170adbc20f9 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:48:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yYEefaIU {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yYEefaIU" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:36 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63dbea6-357a-48e6-bd3d-5021f41044c2]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:36 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e1700d-7e77-4cef-85fd-e170adbc20f9 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yYEefaIU'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:48:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:36 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[0260ef64-9bc9-4b9e-a2b2-2e2df5724d3d]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:36 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e1700d-7e77-4cef-85fd-e170adbc20f9 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:48:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:36 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[1113961c-e425-4040-b4d1-12b6a042f515]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:36 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e1700d-7e77-4cef-85fd-e170adbc20f9 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:48:36 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:48:36 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:48:36 user nova-compute[103546]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)
Nov 16 03:48:36 user nova-compute[103546]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)
Nov 16 03:48:36 user nova-compute[103546]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)
Nov 16 03:48:36 user nova-compute[103546]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)
Nov 16 03:48:36 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:48:36 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e1700d-7e77-4cef-85fd-e170adbc20f9 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:48:36 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:48:36 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:48:36 user nova-compute[103546]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)
Nov 16 03:48:36 user nova-compute[103546]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)
Nov 16 03:48:36 user nova-compute[103546]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)
Nov 16 03:48:36 user nova-compute[103546]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)
Nov 16 03:48:36 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:48:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4 -p 172.16.0.220:3260 --login {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:36 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5410ed-7bc7-4fab-a43f-91ae5f43d930]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:36 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e1700d-7e77-4cef-85fd-e170adbc20f9 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4, portal: 172.16.0.220,3260]
Nov 16 03:48:36 user nova-compute[103546]: Login to [iface: default, target: iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4, portal: 172.16.0.220,3260] successful.
Nov 16 03:48:36 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:48:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:36 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1be05ac-fc8d-41ca-8068-967854606a4a]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:36 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e1700d-7e77-4cef-85fd-e170adbc20f9 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:48:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:37 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b132030-bfc1-4f4e-8ce9-ffc743db1e1a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:37 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e1700d-7e77-4cef-85fd-e170adbc20f9 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:48:37 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:48:37 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:48:37 user nova-compute[103546]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)
Nov 16 03:48:37 user nova-compute[103546]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)
Nov 16 03:48:37 user nova-compute[103546]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)
Nov 16 03:48:37 user nova-compute[103546]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)
Nov 16 03:48:37 user nova-compute[103546]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4 (non-flash)
Nov 16 03:48:37 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:48:37 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e1700d-7e77-4cef-85fd-e170adbc20f9 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:48:37 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:48:37 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:48:37 user nova-compute[103546]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)
Nov 16 03:48:37 user nova-compute[103546]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)
Nov 16 03:48:37 user nova-compute[103546]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)
Nov 16 03:48:37 user nova-compute[103546]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)
Nov 16 03:48:37 user nova-compute[103546]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4 (non-flash)
Nov 16 03:48:37 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:48:37 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-68e1700d-7e77-4cef-85fd-e170adbc20f9 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:48:37 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e1700d-7e77-4cef-85fd-e170adbc20f9 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 03:48:37 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-68e1700d-7e77-4cef-85fd-e170adbc20f9 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 03:48:37 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-68e1700d-7e77-4cef-85fd-e170adbc20f9 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 03:48:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:37 user nova-compute[103546]: DEBUG nova.compute.manager [req-1115badd-4947-4283-b300-eab9eb8af0bd req-f44b4a7c-9486-4e01-b2fb-a6c42b4d4f90 service nova] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Received event network-changed-48a6af37-c461-4721-b870-432cf404dcf7 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:48:37 user nova-compute[103546]: DEBUG nova.compute.manager [req-1115badd-4947-4283-b300-eab9eb8af0bd req-f44b4a7c-9486-4e01-b2fb-a6c42b4d4f90 service nova] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Refreshing instance network info cache due to event network-changed-48a6af37-c461-4721-b870-432cf404dcf7. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:48:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-1115badd-4947-4283-b300-eab9eb8af0bd req-f44b4a7c-9486-4e01-b2fb-a6c42b4d4f90 service nova] Acquiring lock "refresh_cache-549ee3db-0014-440f-bd3a-0d389f5eab88" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:48:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-1115badd-4947-4283-b300-eab9eb8af0bd req-f44b4a7c-9486-4e01-b2fb-a6c42b4d4f90 service nova] Acquired lock "refresh_cache-549ee3db-0014-440f-bd3a-0d389f5eab88" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:48:37 user nova-compute[103546]: DEBUG nova.network.neutron [req-1115badd-4947-4283-b300-eab9eb8af0bd req-f44b4a7c-9486-4e01-b2fb-a6c42b4d4f90 service nova] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Refreshing network info cache for port 48a6af37-c461-4721-b870-432cf404dcf7 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:48:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.024s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:37 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[9916682d-fe81-4919-8223-b95c75f6b822]: (4, ('- - 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:37 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-68e1700d-7e77-4cef-85fd-e170adbc20f9 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 03:48:37 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e1700d-7e77-4cef-85fd-e170adbc20f9 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yYEefaIU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 03:48:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-db59c4d1-e20f-441b-99f1-851dc107a6c7 tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Acquiring lock "interface-549ee3db-0014-440f-bd3a-0d389f5eab88-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:48:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-db59c4d1-e20f-441b-99f1-851dc107a6c7 tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Lock "interface-549ee3db-0014-440f-bd3a-0d389f5eab88-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:48:37 user nova-compute[103546]: DEBUG nova.objects.instance [None req-db59c4d1-e20f-441b-99f1-851dc107a6c7 tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Lazy-loading 'flavor' on Instance uuid 549ee3db-0014-440f-bd3a-0d389f5eab88 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:48:37 user nova-compute[103546]: DEBUG nova.objects.instance [None req-db59c4d1-e20f-441b-99f1-851dc107a6c7 tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Lazy-loading 'pci_requests' on Instance uuid 549ee3db-0014-440f-bd3a-0d389f5eab88 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:48:37 user nova-compute[103546]: DEBUG nova.objects.base [None req-db59c4d1-e20f-441b-99f1-851dc107a6c7 tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Object Instance<549ee3db-0014-440f-bd3a-0d389f5eab88> lazy-loaded attributes: flavor,pci_requests {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 03:48:37 user nova-compute[103546]: DEBUG nova.network.neutron [None req-db59c4d1-e20f-441b-99f1-851dc107a6c7 tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] allocate_for_instance() {{(pid=103546) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 03:48:37 user nova-compute[103546]: DEBUG nova.network.neutron [req-1115badd-4947-4283-b300-eab9eb8af0bd req-f44b4a7c-9486-4e01-b2fb-a6c42b4d4f90 service nova] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Updated VIF entry in instance network info cache for port 48a6af37-c461-4721-b870-432cf404dcf7. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 03:48:37 user nova-compute[103546]: DEBUG nova.network.neutron [req-1115badd-4947-4283-b300-eab9eb8af0bd req-f44b4a7c-9486-4e01-b2fb-a6c42b4d4f90 service nova] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Updating instance_info_cache with network_info: [{"id": "48a6af37-c461-4721-b870-432cf404dcf7", "address": "fa:16:3e:5b:50:00", "network": {"id": "4c04adce-4d50-4cc1-8c17-5cebba34fbec", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-399866268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4445eb24618042ab9d24c869de5ccaab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48a6af37-c4", "ovs_interfaceid": "48a6af37-c461-4721-b870-432cf404dcf7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:48:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-1115badd-4947-4283-b300-eab9eb8af0bd req-f44b4a7c-9486-4e01-b2fb-a6c42b4d4f90 service nova] Releasing lock "refresh_cache-549ee3db-0014-440f-bd3a-0d389f5eab88" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:48:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] Acquiring lock "c24a386f-32f5-4095-b2b3-69a70a54ff66" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:48:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] Lock "c24a386f-32f5-4095-b2b3-69a70a54ff66" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:48:37 user nova-compute[103546]: DEBUG os_brick.utils [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:48:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:37 user nova-compute[103546]: DEBUG nova.policy [None req-db59c4d1-e20f-441b-99f1-851dc107a6c7 tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '843e14f393d849a9abc7759907a303ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4445eb24618042ab9d24c869de5ccaab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103546) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 03:48:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:37 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab24b43-53c4-4b5c-9734-f84cb9f0b303]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af5c39b14ece\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:37 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc92cafc-3290-4d0f-8ae8-82b203199dc9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:37 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3da29bc-14ad-4dda-9563-d359fa6ad6dc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:37 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6aefca8-1af6-4aa5-bd52-b397816ae28c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] Running cmd (subprocess): nvme version {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] 'nvme version' failed. Not Retrying. {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:48:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:48:37 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.nvmeof [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] nvme not present on system {{(pid=103546) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 03:48:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:48:37 user nova-compute[103546]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 03:48:37 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d333d0-e5b1-4f65-ace2-8b78ff28f22b]: (4, '') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:37 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=103546) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 03:48:37 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 03:48:37 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] LIGHTOS: no hostnqn found. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 03:48:37 user nova-compute[103546]: DEBUG os_brick.utils [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af5c39b14ece', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:48:37 user nova-compute[103546]: INFO nova.compute.manager [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Swapping volume 34b3df15-2d1d-4474-839a-465db0816beb for 164d9730-8eb2-44f5-aa18-2966bb91b153
Nov 16 03:48:38 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-68e1700d-7e77-4cef-85fd-e170adbc20f9 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:48:38 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e1700d-7e77-4cef-85fd-e170adbc20f9 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] <== connect_volume: return (1377ms) {'type': 'block', 'scsi_wwn': '23762333837643962', 'path': '/dev/sdi'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:48:38 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68e1700d-7e77-4cef-85fd-e170adbc20f9 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762333837643962', 'path': '/dev/sdi'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 03:48:38 user nova-compute[103546]: DEBUG nova.objects.instance [None req-68e1700d-7e77-4cef-85fd-e170adbc20f9 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Lazy-loading 'flavor' on Instance uuid 05c929d5-2f1c-4be4-8864-6ec81625daac {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:48:38 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-68e1700d-7e77-4cef-85fd-e170adbc20f9 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 03:48:38 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 03:48:38 user nova-compute[103546]:   <source dev="/dev/sdi"/>
Nov 16 03:48:38 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 03:48:38 user nova-compute[103546]:   <serial>289d7bf6-d933-4c8c-8601-9b6dd76de7c4</serial>
Nov 16 03:48:38 user nova-compute[103546]: </disk>
Nov 16 03:48:38 user nova-compute[103546]:  {{(pid=103546) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 03:48:38 user nova-compute[103546]: DEBUG nova.network.neutron [None req-db59c4d1-e20f-441b-99f1-851dc107a6c7 tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Successfully created port: fe4680c0-c534-4f5b-8833-be40c2784953 {{(pid=103546) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 03:48:38 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:48:38 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-68e1700d-7e77-4cef-85fd-e170adbc20f9 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:48:38 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-68e1700d-7e77-4cef-85fd-e170adbc20f9 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] No BDM found with device name vdb, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:48:38 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-68e1700d-7e77-4cef-85fd-e170adbc20f9 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] No VIF found with MAC fa:16:3e:4d:ec:83, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 03:48:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-68e1700d-7e77-4cef-85fd-e170adbc20f9 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Lock "05c929d5-2f1c-4be4-8864-6ec81625daac" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.558s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:48:38 user nova-compute[103546]: DEBUG nova.network.neutron [None req-db59c4d1-e20f-441b-99f1-851dc107a6c7 tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Successfully updated port: fe4680c0-c534-4f5b-8833-be40c2784953 {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 03:48:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-db59c4d1-e20f-441b-99f1-851dc107a6c7 tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Acquiring lock "refresh_cache-549ee3db-0014-440f-bd3a-0d389f5eab88" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:48:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-db59c4d1-e20f-441b-99f1-851dc107a6c7 tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Acquired lock "refresh_cache-549ee3db-0014-440f-bd3a-0d389f5eab88" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:48:38 user nova-compute[103546]: DEBUG nova.network.neutron [None req-db59c4d1-e20f-441b-99f1-851dc107a6c7 tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 03:48:38 user nova-compute[103546]: DEBUG nova.compute.manager [req-57057940-dfff-4ccc-85c9-f0b0f7cacb1d req-3f24a221-1dc3-4647-9ab1-d9d3e94e384c service nova] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Received event network-changed-fe4680c0-c534-4f5b-8833-be40c2784953 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:48:38 user nova-compute[103546]: DEBUG nova.compute.manager [req-57057940-dfff-4ccc-85c9-f0b0f7cacb1d req-3f24a221-1dc3-4647-9ab1-d9d3e94e384c service nova] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Refreshing instance network info cache due to event network-changed-fe4680c0-c534-4f5b-8833-be40c2784953. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:48:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-57057940-dfff-4ccc-85c9-f0b0f7cacb1d req-3f24a221-1dc3-4647-9ab1-d9d3e94e384c service nova] Acquiring lock "refresh_cache-549ee3db-0014-440f-bd3a-0d389f5eab88" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:48:39 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-94a8271a-e222-44bf-8f17-da2961d197e3 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Acquiring lock "05c929d5-2f1c-4be4-8864-6ec81625daac" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:48:39 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-94a8271a-e222-44bf-8f17-da2961d197e3 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Lock "05c929d5-2f1c-4be4-8864-6ec81625daac" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:48:39 user nova-compute[103546]: INFO nova.compute.manager [None req-94a8271a-e222-44bf-8f17-da2961d197e3 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Detaching volume 289d7bf6-d933-4c8c-8601-9b6dd76de7c4
Nov 16 03:48:39 user nova-compute[103546]: INFO nova.virt.block_device [None req-94a8271a-e222-44bf-8f17-da2961d197e3 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Attempting to driver detach volume 289d7bf6-d933-4c8c-8601-9b6dd76de7c4 from mountpoint /dev/vdb
Nov 16 03:48:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-94a8271a-e222-44bf-8f17-da2961d197e3 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Attempting to detach device vdb from instance 05c929d5-2f1c-4be4-8864-6ec81625daac from the persistent domain config. {{(pid=103546) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 03:48:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-94a8271a-e222-44bf-8f17-da2961d197e3 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 03:48:39 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 03:48:39 user nova-compute[103546]:   <source dev="/dev/sdi"/>
Nov 16 03:48:39 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 03:48:39 user nova-compute[103546]:   <serial>289d7bf6-d933-4c8c-8601-9b6dd76de7c4</serial>
Nov 16 03:48:39 user nova-compute[103546]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 03:48:39 user nova-compute[103546]: </disk>
Nov 16 03:48:39 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 03:48:39 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-94a8271a-e222-44bf-8f17-da2961d197e3 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Successfully detached device vdb from instance 05c929d5-2f1c-4be4-8864-6ec81625daac from the persistent domain config.
Nov 16 03:48:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-94a8271a-e222-44bf-8f17-da2961d197e3 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 05c929d5-2f1c-4be4-8864-6ec81625daac from the live domain config. {{(pid=103546) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 03:48:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-94a8271a-e222-44bf-8f17-da2961d197e3 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 03:48:39 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 03:48:39 user nova-compute[103546]:   <source dev="/dev/sdi"/>
Nov 16 03:48:39 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 03:48:39 user nova-compute[103546]:   <serial>289d7bf6-d933-4c8c-8601-9b6dd76de7c4</serial>
Nov 16 03:48:39 user nova-compute[103546]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 03:48:39 user nova-compute[103546]: </disk>
Nov 16 03:48:39 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 03:48:39 user nova-compute[103546]: DEBUG nova.network.neutron [None req-db59c4d1-e20f-441b-99f1-851dc107a6c7 tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Updating instance_info_cache with network_info: [{"id": "48a6af37-c461-4721-b870-432cf404dcf7", "address": "fa:16:3e:5b:50:00", "network": {"id": "4c04adce-4d50-4cc1-8c17-5cebba34fbec", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-399866268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4445eb24618042ab9d24c869de5ccaab", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48a6af37-c4", "ovs_interfaceid": "48a6af37-c461-4721-b870-432cf404dcf7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fe4680c0-c534-4f5b-8833-be40c2784953", "address": "fa:16:3e:38:66:93", "network": {"id": "45e450ee-a16a-4ae4-9e30-f5b3db0e6335", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-951951059", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4445eb24618042ab9d24c869de5ccaab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe4680c0-c5", "ovs_interfaceid": "fe4680c0-c534-4f5b-8833-be40c2784953", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:48:39 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-db59c4d1-e20f-441b-99f1-851dc107a6c7 tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Releasing lock "refresh_cache-549ee3db-0014-440f-bd3a-0d389f5eab88" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:48:39 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-57057940-dfff-4ccc-85c9-f0b0f7cacb1d req-3f24a221-1dc3-4647-9ab1-d9d3e94e384c service nova] Acquired lock "refresh_cache-549ee3db-0014-440f-bd3a-0d389f5eab88" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:48:39 user nova-compute[103546]: DEBUG nova.network.neutron [req-57057940-dfff-4ccc-85c9-f0b0f7cacb1d req-3f24a221-1dc3-4647-9ab1-d9d3e94e384c service nova] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Refreshing network info cache for port fe4680c0-c534-4f5b-8833-be40c2784953 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:48:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-db59c4d1-e20f-441b-99f1-851dc107a6c7 tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T03:46:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-350344638',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-350344638',id=7,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJC87S7hgP6v1mMgMgWP5mrEmsB7FxLODxvVGTyu4rK6Vav//N6bGlF4cB4wdjC5yBjD4JDskSZdj5aiBMflE+VUYysZErN4auZ89tuKfEpG07XZH2cPGYOTHxF0eBL3Dw==',key_name='tempest-keypair-83664986',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:46:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4445eb24618042ab9d24c869de5ccaab',ramdisk_id='',reservation_id='r-s6hqst93',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-401054631',owner_user_name='tempest-TaggedAttachmentsTest-401054631-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T03:46:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='843e14f393d849a9abc7759907a303ea',uuid=549ee3db-0014-440f-bd3a-0d389f5eab88,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe4680c0-c534-4f5b-8833-be40c2784953", "address": "fa:16:3e:38:66:93", "network": {"id": "45e450ee-a16a-4ae4-9e30-f5b3db0e6335", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-951951059", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4445eb24618042ab9d24c869de5ccaab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe4680c0-c5", "ovs_interfaceid": "fe4680c0-c534-4f5b-8833-be40c2784953", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 03:48:39 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-db59c4d1-e20f-441b-99f1-851dc107a6c7 tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Converting VIF {"id": "fe4680c0-c534-4f5b-8833-be40c2784953", "address": "fa:16:3e:38:66:93", "network": {"id": "45e450ee-a16a-4ae4-9e30-f5b3db0e6335", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-951951059", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4445eb24618042ab9d24c869de5ccaab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe4680c0-c5", "ovs_interfaceid": "fe4680c0-c534-4f5b-8833-be40c2784953", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:48:39 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-db59c4d1-e20f-441b-99f1-851dc107a6c7 tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:66:93,bridge_name='br-int',has_traffic_filtering=True,id=fe4680c0-c534-4f5b-8833-be40c2784953,network=Network(45e450ee-a16a-4ae4-9e30-f5b3db0e6335),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe4680c0-c5') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:48:39 user nova-compute[103546]: DEBUG os_vif [None req-db59c4d1-e20f-441b-99f1-851dc107a6c7 tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:66:93,bridge_name='br-int',has_traffic_filtering=True,id=fe4680c0-c534-4f5b-8833-be40c2784953,network=Network(45e450ee-a16a-4ae4-9e30-f5b3db0e6335),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe4680c0-c5') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 03:48:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:48:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:48:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 03:48:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:48:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bd50b6ce-52fc-5df8-ac6c-07dfe44ffe0f', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:48:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:48:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:48:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:48:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe4680c0-c5, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:48:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfe4680c0-c5, col_values=(('qos', UUID('fcc5168d-76f6-4f71-b547-a814f947d67f')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:48:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfe4680c0-c5, col_values=(('external_ids', {'iface-id': 'fe4680c0-c534-4f5b-8833-be40c2784953', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:66:93', 'vm-uuid': '549ee3db-0014-440f-bd3a-0d389f5eab88'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:48:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:48:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:48:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:48:39 user nova-compute[103546]: INFO os_vif [None req-db59c4d1-e20f-441b-99f1-851dc107a6c7 tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:66:93,bridge_name='br-int',has_traffic_filtering=True,id=fe4680c0-c534-4f5b-8833-be40c2784953,network=Network(45e450ee-a16a-4ae4-9e30-f5b3db0e6335),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe4680c0-c5')
Nov 16 03:48:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-db59c4d1-e20f-441b-99f1-851dc107a6c7 tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T03:46:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-350344638',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-350344638',id=7,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJC87S7hgP6v1mMgMgWP5mrEmsB7FxLODxvVGTyu4rK6Vav//N6bGlF4cB4wdjC5yBjD4JDskSZdj5aiBMflE+VUYysZErN4auZ89tuKfEpG07XZH2cPGYOTHxF0eBL3Dw==',key_name='tempest-keypair-83664986',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:46:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4445eb24618042ab9d24c869de5ccaab',ramdisk_id='',reservation_id='r-s6hqst93',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-401054631',owner_user_name='tempest-TaggedAttachmentsTest-401054631-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T03:46:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='843e14f393d849a9abc7759907a303ea',uuid=549ee3db-0014-440f-bd3a-0d389f5eab88,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe4680c0-c534-4f5b-8833-be40c2784953", "address": "fa:16:3e:38:66:93", "network": {"id": "45e450ee-a16a-4ae4-9e30-f5b3db0e6335", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-951951059", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4445eb24618042ab9d24c869de5ccaab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe4680c0-c5", "ovs_interfaceid": "fe4680c0-c534-4f5b-8833-be40c2784953", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 03:48:39 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-db59c4d1-e20f-441b-99f1-851dc107a6c7 tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Converting VIF {"id": "fe4680c0-c534-4f5b-8833-be40c2784953", "address": "fa:16:3e:38:66:93", "network": {"id": "45e450ee-a16a-4ae4-9e30-f5b3db0e6335", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-951951059", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4445eb24618042ab9d24c869de5ccaab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe4680c0-c5", "ovs_interfaceid": "fe4680c0-c534-4f5b-8833-be40c2784953", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:48:39 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-db59c4d1-e20f-441b-99f1-851dc107a6c7 tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:66:93,bridge_name='br-int',has_traffic_filtering=True,id=fe4680c0-c534-4f5b-8833-be40c2784953,network=Network(45e450ee-a16a-4ae4-9e30-f5b3db0e6335),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe4680c0-c5') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:48:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-db59c4d1-e20f-441b-99f1-851dc107a6c7 tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] attach device xml: <interface type="ethernet">
Nov 16 03:48:39 user nova-compute[103546]:   <mac address="fa:16:3e:38:66:93"/>
Nov 16 03:48:39 user nova-compute[103546]:   <model type="virtio"/>
Nov 16 03:48:39 user nova-compute[103546]:   <mtu size="1442"/>
Nov 16 03:48:39 user nova-compute[103546]:   <target dev="tapfe4680c0-c5"/>
Nov 16 03:48:39 user nova-compute[103546]: </interface>
Nov 16 03:48:39 user nova-compute[103546]:  {{(pid=103546) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 03:48:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:48:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:48:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:48:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:48:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-db59c4d1-e20f-441b-99f1-851dc107a6c7 tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:48:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-db59c4d1-e20f-441b-99f1-851dc107a6c7 tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] No BDM found with device name hda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:48:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-db59c4d1-e20f-441b-99f1-851dc107a6c7 tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] No VIF found with MAC fa:16:3e:5b:50:00, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 03:48:40 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-db59c4d1-e20f-441b-99f1-851dc107a6c7 tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 03:48:40 user nova-compute[103546]:   <nova:package version="0.0.0"/>
Nov 16 03:48:40 user nova-compute[103546]:   <nova:name>tempest-device-tagging-server-350344638</nova:name>
Nov 16 03:48:40 user nova-compute[103546]:   <nova:creationTime>2023-11-16 03:48:40</nova:creationTime>
Nov 16 03:48:40 user nova-compute[103546]:   <nova:flavor name="m1.tiny">
Nov 16 03:48:40 user nova-compute[103546]:     <nova:memory>512</nova:memory>
Nov 16 03:48:40 user nova-compute[103546]:     <nova:disk>1</nova:disk>
Nov 16 03:48:40 user nova-compute[103546]:     <nova:swap>0</nova:swap>
Nov 16 03:48:40 user nova-compute[103546]:     <nova:ephemeral>0</nova:ephemeral>
Nov 16 03:48:40 user nova-compute[103546]:     <nova:vcpus>1</nova:vcpus>
Nov 16 03:48:40 user nova-compute[103546]:   </nova:flavor>
Nov 16 03:48:40 user nova-compute[103546]:   <nova:owner>
Nov 16 03:48:40 user nova-compute[103546]:     <nova:user uuid="843e14f393d849a9abc7759907a303ea">tempest-TaggedAttachmentsTest-401054631-project-member</nova:user>
Nov 16 03:48:40 user nova-compute[103546]:     <nova:project uuid="4445eb24618042ab9d24c869de5ccaab">tempest-TaggedAttachmentsTest-401054631</nova:project>
Nov 16 03:48:40 user nova-compute[103546]:   </nova:owner>
Nov 16 03:48:40 user nova-compute[103546]:   <nova:root type="image" uuid="5c6f539a-01e5-4478-bf8f-a14310b5d7dd"/>
Nov 16 03:48:40 user nova-compute[103546]:   <nova:ports>
Nov 16 03:48:40 user nova-compute[103546]:     <nova:port uuid="48a6af37-c461-4721-b870-432cf404dcf7">
Nov 16 03:48:40 user nova-compute[103546]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 16 03:48:40 user nova-compute[103546]:     </nova:port>
Nov 16 03:48:40 user nova-compute[103546]:     <nova:port uuid="fe4680c0-c534-4f5b-8833-be40c2784953">
Nov 16 03:48:40 user nova-compute[103546]:       <nova:ip type="fixed" address="10.10.10.225" ipVersion="4"/>
Nov 16 03:48:40 user nova-compute[103546]:     </nova:port>
Nov 16 03:48:40 user nova-compute[103546]:   </nova:ports>
Nov 16 03:48:40 user nova-compute[103546]: </nova:instance>
Nov 16 03:48:40 user nova-compute[103546]:  {{(pid=103546) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 16 03:48:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-db59c4d1-e20f-441b-99f1-851dc107a6c7 tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Lock "interface-549ee3db-0014-440f-bd3a-0d389f5eab88-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 2.672s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:48:40 user nova-compute[103546]: DEBUG nova.network.neutron [req-57057940-dfff-4ccc-85c9-f0b0f7cacb1d req-3f24a221-1dc3-4647-9ab1-d9d3e94e384c service nova] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Updated VIF entry in instance network info cache for port fe4680c0-c534-4f5b-8833-be40c2784953. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 03:48:40 user nova-compute[103546]: DEBUG nova.network.neutron [req-57057940-dfff-4ccc-85c9-f0b0f7cacb1d req-3f24a221-1dc3-4647-9ab1-d9d3e94e384c service nova] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Updating instance_info_cache with network_info: [{"id": "48a6af37-c461-4721-b870-432cf404dcf7", "address": "fa:16:3e:5b:50:00", "network": {"id": "4c04adce-4d50-4cc1-8c17-5cebba34fbec", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-399866268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4445eb24618042ab9d24c869de5ccaab", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48a6af37-c4", "ovs_interfaceid": "48a6af37-c461-4721-b870-432cf404dcf7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fe4680c0-c534-4f5b-8833-be40c2784953", "address": "fa:16:3e:38:66:93", "network": {"id": "45e450ee-a16a-4ae4-9e30-f5b3db0e6335", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-951951059", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4445eb24618042ab9d24c869de5ccaab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe4680c0-c5", "ovs_interfaceid": "fe4680c0-c534-4f5b-8833-be40c2784953", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:48:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-57057940-dfff-4ccc-85c9-f0b0f7cacb1d req-3f24a221-1dc3-4647-9ab1-d9d3e94e384c service nova] Releasing lock "refresh_cache-549ee3db-0014-440f-bd3a-0d389f5eab88" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:48:40 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-94a8271a-e222-44bf-8f17-da2961d197e3 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 05c929d5-2f1c-4be4-8864-6ec81625daac {{(pid=103546) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 03:48:40 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:48:40 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:48:40 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:48:40 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:48:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-da1b6f56-21f3-4db0-bd03-dc488eb8482c tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Acquiring lock "549ee3db-0014-440f-bd3a-0d389f5eab88" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:48:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-da1b6f56-21f3-4db0-bd03-dc488eb8482c tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Lock "549ee3db-0014-440f-bd3a-0d389f5eab88" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:48:40 user nova-compute[103546]: DEBUG nova.objects.instance [None req-da1b6f56-21f3-4db0-bd03-dc488eb8482c tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Lazy-loading 'flavor' on Instance uuid 549ee3db-0014-440f-bd3a-0d389f5eab88 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:48:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-da1b6f56-21f3-4db0-bd03-dc488eb8482c tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Lock "549ee3db-0014-440f-bd3a-0d389f5eab88" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.092s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:48:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-da1b6f56-21f3-4db0-bd03-dc488eb8482c tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Acquiring lock "549ee3db-0014-440f-bd3a-0d389f5eab88" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:48:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-da1b6f56-21f3-4db0-bd03-dc488eb8482c tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Lock "549ee3db-0014-440f-bd3a-0d389f5eab88" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:48:40 user nova-compute[103546]: INFO nova.compute.manager [None req-da1b6f56-21f3-4db0-bd03-dc488eb8482c tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Attaching volume c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b to /dev/vdb
Nov 16 03:48:40 user nova-compute[103546]: DEBUG os_brick.utils [None req-da1b6f56-21f3-4db0-bd03-dc488eb8482c tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:48:40 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:40 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:40 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8291828-3cf3-4271-9dba-0f407567e507]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af5c39b14ece\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:40 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:40 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa3da806-8e98-4335-9206-aa0334223876 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 03:48:40 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa3da806-8e98-4335-9206-aa0334223876 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mCDFzYxJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:48:40 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-aa3da806-8e98-4335-9206-aa0334223876 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:48:40 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-aa3da806-8e98-4335-9206-aa0334223876 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:48:40 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-aa3da806-8e98-4335-9206-aa0334223876 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:48:40 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-aa3da806-8e98-4335-9206-aa0334223876 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:48:40 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-aa3da806-8e98-4335-9206-aa0334223876 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:48:40 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-aa3da806-8e98-4335-9206-aa0334223876 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:48:40 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-aa3da806-8e98-4335-9206-aa0334223876 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 03:48:40 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:40 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d378c4-9b50-4f38-b967-62c816403e8a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:40 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:40 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:40 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:40 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd25bb31-7781-42ea-8ece-a3a84da52b56]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:40 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:40 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b6fc74-3df6-4091-8d01-8181e7276601]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:40 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa3da806-8e98-4335-9206-aa0334223876 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 03:48:40 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:48:40 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a -p 172.16.0.220:3260 --interface default --op new {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:40 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[37bf74dc-d5b8-4855-9029-d4f32b698581]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:40 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-da1b6f56-21f3-4db0-bd03-dc488eb8482c tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Running cmd (subprocess): nvme version {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:40 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-da1b6f56-21f3-4db0-bd03-dc488eb8482c tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] 'nvme version' failed. Not Retrying. {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:48:40 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:40 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5959d9-b8c9-4cdd-9256-5903f7c4f39f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a] added\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:40 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.nvmeof [None req-da1b6f56-21f3-4db0-bd03-dc488eb8482c tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] nvme not present on system {{(pid=103546) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 03:48:40 user nova-compute[103546]: DEBUG nova.compute.manager [req-a62f5250-d440-417c-95e0-468a22e4ffbe req-4fba2913-db96-4b32-83b1-799e014fed16 service nova] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Received event network-vif-plugged-fe4680c0-c534-4f5b-8833-be40c2784953 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:48:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a62f5250-d440-417c-95e0-468a22e4ffbe req-4fba2913-db96-4b32-83b1-799e014fed16 service nova] Acquiring lock "549ee3db-0014-440f-bd3a-0d389f5eab88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:48:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a62f5250-d440-417c-95e0-468a22e4ffbe req-4fba2913-db96-4b32-83b1-799e014fed16 service nova] Lock "549ee3db-0014-440f-bd3a-0d389f5eab88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:48:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a62f5250-d440-417c-95e0-468a22e4ffbe req-4fba2913-db96-4b32-83b1-799e014fed16 service nova] Lock "549ee3db-0014-440f-bd3a-0d389f5eab88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:48:40 user nova-compute[103546]: DEBUG nova.compute.manager [req-a62f5250-d440-417c-95e0-468a22e4ffbe req-4fba2913-db96-4b32-83b1-799e014fed16 service nova] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] No waiting events found dispatching network-vif-plugged-fe4680c0-c534-4f5b-8833-be40c2784953 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:48:40 user nova-compute[103546]: WARNING nova.compute.manager [req-a62f5250-d440-417c-95e0-468a22e4ffbe req-4fba2913-db96-4b32-83b1-799e014fed16 service nova] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Received unexpected event network-vif-plugged-fe4680c0-c534-4f5b-8833-be40c2784953 for instance with vm_state active and task_state None.
Nov 16 03:48:40 user nova-compute[103546]: DEBUG nova.compute.manager [req-a62f5250-d440-417c-95e0-468a22e4ffbe req-4fba2913-db96-4b32-83b1-799e014fed16 service nova] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Received event network-vif-plugged-fe4680c0-c534-4f5b-8833-be40c2784953 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:48:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a62f5250-d440-417c-95e0-468a22e4ffbe req-4fba2913-db96-4b32-83b1-799e014fed16 service nova] Acquiring lock "549ee3db-0014-440f-bd3a-0d389f5eab88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:48:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a62f5250-d440-417c-95e0-468a22e4ffbe req-4fba2913-db96-4b32-83b1-799e014fed16 service nova] Lock "549ee3db-0014-440f-bd3a-0d389f5eab88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:48:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a62f5250-d440-417c-95e0-468a22e4ffbe req-4fba2913-db96-4b32-83b1-799e014fed16 service nova] Lock "549ee3db-0014-440f-bd3a-0d389f5eab88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:48:40 user nova-compute[103546]: DEBUG nova.compute.manager [req-a62f5250-d440-417c-95e0-468a22e4ffbe req-4fba2913-db96-4b32-83b1-799e014fed16 service nova] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] No waiting events found dispatching network-vif-plugged-fe4680c0-c534-4f5b-8833-be40c2784953 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:48:40 user nova-compute[103546]: WARNING nova.compute.manager [req-a62f5250-d440-417c-95e0-468a22e4ffbe req-4fba2913-db96-4b32-83b1-799e014fed16 service nova] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Received unexpected event network-vif-plugged-fe4680c0-c534-4f5b-8833-be40c2784953 for instance with vm_state active and task_state None.
Nov 16 03:48:40 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa3da806-8e98-4335-9206-aa0334223876 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a] added
Nov 16 03:48:40 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:48:40 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:40 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:48:40 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:40 user nova-compute[103546]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 03:48:40 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6475684-82fd-495b-8791-21a2d1cf321e]: (4, '') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:40 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-da1b6f56-21f3-4db0-bd03-dc488eb8482c tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=103546) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 03:48:40 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-da1b6f56-21f3-4db0-bd03-dc488eb8482c tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 03:48:40 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-da1b6f56-21f3-4db0-bd03-dc488eb8482c tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] LIGHTOS: no hostnqn found. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 03:48:40 user nova-compute[103546]: DEBUG os_brick.utils [None req-da1b6f56-21f3-4db0-bd03-dc488eb8482c tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af5c39b14ece', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:48:40 user nova-compute[103546]: DEBUG nova.virt.block_device [None req-da1b6f56-21f3-4db0-bd03-dc488eb8482c tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Updating existing volume attachment record: 8c7316ef-4c13-45fa-a94b-7745f580633f {{(pid=103546) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 03:48:40 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:40 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f370ff3d-40e1-4bb8-9884-160f377db89f]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:40 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa3da806-8e98-4335-9206-aa0334223876 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:48:40 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:41 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:41 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b852c6a-a9ca-40c0-9164-e3087c936592]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:41 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa3da806-8e98-4335-9206-aa0334223876 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:48:41 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mCDFzYxJ {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:41 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mCDFzYxJ" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:41 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb4ae31-b30c-49f9-85ae-011bf8860ccf]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:41 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa3da806-8e98-4335-9206-aa0334223876 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mCDFzYxJ'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:48:41 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:41 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:41 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[687644e7-2829-4164-bd1f-d7f86c1e73da]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:41 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa3da806-8e98-4335-9206-aa0334223876 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:48:41 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:41 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:41 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[1240e405-894b-4a2f-844e-a6fddbd807f0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:41 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa3da806-8e98-4335-9206-aa0334223876 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:48:41 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:48:41 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:48:41 user nova-compute[103546]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)
Nov 16 03:48:41 user nova-compute[103546]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)
Nov 16 03:48:41 user nova-compute[103546]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)
Nov 16 03:48:41 user nova-compute[103546]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)
Nov 16 03:48:41 user nova-compute[103546]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4 (non-flash)
Nov 16 03:48:41 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:48:41 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa3da806-8e98-4335-9206-aa0334223876 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:48:41 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:48:41 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:48:41 user nova-compute[103546]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)
Nov 16 03:48:41 user nova-compute[103546]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)
Nov 16 03:48:41 user nova-compute[103546]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)
Nov 16 03:48:41 user nova-compute[103546]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)
Nov 16 03:48:41 user nova-compute[103546]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4 (non-flash)
Nov 16 03:48:41 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:48:41 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a -p 172.16.0.220:3260 --login {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:41 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:41 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b4fa78-6584-4d85-9ab2-db6866101645]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:41 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa3da806-8e98-4335-9206-aa0334223876 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a, portal: 172.16.0.220,3260]
Nov 16 03:48:41 user nova-compute[103546]: Login to [iface: default, target: iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a, portal: 172.16.0.220,3260] successful.
Nov 16 03:48:41 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:48:41 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:41 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:41 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[1218baaf-8538-42ad-a7a4-632749264564]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:41 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa3da806-8e98-4335-9206-aa0334223876 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:48:41 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:41 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:41 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[be14be1b-aeaf-4d3f-bc55-e4bbf5872812]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:41 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa3da806-8e98-4335-9206-aa0334223876 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a (non-flash)
Nov 16 03:48:41 user nova-compute[103546]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:48:41 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:48:41 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:48:41 user nova-compute[103546]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)
Nov 16 03:48:41 user nova-compute[103546]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)
Nov 16 03:48:41 user nova-compute[103546]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)
Nov 16 03:48:41 user nova-compute[103546]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)
Nov 16 03:48:41 user nova-compute[103546]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4 (non-flash)
Nov 16 03:48:41 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:48:41 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa3da806-8e98-4335-9206-aa0334223876 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a (non-flash)
Nov 16 03:48:41 user nova-compute[103546]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:48:41 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:48:41 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:48:41 user nova-compute[103546]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)
Nov 16 03:48:41 user nova-compute[103546]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)
Nov 16 03:48:41 user nova-compute[103546]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)
Nov 16 03:48:41 user nova-compute[103546]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)
Nov 16 03:48:41 user nova-compute[103546]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4 (non-flash)
Nov 16 03:48:41 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:48:41 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-aa3da806-8e98-4335-9206-aa0334223876 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.369s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:48:41 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa3da806-8e98-4335-9206-aa0334223876 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 03:48:41 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-aa3da806-8e98-4335-9206-aa0334223876 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] HCTL ('41', '-', '-', 0) found on session 10 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 03:48:41 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-aa3da806-8e98-4335-9206-aa0334223876 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 03:48:41 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:41 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.015s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:41 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c3897ef-5f79-4dfe-aae5-79d3a17cef26]: (4, ('- - 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:41 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-aa3da806-8e98-4335-9206-aa0334223876 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Searching for a device in session 10 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 03:48:41 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa3da806-8e98-4335-9206-aa0334223876 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mCDFzYxJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 03:48:42 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-aa3da806-8e98-4335-9206-aa0334223876 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.406s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:48:42 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa3da806-8e98-4335-9206-aa0334223876 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] <== connect_volume: return (1408ms) {'type': 'block', 'scsi_wwn': '23838313333633863', 'path': '/dev/sdj'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:48:42 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa3da806-8e98-4335-9206-aa0334223876 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838313333633863', 'path': '/dev/sdj'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 03:48:42 user nova-compute[103546]: DEBUG nova.objects.instance [None req-aa3da806-8e98-4335-9206-aa0334223876 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Lazy-loading 'flavor' on Instance uuid fead4119-3ab9-4337-8b48-d3920e1112f4 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:48:42 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-aa3da806-8e98-4335-9206-aa0334223876 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 03:48:42 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 03:48:42 user nova-compute[103546]:   <source dev="/dev/sdj"/>
Nov 16 03:48:42 user nova-compute[103546]:   <target dev="sdc" bus="scsi"/>
Nov 16 03:48:42 user nova-compute[103546]:   <serial>67611f41-96e1-49ec-a7e0-590702437c7a</serial>
Nov 16 03:48:42 user nova-compute[103546]:   <address type="drive" controller="0" unit="2"/>
Nov 16 03:48:42 user nova-compute[103546]: </disk>
Nov 16 03:48:42 user nova-compute[103546]:  {{(pid=103546) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 03:48:42 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:48:42 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-aa3da806-8e98-4335-9206-aa0334223876 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] No BDM found with device name sda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:48:42 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-aa3da806-8e98-4335-9206-aa0334223876 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] No BDM found with device name sdb, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:48:42 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-aa3da806-8e98-4335-9206-aa0334223876 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] No BDM found with device name sdc, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:48:42 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-aa3da806-8e98-4335-9206-aa0334223876 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] No VIF found with MAC fa:16:3e:63:86:8e, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 03:48:42 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-aa3da806-8e98-4335-9206-aa0334223876 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Lock "fead4119-3ab9-4337-8b48-d3920e1112f4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.643s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:48:43 user nova-compute[103546]: DEBUG nova.compute.manager [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AXhBDQeb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c24a386f-32f5-4095-b2b3-69a70a54ff66', 'attached_at': '', 'detached_at': '', 'volume_id': '164d9730-8eb2-44f5-aa18-2966bb91b153', 'serial': '164d9730-8eb2-44f5-aa18-2966bb91b153'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DfTzSXUe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': 'c24a386f-32f5-4095-b2b3-69a70a54ff66', 'attached_at': '', 'detached_at': '', 'volume_id': '34b3df15-2d1d-4474-839a-465db0816beb', 'serial'} {{(pid=103546) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 16 03:48:43 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 03:48:43 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AXhBDQeb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:48:43 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:48:43 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:48:43 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:48:43 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:48:43 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:48:43 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:48:43 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 03:48:43 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153 -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:43 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:43 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2419b03-9a44-4dd3-b78d-367f5800c895]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:43 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 03:48:43 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:48:43 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153 -p 172.16.0.220:3260 --interface default --op new {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:43 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:43 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb71be5-b0db-45dc-9346-2ed4858cb49b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153] added\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:43 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153] added
Nov 16 03:48:43 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:48:43 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:43 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:43 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d6d0821-18d7-4fd9-bce9-18003a39b733]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:43 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:48:43 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:43 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:43 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[959b3b60-29a1-4aff-be4c-b2c6b048f0d7]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:43 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:48:43 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AXhBDQeb {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:43 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AXhBDQeb" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:43 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a62a11a-9ce9-49dd-b967-c5674c3b8a3d]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:43 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AXhBDQeb'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:48:43 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:43 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:43 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb09746-6384-4ca7-914f-85f14bf4ca2a]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:43 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:48:43 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:43 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:43 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5fe4d6-f785-4846-9feb-479dd2defd84]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:43 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a (non-flash)
Nov 16 03:48:43 user nova-compute[103546]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:48:43 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:48:43 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:48:43 user nova-compute[103546]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)
Nov 16 03:48:43 user nova-compute[103546]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)
Nov 16 03:48:43 user nova-compute[103546]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)
Nov 16 03:48:43 user nova-compute[103546]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)
Nov 16 03:48:43 user nova-compute[103546]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4 (non-flash)
Nov 16 03:48:43 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:48:43 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a (non-flash)
Nov 16 03:48:43 user nova-compute[103546]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:48:43 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:48:43 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:48:43 user nova-compute[103546]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)
Nov 16 03:48:43 user nova-compute[103546]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)
Nov 16 03:48:43 user nova-compute[103546]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)
Nov 16 03:48:43 user nova-compute[103546]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)
Nov 16 03:48:43 user nova-compute[103546]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4 (non-flash)
Nov 16 03:48:43 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:48:43 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153 -p 172.16.0.220:3260 --login {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:43 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:43 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[2923f3a5-d94c-4de9-aa43-91d864a9cad9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:43 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153, portal: 172.16.0.220,3260]
Nov 16 03:48:43 user nova-compute[103546]: Login to [iface: default, target: iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153, portal: 172.16.0.220,3260] successful.
Nov 16 03:48:43 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:48:43 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:43 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:43 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1c0d65-8d62-4c97-838f-53657846e4fb]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:43 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:48:43 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:43 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:43 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[4856e735-c927-4422-bc00-413cfa90e8df]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:43 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a (non-flash)
Nov 16 03:48:43 user nova-compute[103546]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153 (non-flash)
Nov 16 03:48:43 user nova-compute[103546]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:48:43 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:48:43 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:48:43 user nova-compute[103546]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)
Nov 16 03:48:43 user nova-compute[103546]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)
Nov 16 03:48:43 user nova-compute[103546]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)
Nov 16 03:48:43 user nova-compute[103546]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)
Nov 16 03:48:43 user nova-compute[103546]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4 (non-flash)
Nov 16 03:48:43 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:48:43 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a (non-flash)
Nov 16 03:48:43 user nova-compute[103546]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153 (non-flash)
Nov 16 03:48:43 user nova-compute[103546]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:48:43 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:48:43 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:48:43 user nova-compute[103546]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)
Nov 16 03:48:43 user nova-compute[103546]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)
Nov 16 03:48:43 user nova-compute[103546]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)
Nov 16 03:48:43 user nova-compute[103546]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)
Nov 16 03:48:43 user nova-compute[103546]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4 (non-flash)
Nov 16 03:48:43 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:48:43 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:48:43 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 03:48:43 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] HCTL ('42', '-', '-', 0) found on session 11 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 03:48:43 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] Scanning host 42 c: -, t: -, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 03:48:43 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:43 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:43 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb3601c-4ef8-4daf-83b2-c27e56d6e4a2]: (4, ('- - 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:43 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] Searching for a device in session 11 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 03:48:43 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AXhBDQeb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 03:48:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-22e14e8e-7501-4724-b315-3ec820585b01 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Acquiring lock "fead4119-3ab9-4337-8b48-d3920e1112f4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:48:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-22e14e8e-7501-4724-b315-3ec820585b01 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Lock "fead4119-3ab9-4337-8b48-d3920e1112f4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:48:44 user nova-compute[103546]: INFO nova.compute.manager [None req-22e14e8e-7501-4724-b315-3ec820585b01 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Detaching volume 67611f41-96e1-49ec-a7e0-590702437c7a
Nov 16 03:48:44 user nova-compute[103546]: INFO nova.virt.block_device [None req-22e14e8e-7501-4724-b315-3ec820585b01 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Attempting to driver detach volume 67611f41-96e1-49ec-a7e0-590702437c7a from mountpoint /dev/sdc
Nov 16 03:48:44 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-22e14e8e-7501-4724-b315-3ec820585b01 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Attempting to detach device sdc from instance fead4119-3ab9-4337-8b48-d3920e1112f4 from the persistent domain config. {{(pid=103546) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 03:48:44 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-22e14e8e-7501-4724-b315-3ec820585b01 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 03:48:44 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 03:48:44 user nova-compute[103546]:   <source dev="/dev/sdj"/>
Nov 16 03:48:44 user nova-compute[103546]:   <target dev="sdc" bus="scsi"/>
Nov 16 03:48:44 user nova-compute[103546]:   <serial>67611f41-96e1-49ec-a7e0-590702437c7a</serial>
Nov 16 03:48:44 user nova-compute[103546]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 16 03:48:44 user nova-compute[103546]: </disk>
Nov 16 03:48:44 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 03:48:44 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-22e14e8e-7501-4724-b315-3ec820585b01 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Successfully detached device sdc from instance fead4119-3ab9-4337-8b48-d3920e1112f4 from the persistent domain config.
Nov 16 03:48:44 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-22e14e8e-7501-4724-b315-3ec820585b01 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance fead4119-3ab9-4337-8b48-d3920e1112f4 from the live domain config. {{(pid=103546) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 03:48:44 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-22e14e8e-7501-4724-b315-3ec820585b01 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 03:48:44 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 03:48:44 user nova-compute[103546]:   <source dev="/dev/sdj"/>
Nov 16 03:48:44 user nova-compute[103546]:   <target dev="sdc" bus="scsi"/>
Nov 16 03:48:44 user nova-compute[103546]:   <serial>67611f41-96e1-49ec-a7e0-590702437c7a</serial>
Nov 16 03:48:44 user nova-compute[103546]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 16 03:48:44 user nova-compute[103546]: </disk>
Nov 16 03:48:44 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 03:48:44 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:48:44 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-22e14e8e-7501-4724-b315-3ec820585b01 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance fead4119-3ab9-4337-8b48-d3920e1112f4 {{(pid=103546) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 03:48:44 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:48:44 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '26436396536663462', 'path': '/dev/sdk'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:48:44 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436396536663462', 'path': '/dev/sdk'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 03:48:44 user nova-compute[103546]: DEBUG nova.objects.instance [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] Lazy-loading 'flavor' on Instance uuid c24a386f-32f5-4095-b2b3-69a70a54ff66 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:48:45 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] COPY block job progress, current cursor: 4194304 final cursor: 1073741824 {{(pid=103546) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 03:48:45 user nova-compute[103546]: DEBUG nova.compute.manager [req-d2b3a759-ace0-44d1-9eed-14f5a44ea4ed req-1ffc27ba-4d80-4a43-a9f2-16d078232b65 service nova] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Received event network-changed-0bf5e09d-1b54-48f7-bbbe-f133102ea245 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:48:45 user nova-compute[103546]: DEBUG nova.compute.manager [req-d2b3a759-ace0-44d1-9eed-14f5a44ea4ed req-1ffc27ba-4d80-4a43-a9f2-16d078232b65 service nova] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Refreshing instance network info cache due to event network-changed-0bf5e09d-1b54-48f7-bbbe-f133102ea245. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:48:45 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d2b3a759-ace0-44d1-9eed-14f5a44ea4ed req-1ffc27ba-4d80-4a43-a9f2-16d078232b65 service nova] Acquiring lock "refresh_cache-ad9b2edb-15d7-4937-9461-15ce61f508a7" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:48:45 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d2b3a759-ace0-44d1-9eed-14f5a44ea4ed req-1ffc27ba-4d80-4a43-a9f2-16d078232b65 service nova] Acquired lock "refresh_cache-ad9b2edb-15d7-4937-9461-15ce61f508a7" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:48:45 user nova-compute[103546]: DEBUG nova.network.neutron [req-d2b3a759-ace0-44d1-9eed-14f5a44ea4ed req-1ffc27ba-4d80-4a43-a9f2-16d078232b65 service nova] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Refreshing network info cache for port 0bf5e09d-1b54-48f7-bbbe-f133102ea245 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:48:45 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-3090571b-d51e-48a4-a5b6-634eff4b870a tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] Acquiring lock "ad9b2edb-15d7-4937-9461-15ce61f508a7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:48:45 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-3090571b-d51e-48a4-a5b6-634eff4b870a tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] Lock "ad9b2edb-15d7-4937-9461-15ce61f508a7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:48:45 user nova-compute[103546]: DEBUG nova.objects.instance [None req-3090571b-d51e-48a4-a5b6-634eff4b870a tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] Lazy-loading 'flavor' on Instance uuid ad9b2edb-15d7-4937-9461-15ce61f508a7 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:48:45 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] COPY block job progress, current cursor: 177209344 final cursor: 1073741824 {{(pid=103546) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 03:48:45 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-3090571b-d51e-48a4-a5b6-634eff4b870a tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] Lock "ad9b2edb-15d7-4937-9461-15ce61f508a7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.083s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:48:45 user nova-compute[103546]: DEBUG nova.network.neutron [req-d2b3a759-ace0-44d1-9eed-14f5a44ea4ed req-1ffc27ba-4d80-4a43-a9f2-16d078232b65 service nova] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Updated VIF entry in instance network info cache for port 0bf5e09d-1b54-48f7-bbbe-f133102ea245. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 03:48:45 user nova-compute[103546]: DEBUG nova.network.neutron [req-d2b3a759-ace0-44d1-9eed-14f5a44ea4ed req-1ffc27ba-4d80-4a43-a9f2-16d078232b65 service nova] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Updating instance_info_cache with network_info: [{"id": "0bf5e09d-1b54-48f7-bbbe-f133102ea245", "address": "fa:16:3e:2f:63:83", "network": {"id": "704209e4-4dd9-4e90-bc67-9843ae1d3340", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1483691372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e2a4cdf0fe94227a70e9ecc30df0cf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bf5e09d-1b", "ovs_interfaceid": "0bf5e09d-1b54-48f7-bbbe-f133102ea245", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:48:45 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d2b3a759-ace0-44d1-9eed-14f5a44ea4ed req-1ffc27ba-4d80-4a43-a9f2-16d078232b65 service nova] Releasing lock "refresh_cache-ad9b2edb-15d7-4937-9461-15ce61f508a7" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:48:45 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-3090571b-d51e-48a4-a5b6-634eff4b870a tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] Acquiring lock "ad9b2edb-15d7-4937-9461-15ce61f508a7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:48:45 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-3090571b-d51e-48a4-a5b6-634eff4b870a tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] Lock "ad9b2edb-15d7-4937-9461-15ce61f508a7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:48:45 user nova-compute[103546]: INFO nova.compute.manager [None req-3090571b-d51e-48a4-a5b6-634eff4b870a tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Attaching volume 1341a8ab-40aa-45e3-9a5d-068116f08b3f to /dev/vdb
Nov 16 03:48:46 user nova-compute[103546]: DEBUG os_brick.utils [None req-3090571b-d51e-48a4-a5b6-634eff4b870a tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[20dd9027-47b9-4f3e-b1c2-469bdd21e00d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af5c39b14ece\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c739533-3336-4e01-9e63-fc3efcbd24ad]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7bde68e-4f24-437c-99f7-9b37633efe01]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b11c20-e758-4e69-8a32-5b3872e893dd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-3090571b-d51e-48a4-a5b6-634eff4b870a tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] Running cmd (subprocess): nvme version {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-3090571b-d51e-48a4-a5b6-634eff4b870a tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] 'nvme version' failed. Not Retrying. {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3090571b-d51e-48a4-a5b6-634eff4b870a tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] nvme not present on system {{(pid=103546) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:48:46 user nova-compute[103546]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 03:48:46 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[7172fe3a-16d0-490a-88f1-f0f2fff26555]: (4, '') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-3090571b-d51e-48a4-a5b6-634eff4b870a tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=103546) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-3090571b-d51e-48a4-a5b6-634eff4b870a tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-3090571b-d51e-48a4-a5b6-634eff4b870a tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] LIGHTOS: no hostnqn found. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG os_brick.utils [None req-3090571b-d51e-48a4-a5b6-634eff4b870a tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af5c39b14ece', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG nova.virt.block_device [None req-3090571b-d51e-48a4-a5b6-634eff4b870a tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Updating existing volume attachment record: 81d66680-7bff-4bd9-b104-5763470ea897 {{(pid=103546) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] COPY block job progress, current cursor: 326107136 final cursor: 1073741824 {{(pid=103546) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da1b6f56-21f3-4db0-bd03-dc488eb8482c tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-da1b6f56-21f3-4db0-bd03-dc488eb8482c tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'umBXpsjk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:48:46 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-da1b6f56-21f3-4db0-bd03-dc488eb8482c tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:48:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-da1b6f56-21f3-4db0-bd03-dc488eb8482c tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-da1b6f56-21f3-4db0-bd03-dc488eb8482c tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:48:46 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-da1b6f56-21f3-4db0-bd03-dc488eb8482c tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:48:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-da1b6f56-21f3-4db0-bd03-dc488eb8482c tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-da1b6f56-21f3-4db0-bd03-dc488eb8482c tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:48:46 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-da1b6f56-21f3-4db0-bd03-dc488eb8482c tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 03:48:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a832652-71f9-4a42-a510-77faa55d544a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-da1b6f56-21f3-4db0-bd03-dc488eb8482c tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 03:48:46 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b -p 172.16.0.220:3260 --interface default --op new {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b59cff-9fb9-4599-8ebf-6c0bf6173b06]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b] added\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-da1b6f56-21f3-4db0-bd03-dc488eb8482c tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b] added
Nov 16 03:48:46 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[86bea40a-c8c2-45f3-a7e5-bc04e2028380]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-da1b6f56-21f3-4db0-bd03-dc488eb8482c tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[4296bcb6-6b13-4209-9bdf-4b7cdf03abf0]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-da1b6f56-21f3-4db0-bd03-dc488eb8482c tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v umBXpsjk {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v umBXpsjk" returned: 0 in 0.025s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[52dd432c-7b68-4a34-846d-385cbbe596d3]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-da1b6f56-21f3-4db0-bd03-dc488eb8482c tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'umBXpsjk'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbca0cc-b0be-4cfa-8a21-bb7f054aba17]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-da1b6f56-21f3-4db0-bd03-dc488eb8482c tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] COPY block job progress, current cursor: 510656512 final cursor: 1073741824 {{(pid=103546) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7017b65-0ec0-4733-a77a-887085870c2b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-da1b6f56-21f3-4db0-bd03-dc488eb8482c tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a (non-flash)
Nov 16 03:48:46 user nova-compute[103546]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153 (non-flash)
Nov 16 03:48:46 user nova-compute[103546]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:48:46 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:48:46 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:48:46 user nova-compute[103546]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)
Nov 16 03:48:46 user nova-compute[103546]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)
Nov 16 03:48:46 user nova-compute[103546]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)
Nov 16 03:48:46 user nova-compute[103546]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)
Nov 16 03:48:46 user nova-compute[103546]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4 (non-flash)
Nov 16 03:48:46 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-da1b6f56-21f3-4db0-bd03-dc488eb8482c tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a (non-flash)
Nov 16 03:48:46 user nova-compute[103546]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153 (non-flash)
Nov 16 03:48:46 user nova-compute[103546]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:48:46 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:48:46 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:48:46 user nova-compute[103546]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)
Nov 16 03:48:46 user nova-compute[103546]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)
Nov 16 03:48:46 user nova-compute[103546]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)
Nov 16 03:48:46 user nova-compute[103546]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)
Nov 16 03:48:46 user nova-compute[103546]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4 (non-flash)
Nov 16 03:48:46 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b -p 172.16.0.220:3260 --login {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b -p 172.16.0.220:3260 --login" returned: 0 in 0.118s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d38761-d654-4242-b8be-f16f26778719]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-da1b6f56-21f3-4db0-bd03-dc488eb8482c tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b, portal: 172.16.0.220,3260]
Nov 16 03:48:46 user nova-compute[103546]: Login to [iface: default, target: iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b, portal: 172.16.0.220,3260] successful.
Nov 16 03:48:46 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4209d2-c0c7-4299-821b-99518e4e36e3]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-da1b6f56-21f3-4db0-bd03-dc488eb8482c tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[2051a0b2-c063-4998-8f12-d23517ad6156]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-da1b6f56-21f3-4db0-bd03-dc488eb8482c tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a (non-flash)
Nov 16 03:48:46 user nova-compute[103546]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153 (non-flash)
Nov 16 03:48:46 user nova-compute[103546]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b (non-flash)
Nov 16 03:48:46 user nova-compute[103546]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:48:46 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:48:46 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:48:46 user nova-compute[103546]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)
Nov 16 03:48:46 user nova-compute[103546]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)
Nov 16 03:48:46 user nova-compute[103546]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)
Nov 16 03:48:46 user nova-compute[103546]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)
Nov 16 03:48:46 user nova-compute[103546]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4 (non-flash)
Nov 16 03:48:46 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-da1b6f56-21f3-4db0-bd03-dc488eb8482c tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a (non-flash)
Nov 16 03:48:46 user nova-compute[103546]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153 (non-flash)
Nov 16 03:48:46 user nova-compute[103546]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b (non-flash)
Nov 16 03:48:46 user nova-compute[103546]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:48:46 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:48:46 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:48:46 user nova-compute[103546]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)
Nov 16 03:48:46 user nova-compute[103546]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)
Nov 16 03:48:46 user nova-compute[103546]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)
Nov 16 03:48:46 user nova-compute[103546]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)
Nov 16 03:48:46 user nova-compute[103546]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4 (non-flash)
Nov 16 03:48:46 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-da1b6f56-21f3-4db0-bd03-dc488eb8482c tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.442s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-da1b6f56-21f3-4db0-bd03-dc488eb8482c tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-da1b6f56-21f3-4db0-bd03-dc488eb8482c tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] HCTL ('43', '-', '-', 0) found on session 12 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-da1b6f56-21f3-4db0-bd03-dc488eb8482c tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Scanning host 43 c: -, t: -, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 03:48:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host43/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:47 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host43/scan" returned: 0 in 0.024s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:47 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a51328-3e68-400c-af85-2e7368db6ddd]: (4, ('- - 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:47 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-da1b6f56-21f3-4db0-bd03-dc488eb8482c tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Searching for a device in session 12 and hctl ['43', '*', '*', 0] yield: None {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 03:48:47 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] COPY block job progress, current cursor: 646971392 final cursor: 1073741824 {{(pid=103546) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 03:48:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:48:47 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] COPY block job progress, current cursor: 771751936 final cursor: 1073741824 {{(pid=103546) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 03:48:48 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-da1b6f56-21f3-4db0-bd03-dc488eb8482c tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Searching for a device in session 12 and hctl ['43', '*', '*', 0] yield: sdl {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 03:48:48 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-da1b6f56-21f3-4db0-bd03-dc488eb8482c tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Connected to sdl using {'target_iqn': 'iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'umBXpsjk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 03:48:48 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-da1b6f56-21f3-4db0-bd03-dc488eb8482c tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.489s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:48:48 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-da1b6f56-21f3-4db0-bd03-dc488eb8482c tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] <== connect_volume: return (1491ms) {'type': 'block', 'scsi_wwn': '23136326338626461', 'path': '/dev/sdl'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:48:48 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da1b6f56-21f3-4db0-bd03-dc488eb8482c tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23136326338626461', 'path': '/dev/sdl'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 03:48:48 user nova-compute[103546]: DEBUG nova.objects.instance [None req-da1b6f56-21f3-4db0-bd03-dc488eb8482c tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Lazy-loading 'flavor' on Instance uuid 549ee3db-0014-440f-bd3a-0d389f5eab88 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:48:48 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-da1b6f56-21f3-4db0-bd03-dc488eb8482c tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 03:48:48 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 03:48:48 user nova-compute[103546]:   <source dev="/dev/sdl"/>
Nov 16 03:48:48 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 03:48:48 user nova-compute[103546]:   <serial>c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b</serial>
Nov 16 03:48:48 user nova-compute[103546]: </disk>
Nov 16 03:48:48 user nova-compute[103546]:  {{(pid=103546) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 03:48:48 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] COPY block job progress, current cursor: 958398464 final cursor: 1073741824 {{(pid=103546) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 03:48:48 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-da1b6f56-21f3-4db0-bd03-dc488eb8482c tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:48:48 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-da1b6f56-21f3-4db0-bd03-dc488eb8482c tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] No BDM found with device name hda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:48:48 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-da1b6f56-21f3-4db0-bd03-dc488eb8482c tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] No VIF found with MAC fa:16:3e:5b:50:00, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 03:48:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-da1b6f56-21f3-4db0-bd03-dc488eb8482c tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Lock "549ee3db-0014-440f-bd3a-0d389f5eab88" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.043s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:48:48 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=103546) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 03:48:48 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 03:48:48 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DfTzSXUe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:48:48 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:48:48 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:48:48 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:48:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:48 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[18533c1e-9278-4dc9-8c3a-bd0e0b5f7954]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:48 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 03:48:48 user nova-compute[103546]: No targets found.
Nov 16 03:48:48 user nova-compute[103546]: iSNS:
Nov 16 03:48:48 user nova-compute[103546]: No targets found.
Nov 16 03:48:48 user nova-compute[103546]: STATIC:
Nov 16 03:48:48 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4
Nov 16 03:48:48 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:48:48 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:48:48 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7
Nov 16 03:48:48 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:48:48 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:48:48 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b
Nov 16 03:48:48 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:48:48 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:48:48 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a
Nov 16 03:48:48 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:48:48 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:48:48 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb
Nov 16 03:48:48 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:48:48 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:48:48 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153
Nov 16 03:48:48 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:48:48 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:48:48 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41
Nov 16 03:48:48 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:48:48 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:48:48 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57
Nov 16 03:48:48 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:48:48 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:48:48 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b
Nov 16 03:48:48 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:48:48 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:48:48 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75
Nov 16 03:48:48 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:48:48 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:48:48 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865
Nov 16 03:48:48 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:48:48 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:48:48 user nova-compute[103546]: FIRMWARE:
Nov 16 03:48:48 user nova-compute[103546]: No targets found.
Nov 16 03:48:48 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:48:48 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 03:48:48 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 03:48:48 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 03:48:48 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 03:48:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:48 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f38c9e69-f1f8-4620-b9ad-41014b6c23d4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:49 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ef1bf0-328e-423d-bf35-f6c533c93c31]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:49 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a (non-flash)
Nov 16 03:48:49 user nova-compute[103546]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153 (non-flash)
Nov 16 03:48:49 user nova-compute[103546]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b (non-flash)
Nov 16 03:48:49 user nova-compute[103546]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:48:49 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:48:49 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:48:49 user nova-compute[103546]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)
Nov 16 03:48:49 user nova-compute[103546]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)
Nov 16 03:48:49 user nova-compute[103546]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)
Nov 16 03:48:49 user nova-compute[103546]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)
Nov 16 03:48:49 user nova-compute[103546]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4 (non-flash)
Nov 16 03:48:49 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:48:49 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a (non-flash)
Nov 16 03:48:49 user nova-compute[103546]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153 (non-flash)
Nov 16 03:48:49 user nova-compute[103546]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b (non-flash)
Nov 16 03:48:49 user nova-compute[103546]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:48:49 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:48:49 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:48:49 user nova-compute[103546]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)
Nov 16 03:48:49 user nova-compute[103546]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)
Nov 16 03:48:49 user nova-compute[103546]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)
Nov 16 03:48:49 user nova-compute[103546]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)
Nov 16 03:48:49 user nova-compute[103546]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4 (non-flash)
Nov 16 03:48:49 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:48:49 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60c4383760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb'): ({'sdh'}, set())}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 03:48:49 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] Removing single pathed devices sdh {{(pid=103546) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 03:48:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:49 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ffd67e6-c08a-403d-9a40-20a10a348912]: (4, ('path checker states:\nup                  10\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:49 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b7a4a9-809b-465c-9ac4-f1e36c4d008e]: (4, ('ok\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:49 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] Flushing IO for device /dev/sdh {{(pid=103546) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 03:48:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.012s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:49 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[1292deef-bb4e-413f-8421-618ef5a2d0b2]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:49 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=103546) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 03:48:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.048s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:49 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca356395-dcd1-43e4-98e7-3436ad63bd68]: (4, ('1', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:49 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 03:48:49 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] SCSI volumes sdh have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 03:48:49 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb')] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 03:48:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:49 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6446ee-e28a-433a-b6b9-30f0c53c93e4]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:49 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:48:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb -p 172.16.0.220:3260 --logout {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb -p 172.16.0.220:3260 --logout" returned: 0 in 0.094s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:49 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[643a7fad-191f-4541-b6a3-c873f8c9c071]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:49 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb, portal: 172.16.0.220,3260]
Nov 16 03:48:49 user nova-compute[103546]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb, portal: 172.16.0.220,3260] successful.
Nov 16 03:48:49 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:48:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb -p 172.16.0.220:3260 --op delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:49 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab941cf8-1971-4d23-b8d7-96cb92b33aaa]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:49 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:48:49 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:48:49 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] <== disconnect_volume: return (378ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:48:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 03:48:49 user nova-compute[103546]: DEBUG nova.compute.manager [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AXhBDQeb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, 'status': 'reserved', 'instance': 'c24a386f-32f5-4095-b2b3-69a70a54ff66', 'attached_at': '', 'detached_at': '', 'volume_id': '164d9730-8eb2-44f5-aa18-2966bb91b153', 'serial'} {{(pid=103546) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 16 03:48:49 user nova-compute[103546]: DEBUG nova.compute.manager [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] swap_volume: removing Cinder connection for volume 34b3df15-2d1d-4474-839a-465db0816beb {{(pid=103546) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 16 03:48:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:48:50 user nova-compute[103546]: DEBUG nova.compute.manager [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] swap_volume: Updating volume 34b3df15-2d1d-4474-839a-465db0816beb BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "AXhBDQeb", "auth_password": "ughzHajlS1wdWf", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdk", "volume_id": "164d9730-8eb2-44f5-aa18-2966bb91b153"}, "status": "reserved", "instance": "c24a386f-32f5-4095-b2b3-69a70a54ff66", "attached_at": "", "detached_at": "", "volume_id": "164d9730-8eb2-44f5-aa18-2966bb91b153", "serial": "164d9730-8eb2-44f5-aa18-2966bb91b153"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '164d9730-8eb2-44f5-aa18-2966bb91b153', 'no_device': None, 'attachment_id': 'c334c53b-bb1e-4833-aff2-97bfe25609cd'} {{(pid=103546) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 16 03:48:50 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-11ff8660-a9de-4dbc-a390-e6957950bcd2 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] Lock "c24a386f-32f5-4095-b2b3-69a70a54ff66" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 12.482s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:48:50 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-66a4c7ba-c236-4e98-a6c9-172ef8047faf tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Acquiring lock "549ee3db-0014-440f-bd3a-0d389f5eab88" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:48:50 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-66a4c7ba-c236-4e98-a6c9-172ef8047faf tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Lock "549ee3db-0014-440f-bd3a-0d389f5eab88" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:48:50 user nova-compute[103546]: INFO nova.compute.manager [None req-66a4c7ba-c236-4e98-a6c9-172ef8047faf tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Detaching volume c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b
Nov 16 03:48:50 user nova-compute[103546]: INFO nova.virt.block_device [None req-66a4c7ba-c236-4e98-a6c9-172ef8047faf tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Attempting to driver detach volume c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b from mountpoint /dev/vdb
Nov 16 03:48:50 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-66a4c7ba-c236-4e98-a6c9-172ef8047faf tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Attempting to detach device vdb from instance 549ee3db-0014-440f-bd3a-0d389f5eab88 from the persistent domain config. {{(pid=103546) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 03:48:50 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-66a4c7ba-c236-4e98-a6c9-172ef8047faf tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 03:48:50 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 03:48:50 user nova-compute[103546]:   <source dev="/dev/sdl"/>
Nov 16 03:48:50 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 03:48:50 user nova-compute[103546]:   <serial>c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b</serial>
Nov 16 03:48:50 user nova-compute[103546]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 16 03:48:50 user nova-compute[103546]: </disk>
Nov 16 03:48:50 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 03:48:50 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-66a4c7ba-c236-4e98-a6c9-172ef8047faf tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Successfully detached device vdb from instance 549ee3db-0014-440f-bd3a-0d389f5eab88 from the persistent domain config.
Nov 16 03:48:50 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-66a4c7ba-c236-4e98-a6c9-172ef8047faf tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 549ee3db-0014-440f-bd3a-0d389f5eab88 from the live domain config. {{(pid=103546) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 03:48:50 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-66a4c7ba-c236-4e98-a6c9-172ef8047faf tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 03:48:50 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 03:48:50 user nova-compute[103546]:   <source dev="/dev/sdl"/>
Nov 16 03:48:50 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 03:48:50 user nova-compute[103546]:   <serial>c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b</serial>
Nov 16 03:48:50 user nova-compute[103546]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 16 03:48:50 user nova-compute[103546]: </disk>
Nov 16 03:48:50 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 03:48:50 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-66a4c7ba-c236-4e98-a6c9-172ef8047faf tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 549ee3db-0014-440f-bd3a-0d389f5eab88 {{(pid=103546) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 03:48:51 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] Acquiring lock "c24a386f-32f5-4095-b2b3-69a70a54ff66" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:48:51 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] Lock "c24a386f-32f5-4095-b2b3-69a70a54ff66" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:48:51 user nova-compute[103546]: DEBUG os_brick.utils [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:48:51 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:51 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:51 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[54aae761-f4ee-481f-b111-2a6ca0e98c6c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af5c39b14ece\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:51 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:51 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:51 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51f663c-ecf0-46e1-ad7a-74b87d37625a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:51 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:51 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:51 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[908be5ad-faf6-49c8-9170-edd6bda49043]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:51 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c451340-d31a-4732-8454-aadb45dab9fb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:51 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] Running cmd (subprocess): nvme version {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:51 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] 'nvme version' failed. Not Retrying. {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:48:51 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] nvme not present on system {{(pid=103546) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 03:48:51 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:51 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:48:51 user nova-compute[103546]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 03:48:51 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d8d16f-5c23-4069-94f4-a1c88fbf909f]: (4, '') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:51 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=103546) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 03:48:51 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 03:48:51 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] LIGHTOS: no hostnqn found. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 03:48:51 user nova-compute[103546]: DEBUG os_brick.utils [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af5c39b14ece', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:48:51 user nova-compute[103546]: INFO nova.compute.manager [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Swapping volume 164d9730-8eb2-44f5-aa18-2966bb91b153 for 34b3df15-2d1d-4474-839a-465db0816beb
Nov 16 03:48:52 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3090571b-d51e-48a4-a5b6-634eff4b870a tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 03:48:52 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3090571b-d51e-48a4-a5b6-634eff4b870a tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LnFNGqtD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:48:52 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-3090571b-d51e-48a4-a5b6-634eff4b870a tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:48:52 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-3090571b-d51e-48a4-a5b6-634eff4b870a tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:48:52 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-3090571b-d51e-48a4-a5b6-634eff4b870a tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:48:52 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-3090571b-d51e-48a4-a5b6-634eff4b870a tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:48:52 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-3090571b-d51e-48a4-a5b6-634eff4b870a tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:48:52 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-3090571b-d51e-48a4-a5b6-634eff4b870a tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:48:52 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-3090571b-d51e-48a4-a5b6-634eff4b870a tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 03:48:52 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:52 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:52 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b1f603-5034-42f8-af39-ac23d3c06bc3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:52 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3090571b-d51e-48a4-a5b6-634eff4b870a tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 03:48:52 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:48:52 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f -p 172.16.0.220:3260 --interface default --op new {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:52 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:52 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[2951b1c7-466b-49c4-bc1f-2d3df8330cab]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f] added\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:52 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3090571b-d51e-48a4-a5b6-634eff4b870a tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f] added
Nov 16 03:48:52 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:48:52 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:52 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:52 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d16ad1c-66ea-4e35-a658-1fb441ea2e8c]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:52 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3090571b-d51e-48a4-a5b6-634eff4b870a tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:48:52 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:52 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:52 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc877a2d-9b34-4536-a58a-b745ea74b666]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:52 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3090571b-d51e-48a4-a5b6-634eff4b870a tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:48:52 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LnFNGqtD {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:52 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LnFNGqtD" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:52 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce3da2c-cdce-4415-86a0-1323e812f312]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:52 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3090571b-d51e-48a4-a5b6-634eff4b870a tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LnFNGqtD'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:48:52 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:52 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:52 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91c4b1f-11aa-401c-abfd-000da37fbc9c]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:52 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3090571b-d51e-48a4-a5b6-634eff4b870a tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:48:52 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:52 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:52 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[29083cb4-7be8-467c-a97e-e1faa07b63d6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:52 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3090571b-d51e-48a4-a5b6-634eff4b870a tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a (non-flash)
Nov 16 03:48:52 user nova-compute[103546]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153 (non-flash)
Nov 16 03:48:52 user nova-compute[103546]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b (non-flash)
Nov 16 03:48:52 user nova-compute[103546]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:48:52 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:48:52 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:48:52 user nova-compute[103546]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)
Nov 16 03:48:52 user nova-compute[103546]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)
Nov 16 03:48:52 user nova-compute[103546]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)
Nov 16 03:48:52 user nova-compute[103546]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4 (non-flash)
Nov 16 03:48:52 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:48:52 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3090571b-d51e-48a4-a5b6-634eff4b870a tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a (non-flash)
Nov 16 03:48:52 user nova-compute[103546]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153 (non-flash)
Nov 16 03:48:52 user nova-compute[103546]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b (non-flash)
Nov 16 03:48:52 user nova-compute[103546]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:48:52 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:48:52 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:48:52 user nova-compute[103546]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)
Nov 16 03:48:52 user nova-compute[103546]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)
Nov 16 03:48:52 user nova-compute[103546]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)
Nov 16 03:48:52 user nova-compute[103546]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4 (non-flash)
Nov 16 03:48:52 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:48:52 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f -p 172.16.0.220:3260 --login {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:52 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:52 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[497ca7da-94e6-472a-9f86-f5669cf7deed]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:52 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3090571b-d51e-48a4-a5b6-634eff4b870a tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f, portal: 172.16.0.220,3260]
Nov 16 03:48:52 user nova-compute[103546]: Login to [iface: default, target: iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f, portal: 172.16.0.220,3260] successful.
Nov 16 03:48:52 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:48:52 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:52 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:52 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf19d7d4-49e7-4cf8-ba88-062065e4e06c]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:52 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3090571b-d51e-48a4-a5b6-634eff4b870a tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:48:52 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:52 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:52 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b4be54-5798-4ec9-91e3-cd2334800e8d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:52 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3090571b-d51e-48a4-a5b6-634eff4b870a tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a (non-flash)
Nov 16 03:48:52 user nova-compute[103546]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153 (non-flash)
Nov 16 03:48:52 user nova-compute[103546]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b (non-flash)
Nov 16 03:48:52 user nova-compute[103546]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f (non-flash)
Nov 16 03:48:52 user nova-compute[103546]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:48:52 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:48:52 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:48:52 user nova-compute[103546]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)
Nov 16 03:48:52 user nova-compute[103546]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)
Nov 16 03:48:52 user nova-compute[103546]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)
Nov 16 03:48:52 user nova-compute[103546]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4 (non-flash)
Nov 16 03:48:52 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:48:52 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3090571b-d51e-48a4-a5b6-634eff4b870a tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a (non-flash)
Nov 16 03:48:52 user nova-compute[103546]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153 (non-flash)
Nov 16 03:48:52 user nova-compute[103546]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b (non-flash)
Nov 16 03:48:52 user nova-compute[103546]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f (non-flash)
Nov 16 03:48:52 user nova-compute[103546]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:48:52 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:48:52 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:48:52 user nova-compute[103546]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)
Nov 16 03:48:52 user nova-compute[103546]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)
Nov 16 03:48:52 user nova-compute[103546]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)
Nov 16 03:48:52 user nova-compute[103546]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4 (non-flash)
Nov 16 03:48:52 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:48:52 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-3090571b-d51e-48a4-a5b6-634eff4b870a tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:48:52 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3090571b-d51e-48a4-a5b6-634eff4b870a tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 03:48:52 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-3090571b-d51e-48a4-a5b6-634eff4b870a tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] HCTL ('39', '-', '-', 0) found on session 13 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 03:48:52 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-3090571b-d51e-48a4-a5b6-634eff4b870a tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 03:48:52 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:52 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:52 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[726a2c0f-80d9-4b7d-a484-845976f30b3d]: (4, ('- - 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:52 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-3090571b-d51e-48a4-a5b6-634eff4b870a tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] Searching for a device in session 13 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 03:48:52 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3090571b-d51e-48a4-a5b6-634eff4b870a tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LnFNGqtD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 03:48:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:48:53 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-3090571b-d51e-48a4-a5b6-634eff4b870a tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:48:53 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3090571b-d51e-48a4-a5b6-634eff4b870a tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '23365373031363035', 'path': '/dev/sdh'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:48:53 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3090571b-d51e-48a4-a5b6-634eff4b870a tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365373031363035', 'path': '/dev/sdh'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 03:48:53 user nova-compute[103546]: DEBUG nova.objects.instance [None req-3090571b-d51e-48a4-a5b6-634eff4b870a tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] Lazy-loading 'flavor' on Instance uuid ad9b2edb-15d7-4937-9461-15ce61f508a7 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:48:53 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-3090571b-d51e-48a4-a5b6-634eff4b870a tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] attach device xml: <disk type="block" device="disk">
Nov 16 03:48:53 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 03:48:53 user nova-compute[103546]:   <source dev="/dev/sdh"/>
Nov 16 03:48:53 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 03:48:53 user nova-compute[103546]:   <serial>1341a8ab-40aa-45e3-9a5d-068116f08b3f</serial>
Nov 16 03:48:53 user nova-compute[103546]: </disk>
Nov 16 03:48:53 user nova-compute[103546]:  {{(pid=103546) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 03:48:54 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-3090571b-d51e-48a4-a5b6-634eff4b870a tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:48:54 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-3090571b-d51e-48a4-a5b6-634eff4b870a tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:48:54 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-3090571b-d51e-48a4-a5b6-634eff4b870a tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] No VIF found with MAC fa:16:3e:2f:63:83, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 03:48:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-3090571b-d51e-48a4-a5b6-634eff4b870a tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] Lock "ad9b2edb-15d7-4937-9461-15ce61f508a7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.354s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:48:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:48:54 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-946e9714-ae15-48ad-8753-94aba921ea01 tempest-VolumesAssistedSnapshotsTest-764589554 tempest-VolumesAssistedSnapshotsTest-764589554-project] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] volume_snapshot_create: create_info: {'snapshot_id': 'f12fa44d-7fd7-493a-a3d6-bb42c6f41105', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=103546) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 16 03:48:54 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-946e9714-ae15-48ad-8753-94aba921ea01 tempest-VolumesAssistedSnapshotsTest-764589554 tempest-VolumesAssistedSnapshotsTest-764589554-project] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] snap xml: <domainsnapshot>
Nov 16 03:48:54 user nova-compute[103546]:   <disks>
Nov 16 03:48:54 user nova-compute[103546]:     <disk name="/dev/sdh" snapshot="external" type="file">
Nov 16 03:48:54 user nova-compute[103546]:       <source file="/dev/new_file"/>
Nov 16 03:48:54 user nova-compute[103546]:     </disk>
Nov 16 03:48:54 user nova-compute[103546]:     <disk name="vda" snapshot="no"/>
Nov 16 03:48:54 user nova-compute[103546]:   </disks>
Nov 16 03:48:54 user nova-compute[103546]: </domainsnapshot>
Nov 16 03:48:54 user nova-compute[103546]:  {{(pid=103546) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 16 03:48:54 user nova-compute[103546]: DEBUG nova.objects.instance [None req-946e9714-ae15-48ad-8753-94aba921ea01 tempest-VolumesAssistedSnapshotsTest-764589554 tempest-VolumesAssistedSnapshotsTest-764589554-project] Lazy-loading 'system_metadata' on Instance uuid ad9b2edb-15d7-4937-9461-15ce61f508a7 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:48:54 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-946e9714-ae15-48ad-8753-94aba921ea01 tempest-VolumesAssistedSnapshotsTest-764589554 tempest-VolumesAssistedSnapshotsTest-764589554-project] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver [None req-946e9714-ae15-48ad-8753-94aba921ea01 tempest-VolumesAssistedSnapshotsTest-764589554 tempest-VolumesAssistedSnapshotsTest-764589554-project] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Traceback (most recent call last):
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7]     rv = execute(f, *args, **kwargs)
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7]     six.reraise(c, e, tb)
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7]     raise value
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7]     rv = meth(*args, **kwargs)
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] 
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver [None req-946e9714-ae15-48ad-8753-94aba921ea01 tempest-VolumesAssistedSnapshotsTest-764589554 tempest-VolumesAssistedSnapshotsTest-764589554-project] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Traceback (most recent call last):
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7]     self._volume_snapshot_create(context, instance, guest,
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7]     rv = execute(f, *args, **kwargs)
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7]     six.reraise(c, e, tb)
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7]     raise value
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7]     rv = meth(*args, **kwargs)
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] 
Nov 16 03:48:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1afbba65-c4c3-495a-b0b0-2b79bf945dd4 tempest-VolumesAssistedSnapshotsTest-764589554 tempest-VolumesAssistedSnapshotsTest-764589554-project] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] volume_snapshot_delete: delete_info: {'volume_id': '1341a8ab-40aa-45e3-9a5d-068116f08b3f'} {{(pid=103546) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver [None req-1afbba65-c4c3-495a-b0b0-2b79bf945dd4 tempest-VolumesAssistedSnapshotsTest-764589554 tempest-VolumesAssistedSnapshotsTest-764589554-project] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Traceback (most recent call last):
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7]     if delete_info['type'] != 'qcow2':
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] KeyError: 'type'
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] 
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver [None req-946e9714-ae15-48ad-8753-94aba921ea01 tempest-VolumesAssistedSnapshotsTest-764589554 tempest-VolumesAssistedSnapshotsTest-764589554-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot f12fa44d-7fd7-493a-a3d6-bb42c6f41105 could not be found.
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver     raise value
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver 
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver 
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot f12fa44d-7fd7-493a-a3d6-bb42c6f41105 could not be found. (HTTP 404) (Request-ID: req-1dfdbcbf-4320-4d0a-9eb5-847a0a732d54)
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver 
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver 
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot f12fa44d-7fd7-493a-a3d6-bb42c6f41105 could not be found.
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver 
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver [None req-1afbba65-c4c3-495a-b0b0-2b79bf945dd4 tempest-VolumesAssistedSnapshotsTest-764589554 tempest-VolumesAssistedSnapshotsTest-764589554-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver 
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver 
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-8d01a40b-1e18-4f17-b159-e0d379041950)
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver 
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver 
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 16 03:48:55 user nova-compute[103546]: ERROR nova.virt.libvirt.driver 
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server [None req-946e9714-ae15-48ad-8753-94aba921ea01 tempest-VolumesAssistedSnapshotsTest-764589554 tempest-VolumesAssistedSnapshotsTest-764589554-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server     raise value
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server 
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server [None req-1afbba65-c4c3-495a-b0b0-2b79bf945dd4 tempest-VolumesAssistedSnapshotsTest-764589554 tempest-VolumesAssistedSnapshotsTest-764589554-project] Exception during message handling: KeyError: 'type'
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 16 03:48:55 user nova-compute[103546]: ERROR oslo_messaging.rpc.server 
Nov 16 03:48:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b1e23816-54a4-444b-bd9c-fa1d9fe77826 tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] Acquiring lock "ad9b2edb-15d7-4937-9461-15ce61f508a7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:48:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b1e23816-54a4-444b-bd9c-fa1d9fe77826 tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] Lock "ad9b2edb-15d7-4937-9461-15ce61f508a7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:48:55 user nova-compute[103546]: INFO nova.compute.manager [None req-b1e23816-54a4-444b-bd9c-fa1d9fe77826 tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Detaching volume 1341a8ab-40aa-45e3-9a5d-068116f08b3f
Nov 16 03:48:55 user nova-compute[103546]: INFO nova.virt.block_device [None req-b1e23816-54a4-444b-bd9c-fa1d9fe77826 tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Attempting to driver detach volume 1341a8ab-40aa-45e3-9a5d-068116f08b3f from mountpoint /dev/vdb
Nov 16 03:48:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-b1e23816-54a4-444b-bd9c-fa1d9fe77826 tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] Attempting to detach device vdb from instance ad9b2edb-15d7-4937-9461-15ce61f508a7 from the persistent domain config. {{(pid=103546) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 03:48:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-b1e23816-54a4-444b-bd9c-fa1d9fe77826 tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] detach device xml: <disk type="block" device="disk">
Nov 16 03:48:55 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 03:48:55 user nova-compute[103546]:   <source dev="/dev/sdh"/>
Nov 16 03:48:55 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 03:48:55 user nova-compute[103546]:   <serial>1341a8ab-40aa-45e3-9a5d-068116f08b3f</serial>
Nov 16 03:48:55 user nova-compute[103546]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 03:48:55 user nova-compute[103546]: </disk>
Nov 16 03:48:55 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 03:48:55 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-b1e23816-54a4-444b-bd9c-fa1d9fe77826 tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] Successfully detached device vdb from instance ad9b2edb-15d7-4937-9461-15ce61f508a7 from the persistent domain config.
Nov 16 03:48:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-b1e23816-54a4-444b-bd9c-fa1d9fe77826 tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ad9b2edb-15d7-4937-9461-15ce61f508a7 from the live domain config. {{(pid=103546) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 03:48:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-b1e23816-54a4-444b-bd9c-fa1d9fe77826 tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] detach device xml: <disk type="block" device="disk">
Nov 16 03:48:55 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 03:48:55 user nova-compute[103546]:   <source dev="/dev/sdh"/>
Nov 16 03:48:55 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 03:48:55 user nova-compute[103546]:   <serial>1341a8ab-40aa-45e3-9a5d-068116f08b3f</serial>
Nov 16 03:48:55 user nova-compute[103546]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 03:48:55 user nova-compute[103546]: </disk>
Nov 16 03:48:55 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 03:48:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-b1e23816-54a4-444b-bd9c-fa1d9fe77826 tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ad9b2edb-15d7-4937-9461-15ce61f508a7 {{(pid=103546) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 03:48:56 user nova-compute[103546]: DEBUG nova.compute.manager [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DfTzSXUe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c24a386f-32f5-4095-b2b3-69a70a54ff66', 'attached_at': '', 'detached_at': '', 'volume_id': '34b3df15-2d1d-4474-839a-465db0816beb', 'serial': '34b3df15-2d1d-4474-839a-465db0816beb'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AXhBDQeb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'volume_id': '164d9730-8eb2-44f5-aa18-2966bb91b153'}, 'status': 'reserved', 'instance': 'c24a386f-32f5-4095-b2b3-69a70a54ff66', 'attached_at': '', 'detached_at': '', 'volume_id': '164d9730-8eb2-44f5-aa18-2966bb91b153', 'serial'} {{(pid=103546) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 16 03:48:56 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 03:48:56 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DfTzSXUe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:48:56 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:48:56 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:48:56 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:48:56 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:48:56 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:48:56 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:48:56 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 03:48:56 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:56 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:56 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[80fb8531-6033-4dcb-9c2a-ecdd72e17d03]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:56 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 03:48:56 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:48:56 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb -p 172.16.0.220:3260 --interface default --op new {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:56 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:56 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9561f77-a74e-48ec-96db-059738f6fb25]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb] added\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:56 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb] added
Nov 16 03:48:56 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:48:56 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:56 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:56 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b6f381d-b73b-4cf0-8a62-03957b27180e]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:56 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:48:56 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:56 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:56 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[db968cd5-6f0d-469a-97f6-7e57ba1b4a1a]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:56 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:48:56 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DfTzSXUe {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:56 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DfTzSXUe" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:56 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7b13b4-b3c3-46b7-b5bd-ad1db09819a2]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:56 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DfTzSXUe'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:48:56 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:56 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:56 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3095b7f2-21d7-4a14-be38-8ceb83a21d9e]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:56 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:48:56 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:57 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:57 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[165244b2-c0fa-4660-ab11-33eb7cc01bd2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:57 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a (non-flash)
Nov 16 03:48:57 user nova-compute[103546]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153 (non-flash)
Nov 16 03:48:57 user nova-compute[103546]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b (non-flash)
Nov 16 03:48:57 user nova-compute[103546]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f (non-flash)
Nov 16 03:48:57 user nova-compute[103546]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:48:57 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:48:57 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:48:57 user nova-compute[103546]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)
Nov 16 03:48:57 user nova-compute[103546]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)
Nov 16 03:48:57 user nova-compute[103546]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)
Nov 16 03:48:57 user nova-compute[103546]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4 (non-flash)
Nov 16 03:48:57 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:48:57 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a (non-flash)
Nov 16 03:48:57 user nova-compute[103546]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153 (non-flash)
Nov 16 03:48:57 user nova-compute[103546]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b (non-flash)
Nov 16 03:48:57 user nova-compute[103546]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f (non-flash)
Nov 16 03:48:57 user nova-compute[103546]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:48:57 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:48:57 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:48:57 user nova-compute[103546]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)
Nov 16 03:48:57 user nova-compute[103546]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)
Nov 16 03:48:57 user nova-compute[103546]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)
Nov 16 03:48:57 user nova-compute[103546]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4 (non-flash)
Nov 16 03:48:57 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:48:57 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb -p 172.16.0.220:3260 --login {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:57 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb -p 172.16.0.220:3260 --login" returned: 0 in 0.110s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:57 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f4a3ee-d381-448e-8d23-314c1c79de2c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:57 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb, portal: 172.16.0.220,3260]
Nov 16 03:48:57 user nova-compute[103546]: Login to [iface: default, target: iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb, portal: 172.16.0.220,3260] successful.
Nov 16 03:48:57 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:48:57 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:57 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:57 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e54948-9a3c-428c-b269-1ecd49064720]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:57 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:48:57 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:57 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:57 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee78d98-51a3-4285-b9dd-55c96c04d074]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:57 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a (non-flash)
Nov 16 03:48:57 user nova-compute[103546]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153 (non-flash)
Nov 16 03:48:57 user nova-compute[103546]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b (non-flash)
Nov 16 03:48:57 user nova-compute[103546]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f (non-flash)
Nov 16 03:48:57 user nova-compute[103546]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)
Nov 16 03:48:57 user nova-compute[103546]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:48:57 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:48:57 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:48:57 user nova-compute[103546]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)
Nov 16 03:48:57 user nova-compute[103546]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)
Nov 16 03:48:57 user nova-compute[103546]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)
Nov 16 03:48:57 user nova-compute[103546]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4 (non-flash)
Nov 16 03:48:57 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:48:57 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a (non-flash)
Nov 16 03:48:57 user nova-compute[103546]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153 (non-flash)
Nov 16 03:48:57 user nova-compute[103546]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b (non-flash)
Nov 16 03:48:57 user nova-compute[103546]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f (non-flash)
Nov 16 03:48:57 user nova-compute[103546]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)
Nov 16 03:48:57 user nova-compute[103546]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:48:57 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:48:57 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:48:57 user nova-compute[103546]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)
Nov 16 03:48:57 user nova-compute[103546]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)
Nov 16 03:48:57 user nova-compute[103546]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)
Nov 16 03:48:57 user nova-compute[103546]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4 (non-flash)
Nov 16 03:48:57 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:48:57 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.373s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:48:57 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 03:48:57 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] HCTL ('44', '-', '-', 0) found on session 14 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 03:48:57 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] Scanning host 44 c: -, t: -, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 03:48:57 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host44/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:48:57 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host44/scan" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:48:57 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[51bb73b7-b3b5-476c-a9d5-c5ac446e4b2d]: (4, ('- - 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:48:57 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] Searching for a device in session 14 and hctl ['44', '*', '*', 0] yield: sdm {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 03:48:57 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] Connected to sdm using {'target_iqn': 'iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DfTzSXUe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 03:48:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:48:58 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.409s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:48:58 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] <== connect_volume: return (1411ms) {'type': 'block', 'scsi_wwn': '26335383139323861', 'path': '/dev/sdm'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:48:58 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335383139323861', 'path': '/dev/sdm'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 03:48:58 user nova-compute[103546]: DEBUG nova.objects.instance [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] Lazy-loading 'flavor' on Instance uuid c24a386f-32f5-4095-b2b3-69a70a54ff66 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:48:58 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=103546) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 03:48:59 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] COPY block job progress, current cursor: 139460608 final cursor: 1073741824 {{(pid=103546) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 03:48:59 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:48:59 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] COPY block job progress, current cursor: 272629760 final cursor: 1073741824 {{(pid=103546) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 03:49:00 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] COPY block job progress, current cursor: 456130560 final cursor: 1073741824 {{(pid=103546) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 03:49:00 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-94a8271a-e222-44bf-8f17-da2961d197e3 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 05c929d5-2f1c-4be4-8864-6ec81625daac is timed out.
Nov 16 03:49:00 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-94a8271a-e222-44bf-8f17-da2961d197e3 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Successfully detached device vdb from instance 05c929d5-2f1c-4be4-8864-6ec81625daac from the live domain config.
Nov 16 03:49:00 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94a8271a-e222-44bf-8f17-da2961d197e3 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 03:49:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a8271a-e222-44bf-8f17-da2961d197e3 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yYEefaIU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:49:00 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-94a8271a-e222-44bf-8f17-da2961d197e3 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:49:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-94a8271a-e222-44bf-8f17-da2961d197e3 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:49:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-94a8271a-e222-44bf-8f17-da2961d197e3 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:49:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:00 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[7307c8b8-7524-423c-b182-897078135f7d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a8271a-e222-44bf-8f17-da2961d197e3 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 03:49:00 user nova-compute[103546]: No targets found.
Nov 16 03:49:00 user nova-compute[103546]: iSNS:
Nov 16 03:49:00 user nova-compute[103546]: No targets found.
Nov 16 03:49:00 user nova-compute[103546]: STATIC:
Nov 16 03:49:00 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4
Nov 16 03:49:00 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:00 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:00 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7
Nov 16 03:49:00 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:00 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:00 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f
Nov 16 03:49:00 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:00 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:00 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b
Nov 16 03:49:00 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:00 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:00 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a
Nov 16 03:49:00 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:00 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:00 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb
Nov 16 03:49:00 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:00 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:00 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153
Nov 16 03:49:00 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:00 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:00 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41
Nov 16 03:49:00 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:00 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:00 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57
Nov 16 03:49:00 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:00 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:00 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b
Nov 16 03:49:00 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:00 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:00 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75
Nov 16 03:49:00 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:00 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:00 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865
Nov 16 03:49:00 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:00 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:00 user nova-compute[103546]: FIRMWARE:
Nov 16 03:49:00 user nova-compute[103546]: No targets found.
Nov 16 03:49:00 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:49:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a8271a-e222-44bf-8f17-da2961d197e3 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 03:49:00 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 03:49:00 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 03:49:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a8271a-e222-44bf-8f17-da2961d197e3 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 03:49:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:00 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[68881a3e-6fb4-4a27-8954-d3384c49b5ff]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.054s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:00 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[912a94b0-ca05-4a33-a132-c3d1018a1338]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a8271a-e222-44bf-8f17-da2961d197e3 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a (non-flash)
Nov 16 03:49:00 user nova-compute[103546]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153 (non-flash)
Nov 16 03:49:00 user nova-compute[103546]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b (non-flash)
Nov 16 03:49:00 user nova-compute[103546]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f (non-flash)
Nov 16 03:49:00 user nova-compute[103546]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)
Nov 16 03:49:00 user nova-compute[103546]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:49:00 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:49:00 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:49:00 user nova-compute[103546]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)
Nov 16 03:49:00 user nova-compute[103546]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)
Nov 16 03:49:00 user nova-compute[103546]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)
Nov 16 03:49:00 user nova-compute[103546]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4 (non-flash)
Nov 16 03:49:00 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:49:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a8271a-e222-44bf-8f17-da2961d197e3 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a (non-flash)
Nov 16 03:49:00 user nova-compute[103546]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153 (non-flash)
Nov 16 03:49:00 user nova-compute[103546]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b (non-flash)
Nov 16 03:49:00 user nova-compute[103546]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f (non-flash)
Nov 16 03:49:00 user nova-compute[103546]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)
Nov 16 03:49:00 user nova-compute[103546]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:49:00 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:49:00 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:49:00 user nova-compute[103546]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)
Nov 16 03:49:00 user nova-compute[103546]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)
Nov 16 03:49:00 user nova-compute[103546]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)
Nov 16 03:49:00 user nova-compute[103546]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4 (non-flash)
Nov 16 03:49:00 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:49:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a8271a-e222-44bf-8f17-da2961d197e3 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60ac54ecb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4'): ({'sdi'}, set())}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 03:49:00 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-94a8271a-e222-44bf-8f17-da2961d197e3 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Removing single pathed devices sdi {{(pid=103546) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 03:49:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:00 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b5f4b1-96cf-488b-b5a9-ba65c2b76077]: (4, ('path checker states:\nup                  11\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.025s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:00 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51ee33f-a8b5-4da8-ae25-1eec88617c25]: (4, ('ok\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:00 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-94a8271a-e222-44bf-8f17-da2961d197e3 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Flushing IO for device /dev/sdi {{(pid=103546) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 03:49:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.015s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:00 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e5493d-e5e2-49b1-8ba3-a3fad3bf6839]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:00 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-94a8271a-e222-44bf-8f17-da2961d197e3 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=103546) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 03:49:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.042s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:00 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d138db-375b-4a19-891b-1f3c280499a4]: (4, ('1', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:00 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-94a8271a-e222-44bf-8f17-da2961d197e3 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 03:49:00 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-94a8271a-e222-44bf-8f17-da2961d197e3 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] SCSI volumes sdi have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 03:49:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a8271a-e222-44bf-8f17-da2961d197e3 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4')] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 03:49:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:00 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[6213dd07-98d9-42b3-a013-ec257af2df84]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a8271a-e222-44bf-8f17-da2961d197e3 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:49:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4 -p 172.16.0.220:3260 --logout {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.093s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:00 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a638cc-7084-4763-ba4b-a562a6809227]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a8271a-e222-44bf-8f17-da2961d197e3 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4, portal: 172.16.0.220,3260]
Nov 16 03:49:00 user nova-compute[103546]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4, portal: 172.16.0.220,3260] successful.
Nov 16 03:49:00 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:49:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4 -p 172.16.0.220:3260 --op delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:289d7bf6-d933-4c8c-8601-9b6dd76de7c4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.048s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:00 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d3bdd9-48ae-45b9-ac7b-87f6cb53bbab]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a8271a-e222-44bf-8f17-da2961d197e3 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:49:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-94a8271a-e222-44bf-8f17-da2961d197e3 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.435s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:49:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a8271a-e222-44bf-8f17-da2961d197e3 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] <== disconnect_volume: return (437ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:49:00 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94a8271a-e222-44bf-8f17-da2961d197e3 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 03:49:00 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] COPY block job progress, current cursor: 637534208 final cursor: 1073741824 {{(pid=103546) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 03:49:01 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] COPY block job progress, current cursor: 784334848 final cursor: 1073741824 {{(pid=103546) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 03:49:01 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] COPY block job progress, current cursor: 903872512 final cursor: 1073741824 {{(pid=103546) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 03:49:01 user nova-compute[103546]: DEBUG nova.objects.instance [None req-94a8271a-e222-44bf-8f17-da2961d197e3 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Lazy-loading 'flavor' on Instance uuid 05c929d5-2f1c-4be4-8864-6ec81625daac {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:49:01 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-94a8271a-e222-44bf-8f17-da2961d197e3 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Lock "05c929d5-2f1c-4be4-8864-6ec81625daac" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.499s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:02 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] COPY block job progress, current cursor: 1064304640 final cursor: 1073741824 {{(pid=103546) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 03:49:02 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=103546) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 03:49:02 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:02 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 03:49:02 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AXhBDQeb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'volume_id': '164d9730-8eb2-44f5-aa18-2966bb91b153'}, None), 'kwargs': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:49:02 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:49:02 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:49:02 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:49:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:02 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2fc8d03-f05a-4a53-bc7a-e1c4ea16bae4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:02 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 03:49:02 user nova-compute[103546]: No targets found.
Nov 16 03:49:02 user nova-compute[103546]: iSNS:
Nov 16 03:49:02 user nova-compute[103546]: No targets found.
Nov 16 03:49:02 user nova-compute[103546]: STATIC:
Nov 16 03:49:02 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7
Nov 16 03:49:02 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:02 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:02 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f
Nov 16 03:49:02 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:02 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:02 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b
Nov 16 03:49:02 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:02 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:02 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a
Nov 16 03:49:02 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:02 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:02 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb
Nov 16 03:49:02 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:02 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:02 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153
Nov 16 03:49:02 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:02 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:02 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41
Nov 16 03:49:02 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:02 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:02 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57
Nov 16 03:49:02 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:02 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:02 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b
Nov 16 03:49:02 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:02 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:02 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75
Nov 16 03:49:02 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:02 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:02 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865
Nov 16 03:49:02 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:02 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:02 user nova-compute[103546]: FIRMWARE:
Nov 16 03:49:02 user nova-compute[103546]: No targets found.
Nov 16 03:49:02 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:49:02 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 03:49:02 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 03:49:02 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 03:49:02 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 03:49:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:02 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[962ad20f-fc7c-4f09-ac47-0364ed0d19d0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:02 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff71028-1115-4093-a158-dc3ffff28393]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:02 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a (non-flash)
Nov 16 03:49:02 user nova-compute[103546]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153 (non-flash)
Nov 16 03:49:02 user nova-compute[103546]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b (non-flash)
Nov 16 03:49:02 user nova-compute[103546]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f (non-flash)
Nov 16 03:49:02 user nova-compute[103546]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)
Nov 16 03:49:02 user nova-compute[103546]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:49:02 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:49:02 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:49:02 user nova-compute[103546]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)
Nov 16 03:49:02 user nova-compute[103546]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)
Nov 16 03:49:02 user nova-compute[103546]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)
Nov 16 03:49:02 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:49:02 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a (non-flash)
Nov 16 03:49:02 user nova-compute[103546]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153 (non-flash)
Nov 16 03:49:02 user nova-compute[103546]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b (non-flash)
Nov 16 03:49:02 user nova-compute[103546]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f (non-flash)
Nov 16 03:49:02 user nova-compute[103546]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)
Nov 16 03:49:02 user nova-compute[103546]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:49:02 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:49:02 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:49:02 user nova-compute[103546]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)
Nov 16 03:49:02 user nova-compute[103546]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)
Nov 16 03:49:02 user nova-compute[103546]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)
Nov 16 03:49:02 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:49:02 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60ac54ee60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153'): ({'sdk'}, set())}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 03:49:02 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] Removing single pathed devices sdk {{(pid=103546) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 03:49:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:02 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f016c1-40f8-4136-b70b-e3e046c04431]: (4, ('path checker states:\nup                  10\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:02 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[268bd7b6-503c-4eeb-b110-e87e029280b1]: (4, ('ok\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:02 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] Flushing IO for device /dev/sdk {{(pid=103546) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 03:49:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.012s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:02 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[4911c3bf-66de-48bb-bf9e-70eb2d57140e]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:02 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=103546) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 03:49:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.038s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:02 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb8a84c-7023-4c9a-9128-c9d75700cb90]: (4, ('1', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:02 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] Checking to see if SCSI volumes sdk have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 03:49:02 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] SCSI volumes sdk have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 03:49:02 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153')] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 03:49:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:03 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b6a3b8-22d7-4868-8334-bf443dc79ad7]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:49:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153 -p 172.16.0.220:3260 --logout {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:03 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffcd5558-b72b-46f3-80ac-94d506ac113b]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153, portal: 172.16.0.220,3260]
Nov 16 03:49:03 user nova-compute[103546]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153, portal: 172.16.0.220,3260] successful.
Nov 16 03:49:03 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:49:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153 -p 172.16.0.220:3260 --op delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:164d9730-8eb2-44f5-aa18-2966bb91b153 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:03 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a4b658-ee0f-4393-834c-4ead82956e41]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:49:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:49:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] <== disconnect_volume: return (358ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:49:03 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 03:49:03 user nova-compute[103546]: DEBUG nova.compute.manager [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DfTzSXUe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdm'}, 'status': 'reserved', 'instance': 'c24a386f-32f5-4095-b2b3-69a70a54ff66', 'attached_at': '', 'detached_at': '', 'volume_id': '34b3df15-2d1d-4474-839a-465db0816beb', 'serial'} {{(pid=103546) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 16 03:49:03 user nova-compute[103546]: DEBUG nova.compute.manager [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] swap_volume: removing Cinder connection for volume 164d9730-8eb2-44f5-aa18-2966bb91b153 {{(pid=103546) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 16 03:49:03 user nova-compute[103546]: DEBUG nova.compute.manager [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] swap_volume: Updating volume 164d9730-8eb2-44f5-aa18-2966bb91b153 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "DfTzSXUe", "auth_password": "cEiFOjSMphUfk2", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdm", "volume_id": "34b3df15-2d1d-4474-839a-465db0816beb"}, "status": "reserved", "instance": "c24a386f-32f5-4095-b2b3-69a70a54ff66", "attached_at": "", "detached_at": "", "volume_id": "34b3df15-2d1d-4474-839a-465db0816beb", "serial": "34b3df15-2d1d-4474-839a-465db0816beb"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '34b3df15-2d1d-4474-839a-465db0816beb', 'no_device': None, 'attachment_id': '6ac5d5fe-0127-40dc-8e63-23a93eed6bb1'} {{(pid=103546) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 16 03:49:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f39cb5ca-44fd-42e3-9d13-c38805b69c35 tempest-TestVolumeSwap-1685981710 tempest-TestVolumeSwap-1685981710-project-admin] Lock "c24a386f-32f5-4095-b2b3-69a70a54ff66" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 12.794s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:04 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4cfb7277-9b35-417b-9fca-341a0068096c tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Acquiring lock "c24a386f-32f5-4095-b2b3-69a70a54ff66" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:04 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4cfb7277-9b35-417b-9fca-341a0068096c tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Lock "c24a386f-32f5-4095-b2b3-69a70a54ff66" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:04 user nova-compute[103546]: INFO nova.compute.manager [None req-4cfb7277-9b35-417b-9fca-341a0068096c tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Detaching volume 34b3df15-2d1d-4474-839a-465db0816beb
Nov 16 03:49:04 user nova-compute[103546]: INFO nova.virt.block_device [None req-4cfb7277-9b35-417b-9fca-341a0068096c tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Attempting to driver detach volume 34b3df15-2d1d-4474-839a-465db0816beb from mountpoint /dev/vdb
Nov 16 03:49:04 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-4cfb7277-9b35-417b-9fca-341a0068096c tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Attempting to detach device vdb from instance c24a386f-32f5-4095-b2b3-69a70a54ff66 from the persistent domain config. {{(pid=103546) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 03:49:04 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-4cfb7277-9b35-417b-9fca-341a0068096c tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 03:49:04 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 03:49:04 user nova-compute[103546]:   <source dev="/dev/sdm"/>
Nov 16 03:49:04 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 03:49:04 user nova-compute[103546]:   <serial>34b3df15-2d1d-4474-839a-465db0816beb</serial>
Nov 16 03:49:04 user nova-compute[103546]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 03:49:04 user nova-compute[103546]: </disk>
Nov 16 03:49:04 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 03:49:04 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-4cfb7277-9b35-417b-9fca-341a0068096c tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Successfully detached device vdb from instance c24a386f-32f5-4095-b2b3-69a70a54ff66 from the persistent domain config.
Nov 16 03:49:04 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-4cfb7277-9b35-417b-9fca-341a0068096c tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c24a386f-32f5-4095-b2b3-69a70a54ff66 from the live domain config. {{(pid=103546) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 03:49:04 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-4cfb7277-9b35-417b-9fca-341a0068096c tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 03:49:04 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 03:49:04 user nova-compute[103546]:   <source dev="/dev/sdm"/>
Nov 16 03:49:04 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 03:49:04 user nova-compute[103546]:   <serial>34b3df15-2d1d-4474-839a-465db0816beb</serial>
Nov 16 03:49:04 user nova-compute[103546]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 03:49:04 user nova-compute[103546]: </disk>
Nov 16 03:49:04 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 03:49:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:04 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-22e14e8e-7501-4724-b315-3ec820585b01 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance fead4119-3ab9-4337-8b48-d3920e1112f4 is timed out.
Nov 16 03:49:04 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-22e14e8e-7501-4724-b315-3ec820585b01 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Successfully detached device sdc from instance fead4119-3ab9-4337-8b48-d3920e1112f4 from the live domain config.
Nov 16 03:49:04 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22e14e8e-7501-4724-b315-3ec820585b01 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 03:49:04 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e14e8e-7501-4724-b315-3ec820585b01 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mCDFzYxJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:49:04 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-22e14e8e-7501-4724-b315-3ec820585b01 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:49:04 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-22e14e8e-7501-4724-b315-3ec820585b01 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:49:04 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-22e14e8e-7501-4724-b315-3ec820585b01 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:49:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:04 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35b9b47-1adf-4c1a-9260-52b34abbfb59]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:04 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e14e8e-7501-4724-b315-3ec820585b01 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 03:49:04 user nova-compute[103546]: No targets found.
Nov 16 03:49:04 user nova-compute[103546]: iSNS:
Nov 16 03:49:04 user nova-compute[103546]: No targets found.
Nov 16 03:49:04 user nova-compute[103546]: STATIC:
Nov 16 03:49:04 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7
Nov 16 03:49:04 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:04 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:04 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f
Nov 16 03:49:04 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:04 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:04 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b
Nov 16 03:49:04 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:04 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:04 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a
Nov 16 03:49:04 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:04 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:04 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb
Nov 16 03:49:04 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:04 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:04 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41
Nov 16 03:49:04 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:04 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:04 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57
Nov 16 03:49:04 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:04 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:04 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b
Nov 16 03:49:04 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:04 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:04 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75
Nov 16 03:49:04 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:04 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:04 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865
Nov 16 03:49:04 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:04 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:04 user nova-compute[103546]: FIRMWARE:
Nov 16 03:49:04 user nova-compute[103546]: No targets found.
Nov 16 03:49:04 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:49:04 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e14e8e-7501-4724-b315-3ec820585b01 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 03:49:04 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 03:49:04 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 03:49:04 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e14e8e-7501-4724-b315-3ec820585b01 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 03:49:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:04 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[4237acdd-ef7a-4279-8f58-a4e327e92e37]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:04 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0008b52-b8cc-4e1b-9175-4a23086c6f62]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:04 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e14e8e-7501-4724-b315-3ec820585b01 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a (non-flash)
Nov 16 03:49:04 user nova-compute[103546]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b (non-flash)
Nov 16 03:49:04 user nova-compute[103546]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f (non-flash)
Nov 16 03:49:04 user nova-compute[103546]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)
Nov 16 03:49:04 user nova-compute[103546]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:49:04 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:49:04 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:49:04 user nova-compute[103546]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)
Nov 16 03:49:04 user nova-compute[103546]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)
Nov 16 03:49:04 user nova-compute[103546]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)
Nov 16 03:49:04 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:49:04 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e14e8e-7501-4724-b315-3ec820585b01 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a (non-flash)
Nov 16 03:49:04 user nova-compute[103546]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b (non-flash)
Nov 16 03:49:04 user nova-compute[103546]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f (non-flash)
Nov 16 03:49:04 user nova-compute[103546]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)
Nov 16 03:49:04 user nova-compute[103546]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:49:04 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:49:04 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:49:04 user nova-compute[103546]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)
Nov 16 03:49:04 user nova-compute[103546]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)
Nov 16 03:49:04 user nova-compute[103546]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)
Nov 16 03:49:04 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:49:04 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e14e8e-7501-4724-b315-3ec820585b01 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60c40ec550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a'): ({'sdj'}, set())}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 03:49:04 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-22e14e8e-7501-4724-b315-3ec820585b01 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Removing single pathed devices sdj {{(pid=103546) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 03:49:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:04 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1cdc8a1-ef4b-4b41-930c-abb9d5106798]: (4, ('path checker states:\nup                  9\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:04 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb78a89b-68b1-4af4-9c31-0e8a06de3f76]: (4, ('ok\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:04 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-22e14e8e-7501-4724-b315-3ec820585b01 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Flushing IO for device /dev/sdj {{(pid=103546) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 03:49:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.012s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:04 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[817f1469-3801-4c52-bc13-69f70b56ea7c]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:04 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-22e14e8e-7501-4724-b315-3ec820585b01 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=103546) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 03:49:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:04 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-4cfb7277-9b35-417b-9fca-341a0068096c tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c24a386f-32f5-4095-b2b3-69a70a54ff66 {{(pid=103546) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 03:49:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.041s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:04 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c85742-95e3-4e3b-b7da-a91b0f59beb2]: (4, ('1', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:04 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-22e14e8e-7501-4724-b315-3ec820585b01 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 03:49:04 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-22e14e8e-7501-4724-b315-3ec820585b01 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] SCSI volumes sdj have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 03:49:04 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e14e8e-7501-4724-b315-3ec820585b01 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a')] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 03:49:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:04 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3271bcf-96f0-423f-84e3-79a06ba39e48]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:04 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e14e8e-7501-4724-b315-3ec820585b01 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:49:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a -p 172.16.0.220:3260 --logout {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:05 user nova-compute[103546]: DEBUG nova.compute.manager [req-a10c292d-f841-4b87-bd80-25452ec9b779 req-59888bf9-9d9b-47c1-9bca-ae2b22854120 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received event network-changed-76b69715-356f-496a-85a3-f5bde976e201 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:49:05 user nova-compute[103546]: DEBUG nova.compute.manager [req-a10c292d-f841-4b87-bd80-25452ec9b779 req-59888bf9-9d9b-47c1-9bca-ae2b22854120 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Refreshing instance network info cache due to event network-changed-76b69715-356f-496a-85a3-f5bde976e201. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:49:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a10c292d-f841-4b87-bd80-25452ec9b779 req-59888bf9-9d9b-47c1-9bca-ae2b22854120 service nova] Acquiring lock "refresh_cache-71059a8d-4e89-472c-9463-b38aa8063e33" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:49:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a10c292d-f841-4b87-bd80-25452ec9b779 req-59888bf9-9d9b-47c1-9bca-ae2b22854120 service nova] Acquired lock "refresh_cache-71059a8d-4e89-472c-9463-b38aa8063e33" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:49:05 user nova-compute[103546]: DEBUG nova.network.neutron [req-a10c292d-f841-4b87-bd80-25452ec9b779 req-59888bf9-9d9b-47c1-9bca-ae2b22854120 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Refreshing network info cache for port 76b69715-356f-496a-85a3-f5bde976e201 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:49:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:05 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f51eb6-e76b-4946-a045-01c6a5bad24e]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:05 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e14e8e-7501-4724-b315-3ec820585b01 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a, portal: 172.16.0.220,3260]
Nov 16 03:49:05 user nova-compute[103546]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a, portal: 172.16.0.220,3260] successful.
Nov 16 03:49:05 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:49:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a -p 172.16.0.220:3260 --op delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67611f41-96e1-49ec-a7e0-590702437c7a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:05 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[110bcad0-3e08-4a84-b31e-7b6394aa7a29]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:05 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e14e8e-7501-4724-b315-3ec820585b01 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:49:05 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-22e14e8e-7501-4724-b315-3ec820585b01 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:49:05 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e14e8e-7501-4724-b315-3ec820585b01 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] <== disconnect_volume: return (354ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:49:05 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22e14e8e-7501-4724-b315-3ec820585b01 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 03:49:05 user nova-compute[103546]: DEBUG nova.network.neutron [req-a10c292d-f841-4b87-bd80-25452ec9b779 req-59888bf9-9d9b-47c1-9bca-ae2b22854120 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Updated VIF entry in instance network info cache for port 76b69715-356f-496a-85a3-f5bde976e201. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 03:49:05 user nova-compute[103546]: DEBUG nova.network.neutron [req-a10c292d-f841-4b87-bd80-25452ec9b779 req-59888bf9-9d9b-47c1-9bca-ae2b22854120 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Updating instance_info_cache with network_info: [{"id": "76b69715-356f-496a-85a3-f5bde976e201", "address": "fa:16:3e:72:5a:35", "network": {"id": "f84b2b6b-c73a-41d8-a9bb-3e73bb607a42", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1721792603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76b69715-35", "ovs_interfaceid": "76b69715-356f-496a-85a3-f5bde976e201", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "21653257-8a66-44f1-b806-2fae4641e1d2", "address": "fa:16:3e:91:a8:b5", "network": {"id": "4b071e67-eb71-49f5-a24f-cada83cca606", "bridge": "br-int", "label": "tempest-device-tagging-net1-1064540428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21653257-8a", "ovs_interfaceid": "21653257-8a66-44f1-b806-2fae4641e1d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "916a3fe8-09df-42a1-9ac0-b81153ed55a1", "address": "fa:16:3e:00:b7:5f", "network": {"id": "4b071e67-eb71-49f5-a24f-cada83cca606", "bridge": "br-int", "label": "tempest-device-tagging-net1-1064540428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap916a3fe8-09", "ovs_interfaceid": "916a3fe8-09df-42a1-9ac0-b81153ed55a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1fb75f05-a4ef-45d5-9eb4-5e8428997947", "address": "fa:16:3e:e6:68:04", "network": {"id": "4b071e67-eb71-49f5-a24f-cada83cca606", "bridge": "br-int", "label": "tempest-device-tagging-net1-1064540428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fb75f05-a4", "ovs_interfaceid": "1fb75f05-a4ef-45d5-9eb4-5e8428997947", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "51e087e4-ff6b-49a8-8190-cfc243436d35", "address": "fa:16:3e:3f:53:f1", "network": {"id": "4b071e67-eb71-49f5-a24f-cada83cca606", "bridge": "br-int", "label": "tempest-device-tagging-net1-1064540428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51e087e4-ff", "ovs_interfaceid": "51e087e4-ff6b-49a8-8190-cfc243436d35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b0f609b8-eb49-4c19-968c-99c95c38b857", "address": "fa:16:3e:dc:33:a5", "network": {"id": "f9af5267-5cc4-44b4-9226-2da63e754907", "bridge": "br-int", "label": "tempest-device-tagging-net2-640329577", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0f609b8-eb", "ovs_interfaceid": "b0f609b8-eb49-4c19-968c-99c95c38b857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fc03966b-fcbc-4ed7-8ffb-2270a55b4e28", "address": "fa:16:3e:75:5a:4b", "network": {"id": "f9af5267-5cc4-44b4-9226-2da63e754907", "bridge": "br-int", "label": "tempest-device-tagging-net2-640329577", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc03966b-fc", "ovs_interfaceid": "fc03966b-fcbc-4ed7-8ffb-2270a55b4e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:49:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a10c292d-f841-4b87-bd80-25452ec9b779 req-59888bf9-9d9b-47c1-9bca-ae2b22854120 service nova] Releasing lock "refresh_cache-71059a8d-4e89-472c-9463-b38aa8063e33" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:49:05 user nova-compute[103546]: DEBUG nova.objects.instance [None req-22e14e8e-7501-4724-b315-3ec820585b01 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Lazy-loading 'flavor' on Instance uuid fead4119-3ab9-4337-8b48-d3920e1112f4 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:49:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-22e14e8e-7501-4724-b315-3ec820585b01 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Lock "fead4119-3ab9-4337-8b48-d3920e1112f4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.616s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cda9451f-df87-4fd5-8ca6-1f8bc8f2e2b7 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Acquiring lock "fead4119-3ab9-4337-8b48-d3920e1112f4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cda9451f-df87-4fd5-8ca6-1f8bc8f2e2b7 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Lock "fead4119-3ab9-4337-8b48-d3920e1112f4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cda9451f-df87-4fd5-8ca6-1f8bc8f2e2b7 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Acquiring lock "fead4119-3ab9-4337-8b48-d3920e1112f4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cda9451f-df87-4fd5-8ca6-1f8bc8f2e2b7 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Lock "fead4119-3ab9-4337-8b48-d3920e1112f4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cda9451f-df87-4fd5-8ca6-1f8bc8f2e2b7 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Lock "fead4119-3ab9-4337-8b48-d3920e1112f4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:07 user nova-compute[103546]: INFO nova.compute.manager [None req-cda9451f-df87-4fd5-8ca6-1f8bc8f2e2b7 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Terminating instance
Nov 16 03:49:07 user nova-compute[103546]: DEBUG nova.compute.manager [None req-cda9451f-df87-4fd5-8ca6-1f8bc8f2e2b7 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Start destroying the instance on the hypervisor. {{(pid=103546) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 03:49:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Acquiring lock "71059a8d-4e89-472c-9463-b38aa8063e33" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Lock "71059a8d-4e89-472c-9463-b38aa8063e33" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Acquiring lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:07 user nova-compute[103546]: INFO nova.compute.manager [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Terminating instance
Nov 16 03:49:07 user nova-compute[103546]: DEBUG nova.compute.manager [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Start destroying the instance on the hypervisor. {{(pid=103546) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 03:49:07 user nova-compute[103546]: DEBUG nova.compute.manager [req-7eb0e660-b9fb-45d9-90b2-36dda0bbdb88 req-a3b43ef2-ed30-4ffd-9a83-0b15b3993de9 service nova] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Received event network-vif-unplugged-55287b83-91c5-4c47-8ec5-c0da5bc3290e {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:49:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-7eb0e660-b9fb-45d9-90b2-36dda0bbdb88 req-a3b43ef2-ed30-4ffd-9a83-0b15b3993de9 service nova] Acquiring lock "fead4119-3ab9-4337-8b48-d3920e1112f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-7eb0e660-b9fb-45d9-90b2-36dda0bbdb88 req-a3b43ef2-ed30-4ffd-9a83-0b15b3993de9 service nova] Lock "fead4119-3ab9-4337-8b48-d3920e1112f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-7eb0e660-b9fb-45d9-90b2-36dda0bbdb88 req-a3b43ef2-ed30-4ffd-9a83-0b15b3993de9 service nova] Lock "fead4119-3ab9-4337-8b48-d3920e1112f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:07 user nova-compute[103546]: DEBUG nova.compute.manager [req-7eb0e660-b9fb-45d9-90b2-36dda0bbdb88 req-a3b43ef2-ed30-4ffd-9a83-0b15b3993de9 service nova] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] No waiting events found dispatching network-vif-unplugged-55287b83-91c5-4c47-8ec5-c0da5bc3290e {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:49:07 user nova-compute[103546]: DEBUG nova.compute.manager [req-7eb0e660-b9fb-45d9-90b2-36dda0bbdb88 req-a3b43ef2-ed30-4ffd-9a83-0b15b3993de9 service nova] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Received event network-vif-unplugged-55287b83-91c5-4c47-8ec5-c0da5bc3290e for instance with task_state deleting. {{(pid=103546) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 03:49:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:07 user nova-compute[103546]: DEBUG nova.compute.manager [req-796d85eb-ff93-4300-b2f7-993a0a1c4636 req-3a5468b8-9cba-46b7-b8b1-80344fc5fe99 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received event network-vif-unplugged-76b69715-356f-496a-85a3-f5bde976e201 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:49:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-796d85eb-ff93-4300-b2f7-993a0a1c4636 req-3a5468b8-9cba-46b7-b8b1-80344fc5fe99 service nova] Acquiring lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-796d85eb-ff93-4300-b2f7-993a0a1c4636 req-3a5468b8-9cba-46b7-b8b1-80344fc5fe99 service nova] Lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-796d85eb-ff93-4300-b2f7-993a0a1c4636 req-3a5468b8-9cba-46b7-b8b1-80344fc5fe99 service nova] Lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:07 user nova-compute[103546]: DEBUG nova.compute.manager [req-796d85eb-ff93-4300-b2f7-993a0a1c4636 req-3a5468b8-9cba-46b7-b8b1-80344fc5fe99 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] No waiting events found dispatching network-vif-unplugged-76b69715-356f-496a-85a3-f5bde976e201 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:49:07 user nova-compute[103546]: DEBUG nova.compute.manager [req-796d85eb-ff93-4300-b2f7-993a0a1c4636 req-3a5468b8-9cba-46b7-b8b1-80344fc5fe99 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received event network-vif-unplugged-76b69715-356f-496a-85a3-f5bde976e201 for instance with task_state deleting. {{(pid=103546) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 03:49:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:07 user nova-compute[103546]: DEBUG nova.compute.manager [req-170dcdb4-b9ae-440b-aee0-cb8fca4facbf req-e8cbec7f-d83e-4480-bc8a-2689d8af4532 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received event network-vif-unplugged-21653257-8a66-44f1-b806-2fae4641e1d2 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:49:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-170dcdb4-b9ae-440b-aee0-cb8fca4facbf req-e8cbec7f-d83e-4480-bc8a-2689d8af4532 service nova] Acquiring lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-170dcdb4-b9ae-440b-aee0-cb8fca4facbf req-e8cbec7f-d83e-4480-bc8a-2689d8af4532 service nova] Lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-170dcdb4-b9ae-440b-aee0-cb8fca4facbf req-e8cbec7f-d83e-4480-bc8a-2689d8af4532 service nova] Lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:07 user nova-compute[103546]: DEBUG nova.compute.manager [req-170dcdb4-b9ae-440b-aee0-cb8fca4facbf req-e8cbec7f-d83e-4480-bc8a-2689d8af4532 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] No waiting events found dispatching network-vif-unplugged-21653257-8a66-44f1-b806-2fae4641e1d2 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:49:07 user nova-compute[103546]: DEBUG nova.compute.manager [req-170dcdb4-b9ae-440b-aee0-cb8fca4facbf req-e8cbec7f-d83e-4480-bc8a-2689d8af4532 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received event network-vif-unplugged-21653257-8a66-44f1-b806-2fae4641e1d2 for instance with task_state deleting. {{(pid=103546) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 03:49:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:08 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Instance destroyed successfully.
Nov 16 03:49:08 user nova-compute[103546]: DEBUG nova.objects.instance [None req-cda9451f-df87-4fd5-8ca6-1f8bc8f2e2b7 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Lazy-loading 'resources' on Instance uuid fead4119-3ab9-4337-8b48-d3920e1112f4 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:49:08 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-cda9451f-df87-4fd5-8ca6-1f8bc8f2e2b7 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T03:46:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1723757256',display_name='tempest-AttachSCSIVolumeTestJSON-server-1723757256',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1723757256',id=6,image_ref='27514916-7235-4bca-ac74-8ed152e6d26c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEEHJrW51ra9jhpP37BWSRWPxPBqEbActvGJHuyJxwUi0tyqpW1Ys4/ut4CnE1EONIQvacihgxdwyWyTgNAMgQOB8Ipa5dWH3rU6BvGXNZ/x+YJAvxnVRrkwO7jJa0K3kQ==',key_name='tempest-keypair-1828100082',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:46:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='459bf831cfa74f74abcb5625afbafa27',ramdisk_id='',reservation_id='r-uw666qus',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='27514916-7235-4bca-ac74-8ed152e6d26c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1568574038',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1568574038-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T03:46:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1715413924824093b543a2fd440edaaa',uuid=fead4119-3ab9-4337-8b48-d3920e1112f4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "55287b83-91c5-4c47-8ec5-c0da5bc3290e", "address": "fa:16:3e:63:86:8e", "network": {"id": "d67be416-4ca1-4f91-9991-95aee2e04c4a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1248186454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "459bf831cfa74f74abcb5625afbafa27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55287b83-91", "ovs_interfaceid": "55287b83-91c5-4c47-8ec5-c0da5bc3290e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 03:49:08 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-cda9451f-df87-4fd5-8ca6-1f8bc8f2e2b7 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Converting VIF {"id": "55287b83-91c5-4c47-8ec5-c0da5bc3290e", "address": "fa:16:3e:63:86:8e", "network": {"id": "d67be416-4ca1-4f91-9991-95aee2e04c4a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1248186454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "459bf831cfa74f74abcb5625afbafa27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55287b83-91", "ovs_interfaceid": "55287b83-91c5-4c47-8ec5-c0da5bc3290e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:49:08 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-cda9451f-df87-4fd5-8ca6-1f8bc8f2e2b7 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:63:86:8e,bridge_name='br-int',has_traffic_filtering=True,id=55287b83-91c5-4c47-8ec5-c0da5bc3290e,network=Network(d67be416-4ca1-4f91-9991-95aee2e04c4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55287b83-91') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:49:08 user nova-compute[103546]: DEBUG os_vif [None req-cda9451f-df87-4fd5-8ca6-1f8bc8f2e2b7 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:86:8e,bridge_name='br-int',has_traffic_filtering=True,id=55287b83-91c5-4c47-8ec5-c0da5bc3290e,network=Network(d67be416-4ca1-4f91-9991-95aee2e04c4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55287b83-91') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 03:49:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap55287b83-91, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:49:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:49:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a47b11f7-9ed7-49d4-aa0d-8cf7c9872ec9) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:49:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:49:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:08 user nova-compute[103546]: INFO os_vif [None req-cda9451f-df87-4fd5-8ca6-1f8bc8f2e2b7 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:86:8e,bridge_name='br-int',has_traffic_filtering=True,id=55287b83-91c5-4c47-8ec5-c0da5bc3290e,network=Network(d67be416-4ca1-4f91-9991-95aee2e04c4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55287b83-91')
Nov 16 03:49:08 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-cda9451f-df87-4fd5-8ca6-1f8bc8f2e2b7 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Deleting instance files /opt/stack/data/nova/instances/fead4119-3ab9-4337-8b48-d3920e1112f4_del
Nov 16 03:49:08 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-cda9451f-df87-4fd5-8ca6-1f8bc8f2e2b7 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Deletion of /opt/stack/data/nova/instances/fead4119-3ab9-4337-8b48-d3920e1112f4_del complete
Nov 16 03:49:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:08 user nova-compute[103546]: INFO nova.compute.manager [None req-cda9451f-df87-4fd5-8ca6-1f8bc8f2e2b7 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 16 03:49:08 user nova-compute[103546]: DEBUG oslo.service.loopingcall [None req-cda9451f-df87-4fd5-8ca6-1f8bc8f2e2b7 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=103546) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 03:49:08 user nova-compute[103546]: DEBUG nova.compute.manager [-] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Deallocating network for instance {{(pid=103546) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 03:49:08 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] deallocate_for_instance() {{(pid=103546) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 03:49:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:09 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Instance destroyed successfully.
Nov 16 03:49:09 user nova-compute[103546]: DEBUG nova.objects.instance [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Lazy-loading 'resources' on Instance uuid 71059a8d-4e89-472c-9463-b38aa8063e33 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T03:47:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-979087498',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-979087498',id=9,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJG5mUAddSpdXo5xKbrCCUDaorTLl+JXOZykC25X5m5JZ0Q8xHTJFntian9eeJtJJoBz5bNafVu8oRPVVoo6ppzucGvYFRw2h3YmPV1yz/S+0Xyvp0oF5B9x4ridLbkfA==',key_name='tempest-keypair-1167953100',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:47:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='54df5ea6e7a24d49bb8f430fb9248934',ramdisk_id='',reservation_id='r-dhhzqrat',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1024082213',owner_user_name='tempest-TaggedBootDevicesTest_v242-1024082213-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T03:47:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d9e6b5b41d341e19548640d455eaa0f',uuid=71059a8d-4e89-472c-9463-b38aa8063e33,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "76b69715-356f-496a-85a3-f5bde976e201", "address": "fa:16:3e:72:5a:35", "network": {"id": "f84b2b6b-c73a-41d8-a9bb-3e73bb607a42", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1721792603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76b69715-35", "ovs_interfaceid": "76b69715-356f-496a-85a3-f5bde976e201", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Converting VIF {"id": "76b69715-356f-496a-85a3-f5bde976e201", "address": "fa:16:3e:72:5a:35", "network": {"id": "f84b2b6b-c73a-41d8-a9bb-3e73bb607a42", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1721792603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76b69715-35", "ovs_interfaceid": "76b69715-356f-496a-85a3-f5bde976e201", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:72:5a:35,bridge_name='br-int',has_traffic_filtering=True,id=76b69715-356f-496a-85a3-f5bde976e201,network=Network(f84b2b6b-c73a-41d8-a9bb-3e73bb607a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76b69715-35') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG os_vif [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:5a:35,bridge_name='br-int',has_traffic_filtering=True,id=76b69715-356f-496a-85a3-f5bde976e201,network=Network(f84b2b6b-c73a-41d8-a9bb-3e73bb607a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76b69715-35') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap76b69715-35, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b69a4766-0799-454d-8ce1-ac6d8b132af0) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:09 user nova-compute[103546]: INFO os_vif [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:5a:35,bridge_name='br-int',has_traffic_filtering=True,id=76b69715-356f-496a-85a3-f5bde976e201,network=Network(f84b2b6b-c73a-41d8-a9bb-3e73bb607a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76b69715-35')
Nov 16 03:49:09 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T03:47:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-979087498',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-979087498',id=9,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJG5mUAddSpdXo5xKbrCCUDaorTLl+JXOZykC25X5m5JZ0Q8xHTJFntian9eeJtJJoBz5bNafVu8oRPVVoo6ppzucGvYFRw2h3YmPV1yz/S+0Xyvp0oF5B9x4ridLbkfA==',key_name='tempest-keypair-1167953100',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:47:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='54df5ea6e7a24d49bb8f430fb9248934',ramdisk_id='',reservation_id='r-dhhzqrat',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1024082213',owner_user_name='tempest-TaggedBootDevicesTest_v242-1024082213-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T03:47:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d9e6b5b41d341e19548640d455eaa0f',uuid=71059a8d-4e89-472c-9463-b38aa8063e33,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21653257-8a66-44f1-b806-2fae4641e1d2", "address": "fa:16:3e:91:a8:b5", "network": {"id": "4b071e67-eb71-49f5-a24f-cada83cca606", "bridge": "br-int", "label": "tempest-device-tagging-net1-1064540428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21653257-8a", "ovs_interfaceid": "21653257-8a66-44f1-b806-2fae4641e1d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Converting VIF {"id": "21653257-8a66-44f1-b806-2fae4641e1d2", "address": "fa:16:3e:91:a8:b5", "network": {"id": "4b071e67-eb71-49f5-a24f-cada83cca606", "bridge": "br-int", "label": "tempest-device-tagging-net1-1064540428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21653257-8a", "ovs_interfaceid": "21653257-8a66-44f1-b806-2fae4641e1d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:a8:b5,bridge_name='br-int',has_traffic_filtering=True,id=21653257-8a66-44f1-b806-2fae4641e1d2,network=Network(4b071e67-eb71-49f5-a24f-cada83cca606),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap21653257-8a') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG os_vif [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:a8:b5,bridge_name='br-int',has_traffic_filtering=True,id=21653257-8a66-44f1-b806-2fae4641e1d2,network=Network(4b071e67-eb71-49f5-a24f-cada83cca606),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap21653257-8a') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap21653257-8a, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c95f48aa-c18b-4413-a308-41bcfe0673e1) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:09 user nova-compute[103546]: INFO os_vif [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:a8:b5,bridge_name='br-int',has_traffic_filtering=True,id=21653257-8a66-44f1-b806-2fae4641e1d2,network=Network(4b071e67-eb71-49f5-a24f-cada83cca606),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap21653257-8a')
Nov 16 03:49:09 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T03:47:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-979087498',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-979087498',id=9,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJG5mUAddSpdXo5xKbrCCUDaorTLl+JXOZykC25X5m5JZ0Q8xHTJFntian9eeJtJJoBz5bNafVu8oRPVVoo6ppzucGvYFRw2h3YmPV1yz/S+0Xyvp0oF5B9x4ridLbkfA==',key_name='tempest-keypair-1167953100',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:47:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='54df5ea6e7a24d49bb8f430fb9248934',ramdisk_id='',reservation_id='r-dhhzqrat',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1024082213',owner_user_name='tempest-TaggedBootDevicesTest_v242-1024082213-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T03:47:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d9e6b5b41d341e19548640d455eaa0f',uuid=71059a8d-4e89-472c-9463-b38aa8063e33,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "916a3fe8-09df-42a1-9ac0-b81153ed55a1", "address": "fa:16:3e:00:b7:5f", "network": {"id": "4b071e67-eb71-49f5-a24f-cada83cca606", "bridge": "br-int", "label": "tempest-device-tagging-net1-1064540428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap916a3fe8-09", "ovs_interfaceid": "916a3fe8-09df-42a1-9ac0-b81153ed55a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Converting VIF {"id": "916a3fe8-09df-42a1-9ac0-b81153ed55a1", "address": "fa:16:3e:00:b7:5f", "network": {"id": "4b071e67-eb71-49f5-a24f-cada83cca606", "bridge": "br-int", "label": "tempest-device-tagging-net1-1064540428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap916a3fe8-09", "ovs_interfaceid": "916a3fe8-09df-42a1-9ac0-b81153ed55a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:b7:5f,bridge_name='br-int',has_traffic_filtering=True,id=916a3fe8-09df-42a1-9ac0-b81153ed55a1,network=Network(4b071e67-eb71-49f5-a24f-cada83cca606),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap916a3fe8-09') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG os_vif [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:b7:5f,bridge_name='br-int',has_traffic_filtering=True,id=916a3fe8-09df-42a1-9ac0-b81153ed55a1,network=Network(4b071e67-eb71-49f5-a24f-cada83cca606),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap916a3fe8-09') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap916a3fe8-09, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=475f9b93-58f7-4cc5-83f8-dbfb5ba76e80) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG nova.compute.manager [req-2d5d8b60-fd18-471d-9f9b-ccb641d73fb2 req-a7313e02-2fd2-403b-a3ab-b9bd9ddeb270 service nova] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Received event network-vif-plugged-55287b83-91c5-4c47-8ec5-c0da5bc3290e {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-2d5d8b60-fd18-471d-9f9b-ccb641d73fb2 req-a7313e02-2fd2-403b-a3ab-b9bd9ddeb270 service nova] Acquiring lock "fead4119-3ab9-4337-8b48-d3920e1112f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-2d5d8b60-fd18-471d-9f9b-ccb641d73fb2 req-a7313e02-2fd2-403b-a3ab-b9bd9ddeb270 service nova] Lock "fead4119-3ab9-4337-8b48-d3920e1112f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-2d5d8b60-fd18-471d-9f9b-ccb641d73fb2 req-a7313e02-2fd2-403b-a3ab-b9bd9ddeb270 service nova] Lock "fead4119-3ab9-4337-8b48-d3920e1112f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG nova.compute.manager [req-2d5d8b60-fd18-471d-9f9b-ccb641d73fb2 req-a7313e02-2fd2-403b-a3ab-b9bd9ddeb270 service nova] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] No waiting events found dispatching network-vif-plugged-55287b83-91c5-4c47-8ec5-c0da5bc3290e {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:49:09 user nova-compute[103546]: WARNING nova.compute.manager [req-2d5d8b60-fd18-471d-9f9b-ccb641d73fb2 req-a7313e02-2fd2-403b-a3ab-b9bd9ddeb270 service nova] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Received unexpected event network-vif-plugged-55287b83-91c5-4c47-8ec5-c0da5bc3290e for instance with vm_state active and task_state deleting.
Nov 16 03:49:09 user nova-compute[103546]: DEBUG nova.compute.manager [req-2d5d8b60-fd18-471d-9f9b-ccb641d73fb2 req-a7313e02-2fd2-403b-a3ab-b9bd9ddeb270 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received event network-vif-unplugged-1fb75f05-a4ef-45d5-9eb4-5e8428997947 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-2d5d8b60-fd18-471d-9f9b-ccb641d73fb2 req-a7313e02-2fd2-403b-a3ab-b9bd9ddeb270 service nova] Acquiring lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-2d5d8b60-fd18-471d-9f9b-ccb641d73fb2 req-a7313e02-2fd2-403b-a3ab-b9bd9ddeb270 service nova] Lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-2d5d8b60-fd18-471d-9f9b-ccb641d73fb2 req-a7313e02-2fd2-403b-a3ab-b9bd9ddeb270 service nova] Lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG nova.compute.manager [req-2d5d8b60-fd18-471d-9f9b-ccb641d73fb2 req-a7313e02-2fd2-403b-a3ab-b9bd9ddeb270 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] No waiting events found dispatching network-vif-unplugged-1fb75f05-a4ef-45d5-9eb4-5e8428997947 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG nova.compute.manager [req-2d5d8b60-fd18-471d-9f9b-ccb641d73fb2 req-a7313e02-2fd2-403b-a3ab-b9bd9ddeb270 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received event network-vif-unplugged-1fb75f05-a4ef-45d5-9eb4-5e8428997947 for instance with task_state deleting. {{(pid=103546) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG nova.compute.manager [req-2d5d8b60-fd18-471d-9f9b-ccb641d73fb2 req-a7313e02-2fd2-403b-a3ab-b9bd9ddeb270 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received event network-vif-plugged-1fb75f05-a4ef-45d5-9eb4-5e8428997947 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-2d5d8b60-fd18-471d-9f9b-ccb641d73fb2 req-a7313e02-2fd2-403b-a3ab-b9bd9ddeb270 service nova] Acquiring lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-2d5d8b60-fd18-471d-9f9b-ccb641d73fb2 req-a7313e02-2fd2-403b-a3ab-b9bd9ddeb270 service nova] Lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-2d5d8b60-fd18-471d-9f9b-ccb641d73fb2 req-a7313e02-2fd2-403b-a3ab-b9bd9ddeb270 service nova] Lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG nova.compute.manager [req-2d5d8b60-fd18-471d-9f9b-ccb641d73fb2 req-a7313e02-2fd2-403b-a3ab-b9bd9ddeb270 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] No waiting events found dispatching network-vif-plugged-1fb75f05-a4ef-45d5-9eb4-5e8428997947 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:49:09 user nova-compute[103546]: WARNING nova.compute.manager [req-2d5d8b60-fd18-471d-9f9b-ccb641d73fb2 req-a7313e02-2fd2-403b-a3ab-b9bd9ddeb270 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received unexpected event network-vif-plugged-1fb75f05-a4ef-45d5-9eb4-5e8428997947 for instance with vm_state active and task_state deleting.
Nov 16 03:49:09 user nova-compute[103546]: DEBUG nova.compute.manager [req-2d5d8b60-fd18-471d-9f9b-ccb641d73fb2 req-a7313e02-2fd2-403b-a3ab-b9bd9ddeb270 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received event network-vif-unplugged-fc03966b-fcbc-4ed7-8ffb-2270a55b4e28 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-2d5d8b60-fd18-471d-9f9b-ccb641d73fb2 req-a7313e02-2fd2-403b-a3ab-b9bd9ddeb270 service nova] Acquiring lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-2d5d8b60-fd18-471d-9f9b-ccb641d73fb2 req-a7313e02-2fd2-403b-a3ab-b9bd9ddeb270 service nova] Lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-2d5d8b60-fd18-471d-9f9b-ccb641d73fb2 req-a7313e02-2fd2-403b-a3ab-b9bd9ddeb270 service nova] Lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG nova.compute.manager [req-2d5d8b60-fd18-471d-9f9b-ccb641d73fb2 req-a7313e02-2fd2-403b-a3ab-b9bd9ddeb270 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] No waiting events found dispatching network-vif-unplugged-fc03966b-fcbc-4ed7-8ffb-2270a55b4e28 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG nova.compute.manager [req-2d5d8b60-fd18-471d-9f9b-ccb641d73fb2 req-a7313e02-2fd2-403b-a3ab-b9bd9ddeb270 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received event network-vif-unplugged-fc03966b-fcbc-4ed7-8ffb-2270a55b4e28 for instance with task_state deleting. {{(pid=103546) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:09 user nova-compute[103546]: INFO os_vif [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:b7:5f,bridge_name='br-int',has_traffic_filtering=True,id=916a3fe8-09df-42a1-9ac0-b81153ed55a1,network=Network(4b071e67-eb71-49f5-a24f-cada83cca606),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap916a3fe8-09')
Nov 16 03:49:09 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T03:47:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-979087498',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-979087498',id=9,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJG5mUAddSpdXo5xKbrCCUDaorTLl+JXOZykC25X5m5JZ0Q8xHTJFntian9eeJtJJoBz5bNafVu8oRPVVoo6ppzucGvYFRw2h3YmPV1yz/S+0Xyvp0oF5B9x4ridLbkfA==',key_name='tempest-keypair-1167953100',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:47:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='54df5ea6e7a24d49bb8f430fb9248934',ramdisk_id='',reservation_id='r-dhhzqrat',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1024082213',owner_user_name='tempest-TaggedBootDevicesTest_v242-1024082213-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T03:47:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d9e6b5b41d341e19548640d455eaa0f',uuid=71059a8d-4e89-472c-9463-b38aa8063e33,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1fb75f05-a4ef-45d5-9eb4-5e8428997947", "address": "fa:16:3e:e6:68:04", "network": {"id": "4b071e67-eb71-49f5-a24f-cada83cca606", "bridge": "br-int", "label": "tempest-device-tagging-net1-1064540428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fb75f05-a4", "ovs_interfaceid": "1fb75f05-a4ef-45d5-9eb4-5e8428997947", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Converting VIF {"id": "1fb75f05-a4ef-45d5-9eb4-5e8428997947", "address": "fa:16:3e:e6:68:04", "network": {"id": "4b071e67-eb71-49f5-a24f-cada83cca606", "bridge": "br-int", "label": "tempest-device-tagging-net1-1064540428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fb75f05-a4", "ovs_interfaceid": "1fb75f05-a4ef-45d5-9eb4-5e8428997947", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:68:04,bridge_name='br-int',has_traffic_filtering=True,id=1fb75f05-a4ef-45d5-9eb4-5e8428997947,network=Network(4b071e67-eb71-49f5-a24f-cada83cca606),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fb75f05-a4') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG os_vif [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:68:04,bridge_name='br-int',has_traffic_filtering=True,id=1fb75f05-a4ef-45d5-9eb4-5e8428997947,network=Network(4b071e67-eb71-49f5-a24f-cada83cca606),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fb75f05-a4') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1fb75f05-a4, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b9936475-c18f-495d-aef3-3e3da5a698cf) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:09 user nova-compute[103546]: INFO os_vif [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:68:04,bridge_name='br-int',has_traffic_filtering=True,id=1fb75f05-a4ef-45d5-9eb4-5e8428997947,network=Network(4b071e67-eb71-49f5-a24f-cada83cca606),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fb75f05-a4')
Nov 16 03:49:09 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T03:47:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-979087498',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-979087498',id=9,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJG5mUAddSpdXo5xKbrCCUDaorTLl+JXOZykC25X5m5JZ0Q8xHTJFntian9eeJtJJoBz5bNafVu8oRPVVoo6ppzucGvYFRw2h3YmPV1yz/S+0Xyvp0oF5B9x4ridLbkfA==',key_name='tempest-keypair-1167953100',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:47:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='54df5ea6e7a24d49bb8f430fb9248934',ramdisk_id='',reservation_id='r-dhhzqrat',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1024082213',owner_user_name='tempest-TaggedBootDevicesTest_v242-1024082213-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T03:47:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d9e6b5b41d341e19548640d455eaa0f',uuid=71059a8d-4e89-472c-9463-b38aa8063e33,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51e087e4-ff6b-49a8-8190-cfc243436d35", "address": "fa:16:3e:3f:53:f1", "network": {"id": "4b071e67-eb71-49f5-a24f-cada83cca606", "bridge": "br-int", "label": "tempest-device-tagging-net1-1064540428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51e087e4-ff", "ovs_interfaceid": "51e087e4-ff6b-49a8-8190-cfc243436d35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Converting VIF {"id": "51e087e4-ff6b-49a8-8190-cfc243436d35", "address": "fa:16:3e:3f:53:f1", "network": {"id": "4b071e67-eb71-49f5-a24f-cada83cca606", "bridge": "br-int", "label": "tempest-device-tagging-net1-1064540428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51e087e4-ff", "ovs_interfaceid": "51e087e4-ff6b-49a8-8190-cfc243436d35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:53:f1,bridge_name='br-int',has_traffic_filtering=True,id=51e087e4-ff6b-49a8-8190-cfc243436d35,network=Network(4b071e67-eb71-49f5-a24f-cada83cca606),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51e087e4-ff') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG os_vif [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:53:f1,bridge_name='br-int',has_traffic_filtering=True,id=51e087e4-ff6b-49a8-8190-cfc243436d35,network=Network(4b071e67-eb71-49f5-a24f-cada83cca606),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51e087e4-ff') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap51e087e4-ff, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f4334eda-575f-45cd-a7c3-d19d83014923) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:09 user nova-compute[103546]: INFO os_vif [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:53:f1,bridge_name='br-int',has_traffic_filtering=True,id=51e087e4-ff6b-49a8-8190-cfc243436d35,network=Network(4b071e67-eb71-49f5-a24f-cada83cca606),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51e087e4-ff')
Nov 16 03:49:09 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T03:47:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-979087498',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-979087498',id=9,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJG5mUAddSpdXo5xKbrCCUDaorTLl+JXOZykC25X5m5JZ0Q8xHTJFntian9eeJtJJoBz5bNafVu8oRPVVoo6ppzucGvYFRw2h3YmPV1yz/S+0Xyvp0oF5B9x4ridLbkfA==',key_name='tempest-keypair-1167953100',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:47:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='54df5ea6e7a24d49bb8f430fb9248934',ramdisk_id='',reservation_id='r-dhhzqrat',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1024082213',owner_user_name='tempest-TaggedBootDevicesTest_v242-1024082213-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T03:47:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d9e6b5b41d341e19548640d455eaa0f',uuid=71059a8d-4e89-472c-9463-b38aa8063e33,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b0f609b8-eb49-4c19-968c-99c95c38b857", "address": "fa:16:3e:dc:33:a5", "network": {"id": "f9af5267-5cc4-44b4-9226-2da63e754907", "bridge": "br-int", "label": "tempest-device-tagging-net2-640329577", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0f609b8-eb", "ovs_interfaceid": "b0f609b8-eb49-4c19-968c-99c95c38b857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Converting VIF {"id": "b0f609b8-eb49-4c19-968c-99c95c38b857", "address": "fa:16:3e:dc:33:a5", "network": {"id": "f9af5267-5cc4-44b4-9226-2da63e754907", "bridge": "br-int", "label": "tempest-device-tagging-net2-640329577", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0f609b8-eb", "ovs_interfaceid": "b0f609b8-eb49-4c19-968c-99c95c38b857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:33:a5,bridge_name='br-int',has_traffic_filtering=True,id=b0f609b8-eb49-4c19-968c-99c95c38b857,network=Network(f9af5267-5cc4-44b4-9226-2da63e754907),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0f609b8-eb') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG os_vif [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:33:a5,bridge_name='br-int',has_traffic_filtering=True,id=b0f609b8-eb49-4c19-968c-99c95c38b857,network=Network(f9af5267-5cc4-44b4-9226-2da63e754907),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0f609b8-eb') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb0f609b8-eb, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=27c588fd-92f0-4530-a650-7d7025f9ffbf) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:09 user nova-compute[103546]: INFO os_vif [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:33:a5,bridge_name='br-int',has_traffic_filtering=True,id=b0f609b8-eb49-4c19-968c-99c95c38b857,network=Network(f9af5267-5cc4-44b4-9226-2da63e754907),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0f609b8-eb')
Nov 16 03:49:09 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T03:47:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-979087498',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-979087498',id=9,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJG5mUAddSpdXo5xKbrCCUDaorTLl+JXOZykC25X5m5JZ0Q8xHTJFntian9eeJtJJoBz5bNafVu8oRPVVoo6ppzucGvYFRw2h3YmPV1yz/S+0Xyvp0oF5B9x4ridLbkfA==',key_name='tempest-keypair-1167953100',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:47:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='54df5ea6e7a24d49bb8f430fb9248934',ramdisk_id='',reservation_id='r-dhhzqrat',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1024082213',owner_user_name='tempest-TaggedBootDevicesTest_v242-1024082213-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T03:47:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d9e6b5b41d341e19548640d455eaa0f',uuid=71059a8d-4e89-472c-9463-b38aa8063e33,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc03966b-fcbc-4ed7-8ffb-2270a55b4e28", "address": "fa:16:3e:75:5a:4b", "network": {"id": "f9af5267-5cc4-44b4-9226-2da63e754907", "bridge": "br-int", "label": "tempest-device-tagging-net2-640329577", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc03966b-fc", "ovs_interfaceid": "fc03966b-fcbc-4ed7-8ffb-2270a55b4e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Converting VIF {"id": "fc03966b-fcbc-4ed7-8ffb-2270a55b4e28", "address": "fa:16:3e:75:5a:4b", "network": {"id": "f9af5267-5cc4-44b4-9226-2da63e754907", "bridge": "br-int", "label": "tempest-device-tagging-net2-640329577", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc03966b-fc", "ovs_interfaceid": "fc03966b-fcbc-4ed7-8ffb-2270a55b4e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:5a:4b,bridge_name='br-int',has_traffic_filtering=True,id=fc03966b-fcbc-4ed7-8ffb-2270a55b4e28,network=Network(f9af5267-5cc4-44b4-9226-2da63e754907),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc03966b-fc') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG os_vif [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:5a:4b,bridge_name='br-int',has_traffic_filtering=True,id=fc03966b-fcbc-4ed7-8ffb-2270a55b4e28,network=Network(f9af5267-5cc4-44b4-9226-2da63e754907),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc03966b-fc') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfc03966b-fc, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=94dd72c8-1c0b-4213-be85-2aeb97ecb8fc) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:09 user nova-compute[103546]: INFO os_vif [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:5a:4b,bridge_name='br-int',has_traffic_filtering=True,id=fc03966b-fcbc-4ed7-8ffb-2270a55b4e28,network=Network(f9af5267-5cc4-44b4-9226-2da63e754907),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc03966b-fc')
Nov 16 03:49:09 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mKMStNlq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:49:09 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:49:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10ccf42-e82c-465f-b136-378895662fe7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 03:49:09 user nova-compute[103546]: No targets found.
Nov 16 03:49:09 user nova-compute[103546]: iSNS:
Nov 16 03:49:09 user nova-compute[103546]: No targets found.
Nov 16 03:49:09 user nova-compute[103546]: STATIC:
Nov 16 03:49:09 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7
Nov 16 03:49:09 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:09 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:09 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f
Nov 16 03:49:09 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:09 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:09 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b
Nov 16 03:49:09 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:09 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:09 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb
Nov 16 03:49:09 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:09 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:09 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41
Nov 16 03:49:09 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:09 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:09 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57
Nov 16 03:49:09 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:09 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:09 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b
Nov 16 03:49:09 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:09 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:09 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75
Nov 16 03:49:09 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:09 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:09 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865
Nov 16 03:49:09 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:09 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:09 user nova-compute[103546]: FIRMWARE:
Nov 16 03:49:09 user nova-compute[103546]: No targets found.
Nov 16 03:49:09 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 03:49:09 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 03:49:09 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[def4722a-0ca3-47c3-a770-e4e0315fc0b6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG nova.compute.manager [req-541ca6ff-aef8-4817-be47-9d42213ca19c req-e45d46d7-89d2-496b-82d7-a54a66ccb42d service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received event network-vif-plugged-76b69715-356f-496a-85a3-f5bde976e201 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-541ca6ff-aef8-4817-be47-9d42213ca19c req-e45d46d7-89d2-496b-82d7-a54a66ccb42d service nova] Acquiring lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-541ca6ff-aef8-4817-be47-9d42213ca19c req-e45d46d7-89d2-496b-82d7-a54a66ccb42d service nova] Lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-541ca6ff-aef8-4817-be47-9d42213ca19c req-e45d46d7-89d2-496b-82d7-a54a66ccb42d service nova] Lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG nova.compute.manager [req-541ca6ff-aef8-4817-be47-9d42213ca19c req-e45d46d7-89d2-496b-82d7-a54a66ccb42d service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] No waiting events found dispatching network-vif-plugged-76b69715-356f-496a-85a3-f5bde976e201 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:49:09 user nova-compute[103546]: WARNING nova.compute.manager [req-541ca6ff-aef8-4817-be47-9d42213ca19c req-e45d46d7-89d2-496b-82d7-a54a66ccb42d service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received unexpected event network-vif-plugged-76b69715-356f-496a-85a3-f5bde976e201 for instance with vm_state active and task_state deleting.
Nov 16 03:49:09 user nova-compute[103546]: DEBUG nova.compute.manager [req-541ca6ff-aef8-4817-be47-9d42213ca19c req-e45d46d7-89d2-496b-82d7-a54a66ccb42d service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received event network-vif-unplugged-51e087e4-ff6b-49a8-8190-cfc243436d35 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-541ca6ff-aef8-4817-be47-9d42213ca19c req-e45d46d7-89d2-496b-82d7-a54a66ccb42d service nova] Acquiring lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-541ca6ff-aef8-4817-be47-9d42213ca19c req-e45d46d7-89d2-496b-82d7-a54a66ccb42d service nova] Lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-541ca6ff-aef8-4817-be47-9d42213ca19c req-e45d46d7-89d2-496b-82d7-a54a66ccb42d service nova] Lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG nova.compute.manager [req-541ca6ff-aef8-4817-be47-9d42213ca19c req-e45d46d7-89d2-496b-82d7-a54a66ccb42d service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] No waiting events found dispatching network-vif-unplugged-51e087e4-ff6b-49a8-8190-cfc243436d35 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG nova.compute.manager [req-541ca6ff-aef8-4817-be47-9d42213ca19c req-e45d46d7-89d2-496b-82d7-a54a66ccb42d service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received event network-vif-unplugged-51e087e4-ff6b-49a8-8190-cfc243436d35 for instance with task_state deleting. {{(pid=103546) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG nova.compute.manager [req-541ca6ff-aef8-4817-be47-9d42213ca19c req-e45d46d7-89d2-496b-82d7-a54a66ccb42d service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received event network-vif-plugged-51e087e4-ff6b-49a8-8190-cfc243436d35 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-541ca6ff-aef8-4817-be47-9d42213ca19c req-e45d46d7-89d2-496b-82d7-a54a66ccb42d service nova] Acquiring lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-541ca6ff-aef8-4817-be47-9d42213ca19c req-e45d46d7-89d2-496b-82d7-a54a66ccb42d service nova] Lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-541ca6ff-aef8-4817-be47-9d42213ca19c req-e45d46d7-89d2-496b-82d7-a54a66ccb42d service nova] Lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG nova.compute.manager [req-541ca6ff-aef8-4817-be47-9d42213ca19c req-e45d46d7-89d2-496b-82d7-a54a66ccb42d service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] No waiting events found dispatching network-vif-plugged-51e087e4-ff6b-49a8-8190-cfc243436d35 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:49:09 user nova-compute[103546]: WARNING nova.compute.manager [req-541ca6ff-aef8-4817-be47-9d42213ca19c req-e45d46d7-89d2-496b-82d7-a54a66ccb42d service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received unexpected event network-vif-plugged-51e087e4-ff6b-49a8-8190-cfc243436d35 for instance with vm_state active and task_state deleting.
Nov 16 03:49:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f1719a-ac82-43b9-826b-f7602fcb2b52]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b (non-flash)
Nov 16 03:49:09 user nova-compute[103546]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f (non-flash)
Nov 16 03:49:09 user nova-compute[103546]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)
Nov 16 03:49:09 user nova-compute[103546]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:49:09 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:49:09 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:49:09 user nova-compute[103546]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)
Nov 16 03:49:09 user nova-compute[103546]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)
Nov 16 03:49:09 user nova-compute[103546]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)
Nov 16 03:49:09 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b (non-flash)
Nov 16 03:49:09 user nova-compute[103546]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f (non-flash)
Nov 16 03:49:09 user nova-compute[103546]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)
Nov 16 03:49:09 user nova-compute[103546]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:49:09 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:49:09 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:49:09 user nova-compute[103546]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 (non-flash)
Nov 16 03:49:09 user nova-compute[103546]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)
Nov 16 03:49:09 user nova-compute[103546]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)
Nov 16 03:49:09 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60ac5ac0d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865'): ({'sde'}, set())}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Removing single pathed devices sde {{(pid=103546) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5ce957-88e3-4b6b-9ecd-5993faf474a1]: (4, ('path checker states:\nup                  8\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[8180ccf6-e954-47bf-bd8c-1987b3ef47f9]: (4, ('ok\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Flushing IO for device /dev/sde {{(pid=103546) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da744da-2a20-4ff7-aa67-b7be8c4815fb]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=103546) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:10 user nova-compute[103546]: INFO nova.compute.manager [-] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Took 1.58 seconds to deallocate network for instance.
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[6831fcbf-4a3d-448b-826a-58214c33c87f]: (4, ('1', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] SCSI volumes sde have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865')] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cda9451f-df87-4fd5-8ca6-1f8bc8f2e2b7 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cda9451f-df87-4fd5-8ca6-1f8bc8f2e2b7 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea81e959-1a18-4ae4-957e-be915035cf2a]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 -p 172.16.0.220:3260 --logout {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e2bfec-c994-455e-9347-3603f75b90ba]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865, portal: 172.16.0.220,3260]
Nov 16 03:49:10 user nova-compute[103546]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865, portal: 172.16.0.220,3260] successful.
Nov 16 03:49:10 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 -p 172.16.0.220:3260 --op delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG nova.compute.manager [req-6d513066-113b-4288-b3f7-82cdb74a31fa req-84c75f06-31cd-439d-8e59-5e74833129a1 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received event network-vif-plugged-21653257-8a66-44f1-b806-2fae4641e1d2 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6d513066-113b-4288-b3f7-82cdb74a31fa req-84c75f06-31cd-439d-8e59-5e74833129a1 service nova] Acquiring lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6d513066-113b-4288-b3f7-82cdb74a31fa req-84c75f06-31cd-439d-8e59-5e74833129a1 service nova] Lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6d513066-113b-4288-b3f7-82cdb74a31fa req-84c75f06-31cd-439d-8e59-5e74833129a1 service nova] Lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG nova.compute.manager [req-6d513066-113b-4288-b3f7-82cdb74a31fa req-84c75f06-31cd-439d-8e59-5e74833129a1 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] No waiting events found dispatching network-vif-plugged-21653257-8a66-44f1-b806-2fae4641e1d2 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:49:10 user nova-compute[103546]: WARNING nova.compute.manager [req-6d513066-113b-4288-b3f7-82cdb74a31fa req-84c75f06-31cd-439d-8e59-5e74833129a1 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received unexpected event network-vif-plugged-21653257-8a66-44f1-b806-2fae4641e1d2 for instance with vm_state active and task_state deleting.
Nov 16 03:49:10 user nova-compute[103546]: DEBUG nova.compute.manager [req-6d513066-113b-4288-b3f7-82cdb74a31fa req-84c75f06-31cd-439d-8e59-5e74833129a1 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received event network-vif-unplugged-916a3fe8-09df-42a1-9ac0-b81153ed55a1 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6d513066-113b-4288-b3f7-82cdb74a31fa req-84c75f06-31cd-439d-8e59-5e74833129a1 service nova] Acquiring lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6d513066-113b-4288-b3f7-82cdb74a31fa req-84c75f06-31cd-439d-8e59-5e74833129a1 service nova] Lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6d513066-113b-4288-b3f7-82cdb74a31fa req-84c75f06-31cd-439d-8e59-5e74833129a1 service nova] Lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG nova.compute.manager [req-6d513066-113b-4288-b3f7-82cdb74a31fa req-84c75f06-31cd-439d-8e59-5e74833129a1 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] No waiting events found dispatching network-vif-unplugged-916a3fe8-09df-42a1-9ac0-b81153ed55a1 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG nova.compute.manager [req-6d513066-113b-4288-b3f7-82cdb74a31fa req-84c75f06-31cd-439d-8e59-5e74833129a1 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received event network-vif-unplugged-916a3fe8-09df-42a1-9ac0-b81153ed55a1 for instance with task_state deleting. {{(pid=103546) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG nova.compute.manager [req-6d513066-113b-4288-b3f7-82cdb74a31fa req-84c75f06-31cd-439d-8e59-5e74833129a1 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received event network-vif-plugged-916a3fe8-09df-42a1-9ac0-b81153ed55a1 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6d513066-113b-4288-b3f7-82cdb74a31fa req-84c75f06-31cd-439d-8e59-5e74833129a1 service nova] Acquiring lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6d513066-113b-4288-b3f7-82cdb74a31fa req-84c75f06-31cd-439d-8e59-5e74833129a1 service nova] Lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6d513066-113b-4288-b3f7-82cdb74a31fa req-84c75f06-31cd-439d-8e59-5e74833129a1 service nova] Lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG nova.compute.manager [req-6d513066-113b-4288-b3f7-82cdb74a31fa req-84c75f06-31cd-439d-8e59-5e74833129a1 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] No waiting events found dispatching network-vif-plugged-916a3fe8-09df-42a1-9ac0-b81153ed55a1 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:49:10 user nova-compute[103546]: WARNING nova.compute.manager [req-6d513066-113b-4288-b3f7-82cdb74a31fa req-84c75f06-31cd-439d-8e59-5e74833129a1 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received unexpected event network-vif-plugged-916a3fe8-09df-42a1-9ac0-b81153ed55a1 for instance with vm_state active and task_state deleting.
Nov 16 03:49:10 user nova-compute[103546]: DEBUG nova.compute.manager [req-6d513066-113b-4288-b3f7-82cdb74a31fa req-84c75f06-31cd-439d-8e59-5e74833129a1 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received event network-changed-2159d4b9-42e0-48d5-bfdf-178ee853063c {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG nova.compute.manager [req-6d513066-113b-4288-b3f7-82cdb74a31fa req-84c75f06-31cd-439d-8e59-5e74833129a1 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Refreshing instance network info cache due to event network-changed-2159d4b9-42e0-48d5-bfdf-178ee853063c. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6d513066-113b-4288-b3f7-82cdb74a31fa req-84c75f06-31cd-439d-8e59-5e74833129a1 service nova] Acquiring lock "refresh_cache-2cb84f00-0601-4199-ba6e-f09a27add736" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6d513066-113b-4288-b3f7-82cdb74a31fa req-84c75f06-31cd-439d-8e59-5e74833129a1 service nova] Acquired lock "refresh_cache-2cb84f00-0601-4199-ba6e-f09a27add736" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG nova.network.neutron [req-6d513066-113b-4288-b3f7-82cdb74a31fa req-84c75f06-31cd-439d-8e59-5e74833129a1 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Refreshing network info cache for port 2159d4b9-42e0-48d5-bfdf-178ee853063c {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5221ff7-1f34-47db-a9c6-ce3f8e58e865 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[372613f6-6369-45e5-a94c-35efdd3d45f5]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] <== disconnect_volume: return (370ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nGCSWKyY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:49:10 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:49:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[1873cb27-baba-4c0d-97dc-89abe59f0b7c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 03:49:10 user nova-compute[103546]: No targets found.
Nov 16 03:49:10 user nova-compute[103546]: iSNS:
Nov 16 03:49:10 user nova-compute[103546]: No targets found.
Nov 16 03:49:10 user nova-compute[103546]: STATIC:
Nov 16 03:49:10 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7
Nov 16 03:49:10 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:10 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:10 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f
Nov 16 03:49:10 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:10 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:10 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b
Nov 16 03:49:10 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:10 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:10 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb
Nov 16 03:49:10 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:10 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:10 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41
Nov 16 03:49:10 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:10 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:10 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57
Nov 16 03:49:10 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:10 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:10 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b
Nov 16 03:49:10 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:10 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:10 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75
Nov 16 03:49:10 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:10 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:10 user nova-compute[103546]: FIRMWARE:
Nov 16 03:49:10 user nova-compute[103546]: No targets found.
Nov 16 03:49:10 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 03:49:10 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 03:49:10 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80fb96e-4fa9-4862-8920-7d2a253cb143]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[119b2cbf-3ddd-426c-bdd2-17cdc0196857]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b (non-flash)
Nov 16 03:49:10 user nova-compute[103546]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f (non-flash)
Nov 16 03:49:10 user nova-compute[103546]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)
Nov 16 03:49:10 user nova-compute[103546]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:49:10 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:49:10 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:49:10 user nova-compute[103546]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)
Nov 16 03:49:10 user nova-compute[103546]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)
Nov 16 03:49:10 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b (non-flash)
Nov 16 03:49:10 user nova-compute[103546]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f (non-flash)
Nov 16 03:49:10 user nova-compute[103546]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)
Nov 16 03:49:10 user nova-compute[103546]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:49:10 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:49:10 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:49:10 user nova-compute[103546]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 (non-flash)
Nov 16 03:49:10 user nova-compute[103546]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)
Nov 16 03:49:10 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60ac5afb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7'): ({'sdf'}, set())}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Removing single pathed devices sdf {{(pid=103546) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[671ef811-bf36-4be2-8ece-408d2bda2f6b]: (4, ('path checker states:\nup                  7\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e229336-34e6-46e9-a81a-cbae02259416]: (4, ('ok\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Flushing IO for device /dev/sdf {{(pid=103546) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1b67c4-8ef6-48e1-bcd0-b6fb2f8b39c0]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=103546) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-cda9451f-df87-4fd5-8ca6-1f8bc8f2e2b7 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.041s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c26ec6-6192-4b53-bc93-795c354c6dfc]: (4, ('1', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] SCSI volumes sdf have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7')] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-cda9451f-df87-4fd5-8ca6-1f8bc8f2e2b7 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1129ac-9a56-44a0-95fe-889488d1f0ec]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 -p 172.16.0.220:3260 --logout {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cda9451f-df87-4fd5-8ca6-1f8bc8f2e2b7 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.423s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:10 user nova-compute[103546]: INFO nova.scheduler.client.report [None req-cda9451f-df87-4fd5-8ca6-1f8bc8f2e2b7 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Deleted allocations for instance fead4119-3ab9-4337-8b48-d3920e1112f4
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa55a81-8968-47af-9b27-7dd0894f4622]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7, portal: 172.16.0.220,3260]
Nov 16 03:49:10 user nova-compute[103546]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7, portal: 172.16.0.220,3260] successful.
Nov 16 03:49:10 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 -p 172.16.0.220:3260 --op delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbd5ba3f-7069-4f25-bc49-017b07ac2ca7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[facb1f20-e118-4547-8737-29f90d7edc58]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.381s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] <== disconnect_volume: return (383ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QtBJqjuH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:49:10 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:49:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cda9451f-df87-4fd5-8ca6-1f8bc8f2e2b7 tempest-AttachSCSIVolumeTestJSON-1568574038 tempest-AttachSCSIVolumeTestJSON-1568574038-project-member] Lock "fead4119-3ab9-4337-8b48-d3920e1112f4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.431s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9c4ee1-3469-4a59-9dd6-1ec6a7c407d7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 03:49:10 user nova-compute[103546]: No targets found.
Nov 16 03:49:10 user nova-compute[103546]: iSNS:
Nov 16 03:49:10 user nova-compute[103546]: No targets found.
Nov 16 03:49:10 user nova-compute[103546]: STATIC:
Nov 16 03:49:10 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f
Nov 16 03:49:10 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:10 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:10 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b
Nov 16 03:49:10 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:10 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:10 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb
Nov 16 03:49:10 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:10 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:10 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41
Nov 16 03:49:10 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:10 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:10 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57
Nov 16 03:49:10 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:10 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:10 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b
Nov 16 03:49:10 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:10 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:10 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75
Nov 16 03:49:10 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:10 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:10 user nova-compute[103546]: FIRMWARE:
Nov 16 03:49:10 user nova-compute[103546]: No targets found.
Nov 16 03:49:10 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 03:49:10 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 03:49:10 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[0774efa5-ee15-4c7b-9d69-e1b4dcd20c30]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b706d3-9917-493d-8eb2-e35fb9e82a09]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b (non-flash)
Nov 16 03:49:10 user nova-compute[103546]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f (non-flash)
Nov 16 03:49:10 user nova-compute[103546]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)
Nov 16 03:49:10 user nova-compute[103546]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:49:10 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:49:10 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:49:10 user nova-compute[103546]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)
Nov 16 03:49:10 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b (non-flash)
Nov 16 03:49:10 user nova-compute[103546]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f (non-flash)
Nov 16 03:49:10 user nova-compute[103546]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)
Nov 16 03:49:10 user nova-compute[103546]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:49:10 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:49:10 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:49:10 user nova-compute[103546]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b (non-flash)
Nov 16 03:49:10 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60cc292a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b'): ({'sdg'}, set())}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Removing single pathed devices sdg {{(pid=103546) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG nova.network.neutron [req-6d513066-113b-4288-b3f7-82cdb74a31fa req-84c75f06-31cd-439d-8e59-5e74833129a1 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Updated VIF entry in instance network info cache for port 2159d4b9-42e0-48d5-bfdf-178ee853063c. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG nova.network.neutron [req-6d513066-113b-4288-b3f7-82cdb74a31fa req-84c75f06-31cd-439d-8e59-5e74833129a1 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Updating instance_info_cache with network_info: [{"id": "2159d4b9-42e0-48d5-bfdf-178ee853063c", "address": "fa:16:3e:5f:ff:36", "network": {"id": "a8bb0411-7c42-419f-9bc2-ea6219b732f8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1141379058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2159d4b9-42", "ovs_interfaceid": "2159d4b9-42e0-48d5-bfdf-178ee853063c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cf751a83-e099-48a1-9219-fb781500b02c", "address": "fa:16:3e:3b:05:73", "network": {"id": "049ff849-6358-448d-9530-ae2102396888", "bridge": "br-int", "label": "tempest-device-tagging-net1-926406277", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf751a83-e0", "ovs_interfaceid": "cf751a83-e099-48a1-9219-fb781500b02c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "96e41ba8-e2bd-48d3-a8e0-94c5f76d618a", "address": "fa:16:3e:e1:ce:8a", "network": {"id": "049ff849-6358-448d-9530-ae2102396888", "bridge": "br-int", "label": "tempest-device-tagging-net1-926406277", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96e41ba8-e2", "ovs_interfaceid": "96e41ba8-e2bd-48d3-a8e0-94c5f76d618a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1b75ba8c-049f-404a-aa82-0323bf51191c", "address": "fa:16:3e:51:e9:22", "network": {"id": "049ff849-6358-448d-9530-ae2102396888", "bridge": "br-int", "label": "tempest-device-tagging-net1-926406277", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b75ba8c-04", "ovs_interfaceid": "1b75ba8c-049f-404a-aa82-0323bf51191c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2216378-faa5-4bdc-8706-0be8df7807c0", "address": "fa:16:3e:aa:93:87", "network": {"id": "049ff849-6358-448d-9530-ae2102396888", "bridge": "br-int", "label": "tempest-device-tagging-net1-926406277", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2216378-fa", "ovs_interfaceid": "c2216378-faa5-4bdc-8706-0be8df7807c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "75b2ff49-49cc-4b86-bdc6-6f9f76c06505", "address": "fa:16:3e:95:e9:f8", "network": {"id": "4a2b26f4-65df-49c9-8832-77cb9c321787", "bridge": "br-int", "label": "tempest-device-tagging-net2-1336305364", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75b2ff49-49", "ovs_interfaceid": "75b2ff49-49cc-4b86-bdc6-6f9f76c06505", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "87ab6a10-d50c-460e-b891-ce6439614185", "address": "fa:16:3e:c4:5b:b6", "network": {"id": "4a2b26f4-65df-49c9-8832-77cb9c321787", "bridge": "br-int", "label": "tempest-device-tagging-net2-1336305364", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87ab6a10-d5", "ovs_interfaceid": "87ab6a10-d50c-460e-b891-ce6439614185", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2cf7c75-7efa-4ab3-a567-cdf3f0fd509f]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6d513066-113b-4288-b3f7-82cdb74a31fa req-84c75f06-31cd-439d-8e59-5e74833129a1 service nova] Releasing lock "refresh_cache-2cb84f00-0601-4199-ba6e-f09a27add736" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG nova.compute.manager [req-6d513066-113b-4288-b3f7-82cdb74a31fa req-84c75f06-31cd-439d-8e59-5e74833129a1 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received event network-vif-unplugged-b0f609b8-eb49-4c19-968c-99c95c38b857 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6d513066-113b-4288-b3f7-82cdb74a31fa req-84c75f06-31cd-439d-8e59-5e74833129a1 service nova] Acquiring lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6d513066-113b-4288-b3f7-82cdb74a31fa req-84c75f06-31cd-439d-8e59-5e74833129a1 service nova] Lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6d513066-113b-4288-b3f7-82cdb74a31fa req-84c75f06-31cd-439d-8e59-5e74833129a1 service nova] Lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG nova.compute.manager [req-6d513066-113b-4288-b3f7-82cdb74a31fa req-84c75f06-31cd-439d-8e59-5e74833129a1 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] No waiting events found dispatching network-vif-unplugged-b0f609b8-eb49-4c19-968c-99c95c38b857 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG nova.compute.manager [req-6d513066-113b-4288-b3f7-82cdb74a31fa req-84c75f06-31cd-439d-8e59-5e74833129a1 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received event network-vif-unplugged-b0f609b8-eb49-4c19-968c-99c95c38b857 for instance with task_state deleting. {{(pid=103546) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG nova.compute.manager [req-6d513066-113b-4288-b3f7-82cdb74a31fa req-84c75f06-31cd-439d-8e59-5e74833129a1 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received event network-vif-plugged-b0f609b8-eb49-4c19-968c-99c95c38b857 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6d513066-113b-4288-b3f7-82cdb74a31fa req-84c75f06-31cd-439d-8e59-5e74833129a1 service nova] Acquiring lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6d513066-113b-4288-b3f7-82cdb74a31fa req-84c75f06-31cd-439d-8e59-5e74833129a1 service nova] Lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6d513066-113b-4288-b3f7-82cdb74a31fa req-84c75f06-31cd-439d-8e59-5e74833129a1 service nova] Lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG nova.compute.manager [req-6d513066-113b-4288-b3f7-82cdb74a31fa req-84c75f06-31cd-439d-8e59-5e74833129a1 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] No waiting events found dispatching network-vif-plugged-b0f609b8-eb49-4c19-968c-99c95c38b857 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:49:10 user nova-compute[103546]: WARNING nova.compute.manager [req-6d513066-113b-4288-b3f7-82cdb74a31fa req-84c75f06-31cd-439d-8e59-5e74833129a1 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received unexpected event network-vif-plugged-b0f609b8-eb49-4c19-968c-99c95c38b857 for instance with vm_state active and task_state deleting.
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[8740dacb-cdbe-4cbb-924f-ad147ba6c5f3]: (4, ('ok\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Flushing IO for device /dev/sdg {{(pid=103546) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[392c10ce-8796-4e6d-97e7-52a3ce2b7ac3]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=103546) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:10 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-66a4c7ba-c236-4e98-a6c9-172ef8047faf tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 549ee3db-0014-440f-bd3a-0d389f5eab88 is timed out.
Nov 16 03:49:10 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-66a4c7ba-c236-4e98-a6c9-172ef8047faf tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Successfully detached device vdb from instance 549ee3db-0014-440f-bd3a-0d389f5eab88 from the live domain config.
Nov 16 03:49:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66a4c7ba-c236-4e98-a6c9-172ef8047faf tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-66a4c7ba-c236-4e98-a6c9-172ef8047faf tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'umBXpsjk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl'}, None), 'kwargs': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:49:10 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-66a4c7ba-c236-4e98-a6c9-172ef8047faf tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:49:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-66a4c7ba-c236-4e98-a6c9-172ef8047faf tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.042s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45b1594-8670-4aa6-b7ef-4a384c140a4e]: (4, ('1', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] SCSI volumes sdg have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b')] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[798a9ae1-75b7-4f7a-89c3-504bc1ecd589]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b -p 172.16.0.220:3260 --logout {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[85409811-70fc-4576-bf7f-92bab81f4c03]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b, portal: 172.16.0.220,3260]
Nov 16 03:49:10 user nova-compute[103546]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b, portal: 172.16.0.220,3260] successful.
Nov 16 03:49:10 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b -p 172.16.0.220:3260 --op delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be95c74-7c8d-48bc-8e7a-68b67513280b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[eddb936d-f84c-4b43-a806-10637aeed195]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] <== disconnect_volume: return (339ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 03:49:10 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Deleting instance files /opt/stack/data/nova/instances/71059a8d-4e89-472c-9463-b38aa8063e33_del
Nov 16 03:49:10 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Deletion of /opt/stack/data/nova/instances/71059a8d-4e89-472c-9463-b38aa8063e33_del complete
Nov 16 03:49:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-66a4c7ba-c236-4e98-a6c9-172ef8047faf tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.176s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:49:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c7d833-6bd6-4ccd-95b4-50a773850328]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-66a4c7ba-c236-4e98-a6c9-172ef8047faf tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 03:49:11 user nova-compute[103546]: No targets found.
Nov 16 03:49:11 user nova-compute[103546]: iSNS:
Nov 16 03:49:11 user nova-compute[103546]: No targets found.
Nov 16 03:49:11 user nova-compute[103546]: STATIC:
Nov 16 03:49:11 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f
Nov 16 03:49:11 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:11 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:11 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb
Nov 16 03:49:11 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:11 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:11 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41
Nov 16 03:49:11 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:11 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:11 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57
Nov 16 03:49:11 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:11 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:11 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b
Nov 16 03:49:11 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:11 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:11 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75
Nov 16 03:49:11 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:11 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:11 user nova-compute[103546]: FIRMWARE:
Nov 16 03:49:11 user nova-compute[103546]: No targets found.
Nov 16 03:49:11 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-66a4c7ba-c236-4e98-a6c9-172ef8047faf tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 03:49:11 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 03:49:11 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-66a4c7ba-c236-4e98-a6c9-172ef8047faf tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[718259fb-3989-4eef-8e56-3a97c7344dd8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:11 user nova-compute[103546]: INFO nova.compute.manager [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Took 3.54 seconds to destroy the instance on the hypervisor.
Nov 16 03:49:11 user nova-compute[103546]: DEBUG oslo.service.loopingcall [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=103546) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG nova.compute.manager [-] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Deallocating network for instance {{(pid=103546) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] deallocate_for_instance() {{(pid=103546) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f6023f-4021-4e48-b810-bcdad486b606]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-66a4c7ba-c236-4e98-a6c9-172ef8047faf tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b (non-flash)
Nov 16 03:49:11 user nova-compute[103546]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f (non-flash)
Nov 16 03:49:11 user nova-compute[103546]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)
Nov 16 03:49:11 user nova-compute[103546]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:49:11 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:49:11 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:49:11 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-66a4c7ba-c236-4e98-a6c9-172ef8047faf tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b (non-flash)
Nov 16 03:49:11 user nova-compute[103546]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f (non-flash)
Nov 16 03:49:11 user nova-compute[103546]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)
Nov 16 03:49:11 user nova-compute[103546]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:49:11 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:49:11 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:49:11 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-66a4c7ba-c236-4e98-a6c9-172ef8047faf tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60cc2792d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b'): ({'sdl'}, set())}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-66a4c7ba-c236-4e98-a6c9-172ef8047faf tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Removing single pathed devices sdl {{(pid=103546) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7f18c5-d5d6-4324-8aae-4b819a983ddc]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdl {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdl" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4be28bf-4021-412a-9c76-64c2305fce89]: (4, ('ok\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-66a4c7ba-c236-4e98-a6c9-172ef8047faf tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Flushing IO for device /dev/sdl {{(pid=103546) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdl {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdl" returned: 0 in 0.012s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e274cad-5752-4fa8-a9fa-d1dc24767b96]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-66a4c7ba-c236-4e98-a6c9-172ef8047faf tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=103546) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdl/device/delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdl/device/delete" returned: 0 in 0.044s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea8fe3e-112e-472f-8c66-00373f93a808]: (4, ('1', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-66a4c7ba-c236-4e98-a6c9-172ef8047faf tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Checking to see if SCSI volumes sdl have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-66a4c7ba-c236-4e98-a6c9-172ef8047faf tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] SCSI volumes sdl have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-66a4c7ba-c236-4e98-a6c9-172ef8047faf tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b')] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace15a66-5086-4229-b6cf-242a5a0757f0]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-66a4c7ba-c236-4e98-a6c9-172ef8047faf tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b -p 172.16.0.220:3260 --logout {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd8efec-ba33-4edd-b9e4-53d2fad129c8]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-66a4c7ba-c236-4e98-a6c9-172ef8047faf tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b, portal: 172.16.0.220,3260]
Nov 16 03:49:11 user nova-compute[103546]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b, portal: 172.16.0.220,3260] successful.
Nov 16 03:49:11 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b -p 172.16.0.220:3260 --op delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5eb6a6f-3e50-4d96-b940-e6ad0caf5a0b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[268fb5a2-2f55-4e48-940c-aa48c50ad205]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-66a4c7ba-c236-4e98-a6c9-172ef8047faf tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-66a4c7ba-c236-4e98-a6c9-172ef8047faf tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-66a4c7ba-c236-4e98-a6c9-172ef8047faf tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] <== disconnect_volume: return (502ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66a4c7ba-c236-4e98-a6c9-172ef8047faf tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Acquiring lock "2cb84f00-0601-4199-ba6e-f09a27add736" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Lock "2cb84f00-0601-4199-ba6e-f09a27add736" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Acquiring lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:11 user nova-compute[103546]: INFO nova.compute.manager [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Terminating instance
Nov 16 03:49:11 user nova-compute[103546]: DEBUG nova.compute.manager [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Start destroying the instance on the hypervisor. {{(pid=103546) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG nova.compute.manager [req-b3eef961-ba05-4d6a-9081-174de8f179a8 req-bcc5e19e-b00a-4a65-a57b-a400d9fc717d service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received event network-vif-plugged-fc03966b-fcbc-4ed7-8ffb-2270a55b4e28 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-b3eef961-ba05-4d6a-9081-174de8f179a8 req-bcc5e19e-b00a-4a65-a57b-a400d9fc717d service nova] Acquiring lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-b3eef961-ba05-4d6a-9081-174de8f179a8 req-bcc5e19e-b00a-4a65-a57b-a400d9fc717d service nova] Lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-b3eef961-ba05-4d6a-9081-174de8f179a8 req-bcc5e19e-b00a-4a65-a57b-a400d9fc717d service nova] Lock "71059a8d-4e89-472c-9463-b38aa8063e33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG nova.compute.manager [req-b3eef961-ba05-4d6a-9081-174de8f179a8 req-bcc5e19e-b00a-4a65-a57b-a400d9fc717d service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] No waiting events found dispatching network-vif-plugged-fc03966b-fcbc-4ed7-8ffb-2270a55b4e28 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:49:11 user nova-compute[103546]: WARNING nova.compute.manager [req-b3eef961-ba05-4d6a-9081-174de8f179a8 req-bcc5e19e-b00a-4a65-a57b-a400d9fc717d service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received unexpected event network-vif-plugged-fc03966b-fcbc-4ed7-8ffb-2270a55b4e28 for instance with vm_state active and task_state deleting.
Nov 16 03:49:11 user nova-compute[103546]: DEBUG nova.compute.manager [req-b3eef961-ba05-4d6a-9081-174de8f179a8 req-bcc5e19e-b00a-4a65-a57b-a400d9fc717d service nova] [instance: fead4119-3ab9-4337-8b48-d3920e1112f4] Received event network-vif-deleted-55287b83-91c5-4c47-8ec5-c0da5bc3290e {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:11 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:12 user nova-compute[103546]: DEBUG nova.compute.manager [req-e548d3f3-e248-445e-9675-8d64247543d3 req-d9e38c60-a2c3-4e4f-903a-f183c3cb6a6b service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received event network-vif-unplugged-2159d4b9-42e0-48d5-bfdf-178ee853063c {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:49:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-e548d3f3-e248-445e-9675-8d64247543d3 req-d9e38c60-a2c3-4e4f-903a-f183c3cb6a6b service nova] Acquiring lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-e548d3f3-e248-445e-9675-8d64247543d3 req-d9e38c60-a2c3-4e4f-903a-f183c3cb6a6b service nova] Lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-e548d3f3-e248-445e-9675-8d64247543d3 req-d9e38c60-a2c3-4e4f-903a-f183c3cb6a6b service nova] Lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:12 user nova-compute[103546]: DEBUG nova.compute.manager [req-e548d3f3-e248-445e-9675-8d64247543d3 req-d9e38c60-a2c3-4e4f-903a-f183c3cb6a6b service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] No waiting events found dispatching network-vif-unplugged-2159d4b9-42e0-48d5-bfdf-178ee853063c {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:49:12 user nova-compute[103546]: DEBUG nova.compute.manager [req-e548d3f3-e248-445e-9675-8d64247543d3 req-d9e38c60-a2c3-4e4f-903a-f183c3cb6a6b service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received event network-vif-unplugged-2159d4b9-42e0-48d5-bfdf-178ee853063c for instance with task_state deleting. {{(pid=103546) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 03:49:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:12 user nova-compute[103546]: DEBUG nova.objects.instance [None req-66a4c7ba-c236-4e98-a6c9-172ef8047faf tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Lazy-loading 'flavor' on Instance uuid 549ee3db-0014-440f-bd3a-0d389f5eab88 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:49:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-66a4c7ba-c236-4e98-a6c9-172ef8047faf tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Lock "549ee3db-0014-440f-bd3a-0d389f5eab88" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.137s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:12 user nova-compute[103546]: DEBUG nova.compute.manager [req-1c93f643-7264-41ef-bbb7-b1135335b999 req-dbe22aaa-e9a4-4b7b-88ee-82c2ecd5371f service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received event network-vif-unplugged-75b2ff49-49cc-4b86-bdc6-6f9f76c06505 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:49:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-1c93f643-7264-41ef-bbb7-b1135335b999 req-dbe22aaa-e9a4-4b7b-88ee-82c2ecd5371f service nova] Acquiring lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-1c93f643-7264-41ef-bbb7-b1135335b999 req-dbe22aaa-e9a4-4b7b-88ee-82c2ecd5371f service nova] Lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-1c93f643-7264-41ef-bbb7-b1135335b999 req-dbe22aaa-e9a4-4b7b-88ee-82c2ecd5371f service nova] Lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:12 user nova-compute[103546]: DEBUG nova.compute.manager [req-1c93f643-7264-41ef-bbb7-b1135335b999 req-dbe22aaa-e9a4-4b7b-88ee-82c2ecd5371f service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] No waiting events found dispatching network-vif-unplugged-75b2ff49-49cc-4b86-bdc6-6f9f76c06505 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:49:12 user nova-compute[103546]: DEBUG nova.compute.manager [req-1c93f643-7264-41ef-bbb7-b1135335b999 req-dbe22aaa-e9a4-4b7b-88ee-82c2ecd5371f service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received event network-vif-unplugged-75b2ff49-49cc-4b86-bdc6-6f9f76c06505 for instance with task_state deleting. {{(pid=103546) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 03:49:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-84452d7a-0352-4e49-83f7-f0c5ae6fd30b tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Acquiring lock "interface-549ee3db-0014-440f-bd3a-0d389f5eab88-fe4680c0-c534-4f5b-8833-be40c2784953" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-84452d7a-0352-4e49-83f7-f0c5ae6fd30b tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Lock "interface-549ee3db-0014-440f-bd3a-0d389f5eab88-fe4680c0-c534-4f5b-8833-be40c2784953" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:12 user nova-compute[103546]: DEBUG nova.objects.instance [None req-84452d7a-0352-4e49-83f7-f0c5ae6fd30b tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Lazy-loading 'flavor' on Instance uuid 549ee3db-0014-440f-bd3a-0d389f5eab88 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:49:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:12 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-84452d7a-0352-4e49-83f7-f0c5ae6fd30b tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T03:46:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-350344638',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-350344638',id=7,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJC87S7hgP6v1mMgMgWP5mrEmsB7FxLODxvVGTyu4rK6Vav//N6bGlF4cB4wdjC5yBjD4JDskSZdj5aiBMflE+VUYysZErN4auZ89tuKfEpG07XZH2cPGYOTHxF0eBL3Dw==',key_name='tempest-keypair-83664986',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:46:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4445eb24618042ab9d24c869de5ccaab',ramdisk_id='',reservation_id='r-s6hqst93',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-401054631',owner_user_name='tempest-TaggedAttachmentsTest-401054631-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T03:46:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='843e14f393d849a9abc7759907a303ea',uuid=549ee3db-0014-440f-bd3a-0d389f5eab88,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe4680c0-c534-4f5b-8833-be40c2784953", "address": "fa:16:3e:38:66:93", "network": {"id": "45e450ee-a16a-4ae4-9e30-f5b3db0e6335", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-951951059", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4445eb24618042ab9d24c869de5ccaab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe4680c0-c5", "ovs_interfaceid": "fe4680c0-c534-4f5b-8833-be40c2784953", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 03:49:12 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-84452d7a-0352-4e49-83f7-f0c5ae6fd30b tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Converting VIF {"id": "fe4680c0-c534-4f5b-8833-be40c2784953", "address": "fa:16:3e:38:66:93", "network": {"id": "45e450ee-a16a-4ae4-9e30-f5b3db0e6335", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-951951059", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4445eb24618042ab9d24c869de5ccaab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe4680c0-c5", "ovs_interfaceid": "fe4680c0-c534-4f5b-8833-be40c2784953", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:49:12 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-84452d7a-0352-4e49-83f7-f0c5ae6fd30b tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:66:93,bridge_name='br-int',has_traffic_filtering=True,id=fe4680c0-c534-4f5b-8833-be40c2784953,network=Network(45e450ee-a16a-4ae4-9e30-f5b3db0e6335),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe4680c0-c5') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:49:12 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-84452d7a-0352-4e49-83f7-f0c5ae6fd30b tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:38:66:93"/><model type="virtio"/><mtu size="1442"/><target dev="tapfe4680c0-c5"/></interface> {{(pid=103546) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 16 03:49:12 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-84452d7a-0352-4e49-83f7-f0c5ae6fd30b tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:38:66:93"/><model type="virtio"/><mtu size="1442"/><target dev="tapfe4680c0-c5"/></interface> {{(pid=103546) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 16 03:49:12 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-84452d7a-0352-4e49-83f7-f0c5ae6fd30b tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Attempting to detach device tapfe4680c0-c5 from instance 549ee3db-0014-440f-bd3a-0d389f5eab88 from the persistent domain config. {{(pid=103546) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 03:49:12 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-84452d7a-0352-4e49-83f7-f0c5ae6fd30b tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] detach device xml: <interface type="ethernet">
Nov 16 03:49:12 user nova-compute[103546]:   <mac address="fa:16:3e:38:66:93"/>
Nov 16 03:49:12 user nova-compute[103546]:   <model type="virtio"/>
Nov 16 03:49:12 user nova-compute[103546]:   <mtu size="1442"/>
Nov 16 03:49:12 user nova-compute[103546]:   <target dev="tapfe4680c0-c5"/>
Nov 16 03:49:12 user nova-compute[103546]: </interface>
Nov 16 03:49:12 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 03:49:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:12 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-84452d7a-0352-4e49-83f7-f0c5ae6fd30b tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:38:66:93"/><model type="virtio"/><mtu size="1442"/><target dev="tapfe4680c0-c5"/></interface> {{(pid=103546) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 16 03:49:12 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-84452d7a-0352-4e49-83f7-f0c5ae6fd30b tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:38:66:93"/><model type="virtio"/><mtu size="1442"/><target dev="tapfe4680c0-c5"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 16 03:49:12 user nova-compute[103546]:   <name>instance-00000007</name>
Nov 16 03:49:12 user nova-compute[103546]:   <uuid>549ee3db-0014-440f-bd3a-0d389f5eab88</uuid>
Nov 16 03:49:12 user nova-compute[103546]:   <metadata>
Nov 16 03:49:12 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 03:49:12 user nova-compute[103546]:   <nova:package version="0.0.0"/>
Nov 16 03:49:12 user nova-compute[103546]:   <nova:name>tempest-device-tagging-server-350344638</nova:name>
Nov 16 03:49:12 user nova-compute[103546]:   <nova:creationTime>2023-11-16 03:48:40</nova:creationTime>
Nov 16 03:49:12 user nova-compute[103546]:   <nova:flavor name="m1.tiny">
Nov 16 03:49:12 user nova-compute[103546]:     <nova:memory>512</nova:memory>
Nov 16 03:49:12 user nova-compute[103546]:     <nova:disk>1</nova:disk>
Nov 16 03:49:12 user nova-compute[103546]:     <nova:swap>0</nova:swap>
Nov 16 03:49:12 user nova-compute[103546]:     <nova:ephemeral>0</nova:ephemeral>
Nov 16 03:49:12 user nova-compute[103546]:     <nova:vcpus>1</nova:vcpus>
Nov 16 03:49:12 user nova-compute[103546]:   </nova:flavor>
Nov 16 03:49:12 user nova-compute[103546]:   <nova:owner>
Nov 16 03:49:12 user nova-compute[103546]:     <nova:user uuid="843e14f393d849a9abc7759907a303ea">tempest-TaggedAttachmentsTest-401054631-project-member</nova:user>
Nov 16 03:49:12 user nova-compute[103546]:     <nova:project uuid="4445eb24618042ab9d24c869de5ccaab">tempest-TaggedAttachmentsTest-401054631</nova:project>
Nov 16 03:49:12 user nova-compute[103546]:   </nova:owner>
Nov 16 03:49:12 user nova-compute[103546]:   <nova:root type="image" uuid="5c6f539a-01e5-4478-bf8f-a14310b5d7dd"/>
Nov 16 03:49:12 user nova-compute[103546]:   <nova:ports>
Nov 16 03:49:12 user nova-compute[103546]:     <nova:port uuid="48a6af37-c461-4721-b870-432cf404dcf7">
Nov 16 03:49:12 user nova-compute[103546]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 16 03:49:12 user nova-compute[103546]:     </nova:port>
Nov 16 03:49:12 user nova-compute[103546]:     <nova:port uuid="fe4680c0-c534-4f5b-8833-be40c2784953">
Nov 16 03:49:12 user nova-compute[103546]:       <nova:ip type="fixed" address="10.10.10.225" ipVersion="4"/>
Nov 16 03:49:12 user nova-compute[103546]:     </nova:port>
Nov 16 03:49:12 user nova-compute[103546]:   </nova:ports>
Nov 16 03:49:12 user nova-compute[103546]: </nova:instance>
Nov 16 03:49:12 user nova-compute[103546]:   </metadata>
Nov 16 03:49:12 user nova-compute[103546]:   <memory unit='KiB'>524288</memory>
Nov 16 03:49:12 user nova-compute[103546]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 16 03:49:12 user nova-compute[103546]:   <vcpu placement='static'>1</vcpu>
Nov 16 03:49:12 user nova-compute[103546]:   <resource>
Nov 16 03:49:12 user nova-compute[103546]:     <partition>/machine</partition>
Nov 16 03:49:12 user nova-compute[103546]:   </resource>
Nov 16 03:49:12 user nova-compute[103546]:   <sysinfo type='smbios'>
Nov 16 03:49:12 user nova-compute[103546]:     <system>
Nov 16 03:49:12 user nova-compute[103546]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 16 03:49:12 user nova-compute[103546]:       <entry name='product'>OpenStack Nova</entry>
Nov 16 03:49:12 user nova-compute[103546]:       <entry name='version'>0.0.0</entry>
Nov 16 03:49:12 user nova-compute[103546]:       <entry name='serial'>549ee3db-0014-440f-bd3a-0d389f5eab88</entry>
Nov 16 03:49:12 user nova-compute[103546]:       <entry name='uuid'>549ee3db-0014-440f-bd3a-0d389f5eab88</entry>
Nov 16 03:49:12 user nova-compute[103546]:       <entry name='family'>Virtual Machine</entry>
Nov 16 03:49:12 user nova-compute[103546]:     </system>
Nov 16 03:49:12 user nova-compute[103546]:   </sysinfo>
Nov 16 03:49:12 user nova-compute[103546]:   <os>
Nov 16 03:49:12 user nova-compute[103546]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 16 03:49:12 user nova-compute[103546]:     <boot dev='hd'/>
Nov 16 03:49:12 user nova-compute[103546]:     <smbios mode='sysinfo'/>
Nov 16 03:49:12 user nova-compute[103546]:   </os>
Nov 16 03:49:12 user nova-compute[103546]:   <features>
Nov 16 03:49:12 user nova-compute[103546]:     <acpi/>
Nov 16 03:49:12 user nova-compute[103546]:     <apic/>
Nov 16 03:49:12 user nova-compute[103546]:     <vmcoreinfo state='on'/>
Nov 16 03:49:12 user nova-compute[103546]:   </features>
Nov 16 03:49:12 user nova-compute[103546]:   <cpu mode='custom' match='exact' check='full'>
Nov 16 03:49:12 user nova-compute[103546]:     <model fallback='forbid'>Nehalem</model>
Nov 16 03:49:12 user nova-compute[103546]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 16 03:49:12 user nova-compute[103546]:     <feature policy='require' name='vme'/>
Nov 16 03:49:12 user nova-compute[103546]:     <feature policy='require' name='x2apic'/>
Nov 16 03:49:12 user nova-compute[103546]:     <feature policy='require' name='hypervisor'/>
Nov 16 03:49:12 user nova-compute[103546]:   </cpu>
Nov 16 03:49:12 user nova-compute[103546]:   <clock offset='utc'>
Nov 16 03:49:12 user nova-compute[103546]:     <timer name='pit' tickpolicy='delay'/>
Nov 16 03:49:12 user nova-compute[103546]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 16 03:49:12 user nova-compute[103546]:     <timer name='hpet' present='no'/>
Nov 16 03:49:12 user nova-compute[103546]:   </clock>
Nov 16 03:49:12 user nova-compute[103546]:   <on_poweroff>destroy</on_poweroff>
Nov 16 03:49:12 user nova-compute[103546]:   <on_reboot>restart</on_reboot>
Nov 16 03:49:12 user nova-compute[103546]:   <on_crash>destroy</on_crash>
Nov 16 03:49:12 user nova-compute[103546]:   <devices>
Nov 16 03:49:12 user nova-compute[103546]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 16 03:49:12 user nova-compute[103546]:     <disk type='file' device='disk'>
Nov 16 03:49:12 user nova-compute[103546]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 16 03:49:12 user nova-compute[103546]:       <source file='/opt/stack/data/nova/instances/549ee3db-0014-440f-bd3a-0d389f5eab88/disk' index='2'/>
Nov 16 03:49:12 user nova-compute[103546]:       <backingStore type='file' index='3'>
Nov 16 03:49:12 user nova-compute[103546]:         <format type='raw'/>
Nov 16 03:49:12 user nova-compute[103546]:         <source file='/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7'/>
Nov 16 03:49:12 user nova-compute[103546]:         <backingStore/>
Nov 16 03:49:12 user nova-compute[103546]:       </backingStore>
Nov 16 03:49:12 user nova-compute[103546]:       <target dev='vda' bus='virtio'/>
Nov 16 03:49:12 user nova-compute[103546]:       <alias name='virtio-disk0'/>
Nov 16 03:49:12 user nova-compute[103546]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 16 03:49:12 user nova-compute[103546]:     </disk>
Nov 16 03:49:12 user nova-compute[103546]:     <disk type='file' device='cdrom'>
Nov 16 03:49:12 user nova-compute[103546]:       <driver name='qemu' type='raw' cache='none'/>
Nov 16 03:49:12 user nova-compute[103546]:       <source file='/opt/stack/data/nova/instances/549ee3db-0014-440f-bd3a-0d389f5eab88/disk.config' index='1'/>
Nov 16 03:49:12 user nova-compute[103546]:       <backingStore/>
Nov 16 03:49:12 user nova-compute[103546]:       <target dev='hda' bus='ide'/>
Nov 16 03:49:12 user nova-compute[103546]:       <readonly/>
Nov 16 03:49:12 user nova-compute[103546]:       <alias name='ide0-0-0'/>
Nov 16 03:49:12 user nova-compute[103546]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 16 03:49:12 user nova-compute[103546]:     </disk>
Nov 16 03:49:12 user nova-compute[103546]:     <controller type='usb' index='0' model='none'>
Nov 16 03:49:12 user nova-compute[103546]:       <alias name='usb'/>
Nov 16 03:49:12 user nova-compute[103546]:     </controller>
Nov 16 03:49:12 user nova-compute[103546]:     <controller type='pci' index='0' model='pci-root'>
Nov 16 03:49:12 user nova-compute[103546]:       <alias name='pci.0'/>
Nov 16 03:49:12 user nova-compute[103546]:     </controller>
Nov 16 03:49:12 user nova-compute[103546]:     <controller type='ide' index='0'>
Nov 16 03:49:12 user nova-compute[103546]:       <alias name='ide'/>
Nov 16 03:49:12 user nova-compute[103546]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 16 03:49:12 user nova-compute[103546]:     </controller>
Nov 16 03:49:12 user nova-compute[103546]:     <interface type='ethernet'>
Nov 16 03:49:12 user nova-compute[103546]:       <mac address='fa:16:3e:5b:50:00'/>
Nov 16 03:49:12 user nova-compute[103546]:       <target dev='tap48a6af37-c4'/>
Nov 16 03:49:12 user nova-compute[103546]:       <model type='virtio'/>
Nov 16 03:49:12 user nova-compute[103546]:       <mtu size='1442'/>
Nov 16 03:49:12 user nova-compute[103546]:       <alias name='net0'/>
Nov 16 03:49:12 user nova-compute[103546]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 16 03:49:12 user nova-compute[103546]:     </interface>
Nov 16 03:49:12 user nova-compute[103546]:     <interface type='ethernet'>
Nov 16 03:49:12 user nova-compute[103546]:       <mac address='fa:16:3e:38:66:93'/>
Nov 16 03:49:12 user nova-compute[103546]:       <target dev='tapfe4680c0-c5'/>
Nov 16 03:49:12 user nova-compute[103546]:       <model type='virtio'/>
Nov 16 03:49:12 user nova-compute[103546]:       <mtu size='1442'/>
Nov 16 03:49:12 user nova-compute[103546]:       <alias name='net1'/>
Nov 16 03:49:12 user nova-compute[103546]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 16 03:49:12 user nova-compute[103546]:     </interface>
Nov 16 03:49:12 user nova-compute[103546]:     <serial type='pty'>
Nov 16 03:49:12 user nova-compute[103546]:       <source path='/dev/pts/6'/>
Nov 16 03:49:12 user nova-compute[103546]:       <log file='/opt/stack/data/nova/instances/549ee3db-0014-440f-bd3a-0d389f5eab88/console.log' append='off'/>
Nov 16 03:49:12 user nova-compute[103546]:       <target type='isa-serial' port='0'>
Nov 16 03:49:12 user nova-compute[103546]:         <model name='isa-serial'/>
Nov 16 03:49:12 user nova-compute[103546]:       </target>
Nov 16 03:49:12 user nova-compute[103546]:       <alias name='serial0'/>
Nov 16 03:49:12 user nova-compute[103546]:     </serial>
Nov 16 03:49:12 user nova-compute[103546]:     <console type='pty' tty='/dev/pts/6'>
Nov 16 03:49:12 user nova-compute[103546]:       <source path='/dev/pts/6'/>
Nov 16 03:49:12 user nova-compute[103546]:       <log file='/opt/stack/data/nova/instances/549ee3db-0014-440f-bd3a-0d389f5eab88/console.log' append='off'/>
Nov 16 03:49:12 user nova-compute[103546]:       <target type='serial' port='0'/>
Nov 16 03:49:12 user nova-compute[103546]:       <alias name='serial0'/>
Nov 16 03:49:12 user nova-compute[103546]:     </console>
Nov 16 03:49:12 user nova-compute[103546]:     <input type='mouse' bus='ps2'>
Nov 16 03:49:12 user nova-compute[103546]:       <alias name='input0'/>
Nov 16 03:49:12 user nova-compute[103546]:     </input>
Nov 16 03:49:12 user nova-compute[103546]:     <input type='keyboard' bus='ps2'>
Nov 16 03:49:12 user nova-compute[103546]:       <alias name='input1'/>
Nov 16 03:49:12 user nova-compute[103546]:     </input>
Nov 16 03:49:12 user nova-compute[103546]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 16 03:49:12 user nova-compute[103546]:       <listen type='address' address='0.0.0.0'/>
Nov 16 03:49:12 user nova-compute[103546]:     </graphics>
Nov 16 03:49:12 user nova-compute[103546]:     <audio id='1' type='none'/>
Nov 16 03:49:12 user nova-compute[103546]:     <video>
Nov 16 03:49:12 user nova-compute[103546]:       <model type='virtio' heads='1' primary='yes'/>
Nov 16 03:49:12 user nova-compute[103546]:       <alias name='video0'/>
Nov 16 03:49:12 user nova-compute[103546]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 16 03:49:12 user nova-compute[103546]:     </video>
Nov 16 03:49:12 user nova-compute[103546]:     <memballoon model='virtio'>
Nov 16 03:49:12 user nova-compute[103546]:       <stats period='10'/>
Nov 16 03:49:12 user nova-compute[103546]:       <alias name='balloon0'/>
Nov 16 03:49:12 user nova-compute[103546]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 16 03:49:12 user nova-compute[103546]:     </memballoon>
Nov 16 03:49:12 user nova-compute[103546]:     <rng model='virtio'>
Nov 16 03:49:12 user nova-compute[103546]:       <backend model='random'>/dev/urandom</backend>
Nov 16 03:49:12 user nova-compute[103546]:       <alias name='rng0'/>
Nov 16 03:49:12 user nova-compute[103546]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 16 03:49:12 user nova-compute[103546]:     </rng>
Nov 16 03:49:12 user nova-compute[103546]:   </devices>
Nov 16 03:49:12 user nova-compute[103546]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 16 03:49:12 user nova-compute[103546]:     <label>libvirt-549ee3db-0014-440f-bd3a-0d389f5eab88</label>
Nov 16 03:49:12 user nova-compute[103546]:     <imagelabel>libvirt-549ee3db-0014-440f-bd3a-0d389f5eab88</imagelabel>
Nov 16 03:49:12 user nova-compute[103546]:   </seclabel>
Nov 16 03:49:12 user nova-compute[103546]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 16 03:49:12 user nova-compute[103546]:     <label>+64055:+108</label>
Nov 16 03:49:12 user nova-compute[103546]:     <imagelabel>+64055:+108</imagelabel>
Nov 16 03:49:12 user nova-compute[103546]:   </seclabel>
Nov 16 03:49:12 user nova-compute[103546]: </domain>
Nov 16 03:49:12 user nova-compute[103546]:  {{(pid=103546) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 16 03:49:13 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-84452d7a-0352-4e49-83f7-f0c5ae6fd30b tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Successfully detached device tapfe4680c0-c5 from instance 549ee3db-0014-440f-bd3a-0d389f5eab88 from the persistent domain config.
Nov 16 03:49:13 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-84452d7a-0352-4e49-83f7-f0c5ae6fd30b tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] (1/8): Attempting to detach device tapfe4680c0-c5 with device alias net1 from instance 549ee3db-0014-440f-bd3a-0d389f5eab88 from the live domain config. {{(pid=103546) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 03:49:13 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-84452d7a-0352-4e49-83f7-f0c5ae6fd30b tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] detach device xml: <interface type="ethernet">
Nov 16 03:49:13 user nova-compute[103546]:   <mac address="fa:16:3e:38:66:93"/>
Nov 16 03:49:13 user nova-compute[103546]:   <model type="virtio"/>
Nov 16 03:49:13 user nova-compute[103546]:   <mtu size="1442"/>
Nov 16 03:49:13 user nova-compute[103546]:   <target dev="tapfe4680c0-c5"/>
Nov 16 03:49:13 user nova-compute[103546]: </interface>
Nov 16 03:49:13 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 03:49:13 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-84452d7a-0352-4e49-83f7-f0c5ae6fd30b tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Start waiting for the detach event from libvirt for device tapfe4680c0-c5 with device alias net1 for instance 549ee3db-0014-440f-bd3a-0d389f5eab88 {{(pid=103546) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 03:49:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:13 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Instance destroyed successfully.
Nov 16 03:49:13 user nova-compute[103546]: DEBUG nova.objects.instance [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Lazy-loading 'resources' on Instance uuid 2cb84f00-0601-4199-ba6e-f09a27add736 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:49:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:13 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T03:47:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-766470017',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-766470017',id=10,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcOUIcHQE+PuNmY75VAQVSRnTba8AjrUsVmfAjG7EHCeVn8jzeyhEYtg2/jiz2Zl4NEr0BAFFwp5JFj1aYk8M4uENNWNNlYcDY92FwqpHASm1hjkK06mxwFNPN/w/A1RQ==',key_name='tempest-keypair-1790126314',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:47:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83b885bd172d45859e0eaa89af06f144',ramdisk_id='',reservation_id='r-06z2rapd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-629950856',owner_user_name='tempest-TaggedBootDevicesTest-629950856-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T03:47:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22747b2af109454c9aa3475c049d39bd',uuid=2cb84f00-0601-4199-ba6e-f09a27add736,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2159d4b9-42e0-48d5-bfdf-178ee853063c", "address": "fa:16:3e:5f:ff:36", "network": {"id": "a8bb0411-7c42-419f-9bc2-ea6219b732f8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1141379058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2159d4b9-42", "ovs_interfaceid": "2159d4b9-42e0-48d5-bfdf-178ee853063c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 03:49:13 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Converting VIF {"id": "2159d4b9-42e0-48d5-bfdf-178ee853063c", "address": "fa:16:3e:5f:ff:36", "network": {"id": "a8bb0411-7c42-419f-9bc2-ea6219b732f8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1141379058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2159d4b9-42", "ovs_interfaceid": "2159d4b9-42e0-48d5-bfdf-178ee853063c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:49:13 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:ff:36,bridge_name='br-int',has_traffic_filtering=True,id=2159d4b9-42e0-48d5-bfdf-178ee853063c,network=Network(a8bb0411-7c42-419f-9bc2-ea6219b732f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2159d4b9-42') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:49:13 user nova-compute[103546]: DEBUG os_vif [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:ff:36,bridge_name='br-int',has_traffic_filtering=True,id=2159d4b9-42e0-48d5-bfdf-178ee853063c,network=Network(a8bb0411-7c42-419f-9bc2-ea6219b732f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2159d4b9-42') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 03:49:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2159d4b9-42, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:49:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:49:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9cd08ca6-fa34-4f9e-9960-b67da3cc9f1c) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:49:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:49:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:13 user nova-compute[103546]: INFO os_vif [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:ff:36,bridge_name='br-int',has_traffic_filtering=True,id=2159d4b9-42e0-48d5-bfdf-178ee853063c,network=Network(a8bb0411-7c42-419f-9bc2-ea6219b732f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2159d4b9-42')
Nov 16 03:49:13 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T03:47:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-766470017',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-766470017',id=10,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcOUIcHQE+PuNmY75VAQVSRnTba8AjrUsVmfAjG7EHCeVn8jzeyhEYtg2/jiz2Zl4NEr0BAFFwp5JFj1aYk8M4uENNWNNlYcDY92FwqpHASm1hjkK06mxwFNPN/w/A1RQ==',key_name='tempest-keypair-1790126314',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:47:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83b885bd172d45859e0eaa89af06f144',ramdisk_id='',reservation_id='r-06z2rapd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-629950856',owner_user_name='tempest-TaggedBootDevicesTest-629950856-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T03:47:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22747b2af109454c9aa3475c049d39bd',uuid=2cb84f00-0601-4199-ba6e-f09a27add736,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cf751a83-e099-48a1-9219-fb781500b02c", "address": "fa:16:3e:3b:05:73", "network": {"id": "049ff849-6358-448d-9530-ae2102396888", "bridge": "br-int", "label": "tempest-device-tagging-net1-926406277", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf751a83-e0", "ovs_interfaceid": "cf751a83-e099-48a1-9219-fb781500b02c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 03:49:13 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Converting VIF {"id": "cf751a83-e099-48a1-9219-fb781500b02c", "address": "fa:16:3e:3b:05:73", "network": {"id": "049ff849-6358-448d-9530-ae2102396888", "bridge": "br-int", "label": "tempest-device-tagging-net1-926406277", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf751a83-e0", "ovs_interfaceid": "cf751a83-e099-48a1-9219-fb781500b02c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:49:13 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:05:73,bridge_name='br-int',has_traffic_filtering=True,id=cf751a83-e099-48a1-9219-fb781500b02c,network=Network(049ff849-6358-448d-9530-ae2102396888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcf751a83-e0') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:49:13 user nova-compute[103546]: DEBUG os_vif [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:05:73,bridge_name='br-int',has_traffic_filtering=True,id=cf751a83-e099-48a1-9219-fb781500b02c,network=Network(049ff849-6358-448d-9530-ae2102396888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcf751a83-e0') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 03:49:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcf751a83-e0, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:49:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:49:13 user nova-compute[103546]: DEBUG nova.compute.manager [req-a467d1d9-200d-4e75-86fa-4c25a71c0352 req-908048a2-61f1-4805-afbe-7db346df9f5e service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received event network-vif-unplugged-cf751a83-e099-48a1-9219-fb781500b02c {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:49:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a467d1d9-200d-4e75-86fa-4c25a71c0352 req-908048a2-61f1-4805-afbe-7db346df9f5e service nova] Acquiring lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a467d1d9-200d-4e75-86fa-4c25a71c0352 req-908048a2-61f1-4805-afbe-7db346df9f5e service nova] Lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a467d1d9-200d-4e75-86fa-4c25a71c0352 req-908048a2-61f1-4805-afbe-7db346df9f5e service nova] Lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:13 user nova-compute[103546]: DEBUG nova.compute.manager [req-a467d1d9-200d-4e75-86fa-4c25a71c0352 req-908048a2-61f1-4805-afbe-7db346df9f5e service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] No waiting events found dispatching network-vif-unplugged-cf751a83-e099-48a1-9219-fb781500b02c {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:49:13 user nova-compute[103546]: DEBUG nova.compute.manager [req-a467d1d9-200d-4e75-86fa-4c25a71c0352 req-908048a2-61f1-4805-afbe-7db346df9f5e service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received event network-vif-unplugged-cf751a83-e099-48a1-9219-fb781500b02c for instance with task_state deleting. {{(pid=103546) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 03:49:13 user nova-compute[103546]: DEBUG nova.compute.manager [req-a467d1d9-200d-4e75-86fa-4c25a71c0352 req-908048a2-61f1-4805-afbe-7db346df9f5e service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received event network-vif-plugged-cf751a83-e099-48a1-9219-fb781500b02c {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:49:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a467d1d9-200d-4e75-86fa-4c25a71c0352 req-908048a2-61f1-4805-afbe-7db346df9f5e service nova] Acquiring lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a467d1d9-200d-4e75-86fa-4c25a71c0352 req-908048a2-61f1-4805-afbe-7db346df9f5e service nova] Lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a467d1d9-200d-4e75-86fa-4c25a71c0352 req-908048a2-61f1-4805-afbe-7db346df9f5e service nova] Lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:13 user nova-compute[103546]: DEBUG nova.compute.manager [req-a467d1d9-200d-4e75-86fa-4c25a71c0352 req-908048a2-61f1-4805-afbe-7db346df9f5e service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] No waiting events found dispatching network-vif-plugged-cf751a83-e099-48a1-9219-fb781500b02c {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:49:13 user nova-compute[103546]: WARNING nova.compute.manager [req-a467d1d9-200d-4e75-86fa-4c25a71c0352 req-908048a2-61f1-4805-afbe-7db346df9f5e service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received unexpected event network-vif-plugged-cf751a83-e099-48a1-9219-fb781500b02c for instance with vm_state active and task_state deleting.
Nov 16 03:49:13 user nova-compute[103546]: DEBUG nova.compute.manager [req-a467d1d9-200d-4e75-86fa-4c25a71c0352 req-908048a2-61f1-4805-afbe-7db346df9f5e service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received event network-vif-unplugged-96e41ba8-e2bd-48d3-a8e0-94c5f76d618a {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:49:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a467d1d9-200d-4e75-86fa-4c25a71c0352 req-908048a2-61f1-4805-afbe-7db346df9f5e service nova] Acquiring lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a467d1d9-200d-4e75-86fa-4c25a71c0352 req-908048a2-61f1-4805-afbe-7db346df9f5e service nova] Lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a467d1d9-200d-4e75-86fa-4c25a71c0352 req-908048a2-61f1-4805-afbe-7db346df9f5e service nova] Lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:13 user nova-compute[103546]: DEBUG nova.compute.manager [req-a467d1d9-200d-4e75-86fa-4c25a71c0352 req-908048a2-61f1-4805-afbe-7db346df9f5e service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] No waiting events found dispatching network-vif-unplugged-96e41ba8-e2bd-48d3-a8e0-94c5f76d618a {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:49:13 user nova-compute[103546]: DEBUG nova.compute.manager [req-a467d1d9-200d-4e75-86fa-4c25a71c0352 req-908048a2-61f1-4805-afbe-7db346df9f5e service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received event network-vif-unplugged-96e41ba8-e2bd-48d3-a8e0-94c5f76d618a for instance with task_state deleting. {{(pid=103546) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 03:49:13 user nova-compute[103546]: DEBUG nova.compute.manager [req-a467d1d9-200d-4e75-86fa-4c25a71c0352 req-908048a2-61f1-4805-afbe-7db346df9f5e service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received event network-vif-plugged-96e41ba8-e2bd-48d3-a8e0-94c5f76d618a {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:49:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a467d1d9-200d-4e75-86fa-4c25a71c0352 req-908048a2-61f1-4805-afbe-7db346df9f5e service nova] Acquiring lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a467d1d9-200d-4e75-86fa-4c25a71c0352 req-908048a2-61f1-4805-afbe-7db346df9f5e service nova] Lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a467d1d9-200d-4e75-86fa-4c25a71c0352 req-908048a2-61f1-4805-afbe-7db346df9f5e service nova] Lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:13 user nova-compute[103546]: DEBUG nova.compute.manager [req-a467d1d9-200d-4e75-86fa-4c25a71c0352 req-908048a2-61f1-4805-afbe-7db346df9f5e service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] No waiting events found dispatching network-vif-plugged-96e41ba8-e2bd-48d3-a8e0-94c5f76d618a {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:49:13 user nova-compute[103546]: WARNING nova.compute.manager [req-a467d1d9-200d-4e75-86fa-4c25a71c0352 req-908048a2-61f1-4805-afbe-7db346df9f5e service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received unexpected event network-vif-plugged-96e41ba8-e2bd-48d3-a8e0-94c5f76d618a for instance with vm_state active and task_state deleting.
Nov 16 03:49:13 user nova-compute[103546]: DEBUG nova.compute.manager [req-a467d1d9-200d-4e75-86fa-4c25a71c0352 req-908048a2-61f1-4805-afbe-7db346df9f5e service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received event network-vif-deleted-1fb75f05-a4ef-45d5-9eb4-5e8428997947 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:49:13 user nova-compute[103546]: INFO nova.compute.manager [req-a467d1d9-200d-4e75-86fa-4c25a71c0352 req-908048a2-61f1-4805-afbe-7db346df9f5e service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Neutron deleted interface 1fb75f05-a4ef-45d5-9eb4-5e8428997947; detaching it from the instance and deleting it from the info cache
Nov 16 03:49:13 user nova-compute[103546]: DEBUG nova.network.neutron [req-a467d1d9-200d-4e75-86fa-4c25a71c0352 req-908048a2-61f1-4805-afbe-7db346df9f5e service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Updating instance_info_cache with network_info: [{"id": "76b69715-356f-496a-85a3-f5bde976e201", "address": "fa:16:3e:72:5a:35", "network": {"id": "f84b2b6b-c73a-41d8-a9bb-3e73bb607a42", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1721792603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76b69715-35", "ovs_interfaceid": "76b69715-356f-496a-85a3-f5bde976e201", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "21653257-8a66-44f1-b806-2fae4641e1d2", "address": "fa:16:3e:91:a8:b5", "network": {"id": "4b071e67-eb71-49f5-a24f-cada83cca606", "bridge": "br-int", "label": "tempest-device-tagging-net1-1064540428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21653257-8a", "ovs_interfaceid": "21653257-8a66-44f1-b806-2fae4641e1d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "916a3fe8-09df-42a1-9ac0-b81153ed55a1", "address": "fa:16:3e:00:b7:5f", "network": {"id": "4b071e67-eb71-49f5-a24f-cada83cca606", "bridge": "br-int", "label": "tempest-device-tagging-net1-1064540428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap916a3fe8-09", "ovs_interfaceid": "916a3fe8-09df-42a1-9ac0-b81153ed55a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "51e087e4-ff6b-49a8-8190-cfc243436d35", "address": "fa:16:3e:3f:53:f1", "network": {"id": "4b071e67-eb71-49f5-a24f-cada83cca606", "bridge": "br-int", "label": "tempest-device-tagging-net1-1064540428", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51e087e4-ff", "ovs_interfaceid": "51e087e4-ff6b-49a8-8190-cfc243436d35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b0f609b8-eb49-4c19-968c-99c95c38b857", "address": "fa:16:3e:dc:33:a5", "network": {"id": "f9af5267-5cc4-44b4-9226-2da63e754907", "bridge": "br-int", "label": "tempest-device-tagging-net2-640329577", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0f609b8-eb", "ovs_interfaceid": "b0f609b8-eb49-4c19-968c-99c95c38b857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fc03966b-fcbc-4ed7-8ffb-2270a55b4e28", "address": "fa:16:3e:75:5a:4b", "network": {"id": "f9af5267-5cc4-44b4-9226-2da63e754907", "bridge": "br-int", "label": "tempest-device-tagging-net2-640329577", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54df5ea6e7a24d49bb8f430fb9248934", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc03966b-fc", "ovs_interfaceid": "fc03966b-fcbc-4ed7-8ffb-2270a55b4e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:49:13 user nova-compute[103546]: DEBUG nova.compute.manager [req-a467d1d9-200d-4e75-86fa-4c25a71c0352 req-908048a2-61f1-4805-afbe-7db346df9f5e service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Detach interface failed, port_id=1fb75f05-a4ef-45d5-9eb4-5e8428997947, reason: Instance 71059a8d-4e89-472c-9463-b38aa8063e33 could not be found. {{(pid=103546) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 03:49:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=969977d6-0883-44a0-82ee-06ea68b7419a) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:49:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:49:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:13 user nova-compute[103546]: INFO os_vif [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:05:73,bridge_name='br-int',has_traffic_filtering=True,id=cf751a83-e099-48a1-9219-fb781500b02c,network=Network(049ff849-6358-448d-9530-ae2102396888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcf751a83-e0')
Nov 16 03:49:13 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T03:47:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-766470017',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-766470017',id=10,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcOUIcHQE+PuNmY75VAQVSRnTba8AjrUsVmfAjG7EHCeVn8jzeyhEYtg2/jiz2Zl4NEr0BAFFwp5JFj1aYk8M4uENNWNNlYcDY92FwqpHASm1hjkK06mxwFNPN/w/A1RQ==',key_name='tempest-keypair-1790126314',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:47:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83b885bd172d45859e0eaa89af06f144',ramdisk_id='',reservation_id='r-06z2rapd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-629950856',owner_user_name='tempest-TaggedBootDevicesTest-629950856-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T03:47:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22747b2af109454c9aa3475c049d39bd',uuid=2cb84f00-0601-4199-ba6e-f09a27add736,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96e41ba8-e2bd-48d3-a8e0-94c5f76d618a", "address": "fa:16:3e:e1:ce:8a", "network": {"id": "049ff849-6358-448d-9530-ae2102396888", "bridge": "br-int", "label": "tempest-device-tagging-net1-926406277", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96e41ba8-e2", "ovs_interfaceid": "96e41ba8-e2bd-48d3-a8e0-94c5f76d618a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 03:49:13 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Converting VIF {"id": "96e41ba8-e2bd-48d3-a8e0-94c5f76d618a", "address": "fa:16:3e:e1:ce:8a", "network": {"id": "049ff849-6358-448d-9530-ae2102396888", "bridge": "br-int", "label": "tempest-device-tagging-net1-926406277", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96e41ba8-e2", "ovs_interfaceid": "96e41ba8-e2bd-48d3-a8e0-94c5f76d618a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:49:13 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:ce:8a,bridge_name='br-int',has_traffic_filtering=True,id=96e41ba8-e2bd-48d3-a8e0-94c5f76d618a,network=Network(049ff849-6358-448d-9530-ae2102396888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap96e41ba8-e2') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:49:13 user nova-compute[103546]: DEBUG os_vif [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:ce:8a,bridge_name='br-int',has_traffic_filtering=True,id=96e41ba8-e2bd-48d3-a8e0-94c5f76d618a,network=Network(049ff849-6358-448d-9530-ae2102396888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap96e41ba8-e2') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 03:49:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96e41ba8-e2, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:49:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=18669e98-fa38-45e6-b5ee-be6531aa93ba) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG nova.compute.manager [req-e8c42466-daa8-46a4-b6c0-f373bffdd0b5 req-2afb2e03-d1f4-42ff-b63a-3c9278f557bd service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received event network-vif-plugged-2159d4b9-42e0-48d5-bfdf-178ee853063c {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-e8c42466-daa8-46a4-b6c0-f373bffdd0b5 req-2afb2e03-d1f4-42ff-b63a-3c9278f557bd service nova] Acquiring lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-e8c42466-daa8-46a4-b6c0-f373bffdd0b5 req-2afb2e03-d1f4-42ff-b63a-3c9278f557bd service nova] Lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-e8c42466-daa8-46a4-b6c0-f373bffdd0b5 req-2afb2e03-d1f4-42ff-b63a-3c9278f557bd service nova] Lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG nova.compute.manager [req-e8c42466-daa8-46a4-b6c0-f373bffdd0b5 req-2afb2e03-d1f4-42ff-b63a-3c9278f557bd service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] No waiting events found dispatching network-vif-plugged-2159d4b9-42e0-48d5-bfdf-178ee853063c {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:49:14 user nova-compute[103546]: WARNING nova.compute.manager [req-e8c42466-daa8-46a4-b6c0-f373bffdd0b5 req-2afb2e03-d1f4-42ff-b63a-3c9278f557bd service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received unexpected event network-vif-plugged-2159d4b9-42e0-48d5-bfdf-178ee853063c for instance with vm_state active and task_state deleting.
Nov 16 03:49:14 user nova-compute[103546]: DEBUG nova.compute.manager [req-e8c42466-daa8-46a4-b6c0-f373bffdd0b5 req-2afb2e03-d1f4-42ff-b63a-3c9278f557bd service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received event network-vif-unplugged-1b75ba8c-049f-404a-aa82-0323bf51191c {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-e8c42466-daa8-46a4-b6c0-f373bffdd0b5 req-2afb2e03-d1f4-42ff-b63a-3c9278f557bd service nova] Acquiring lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-e8c42466-daa8-46a4-b6c0-f373bffdd0b5 req-2afb2e03-d1f4-42ff-b63a-3c9278f557bd service nova] Lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-e8c42466-daa8-46a4-b6c0-f373bffdd0b5 req-2afb2e03-d1f4-42ff-b63a-3c9278f557bd service nova] Lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG nova.compute.manager [req-e8c42466-daa8-46a4-b6c0-f373bffdd0b5 req-2afb2e03-d1f4-42ff-b63a-3c9278f557bd service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] No waiting events found dispatching network-vif-unplugged-1b75ba8c-049f-404a-aa82-0323bf51191c {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG nova.compute.manager [req-e8c42466-daa8-46a4-b6c0-f373bffdd0b5 req-2afb2e03-d1f4-42ff-b63a-3c9278f557bd service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received event network-vif-unplugged-1b75ba8c-049f-404a-aa82-0323bf51191c for instance with task_state deleting. {{(pid=103546) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG nova.compute.manager [req-e8c42466-daa8-46a4-b6c0-f373bffdd0b5 req-2afb2e03-d1f4-42ff-b63a-3c9278f557bd service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received event network-vif-plugged-1b75ba8c-049f-404a-aa82-0323bf51191c {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-e8c42466-daa8-46a4-b6c0-f373bffdd0b5 req-2afb2e03-d1f4-42ff-b63a-3c9278f557bd service nova] Acquiring lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-e8c42466-daa8-46a4-b6c0-f373bffdd0b5 req-2afb2e03-d1f4-42ff-b63a-3c9278f557bd service nova] Lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-e8c42466-daa8-46a4-b6c0-f373bffdd0b5 req-2afb2e03-d1f4-42ff-b63a-3c9278f557bd service nova] Lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG nova.compute.manager [req-e8c42466-daa8-46a4-b6c0-f373bffdd0b5 req-2afb2e03-d1f4-42ff-b63a-3c9278f557bd service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] No waiting events found dispatching network-vif-plugged-1b75ba8c-049f-404a-aa82-0323bf51191c {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:49:14 user nova-compute[103546]: WARNING nova.compute.manager [req-e8c42466-daa8-46a4-b6c0-f373bffdd0b5 req-2afb2e03-d1f4-42ff-b63a-3c9278f557bd service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received unexpected event network-vif-plugged-1b75ba8c-049f-404a-aa82-0323bf51191c for instance with vm_state active and task_state deleting.
Nov 16 03:49:14 user nova-compute[103546]: DEBUG nova.compute.manager [req-e8c42466-daa8-46a4-b6c0-f373bffdd0b5 req-2afb2e03-d1f4-42ff-b63a-3c9278f557bd service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received event network-vif-unplugged-c2216378-faa5-4bdc-8706-0be8df7807c0 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-e8c42466-daa8-46a4-b6c0-f373bffdd0b5 req-2afb2e03-d1f4-42ff-b63a-3c9278f557bd service nova] Acquiring lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-e8c42466-daa8-46a4-b6c0-f373bffdd0b5 req-2afb2e03-d1f4-42ff-b63a-3c9278f557bd service nova] Lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-e8c42466-daa8-46a4-b6c0-f373bffdd0b5 req-2afb2e03-d1f4-42ff-b63a-3c9278f557bd service nova] Lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG nova.compute.manager [req-e8c42466-daa8-46a4-b6c0-f373bffdd0b5 req-2afb2e03-d1f4-42ff-b63a-3c9278f557bd service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] No waiting events found dispatching network-vif-unplugged-c2216378-faa5-4bdc-8706-0be8df7807c0 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG nova.compute.manager [req-e8c42466-daa8-46a4-b6c0-f373bffdd0b5 req-2afb2e03-d1f4-42ff-b63a-3c9278f557bd service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received event network-vif-unplugged-c2216378-faa5-4bdc-8706-0be8df7807c0 for instance with task_state deleting. {{(pid=103546) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG nova.compute.manager [req-e8c42466-daa8-46a4-b6c0-f373bffdd0b5 req-2afb2e03-d1f4-42ff-b63a-3c9278f557bd service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received event network-vif-plugged-c2216378-faa5-4bdc-8706-0be8df7807c0 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-e8c42466-daa8-46a4-b6c0-f373bffdd0b5 req-2afb2e03-d1f4-42ff-b63a-3c9278f557bd service nova] Acquiring lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-e8c42466-daa8-46a4-b6c0-f373bffdd0b5 req-2afb2e03-d1f4-42ff-b63a-3c9278f557bd service nova] Lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-e8c42466-daa8-46a4-b6c0-f373bffdd0b5 req-2afb2e03-d1f4-42ff-b63a-3c9278f557bd service nova] Lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG nova.compute.manager [req-e8c42466-daa8-46a4-b6c0-f373bffdd0b5 req-2afb2e03-d1f4-42ff-b63a-3c9278f557bd service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] No waiting events found dispatching network-vif-plugged-c2216378-faa5-4bdc-8706-0be8df7807c0 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:49:14 user nova-compute[103546]: WARNING nova.compute.manager [req-e8c42466-daa8-46a4-b6c0-f373bffdd0b5 req-2afb2e03-d1f4-42ff-b63a-3c9278f557bd service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received unexpected event network-vif-plugged-c2216378-faa5-4bdc-8706-0be8df7807c0 for instance with vm_state active and task_state deleting.
Nov 16 03:49:14 user nova-compute[103546]: DEBUG nova.compute.manager [req-e8c42466-daa8-46a4-b6c0-f373bffdd0b5 req-2afb2e03-d1f4-42ff-b63a-3c9278f557bd service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received event network-vif-unplugged-87ab6a10-d50c-460e-b891-ce6439614185 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-e8c42466-daa8-46a4-b6c0-f373bffdd0b5 req-2afb2e03-d1f4-42ff-b63a-3c9278f557bd service nova] Acquiring lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-e8c42466-daa8-46a4-b6c0-f373bffdd0b5 req-2afb2e03-d1f4-42ff-b63a-3c9278f557bd service nova] Lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-e8c42466-daa8-46a4-b6c0-f373bffdd0b5 req-2afb2e03-d1f4-42ff-b63a-3c9278f557bd service nova] Lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG nova.compute.manager [req-e8c42466-daa8-46a4-b6c0-f373bffdd0b5 req-2afb2e03-d1f4-42ff-b63a-3c9278f557bd service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] No waiting events found dispatching network-vif-unplugged-87ab6a10-d50c-460e-b891-ce6439614185 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG nova.compute.manager [req-e8c42466-daa8-46a4-b6c0-f373bffdd0b5 req-2afb2e03-d1f4-42ff-b63a-3c9278f557bd service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received event network-vif-unplugged-87ab6a10-d50c-460e-b891-ce6439614185 for instance with task_state deleting. {{(pid=103546) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG nova.compute.manager [req-e8c42466-daa8-46a4-b6c0-f373bffdd0b5 req-2afb2e03-d1f4-42ff-b63a-3c9278f557bd service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received event network-vif-plugged-87ab6a10-d50c-460e-b891-ce6439614185 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-e8c42466-daa8-46a4-b6c0-f373bffdd0b5 req-2afb2e03-d1f4-42ff-b63a-3c9278f557bd service nova] Acquiring lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-e8c42466-daa8-46a4-b6c0-f373bffdd0b5 req-2afb2e03-d1f4-42ff-b63a-3c9278f557bd service nova] Lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-e8c42466-daa8-46a4-b6c0-f373bffdd0b5 req-2afb2e03-d1f4-42ff-b63a-3c9278f557bd service nova] Lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG nova.compute.manager [req-e8c42466-daa8-46a4-b6c0-f373bffdd0b5 req-2afb2e03-d1f4-42ff-b63a-3c9278f557bd service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] No waiting events found dispatching network-vif-plugged-87ab6a10-d50c-460e-b891-ce6439614185 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:49:14 user nova-compute[103546]: WARNING nova.compute.manager [req-e8c42466-daa8-46a4-b6c0-f373bffdd0b5 req-2afb2e03-d1f4-42ff-b63a-3c9278f557bd service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received unexpected event network-vif-plugged-87ab6a10-d50c-460e-b891-ce6439614185 for instance with vm_state active and task_state deleting.
Nov 16 03:49:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:14 user nova-compute[103546]: INFO os_vif [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:ce:8a,bridge_name='br-int',has_traffic_filtering=True,id=96e41ba8-e2bd-48d3-a8e0-94c5f76d618a,network=Network(049ff849-6358-448d-9530-ae2102396888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap96e41ba8-e2')
Nov 16 03:49:14 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T03:47:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-766470017',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-766470017',id=10,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcOUIcHQE+PuNmY75VAQVSRnTba8AjrUsVmfAjG7EHCeVn8jzeyhEYtg2/jiz2Zl4NEr0BAFFwp5JFj1aYk8M4uENNWNNlYcDY92FwqpHASm1hjkK06mxwFNPN/w/A1RQ==',key_name='tempest-keypair-1790126314',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:47:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83b885bd172d45859e0eaa89af06f144',ramdisk_id='',reservation_id='r-06z2rapd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-629950856',owner_user_name='tempest-TaggedBootDevicesTest-629950856-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T03:47:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22747b2af109454c9aa3475c049d39bd',uuid=2cb84f00-0601-4199-ba6e-f09a27add736,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1b75ba8c-049f-404a-aa82-0323bf51191c", "address": "fa:16:3e:51:e9:22", "network": {"id": "049ff849-6358-448d-9530-ae2102396888", "bridge": "br-int", "label": "tempest-device-tagging-net1-926406277", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b75ba8c-04", "ovs_interfaceid": "1b75ba8c-049f-404a-aa82-0323bf51191c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Converting VIF {"id": "1b75ba8c-049f-404a-aa82-0323bf51191c", "address": "fa:16:3e:51:e9:22", "network": {"id": "049ff849-6358-448d-9530-ae2102396888", "bridge": "br-int", "label": "tempest-device-tagging-net1-926406277", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b75ba8c-04", "ovs_interfaceid": "1b75ba8c-049f-404a-aa82-0323bf51191c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:e9:22,bridge_name='br-int',has_traffic_filtering=True,id=1b75ba8c-049f-404a-aa82-0323bf51191c,network=Network(049ff849-6358-448d-9530-ae2102396888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b75ba8c-04') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG os_vif [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:e9:22,bridge_name='br-int',has_traffic_filtering=True,id=1b75ba8c-049f-404a-aa82-0323bf51191c,network=Network(049ff849-6358-448d-9530-ae2102396888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b75ba8c-04') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1b75ba8c-04, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1eed384e-fbd2-4c91-8e84-cb9c42af19ab) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:14 user nova-compute[103546]: INFO os_vif [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:e9:22,bridge_name='br-int',has_traffic_filtering=True,id=1b75ba8c-049f-404a-aa82-0323bf51191c,network=Network(049ff849-6358-448d-9530-ae2102396888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b75ba8c-04')
Nov 16 03:49:14 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T03:47:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-766470017',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-766470017',id=10,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcOUIcHQE+PuNmY75VAQVSRnTba8AjrUsVmfAjG7EHCeVn8jzeyhEYtg2/jiz2Zl4NEr0BAFFwp5JFj1aYk8M4uENNWNNlYcDY92FwqpHASm1hjkK06mxwFNPN/w/A1RQ==',key_name='tempest-keypair-1790126314',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:47:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83b885bd172d45859e0eaa89af06f144',ramdisk_id='',reservation_id='r-06z2rapd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-629950856',owner_user_name='tempest-TaggedBootDevicesTest-629950856-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T03:47:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22747b2af109454c9aa3475c049d39bd',uuid=2cb84f00-0601-4199-ba6e-f09a27add736,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c2216378-faa5-4bdc-8706-0be8df7807c0", "address": "fa:16:3e:aa:93:87", "network": {"id": "049ff849-6358-448d-9530-ae2102396888", "bridge": "br-int", "label": "tempest-device-tagging-net1-926406277", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2216378-fa", "ovs_interfaceid": "c2216378-faa5-4bdc-8706-0be8df7807c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Converting VIF {"id": "c2216378-faa5-4bdc-8706-0be8df7807c0", "address": "fa:16:3e:aa:93:87", "network": {"id": "049ff849-6358-448d-9530-ae2102396888", "bridge": "br-int", "label": "tempest-device-tagging-net1-926406277", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2216378-fa", "ovs_interfaceid": "c2216378-faa5-4bdc-8706-0be8df7807c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:93:87,bridge_name='br-int',has_traffic_filtering=True,id=c2216378-faa5-4bdc-8706-0be8df7807c0,network=Network(049ff849-6358-448d-9530-ae2102396888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2216378-fa') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG os_vif [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:93:87,bridge_name='br-int',has_traffic_filtering=True,id=c2216378-faa5-4bdc-8706-0be8df7807c0,network=Network(049ff849-6358-448d-9530-ae2102396888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2216378-fa') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc2216378-fa, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1d186975-1edd-4765-ac77-b89eb8575da3) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:14 user nova-compute[103546]: INFO os_vif [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:93:87,bridge_name='br-int',has_traffic_filtering=True,id=c2216378-faa5-4bdc-8706-0be8df7807c0,network=Network(049ff849-6358-448d-9530-ae2102396888),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2216378-fa')
Nov 16 03:49:14 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T03:47:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-766470017',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-766470017',id=10,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcOUIcHQE+PuNmY75VAQVSRnTba8AjrUsVmfAjG7EHCeVn8jzeyhEYtg2/jiz2Zl4NEr0BAFFwp5JFj1aYk8M4uENNWNNlYcDY92FwqpHASm1hjkK06mxwFNPN/w/A1RQ==',key_name='tempest-keypair-1790126314',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:47:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83b885bd172d45859e0eaa89af06f144',ramdisk_id='',reservation_id='r-06z2rapd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-629950856',owner_user_name='tempest-TaggedBootDevicesTest-629950856-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T03:47:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22747b2af109454c9aa3475c049d39bd',uuid=2cb84f00-0601-4199-ba6e-f09a27add736,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "75b2ff49-49cc-4b86-bdc6-6f9f76c06505", "address": "fa:16:3e:95:e9:f8", "network": {"id": "4a2b26f4-65df-49c9-8832-77cb9c321787", "bridge": "br-int", "label": "tempest-device-tagging-net2-1336305364", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75b2ff49-49", "ovs_interfaceid": "75b2ff49-49cc-4b86-bdc6-6f9f76c06505", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Converting VIF {"id": "75b2ff49-49cc-4b86-bdc6-6f9f76c06505", "address": "fa:16:3e:95:e9:f8", "network": {"id": "4a2b26f4-65df-49c9-8832-77cb9c321787", "bridge": "br-int", "label": "tempest-device-tagging-net2-1336305364", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75b2ff49-49", "ovs_interfaceid": "75b2ff49-49cc-4b86-bdc6-6f9f76c06505", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:e9:f8,bridge_name='br-int',has_traffic_filtering=True,id=75b2ff49-49cc-4b86-bdc6-6f9f76c06505,network=Network(4a2b26f4-65df-49c9-8832-77cb9c321787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75b2ff49-49') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG os_vif [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:e9:f8,bridge_name='br-int',has_traffic_filtering=True,id=75b2ff49-49cc-4b86-bdc6-6f9f76c06505,network=Network(4a2b26f4-65df-49c9-8832-77cb9c321787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75b2ff49-49') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap75b2ff49-49, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=654b4bee-0cc8-4acd-aab1-b0360d287a12) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:14 user nova-compute[103546]: INFO os_vif [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:e9:f8,bridge_name='br-int',has_traffic_filtering=True,id=75b2ff49-49cc-4b86-bdc6-6f9f76c06505,network=Network(4a2b26f4-65df-49c9-8832-77cb9c321787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75b2ff49-49')
Nov 16 03:49:14 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T03:47:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-766470017',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-766470017',id=10,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcOUIcHQE+PuNmY75VAQVSRnTba8AjrUsVmfAjG7EHCeVn8jzeyhEYtg2/jiz2Zl4NEr0BAFFwp5JFj1aYk8M4uENNWNNlYcDY92FwqpHASm1hjkK06mxwFNPN/w/A1RQ==',key_name='tempest-keypair-1790126314',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:47:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83b885bd172d45859e0eaa89af06f144',ramdisk_id='',reservation_id='r-06z2rapd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-629950856',owner_user_name='tempest-TaggedBootDevicesTest-629950856-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T03:47:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22747b2af109454c9aa3475c049d39bd',uuid=2cb84f00-0601-4199-ba6e-f09a27add736,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "87ab6a10-d50c-460e-b891-ce6439614185", "address": "fa:16:3e:c4:5b:b6", "network": {"id": "4a2b26f4-65df-49c9-8832-77cb9c321787", "bridge": "br-int", "label": "tempest-device-tagging-net2-1336305364", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87ab6a10-d5", "ovs_interfaceid": "87ab6a10-d50c-460e-b891-ce6439614185", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Converting VIF {"id": "87ab6a10-d50c-460e-b891-ce6439614185", "address": "fa:16:3e:c4:5b:b6", "network": {"id": "4a2b26f4-65df-49c9-8832-77cb9c321787", "bridge": "br-int", "label": "tempest-device-tagging-net2-1336305364", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87ab6a10-d5", "ovs_interfaceid": "87ab6a10-d50c-460e-b891-ce6439614185", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:5b:b6,bridge_name='br-int',has_traffic_filtering=True,id=87ab6a10-d50c-460e-b891-ce6439614185,network=Network(4a2b26f4-65df-49c9-8832-77cb9c321787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87ab6a10-d5') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG os_vif [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:5b:b6,bridge_name='br-int',has_traffic_filtering=True,id=87ab6a10-d50c-460e-b891-ce6439614185,network=Network(4a2b26f4-65df-49c9-8832-77cb9c321787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87ab6a10-d5') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap87ab6a10-d5, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=170efddd-3fe9-4f0b-bf53-6be3b3b3f63a) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:14 user nova-compute[103546]: INFO os_vif [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:5b:b6,bridge_name='br-int',has_traffic_filtering=True,id=87ab6a10-d50c-460e-b891-ce6439614185,network=Network(4a2b26f4-65df-49c9-8832-77cb9c321787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87ab6a10-d5')
Nov 16 03:49:14 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JeMtFvRk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:49:14 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:49:14 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[8002f092-6950-40d9-85ed-127d4a56136a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 03:49:14 user nova-compute[103546]: No targets found.
Nov 16 03:49:14 user nova-compute[103546]: iSNS:
Nov 16 03:49:14 user nova-compute[103546]: No targets found.
Nov 16 03:49:14 user nova-compute[103546]: STATIC:
Nov 16 03:49:14 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f
Nov 16 03:49:14 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:14 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:14 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb
Nov 16 03:49:14 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:14 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:14 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41
Nov 16 03:49:14 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:14 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:14 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57
Nov 16 03:49:14 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:14 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:14 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75
Nov 16 03:49:14 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:14 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:14 user nova-compute[103546]: FIRMWARE:
Nov 16 03:49:14 user nova-compute[103546]: No targets found.
Nov 16 03:49:14 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 03:49:14 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 03:49:14 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c4f5d8-6b05-4622-a7e8-cd2b8dd45325]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1ff511-522d-4122-b4e2-0dd06c86148c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f (non-flash)
Nov 16 03:49:14 user nova-compute[103546]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)
Nov 16 03:49:14 user nova-compute[103546]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:49:14 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:49:14 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:49:14 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f (non-flash)
Nov 16 03:49:14 user nova-compute[103546]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)
Nov 16 03:49:14 user nova-compute[103546]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 (non-flash)
Nov 16 03:49:14 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:49:14 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:49:14 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60ac54f250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57'): ({'sdb'}, set())}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Removing single pathed devices sdb {{(pid=103546) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[7591bc2d-215d-4d90-9247-6712495716c0]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5910f883-f42c-4cfe-8baf-5b2c4e4a0994]: (4, ('ok\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Flushing IO for device /dev/sdb {{(pid=103546) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad4aced-d103-4b90-b47a-234d24e73e07]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=103546) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7bdc57-f45f-4a8d-a90c-cd9f084f8188]: (4, ('1', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] SCSI volumes sdb have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57')] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[95596a8b-d9e1-4226-b6bd-13b1a799a316]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 -p 172.16.0.220:3260 --logout {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG nova.compute.manager [req-8a12ecf8-4779-4dae-8f66-5476a6a7372d req-7901ac17-87aa-4ea3-b3fe-167f578547f1 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received event network-vif-plugged-75b2ff49-49cc-4b86-bdc6-6f9f76c06505 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8a12ecf8-4779-4dae-8f66-5476a6a7372d req-7901ac17-87aa-4ea3-b3fe-167f578547f1 service nova] Acquiring lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8a12ecf8-4779-4dae-8f66-5476a6a7372d req-7901ac17-87aa-4ea3-b3fe-167f578547f1 service nova] Lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8a12ecf8-4779-4dae-8f66-5476a6a7372d req-7901ac17-87aa-4ea3-b3fe-167f578547f1 service nova] Lock "2cb84f00-0601-4199-ba6e-f09a27add736-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG nova.compute.manager [req-8a12ecf8-4779-4dae-8f66-5476a6a7372d req-7901ac17-87aa-4ea3-b3fe-167f578547f1 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] No waiting events found dispatching network-vif-plugged-75b2ff49-49cc-4b86-bdc6-6f9f76c06505 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:49:14 user nova-compute[103546]: WARNING nova.compute.manager [req-8a12ecf8-4779-4dae-8f66-5476a6a7372d req-7901ac17-87aa-4ea3-b3fe-167f578547f1 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received unexpected event network-vif-plugged-75b2ff49-49cc-4b86-bdc6-6f9f76c06505 for instance with vm_state active and task_state deleting.
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[038905cf-fb25-43a6-9438-0911e11d6e8b]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57, portal: 172.16.0.220,3260]
Nov 16 03:49:14 user nova-compute[103546]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57, portal: 172.16.0.220,3260] successful.
Nov 16 03:49:14 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 -p 172.16.0.220:3260 --op delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dada35b-3508-4544-8fec-013f8b89fd57 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8139fd-8d61-4113-972c-e11b92cf9c05]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] <== disconnect_volume: return (321ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GUvFluYm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:49:14 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:49:14 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3fc3037-0cb8-4fc8-8b07-3ef47c51d255]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 03:49:14 user nova-compute[103546]: No targets found.
Nov 16 03:49:14 user nova-compute[103546]: iSNS:
Nov 16 03:49:14 user nova-compute[103546]: No targets found.
Nov 16 03:49:14 user nova-compute[103546]: STATIC:
Nov 16 03:49:14 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f
Nov 16 03:49:14 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:14 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:14 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb
Nov 16 03:49:14 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:14 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:14 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41
Nov 16 03:49:14 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:14 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:14 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75
Nov 16 03:49:14 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:14 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:14 user nova-compute[103546]: FIRMWARE:
Nov 16 03:49:14 user nova-compute[103546]: No targets found.
Nov 16 03:49:14 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 03:49:14 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 03:49:14 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[96986af3-9968-43b1-b5e4-d0e4bb66e960]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d436ba72-c303-4f2e-a769-c199a924f045]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f (non-flash)
Nov 16 03:49:14 user nova-compute[103546]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)
Nov 16 03:49:14 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:49:14 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:49:14 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f (non-flash)
Nov 16 03:49:14 user nova-compute[103546]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)
Nov 16 03:49:14 user nova-compute[103546]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 (non-flash)
Nov 16 03:49:14 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:49:14 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60ac54f250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75'): ({'sdc'}, set())}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Removing single pathed devices sdc {{(pid=103546) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[8badba58-44b6-4218-8e24-f3dc0cf56130]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce5321a-0296-4a95-8e5b-02a6b5ef9861]: (4, ('ok\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Flushing IO for device /dev/sdc {{(pid=103546) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f4c78f-af39-4747-b2f0-811c0cf7f366]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=103546) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[88da765e-8315-4747-a441-b008e95cfb94]: (4, ('1', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] SCSI volumes sdc have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75')] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[49248553-f806-4851-8246-3309d0333fbd]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 -p 172.16.0.220:3260 --logout {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ebad102-9f6c-4730-8208-cc55b3715187]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75, portal: 172.16.0.220,3260]
Nov 16 03:49:14 user nova-compute[103546]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75, portal: 172.16.0.220,3260] successful.
Nov 16 03:49:14 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:49:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 -p 172.16.0.220:3260 --op delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4391e54b-de96-4437-a37c-077312643d75 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f503427d-3f43-45b0-878b-76ed2a0534a1]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] <== disconnect_volume: return (322ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nYvPcsCQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:49:15 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:49:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[79edff07-d065-4ccb-865d-38b369051d99]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 03:49:15 user nova-compute[103546]: No targets found.
Nov 16 03:49:15 user nova-compute[103546]: iSNS:
Nov 16 03:49:15 user nova-compute[103546]: No targets found.
Nov 16 03:49:15 user nova-compute[103546]: STATIC:
Nov 16 03:49:15 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f
Nov 16 03:49:15 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:15 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:15 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb
Nov 16 03:49:15 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:15 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:15 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41
Nov 16 03:49:15 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:15 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:15 user nova-compute[103546]: FIRMWARE:
Nov 16 03:49:15 user nova-compute[103546]: No targets found.
Nov 16 03:49:15 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 03:49:15 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 03:49:15 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[109f9811-9f01-4526-9f33-73385a6d47fd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[8592ed54-18d7-4857-b533-8e34a6505875]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f (non-flash)
Nov 16 03:49:15 user nova-compute[103546]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)
Nov 16 03:49:15 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:49:15 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f (non-flash)
Nov 16 03:49:15 user nova-compute[103546]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)
Nov 16 03:49:15 user nova-compute[103546]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 (non-flash)
Nov 16 03:49:15 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60ac54f250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41'): ({'sdd'}, set())}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Removing single pathed devices sdd {{(pid=103546) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9bf3bed-09bd-45c3-b9d2-40476bcbb5d6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[121f0e64-f429-4071-9bb4-2eb209e5879c]: (4, ('ok\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Flushing IO for device /dev/sdd {{(pid=103546) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e4b83b-2584-49d8-9ad3-ad1a4ed79291]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=103546) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e43439-d587-4bad-ab75-7e6ccf3a8bc0]: (4, ('1', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] SCSI volumes sdd have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41')] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9df5176-4fd3-497c-93d2-ab2267291d81]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 -p 172.16.0.220:3260 --logout {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:49:15 user nova-compute[103546]: INFO nova.compute.manager [-] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Took 4.17 seconds to deallocate network for instance.
Nov 16 03:49:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0142606-9364-43d5-ac93-7df4a01ed28f]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41, portal: 172.16.0.220,3260]
Nov 16 03:49:15 user nova-compute[103546]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41, portal: 172.16.0.220,3260] successful.
Nov 16 03:49:15 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 -p 172.16.0.220:3260 --op delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2056c0fd-acb4-436c-a1ae-f2e316b94d41 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2385e6-3390-4761-8956-9cd0370a7775]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] <== disconnect_volume: return (298ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 03:49:15 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Deleting instance files /opt/stack/data/nova/instances/2cb84f00-0601-4199-ba6e-f09a27add736_del
Nov 16 03:49:15 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Deletion of /opt/stack/data/nova/instances/2cb84f00-0601-4199-ba6e-f09a27add736_del complete
Nov 16 03:49:15 user nova-compute[103546]: INFO nova.compute.manager [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Took 3.77 seconds to destroy the instance on the hypervisor.
Nov 16 03:49:15 user nova-compute[103546]: DEBUG oslo.service.loopingcall [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=103546) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG nova.compute.manager [-] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Deallocating network for instance {{(pid=103546) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] deallocate_for_instance() {{(pid=103546) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 03:49:15 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-b1e23816-54a4-444b-bd9c-fa1d9fe77826 tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ad9b2edb-15d7-4937-9461-15ce61f508a7 is timed out.
Nov 16 03:49:15 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-b1e23816-54a4-444b-bd9c-fa1d9fe77826 tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] Successfully detached device vdb from instance ad9b2edb-15d7-4937-9461-15ce61f508a7 from the live domain config.
Nov 16 03:49:15 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1e23816-54a4-444b-bd9c-fa1d9fe77826 tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e23816-54a4-444b-bd9c-fa1d9fe77826 tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LnFNGqtD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:49:15 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-b1e23816-54a4-444b-bd9c-fa1d9fe77826 tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:49:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-b1e23816-54a4-444b-bd9c-fa1d9fe77826 tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-b1e23816-54a4-444b-bd9c-fa1d9fe77826 tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[0384723e-5833-4833-bb9b-152ae270855f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e23816-54a4-444b-bd9c-fa1d9fe77826 tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 03:49:15 user nova-compute[103546]: No targets found.
Nov 16 03:49:15 user nova-compute[103546]: iSNS:
Nov 16 03:49:15 user nova-compute[103546]: No targets found.
Nov 16 03:49:15 user nova-compute[103546]: STATIC:
Nov 16 03:49:15 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f
Nov 16 03:49:15 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:15 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:15 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb
Nov 16 03:49:15 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:15 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:15 user nova-compute[103546]: FIRMWARE:
Nov 16 03:49:15 user nova-compute[103546]: No targets found.
Nov 16 03:49:15 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e23816-54a4-444b-bd9c-fa1d9fe77826 tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 03:49:15 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 03:49:15 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e23816-54a4-444b-bd9c-fa1d9fe77826 tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG nova.compute.manager [req-b6f29b79-f534-4465-8b27-fee9cb6f44cd req-8dea6f81-3325-4104-9472-93c66eabc301 service nova] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Received event network-vif-unplugged-fe4680c0-c534-4f5b-8833-be40c2784953 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-b6f29b79-f534-4465-8b27-fee9cb6f44cd req-8dea6f81-3325-4104-9472-93c66eabc301 service nova] Acquiring lock "549ee3db-0014-440f-bd3a-0d389f5eab88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-b6f29b79-f534-4465-8b27-fee9cb6f44cd req-8dea6f81-3325-4104-9472-93c66eabc301 service nova] Lock "549ee3db-0014-440f-bd3a-0d389f5eab88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-b6f29b79-f534-4465-8b27-fee9cb6f44cd req-8dea6f81-3325-4104-9472-93c66eabc301 service nova] Lock "549ee3db-0014-440f-bd3a-0d389f5eab88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG nova.compute.manager [req-b6f29b79-f534-4465-8b27-fee9cb6f44cd req-8dea6f81-3325-4104-9472-93c66eabc301 service nova] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] No waiting events found dispatching network-vif-unplugged-fe4680c0-c534-4f5b-8833-be40c2784953 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:49:15 user nova-compute[103546]: WARNING nova.compute.manager [req-b6f29b79-f534-4465-8b27-fee9cb6f44cd req-8dea6f81-3325-4104-9472-93c66eabc301 service nova] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Received unexpected event network-vif-unplugged-fe4680c0-c534-4f5b-8833-be40c2784953 for instance with vm_state active and task_state None.
Nov 16 03:49:15 user nova-compute[103546]: DEBUG nova.compute.manager [req-b6f29b79-f534-4465-8b27-fee9cb6f44cd req-8dea6f81-3325-4104-9472-93c66eabc301 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received event network-vif-deleted-b0f609b8-eb49-4c19-968c-99c95c38b857 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG nova.compute.manager [req-b6f29b79-f534-4465-8b27-fee9cb6f44cd req-8dea6f81-3325-4104-9472-93c66eabc301 service nova] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Received event network-vif-plugged-fe4680c0-c534-4f5b-8833-be40c2784953 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-b6f29b79-f534-4465-8b27-fee9cb6f44cd req-8dea6f81-3325-4104-9472-93c66eabc301 service nova] Acquiring lock "549ee3db-0014-440f-bd3a-0d389f5eab88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-b6f29b79-f534-4465-8b27-fee9cb6f44cd req-8dea6f81-3325-4104-9472-93c66eabc301 service nova] Lock "549ee3db-0014-440f-bd3a-0d389f5eab88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-b6f29b79-f534-4465-8b27-fee9cb6f44cd req-8dea6f81-3325-4104-9472-93c66eabc301 service nova] Lock "549ee3db-0014-440f-bd3a-0d389f5eab88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG nova.compute.manager [req-b6f29b79-f534-4465-8b27-fee9cb6f44cd req-8dea6f81-3325-4104-9472-93c66eabc301 service nova] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] No waiting events found dispatching network-vif-plugged-fe4680c0-c534-4f5b-8833-be40c2784953 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:49:15 user nova-compute[103546]: WARNING nova.compute.manager [req-b6f29b79-f534-4465-8b27-fee9cb6f44cd req-8dea6f81-3325-4104-9472-93c66eabc301 service nova] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Received unexpected event network-vif-plugged-fe4680c0-c534-4f5b-8833-be40c2784953 for instance with vm_state active and task_state None.
Nov 16 03:49:15 user nova-compute[103546]: DEBUG nova.compute.manager [req-b6f29b79-f534-4465-8b27-fee9cb6f44cd req-8dea6f81-3325-4104-9472-93c66eabc301 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received event network-vif-deleted-76b69715-356f-496a-85a3-f5bde976e201 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG nova.compute.manager [req-b6f29b79-f534-4465-8b27-fee9cb6f44cd req-8dea6f81-3325-4104-9472-93c66eabc301 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received event network-vif-deleted-51e087e4-ff6b-49a8-8190-cfc243436d35 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG nova.compute.manager [req-b6f29b79-f534-4465-8b27-fee9cb6f44cd req-8dea6f81-3325-4104-9472-93c66eabc301 service nova] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Received event network-vif-deleted-fc03966b-fcbc-4ed7-8ffb-2270a55b4e28 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2c438c-d882-4daa-b91a-ecc60dab509a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af2e70b-fb6a-456a-9180-17f4edde1138]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e23816-54a4-444b-bd9c-fa1d9fe77826 tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f (non-flash)
Nov 16 03:49:15 user nova-compute[103546]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)
Nov 16 03:49:15 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e23816-54a4-444b-bd9c-fa1d9fe77826 tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f (non-flash)
Nov 16 03:49:15 user nova-compute[103546]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)
Nov 16 03:49:15 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e23816-54a4-444b-bd9c-fa1d9fe77826 tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60c40ecc10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f'): ({'sdh'}, set())}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-b1e23816-54a4-444b-bd9c-fa1d9fe77826 tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] Removing single pathed devices sdh {{(pid=103546) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f4b922-81ad-43f5-8bce-50da3fa3f226]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f262afa3-5366-4ffe-8411-8dfda95121fd]: (4, ('ok\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-b1e23816-54a4-444b-bd9c-fa1d9fe77826 tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] Flushing IO for device /dev/sdh {{(pid=103546) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 03:49:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.012s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:16 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[769d9c75-89a6-4700-9a53-5a107906b8a7]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:16 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-b1e23816-54a4-444b-bd9c-fa1d9fe77826 tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=103546) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 03:49:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.051s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:16 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c02793e-34a2-47bd-b348-bc179e63d9c0]: (4, ('1', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:16 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-b1e23816-54a4-444b-bd9c-fa1d9fe77826 tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 03:49:16 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-b1e23816-54a4-444b-bd9c-fa1d9fe77826 tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] SCSI volumes sdh have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 03:49:16 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e23816-54a4-444b-bd9c-fa1d9fe77826 tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f')] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 03:49:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:16 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6cfe0b-438c-4362-90fd-be20b5ebd972]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:16 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e23816-54a4-444b-bd9c-fa1d9fe77826 tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:49:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f -p 172.16.0.220:3260 --logout {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:16 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d456e8-724f-48e2-8634-963b2e07e062]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:16 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e23816-54a4-444b-bd9c-fa1d9fe77826 tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f, portal: 172.16.0.220,3260]
Nov 16 03:49:16 user nova-compute[103546]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f, portal: 172.16.0.220,3260] successful.
Nov 16 03:49:16 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:49:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f -p 172.16.0.220:3260 --op delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1341a8ab-40aa-45e3-9a5d-068116f08b3f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:16 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d855edfe-8eb4-4409-8096-65bd0cba0f7c]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:16 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e23816-54a4-444b-bd9c-fa1d9fe77826 tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:49:16 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-b1e23816-54a4-444b-bd9c-fa1d9fe77826 tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:49:16 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e23816-54a4-444b-bd9c-fa1d9fe77826 tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] <== disconnect_volume: return (316ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:49:16 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1e23816-54a4-444b-bd9c-fa1d9fe77826 tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 03:49:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4a3124f5-fa4d-4df2-8c8f-225a965b1153 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Acquiring lock "51554aab-44ec-4161-b926-9c07a3f838a5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4a3124f5-fa4d-4df2-8c8f-225a965b1153 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Lock "51554aab-44ec-4161-b926-9c07a3f838a5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:16 user nova-compute[103546]: DEBUG nova.objects.instance [None req-4a3124f5-fa4d-4df2-8c8f-225a965b1153 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Lazy-loading 'flavor' on Instance uuid 51554aab-44ec-4161-b926-9c07a3f838a5 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:49:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4a3124f5-fa4d-4df2-8c8f-225a965b1153 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Lock "51554aab-44ec-4161-b926-9c07a3f838a5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4a3124f5-fa4d-4df2-8c8f-225a965b1153 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Acquiring lock "51554aab-44ec-4161-b926-9c07a3f838a5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4a3124f5-fa4d-4df2-8c8f-225a965b1153 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Lock "51554aab-44ec-4161-b926-9c07a3f838a5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:16 user nova-compute[103546]: INFO nova.compute.manager [None req-4a3124f5-fa4d-4df2-8c8f-225a965b1153 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Attaching volume 4156a8b3-4b47-48ef-ad34-1ace6437b49c to /dev/vdb
Nov 16 03:49:16 user nova-compute[103546]: DEBUG os_brick.utils [None req-4a3124f5-fa4d-4df2-8c8f-225a965b1153 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:49:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:16 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb5ff17-9e90-430b-bf26-2440b229f7fa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af5c39b14ece\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:16 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e226ae9-d73e-4e06-9850-709d5f9b7f34]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:16 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[744fbe24-ab9e-422b-b128-7ed08de89c1b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:16 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe58eb7-201c-4130-9bda-afd3b1efd6e7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-4a3124f5-fa4d-4df2-8c8f-225a965b1153 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Running cmd (subprocess): nvme version {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-4a3124f5-fa4d-4df2-8c8f-225a965b1153 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] 'nvme version' failed. Not Retrying. {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:49:16 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4a3124f5-fa4d-4df2-8c8f-225a965b1153 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] nvme not present on system {{(pid=103546) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 03:49:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:49:16 user nova-compute[103546]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 03:49:16 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5fd048-ee53-44c1-843a-b35212a5bc70]: (4, '') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:16 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-4a3124f5-fa4d-4df2-8c8f-225a965b1153 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=103546) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 03:49:16 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-4a3124f5-fa4d-4df2-8c8f-225a965b1153 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 03:49:16 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-4a3124f5-fa4d-4df2-8c8f-225a965b1153 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] LIGHTOS: no hostnqn found. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 03:49:16 user nova-compute[103546]: DEBUG os_brick.utils [None req-4a3124f5-fa4d-4df2-8c8f-225a965b1153 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af5c39b14ece', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:49:16 user nova-compute[103546]: DEBUG nova.virt.block_device [None req-4a3124f5-fa4d-4df2-8c8f-225a965b1153 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Updating existing volume attachment record: 2b8fad4b-f436-4583-8c83-8736a6b6e5c5 {{(pid=103546) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 03:49:16 user nova-compute[103546]: DEBUG nova.objects.instance [None req-b1e23816-54a4-444b-bd9c-fa1d9fe77826 tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] Lazy-loading 'flavor' on Instance uuid ad9b2edb-15d7-4937-9461-15ce61f508a7 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:49:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b1e23816-54a4-444b-bd9c-fa1d9fe77826 tempest-VolumesAssistedSnapshotsTest-484252483 tempest-VolumesAssistedSnapshotsTest-484252483-project-admin] Lock "ad9b2edb-15d7-4937-9461-15ce61f508a7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.720s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:17 user nova-compute[103546]: INFO nova.compute.manager [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] [instance: 71059a8d-4e89-472c-9463-b38aa8063e33] Took 2.20 seconds to detach 3 volumes for instance.
Nov 16 03:49:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:17 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:49:17 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:49:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.335s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:17 user nova-compute[103546]: INFO nova.scheduler.client.report [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Deleted allocations for instance 71059a8d-4e89-472c-9463-b38aa8063e33
Nov 16 03:49:17 user nova-compute[103546]: DEBUG nova.compute.manager [req-c5b806e6-e0a4-4f41-b83a-0ab60a37b65b req-c9c9be11-5b11-43da-b728-7a3d318002c2 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received event network-vif-deleted-c2216378-faa5-4bdc-8706-0be8df7807c0 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:49:17 user nova-compute[103546]: INFO nova.compute.manager [req-c5b806e6-e0a4-4f41-b83a-0ab60a37b65b req-c9c9be11-5b11-43da-b728-7a3d318002c2 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Neutron deleted interface c2216378-faa5-4bdc-8706-0be8df7807c0; detaching it from the instance and deleting it from the info cache
Nov 16 03:49:17 user nova-compute[103546]: DEBUG nova.network.neutron [req-c5b806e6-e0a4-4f41-b83a-0ab60a37b65b req-c9c9be11-5b11-43da-b728-7a3d318002c2 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Updating instance_info_cache with network_info: [{"id": "2159d4b9-42e0-48d5-bfdf-178ee853063c", "address": "fa:16:3e:5f:ff:36", "network": {"id": "a8bb0411-7c42-419f-9bc2-ea6219b732f8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1141379058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2159d4b9-42", "ovs_interfaceid": "2159d4b9-42e0-48d5-bfdf-178ee853063c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cf751a83-e099-48a1-9219-fb781500b02c", "address": "fa:16:3e:3b:05:73", "network": {"id": "049ff849-6358-448d-9530-ae2102396888", "bridge": "br-int", "label": "tempest-device-tagging-net1-926406277", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf751a83-e0", "ovs_interfaceid": "cf751a83-e099-48a1-9219-fb781500b02c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "96e41ba8-e2bd-48d3-a8e0-94c5f76d618a", "address": "fa:16:3e:e1:ce:8a", "network": {"id": "049ff849-6358-448d-9530-ae2102396888", "bridge": "br-int", "label": "tempest-device-tagging-net1-926406277", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96e41ba8-e2", "ovs_interfaceid": "96e41ba8-e2bd-48d3-a8e0-94c5f76d618a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1b75ba8c-049f-404a-aa82-0323bf51191c", "address": "fa:16:3e:51:e9:22", "network": {"id": "049ff849-6358-448d-9530-ae2102396888", "bridge": "br-int", "label": "tempest-device-tagging-net1-926406277", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b75ba8c-04", "ovs_interfaceid": "1b75ba8c-049f-404a-aa82-0323bf51191c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "75b2ff49-49cc-4b86-bdc6-6f9f76c06505", "address": "fa:16:3e:95:e9:f8", "network": {"id": "4a2b26f4-65df-49c9-8832-77cb9c321787", "bridge": "br-int", "label": "tempest-device-tagging-net2-1336305364", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75b2ff49-49", "ovs_interfaceid": "75b2ff49-49cc-4b86-bdc6-6f9f76c06505", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "87ab6a10-d50c-460e-b891-ce6439614185", "address": "fa:16:3e:c4:5b:b6", "network": {"id": "4a2b26f4-65df-49c9-8832-77cb9c321787", "bridge": "br-int", "label": "tempest-device-tagging-net2-1336305364", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87ab6a10-d5", "ovs_interfaceid": "87ab6a10-d50c-460e-b891-ce6439614185", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:49:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4896cd22-6054-4063-8ef3-45690aa3d5a6 tempest-TaggedBootDevicesTest_v242-1024082213 tempest-TaggedBootDevicesTest_v242-1024082213-project-member] Lock "71059a8d-4e89-472c-9463-b38aa8063e33" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.467s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:18 user nova-compute[103546]: DEBUG nova.compute.manager [req-c5b806e6-e0a4-4f41-b83a-0ab60a37b65b req-c9c9be11-5b11-43da-b728-7a3d318002c2 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Detach interface failed, port_id=c2216378-faa5-4bdc-8706-0be8df7807c0, reason: Instance 2cb84f00-0601-4199-ba6e-f09a27add736 could not be found. {{(pid=103546) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 03:49:18 user nova-compute[103546]: DEBUG nova.compute.manager [req-c5b806e6-e0a4-4f41-b83a-0ab60a37b65b req-c9c9be11-5b11-43da-b728-7a3d318002c2 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received event network-vif-deleted-1b75ba8c-049f-404a-aa82-0323bf51191c {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:49:18 user nova-compute[103546]: INFO nova.compute.manager [req-c5b806e6-e0a4-4f41-b83a-0ab60a37b65b req-c9c9be11-5b11-43da-b728-7a3d318002c2 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Neutron deleted interface 1b75ba8c-049f-404a-aa82-0323bf51191c; detaching it from the instance and deleting it from the info cache
Nov 16 03:49:18 user nova-compute[103546]: DEBUG nova.network.neutron [req-c5b806e6-e0a4-4f41-b83a-0ab60a37b65b req-c9c9be11-5b11-43da-b728-7a3d318002c2 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Updating instance_info_cache with network_info: [{"id": "2159d4b9-42e0-48d5-bfdf-178ee853063c", "address": "fa:16:3e:5f:ff:36", "network": {"id": "a8bb0411-7c42-419f-9bc2-ea6219b732f8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1141379058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2159d4b9-42", "ovs_interfaceid": "2159d4b9-42e0-48d5-bfdf-178ee853063c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cf751a83-e099-48a1-9219-fb781500b02c", "address": "fa:16:3e:3b:05:73", "network": {"id": "049ff849-6358-448d-9530-ae2102396888", "bridge": "br-int", "label": "tempest-device-tagging-net1-926406277", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf751a83-e0", "ovs_interfaceid": "cf751a83-e099-48a1-9219-fb781500b02c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "96e41ba8-e2bd-48d3-a8e0-94c5f76d618a", "address": "fa:16:3e:e1:ce:8a", "network": {"id": "049ff849-6358-448d-9530-ae2102396888", "bridge": "br-int", "label": "tempest-device-tagging-net1-926406277", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96e41ba8-e2", "ovs_interfaceid": "96e41ba8-e2bd-48d3-a8e0-94c5f76d618a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "75b2ff49-49cc-4b86-bdc6-6f9f76c06505", "address": "fa:16:3e:95:e9:f8", "network": {"id": "4a2b26f4-65df-49c9-8832-77cb9c321787", "bridge": "br-int", "label": "tempest-device-tagging-net2-1336305364", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75b2ff49-49", "ovs_interfaceid": "75b2ff49-49cc-4b86-bdc6-6f9f76c06505", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "87ab6a10-d50c-460e-b891-ce6439614185", "address": "fa:16:3e:c4:5b:b6", "network": {"id": "4a2b26f4-65df-49c9-8832-77cb9c321787", "bridge": "br-int", "label": "tempest-device-tagging-net2-1336305364", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87ab6a10-d5", "ovs_interfaceid": "87ab6a10-d50c-460e-b891-ce6439614185", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:49:18 user nova-compute[103546]: DEBUG nova.compute.manager [req-c5b806e6-e0a4-4f41-b83a-0ab60a37b65b req-c9c9be11-5b11-43da-b728-7a3d318002c2 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Detach interface failed, port_id=1b75ba8c-049f-404a-aa82-0323bf51191c, reason: Instance 2cb84f00-0601-4199-ba6e-f09a27add736 could not be found. {{(pid=103546) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 03:49:18 user nova-compute[103546]: DEBUG nova.compute.manager [req-c5b806e6-e0a4-4f41-b83a-0ab60a37b65b req-c9c9be11-5b11-43da-b728-7a3d318002c2 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received event network-vif-deleted-87ab6a10-d50c-460e-b891-ce6439614185 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:49:18 user nova-compute[103546]: INFO nova.compute.manager [req-c5b806e6-e0a4-4f41-b83a-0ab60a37b65b req-c9c9be11-5b11-43da-b728-7a3d318002c2 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Neutron deleted interface 87ab6a10-d50c-460e-b891-ce6439614185; detaching it from the instance and deleting it from the info cache
Nov 16 03:49:18 user nova-compute[103546]: DEBUG nova.network.neutron [req-c5b806e6-e0a4-4f41-b83a-0ab60a37b65b req-c9c9be11-5b11-43da-b728-7a3d318002c2 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Updating instance_info_cache with network_info: [{"id": "2159d4b9-42e0-48d5-bfdf-178ee853063c", "address": "fa:16:3e:5f:ff:36", "network": {"id": "a8bb0411-7c42-419f-9bc2-ea6219b732f8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1141379058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2159d4b9-42", "ovs_interfaceid": "2159d4b9-42e0-48d5-bfdf-178ee853063c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cf751a83-e099-48a1-9219-fb781500b02c", "address": "fa:16:3e:3b:05:73", "network": {"id": "049ff849-6358-448d-9530-ae2102396888", "bridge": "br-int", "label": "tempest-device-tagging-net1-926406277", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf751a83-e0", "ovs_interfaceid": "cf751a83-e099-48a1-9219-fb781500b02c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "96e41ba8-e2bd-48d3-a8e0-94c5f76d618a", "address": "fa:16:3e:e1:ce:8a", "network": {"id": "049ff849-6358-448d-9530-ae2102396888", "bridge": "br-int", "label": "tempest-device-tagging-net1-926406277", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96e41ba8-e2", "ovs_interfaceid": "96e41ba8-e2bd-48d3-a8e0-94c5f76d618a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "75b2ff49-49cc-4b86-bdc6-6f9f76c06505", "address": "fa:16:3e:95:e9:f8", "network": {"id": "4a2b26f4-65df-49c9-8832-77cb9c321787", "bridge": "br-int", "label": "tempest-device-tagging-net2-1336305364", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75b2ff49-49", "ovs_interfaceid": "75b2ff49-49cc-4b86-bdc6-6f9f76c06505", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:49:18 user nova-compute[103546]: DEBUG nova.compute.manager [req-c5b806e6-e0a4-4f41-b83a-0ab60a37b65b req-c9c9be11-5b11-43da-b728-7a3d318002c2 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Detach interface failed, port_id=87ab6a10-d50c-460e-b891-ce6439614185, reason: Instance 2cb84f00-0601-4199-ba6e-f09a27add736 could not be found. {{(pid=103546) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 03:49:18 user nova-compute[103546]: DEBUG nova.compute.manager [req-c5b806e6-e0a4-4f41-b83a-0ab60a37b65b req-c9c9be11-5b11-43da-b728-7a3d318002c2 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received event network-vif-deleted-75b2ff49-49cc-4b86-bdc6-6f9f76c06505 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:49:18 user nova-compute[103546]: INFO nova.compute.manager [req-c5b806e6-e0a4-4f41-b83a-0ab60a37b65b req-c9c9be11-5b11-43da-b728-7a3d318002c2 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Neutron deleted interface 75b2ff49-49cc-4b86-bdc6-6f9f76c06505; detaching it from the instance and deleting it from the info cache
Nov 16 03:49:18 user nova-compute[103546]: DEBUG nova.network.neutron [req-c5b806e6-e0a4-4f41-b83a-0ab60a37b65b req-c9c9be11-5b11-43da-b728-7a3d318002c2 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Updating instance_info_cache with network_info: [{"id": "2159d4b9-42e0-48d5-bfdf-178ee853063c", "address": "fa:16:3e:5f:ff:36", "network": {"id": "a8bb0411-7c42-419f-9bc2-ea6219b732f8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1141379058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2159d4b9-42", "ovs_interfaceid": "2159d4b9-42e0-48d5-bfdf-178ee853063c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cf751a83-e099-48a1-9219-fb781500b02c", "address": "fa:16:3e:3b:05:73", "network": {"id": "049ff849-6358-448d-9530-ae2102396888", "bridge": "br-int", "label": "tempest-device-tagging-net1-926406277", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf751a83-e0", "ovs_interfaceid": "cf751a83-e099-48a1-9219-fb781500b02c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "96e41ba8-e2bd-48d3-a8e0-94c5f76d618a", "address": "fa:16:3e:e1:ce:8a", "network": {"id": "049ff849-6358-448d-9530-ae2102396888", "bridge": "br-int", "label": "tempest-device-tagging-net1-926406277", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83b885bd172d45859e0eaa89af06f144", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96e41ba8-e2", "ovs_interfaceid": "96e41ba8-e2bd-48d3-a8e0-94c5f76d618a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:49:18 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:18 user nova-compute[103546]: DEBUG nova.compute.manager [req-c5b806e6-e0a4-4f41-b83a-0ab60a37b65b req-c9c9be11-5b11-43da-b728-7a3d318002c2 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Detach interface failed, port_id=75b2ff49-49cc-4b86-bdc6-6f9f76c06505, reason: Instance 2cb84f00-0601-4199-ba6e-f09a27add736 could not be found. {{(pid=103546) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 03:49:18 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:49:18 user nova-compute[103546]: INFO nova.compute.manager [-] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Took 3.01 seconds to deallocate network for instance.
Nov 16 03:49:19 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:49:19 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:49:19 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Starting heal instance info cache {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 03:49:19 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Skipping network cache update for instance because it has been migrated to another host. {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9966}}
Nov 16 03:49:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "refresh_cache-c24a386f-32f5-4095-b2b3-69a70a54ff66" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:49:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquired lock "refresh_cache-c24a386f-32f5-4095-b2b3-69a70a54ff66" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:49:19 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Forcefully refreshing network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 03:49:19 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:19 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Updating instance_info_cache with network_info: [{"id": "38395643-bb34-441c-ab0e-c9201f35ec04", "address": "fa:16:3e:2e:8e:90", "network": {"id": "32de335d-6f62-41f6-8520-1cc09523ef83", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1595594660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24d430f3bdd040ed87450fa998e0a8b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38395643-bb", "ovs_interfaceid": "38395643-bb34-441c-ab0e-c9201f35ec04", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:49:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Releasing lock "refresh_cache-c24a386f-32f5-4095-b2b3-69a70a54ff66" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:49:19 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Updated the network info_cache for instance {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 03:49:19 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:49:19 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:49:19 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:49:19 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:49:19 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:49:19 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:49:19 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=103546) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 03:49:19 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager.update_available_resource {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:49:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:19 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Auditing locally available compute resources for user (node: user) {{(pid=103546) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 03:49:20 user nova-compute[103546]: DEBUG nova.compute.manager [req-44757122-0791-4788-bded-706b4310a980 req-ca3b5442-1b3c-457e-8e1e-85b3b651a6a0 service nova] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Received event network-vif-deleted-2159d4b9-42e0-48d5-bfdf-178ee853063c {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:49:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63b95121-b211-42c3-831e-0392d4abd09a/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63b95121-b211-42c3-831e-0392d4abd09a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63b95121-b211-42c3-831e-0392d4abd09a/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63b95121-b211-42c3-831e-0392d4abd09a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/549ee3db-0014-440f-bd3a-0d389f5eab88/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:20 user nova-compute[103546]: INFO nova.compute.manager [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] [instance: 2cb84f00-0601-4199-ba6e-f09a27add736] Took 2.17 seconds to detach 3 volumes for instance.
Nov 16 03:49:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/549ee3db-0014-440f-bd3a-0d389f5eab88/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/549ee3db-0014-440f-bd3a-0d389f5eab88/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/549ee3db-0014-440f-bd3a-0d389f5eab88/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c929d5-2f1c-4be4-8864-6ec81625daac/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:20 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:49:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c929d5-2f1c-4be4-8864-6ec81625daac/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c929d5-2f1c-4be4-8864-6ec81625daac/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:21 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:49:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.404s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:21 user nova-compute[103546]: INFO nova.scheduler.client.report [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Deleted allocations for instance 2cb84f00-0601-4199-ba6e-f09a27add736
Nov 16 03:49:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c929d5-2f1c-4be4-8864-6ec81625daac/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-7158088b-9d7c-40ea-98a8-9a7069d5cd6a tempest-TaggedBootDevicesTest-629950856 tempest-TaggedBootDevicesTest-629950856-project-member] Lock "2cb84f00-0601-4199-ba6e-f09a27add736" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.592s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad9b2edb-15d7-4937-9461-15ce61f508a7/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad9b2edb-15d7-4937-9461-15ce61f508a7/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad9b2edb-15d7-4937-9461-15ce61f508a7/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad9b2edb-15d7-4937-9461-15ce61f508a7/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e2954-d786-4544-903d-8edc63646e2d/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e2954-d786-4544-903d-8edc63646e2d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e2954-d786-4544-903d-8edc63646e2d/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:21 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a3124f5-fa4d-4df2-8c8f-225a965b1153 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 03:49:21 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3124f5-fa4d-4df2-8c8f-225a965b1153 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YukJztTB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:49:21 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-4a3124f5-fa4d-4df2-8c8f-225a965b1153 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:49:21 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-4a3124f5-fa4d-4df2-8c8f-225a965b1153 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:49:21 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-4a3124f5-fa4d-4df2-8c8f-225a965b1153 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:49:21 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-4a3124f5-fa4d-4df2-8c8f-225a965b1153 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:49:21 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-4a3124f5-fa4d-4df2-8c8f-225a965b1153 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:49:21 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-4a3124f5-fa4d-4df2-8c8f-225a965b1153 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:49:21 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-4a3124f5-fa4d-4df2-8c8f-225a965b1153 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 03:49:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:21 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d76b55c-c054-4195-bfa3-1e48d8d1aa49]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:21 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3124f5-fa4d-4df2-8c8f-225a965b1153 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 03:49:21 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:49:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260 --interface default --op new {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:21 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bbd578b-5254-4ddc-9536-40add83ae8a1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c] added\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:21 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3124f5-fa4d-4df2-8c8f-225a965b1153 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c] added
Nov 16 03:49:21 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:49:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:21 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd2aafc-94cc-4f84-933c-adbd5e7325b8]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:21 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3124f5-fa4d-4df2-8c8f-225a965b1153 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:49:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e2954-d786-4544-903d-8edc63646e2d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c24a386f-32f5-4095-b2b3-69a70a54ff66/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:21 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dcbc984-6420-4085-b328-bed021bb33b7]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:21 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3124f5-fa4d-4df2-8c8f-225a965b1153 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:49:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YukJztTB {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YukJztTB" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:21 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5c07a0-aca9-44b3-b0a4-8da16d9cc1ae]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:21 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3124f5-fa4d-4df2-8c8f-225a965b1153 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YukJztTB'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:49:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:22 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[2710c211-3109-44dd-8751-ee9925dd6eb8]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:22 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3124f5-fa4d-4df2-8c8f-225a965b1153 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:49:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:22 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51c38bd-be64-45dd-a8c3-54f6ebe07605]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:22 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3124f5-fa4d-4df2-8c8f-225a965b1153 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)
Nov 16 03:49:22 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:49:22 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3124f5-fa4d-4df2-8c8f-225a965b1153 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)
Nov 16 03:49:22 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:49:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260 --login {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:22 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d7885b-e67f-4469-9d1b-6ac7e47ce8a4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:22 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3124f5-fa4d-4df2-8c8f-225a965b1153 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c, portal: 172.16.0.220,3260]
Nov 16 03:49:22 user nova-compute[103546]: Login to [iface: default, target: iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c, portal: 172.16.0.220,3260] successful.
Nov 16 03:49:22 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:49:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:22 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d2e9a7-f2c9-4b7e-b32d-d595bef64ec8]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:22 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3124f5-fa4d-4df2-8c8f-225a965b1153 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:49:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c24a386f-32f5-4095-b2b3-69a70a54ff66/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c24a386f-32f5-4095-b2b3-69a70a54ff66/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:22 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[1187e03c-3edd-4384-9b83-02cddf3bed46]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:22 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3124f5-fa4d-4df2-8c8f-225a965b1153 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)
Nov 16 03:49:22 user nova-compute[103546]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)
Nov 16 03:49:22 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:49:22 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3124f5-fa4d-4df2-8c8f-225a965b1153 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)
Nov 16 03:49:22 user nova-compute[103546]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)
Nov 16 03:49:22 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:49:22 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-4a3124f5-fa4d-4df2-8c8f-225a965b1153 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:49:22 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3124f5-fa4d-4df2-8c8f-225a965b1153 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 03:49:22 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-4a3124f5-fa4d-4df2-8c8f-225a965b1153 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 03:49:22 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-4a3124f5-fa4d-4df2-8c8f-225a965b1153 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 03:49:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:22 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[6063e6f0-8e78-4bea-999e-476046fe8328]: (4, ('- - 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:22 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-4a3124f5-fa4d-4df2-8c8f-225a965b1153 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: None {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 03:49:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c24a386f-32f5-4095-b2b3-69a70a54ff66/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51554aab-44ec-4161-b926-9c07a3f838a5/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51554aab-44ec-4161-b926-9c07a3f838a5/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51554aab-44ec-4161-b926-9c07a3f838a5/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51554aab-44ec-4161-b926-9c07a3f838a5/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e347e48-0b4e-4ce6-a677-5d1dc099ac6c/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e347e48-0b4e-4ce6-a677-5d1dc099ac6c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e347e48-0b4e-4ce6-a677-5d1dc099ac6c/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e347e48-0b4e-4ce6-a677-5d1dc099ac6c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:23 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-4a3124f5-fa4d-4df2-8c8f-225a965b1153 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 03:49:23 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3124f5-fa4d-4df2-8c8f-225a965b1153 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YukJztTB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 03:49:23 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-4a3124f5-fa4d-4df2-8c8f-225a965b1153 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.598s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:49:23 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3124f5-fa4d-4df2-8c8f-225a965b1153 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] <== connect_volume: return (1599ms) {'type': 'block', 'scsi_wwn': '23133393238633038', 'path': '/dev/sdb'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:49:23 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a3124f5-fa4d-4df2-8c8f-225a965b1153 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23133393238633038', 'path': '/dev/sdb'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 03:49:23 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:49:23 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:49:23 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Hypervisor/Node resource view: name=user free_ram=7704MB free_disk=25.454296112060547GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=103546) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 03:49:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:23 user nova-compute[103546]: DEBUG nova.objects.instance [None req-4a3124f5-fa4d-4df2-8c8f-225a965b1153 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Lazy-loading 'flavor' on Instance uuid 51554aab-44ec-4161-b926-9c07a3f838a5 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:49:23 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-4a3124f5-fa4d-4df2-8c8f-225a965b1153 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 03:49:23 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 03:49:23 user nova-compute[103546]:   <source dev="/dev/sdb"/>
Nov 16 03:49:23 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 03:49:23 user nova-compute[103546]:   <serial>4156a8b3-4b47-48ef-ad34-1ace6437b49c</serial>
Nov 16 03:49:23 user nova-compute[103546]: </disk>
Nov 16 03:49:23 user nova-compute[103546]:  {{(pid=103546) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 03:49:23 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 279e2954-d786-4544-903d-8edc63646e2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:49:23 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 51554aab-44ec-4161-b926-9c07a3f838a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:49:23 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance c24a386f-32f5-4095-b2b3-69a70a54ff66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:49:23 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 05c929d5-2f1c-4be4-8864-6ec81625daac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:49:23 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 549ee3db-0014-440f-bd3a-0d389f5eab88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:49:23 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance ad9b2edb-15d7-4937-9461-15ce61f508a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:49:23 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 63b95121-b211-42c3-831e-0392d4abd09a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:49:23 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:49:23 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 03:49:23 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 03:49:23 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:49:23 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:49:23 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Compute_service record updated for user:user {{(pid=103546) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 03:49:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.402s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:23 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-4a3124f5-fa4d-4df2-8c8f-225a965b1153 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:49:23 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-4a3124f5-fa4d-4df2-8c8f-225a965b1153 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] No BDM found with device name vdb, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:49:23 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-4a3124f5-fa4d-4df2-8c8f-225a965b1153 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] No VIF found with MAC fa:16:3e:9a:45:d0, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 03:49:24 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4a3124f5-fa4d-4df2-8c8f-225a965b1153 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Lock "51554aab-44ec-4161-b926-9c07a3f838a5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.553s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:24 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:49:24 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-4cfb7277-9b35-417b-9fca-341a0068096c tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c24a386f-32f5-4095-b2b3-69a70a54ff66 is timed out.
Nov 16 03:49:24 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-4cfb7277-9b35-417b-9fca-341a0068096c tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Successfully detached device vdb from instance c24a386f-32f5-4095-b2b3-69a70a54ff66 from the live domain config.
Nov 16 03:49:24 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cfb7277-9b35-417b-9fca-341a0068096c tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 03:49:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfb7277-9b35-417b-9fca-341a0068096c tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DfTzSXUe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdm', 'volume_id': '34b3df15-2d1d-4474-839a-465db0816beb'}, None), 'kwargs': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:49:24 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-4cfb7277-9b35-417b-9fca-341a0068096c tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:49:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-4cfb7277-9b35-417b-9fca-341a0068096c tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:49:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-4cfb7277-9b35-417b-9fca-341a0068096c tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:49:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:24 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e913bfa-5eac-483d-b117-05c0c97a7fc7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfb7277-9b35-417b-9fca-341a0068096c tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 03:49:24 user nova-compute[103546]: No targets found.
Nov 16 03:49:24 user nova-compute[103546]: iSNS:
Nov 16 03:49:24 user nova-compute[103546]: No targets found.
Nov 16 03:49:24 user nova-compute[103546]: STATIC:
Nov 16 03:49:24 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c
Nov 16 03:49:24 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:24 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:24 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb
Nov 16 03:49:24 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:24 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:24 user nova-compute[103546]: FIRMWARE:
Nov 16 03:49:24 user nova-compute[103546]: No targets found.
Nov 16 03:49:24 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:49:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfb7277-9b35-417b-9fca-341a0068096c tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 03:49:24 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 03:49:24 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 03:49:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfb7277-9b35-417b-9fca-341a0068096c tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 03:49:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:24 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91ae57a-97bd-4077-a0d7-b12e84e20e08]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:25 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ff1f79-15c8-4d8e-a1e7-6036fa5db234]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:25 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfb7277-9b35-417b-9fca-341a0068096c tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)
Nov 16 03:49:25 user nova-compute[103546]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)
Nov 16 03:49:25 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:49:25 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfb7277-9b35-417b-9fca-341a0068096c tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb (non-flash)
Nov 16 03:49:25 user nova-compute[103546]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)
Nov 16 03:49:25 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:49:25 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfb7277-9b35-417b-9fca-341a0068096c tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60ac5ae200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb'): ({'sdm'}, set())}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 03:49:25 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-4cfb7277-9b35-417b-9fca-341a0068096c tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Removing single pathed devices sdm {{(pid=103546) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 03:49:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:25 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed1296b-6387-4e11-bf5e-f6e5941b4d60]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdm {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdm" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:25 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df2e7fa-01ea-4abd-abb2-69de9bb518b1]: (4, ('ok\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:25 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-4cfb7277-9b35-417b-9fca-341a0068096c tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Flushing IO for device /dev/sdm {{(pid=103546) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 03:49:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdm {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdm" returned: 0 in 0.012s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:25 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[693b5109-f4a2-4735-8297-379d46913a56]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:25 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-4cfb7277-9b35-417b-9fca-341a0068096c tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=103546) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 03:49:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdm/device/delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdm/device/delete" returned: 0 in 0.043s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:25 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a71f50-a5b8-4959-b03d-e8dbd4226d83]: (4, ('1', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:25 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-4cfb7277-9b35-417b-9fca-341a0068096c tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Checking to see if SCSI volumes sdm have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 03:49:25 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-4cfb7277-9b35-417b-9fca-341a0068096c tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] SCSI volumes sdm have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 03:49:25 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfb7277-9b35-417b-9fca-341a0068096c tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb')] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 03:49:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:25 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c460196-f6b4-4969-8555-6e8f93d8d6a2]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:25 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfb7277-9b35-417b-9fca-341a0068096c tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:49:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb -p 172.16.0.220:3260 --logout {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb -p 172.16.0.220:3260 --logout" returned: 0 in 0.091s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:25 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f06e95-4993-43c4-b701-0fcdaa97f552]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:25 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfb7277-9b35-417b-9fca-341a0068096c tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb, portal: 172.16.0.220,3260]
Nov 16 03:49:25 user nova-compute[103546]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb, portal: 172.16.0.220,3260] successful.
Nov 16 03:49:25 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:49:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb -p 172.16.0.220:3260 --op delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34b3df15-2d1d-4474-839a-465db0816beb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:25 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60c746e-a527-41a6-bc50-e9a2a51f4f37]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:25 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfb7277-9b35-417b-9fca-341a0068096c tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:49:25 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-4cfb7277-9b35-417b-9fca-341a0068096c tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:49:25 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfb7277-9b35-417b-9fca-341a0068096c tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] <== disconnect_volume: return (332ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:49:25 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cfb7277-9b35-417b-9fca-341a0068096c tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 03:49:26 user nova-compute[103546]: DEBUG nova.objects.instance [None req-4cfb7277-9b35-417b-9fca-341a0068096c tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Lazy-loading 'flavor' on Instance uuid c24a386f-32f5-4095-b2b3-69a70a54ff66 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:49:26 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4cfb7277-9b35-417b-9fca-341a0068096c tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Lock "c24a386f-32f5-4095-b2b3-69a70a54ff66" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.697s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:26 user nova-compute[103546]: DEBUG nova.compute.manager [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Stashing vm_state: active {{(pid=103546) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 16 03:49:26 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:26 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:26 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=103546) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 03:49:26 user nova-compute[103546]: INFO nova.compute.claims [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Claim successful on node user
Nov 16 03:49:26 user nova-compute[103546]: INFO nova.compute.resource_tracker [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Updating resource usage from migration 3b29b254-f016-4d50-9bc9-d37b6945b409
Nov 16 03:49:27 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:49:27 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:49:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.400s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:27 user nova-compute[103546]: INFO nova.compute.manager [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Migrating
Nov 16 03:49:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:49:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Acquired lock "compute-rpcapi-router" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:49:27 user nova-compute[103546]: INFO nova.compute.rpcapi [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 16 03:49:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Releasing lock "compute-rpcapi-router" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:49:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Acquiring lock "refresh_cache-51554aab-44ec-4161-b926-9c07a3f838a5" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:49:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Acquired lock "refresh_cache-51554aab-44ec-4161-b926-9c07a3f838a5" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:49:27 user nova-compute[103546]: DEBUG nova.network.neutron [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 03:49:27 user nova-compute[103546]: DEBUG nova.network.neutron [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Updating instance_info_cache with network_info: [{"id": "e36fae5d-773f-47c0-b79a-5aadf6412cbc", "address": "fa:16:3e:9a:45:d0", "network": {"id": "ef471a6e-7bd1-4a61-aa01-fd7557bfae1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-865941926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76ca2da0c584a7382040eb113da4c2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape36fae5d-77", "ovs_interfaceid": "e36fae5d-773f-47c0-b79a-5aadf6412cbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:49:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Releasing lock "refresh_cache-51554aab-44ec-4161-b926-9c07a3f838a5" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:49:27 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Starting migrate_disk_and_power_off {{(pid=103546) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 16 03:49:27 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:27 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:27 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG nova.compute.manager [req-db18d765-f141-4df1-96b8-b7f1dcafd823 req-c8a5d3cb-d12d-46d8-8811-6192b460acc2 service nova] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Received event network-vif-unplugged-e36fae5d-773f-47c0-b79a-5aadf6412cbc {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-db18d765-f141-4df1-96b8-b7f1dcafd823 req-c8a5d3cb-d12d-46d8-8811-6192b460acc2 service nova] Acquiring lock "51554aab-44ec-4161-b926-9c07a3f838a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-db18d765-f141-4df1-96b8-b7f1dcafd823 req-c8a5d3cb-d12d-46d8-8811-6192b460acc2 service nova] Lock "51554aab-44ec-4161-b926-9c07a3f838a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-db18d765-f141-4df1-96b8-b7f1dcafd823 req-c8a5d3cb-d12d-46d8-8811-6192b460acc2 service nova] Lock "51554aab-44ec-4161-b926-9c07a3f838a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG nova.compute.manager [req-db18d765-f141-4df1-96b8-b7f1dcafd823 req-c8a5d3cb-d12d-46d8-8811-6192b460acc2 service nova] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] No waiting events found dispatching network-vif-unplugged-e36fae5d-773f-47c0-b79a-5aadf6412cbc {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:49:28 user nova-compute[103546]: WARNING nova.compute.manager [req-db18d765-f141-4df1-96b8-b7f1dcafd823 req-c8a5d3cb-d12d-46d8-8811-6192b460acc2 service nova] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Received unexpected event network-vif-unplugged-e36fae5d-773f-47c0-b79a-5aadf6412cbc for instance with vm_state active and task_state resize_migrating.
Nov 16 03:49:28 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Instance destroyed successfully.
Nov 16 03:49:28 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:46:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1580842921',display_name='tempest-ServerActionsTestOtherB-server-1580842921',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1580842921',id=2,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4BC4cHDV2fbJoL15YFOsrL3Jj/txUDoSxREB28Izf7niUsDWNVN4I6jw0qVmlW7BvPaNCWUAskE06oeKsT+2XD63IEOwvY2xtSda7L7/qiL3VY46L9X29CD+3k2W4RoA==',key_name='tempest-keypair-857843108',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:46:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f76ca2da0c584a7382040eb113da4c2a',ramdisk_id='',reservation_id='r-kl1f6eox',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-648062424',owner_user_name='tempest-ServerActionsTestOtherB-648062424-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:49:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4bf11ccac9f4203808f8dca52cde36c',uuid=51554aab-44ec-4161-b926-9c07a3f838a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e36fae5d-773f-47c0-b79a-5aadf6412cbc", "address": "fa:16:3e:9a:45:d0", "network": {"id": "ef471a6e-7bd1-4a61-aa01-fd7557bfae1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-865941926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-865941926-network", "vif_mac": "fa:16:3e:9a:45:d0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76ca2da0c584a7382040eb113da4c2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape36fae5d-77", "ovs_interfaceid": "e36fae5d-773f-47c0-b79a-5aadf6412cbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Converting VIF {"id": "e36fae5d-773f-47c0-b79a-5aadf6412cbc", "address": "fa:16:3e:9a:45:d0", "network": {"id": "ef471a6e-7bd1-4a61-aa01-fd7557bfae1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-865941926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-865941926-network", "vif_mac": "fa:16:3e:9a:45:d0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76ca2da0c584a7382040eb113da4c2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape36fae5d-77", "ovs_interfaceid": "e36fae5d-773f-47c0-b79a-5aadf6412cbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:45:d0,bridge_name='br-int',has_traffic_filtering=True,id=e36fae5d-773f-47c0-b79a-5aadf6412cbc,network=Network(ef471a6e-7bd1-4a61-aa01-fd7557bfae1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape36fae5d-77') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG os_vif [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:45:d0,bridge_name='br-int',has_traffic_filtering=True,id=e36fae5d-773f-47c0-b79a-5aadf6412cbc,network=Network(ef471a6e-7bd1-4a61-aa01-fd7557bfae1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape36fae5d-77') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape36fae5d-77, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=62fe5175-2699-4f62-8d42-d1dc7cd01c8b) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:28 user nova-compute[103546]: INFO os_vif [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:45:d0,bridge_name='br-int',has_traffic_filtering=True,id=e36fae5d-773f-47c0-b79a-5aadf6412cbc,network=Network(ef471a6e-7bd1-4a61-aa01-fd7557bfae1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape36fae5d-77')
Nov 16 03:49:28 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YukJztTB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:49:28 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:49:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8a94e1-4c29-4c41-95ac-771f19e80ecc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 03:49:28 user nova-compute[103546]: No targets found.
Nov 16 03:49:28 user nova-compute[103546]: iSNS:
Nov 16 03:49:28 user nova-compute[103546]: No targets found.
Nov 16 03:49:28 user nova-compute[103546]: STATIC:
Nov 16 03:49:28 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c
Nov 16 03:49:28 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:49:28 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:49:28 user nova-compute[103546]: FIRMWARE:
Nov 16 03:49:28 user nova-compute[103546]: No targets found.
Nov 16 03:49:28 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 03:49:28 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 03:49:28 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe35f9e-dc83-4652-b39b-bea55f53e23c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e28b25-f709-4d43-9ba2-2a440308fc46]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)
Nov 16 03:49:28 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)
Nov 16 03:49:28 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60cc13e710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c'): ({'sdb'}, set())}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Removing single pathed devices sdb {{(pid=103546) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a7aa01-ec6f-45da-8e97-fef6bfb8b2e3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[441271fd-9cbd-4a18-a4b1-d8a4cf8c538f]: (4, ('ok\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Flushing IO for device /dev/sdb {{(pid=103546) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a7bf6a-66ab-4cfb-b669-45cde323d0e7]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=103546) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4358ca7-2aa3-4159-b41d-9259ec9d5bd4]: (4, ('1', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] SCSI volumes sdb have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c')] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd245b0-f15c-42cc-b95e-1cb55ad2e2b0]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260 --logout {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe62ca9-89c3-48c5-8806-a9acb938daef]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c, portal: 172.16.0.220,3260]
Nov 16 03:49:28 user nova-compute[103546]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c, portal: 172.16.0.220,3260] successful.
Nov 16 03:49:28 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260 --op delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cca9e38-f05a-496e-aa65-4f3021919f0d]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] <== disconnect_volume: return (296ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 03:49:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51554aab-44ec-4161-b926-9c07a3f838a5/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51554aab-44ec-4161-b926-9c07a3f838a5/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51554aab-44ec-4161-b926-9c07a3f838a5/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51554aab-44ec-4161-b926-9c07a3f838a5/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:29 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 03:49:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/51554aab-44ec-4161-b926-9c07a3f838a5_resize/disk /opt/stack/data/nova/instances/51554aab-44ec-4161-b926-9c07a3f838a5/disk {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] CMD "cp -r /opt/stack/data/nova/instances/51554aab-44ec-4161-b926-9c07a3f838a5_resize/disk /opt/stack/data/nova/instances/51554aab-44ec-4161-b926-9c07a3f838a5/disk" returned: 0 in 0.428s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/51554aab-44ec-4161-b926-9c07a3f838a5_resize/disk.info /opt/stack/data/nova/instances/51554aab-44ec-4161-b926-9c07a3f838a5/disk.info {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] CMD "cp -r /opt/stack/data/nova/instances/51554aab-44ec-4161-b926-9c07a3f838a5_resize/disk.info /opt/stack/data/nova/instances/51554aab-44ec-4161-b926-9c07a3f838a5/disk.info" returned: 0 in 0.034s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:30 user nova-compute[103546]: DEBUG nova.compute.manager [req-c0f8f9b9-afd9-4fb2-8d01-387c24b68f96 req-a215a1d6-22db-4857-adc6-eee7c0ca8fc7 service nova] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Received event network-vif-plugged-e36fae5d-773f-47c0-b79a-5aadf6412cbc {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:49:30 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-c0f8f9b9-afd9-4fb2-8d01-387c24b68f96 req-a215a1d6-22db-4857-adc6-eee7c0ca8fc7 service nova] Acquiring lock "51554aab-44ec-4161-b926-9c07a3f838a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:30 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-c0f8f9b9-afd9-4fb2-8d01-387c24b68f96 req-a215a1d6-22db-4857-adc6-eee7c0ca8fc7 service nova] Lock "51554aab-44ec-4161-b926-9c07a3f838a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:30 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-c0f8f9b9-afd9-4fb2-8d01-387c24b68f96 req-a215a1d6-22db-4857-adc6-eee7c0ca8fc7 service nova] Lock "51554aab-44ec-4161-b926-9c07a3f838a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:30 user nova-compute[103546]: DEBUG nova.compute.manager [req-c0f8f9b9-afd9-4fb2-8d01-387c24b68f96 req-a215a1d6-22db-4857-adc6-eee7c0ca8fc7 service nova] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] No waiting events found dispatching network-vif-plugged-e36fae5d-773f-47c0-b79a-5aadf6412cbc {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:49:30 user nova-compute[103546]: WARNING nova.compute.manager [req-c0f8f9b9-afd9-4fb2-8d01-387c24b68f96 req-a215a1d6-22db-4857-adc6-eee7c0ca8fc7 service nova] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Received unexpected event network-vif-plugged-e36fae5d-773f-47c0-b79a-5aadf6412cbc for instance with vm_state active and task_state resize_migrating.
Nov 16 03:49:30 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Acquiring lock "ddaf87db-e525-4839-a538-4b766b3e875a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:30 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Lock "ddaf87db-e525-4839-a538-4b766b3e875a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:30 user nova-compute[103546]: DEBUG nova.compute.manager [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: ddaf87db-e525-4839-a538-4b766b3e875a] Starting instance... {{(pid=103546) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 03:49:30 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:30 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:30 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=103546) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 03:49:30 user nova-compute[103546]: INFO nova.compute.claims [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: ddaf87db-e525-4839-a538-4b766b3e875a] Claim successful on node user
Nov 16 03:49:30 user nova-compute[103546]: DEBUG nova.network.neutron [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Port e36fae5d-773f-47c0-b79a-5aadf6412cbc binding to destination host user is already ACTIVE {{(pid=103546) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 16 03:49:30 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Acquiring lock "51554aab-44ec-4161-b926-9c07a3f838a5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:30 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Lock "51554aab-44ec-4161-b926-9c07a3f838a5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:30 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Lock "51554aab-44ec-4161-b926-9c07a3f838a5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:31 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Acquiring lock "refresh_cache-51554aab-44ec-4161-b926-9c07a3f838a5" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:49:31 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Acquired lock "refresh_cache-51554aab-44ec-4161-b926-9c07a3f838a5" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:49:31 user nova-compute[103546]: DEBUG nova.network.neutron [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 03:49:31 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:49:31 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:49:31 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.421s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:31 user nova-compute[103546]: DEBUG nova.compute.manager [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: ddaf87db-e525-4839-a538-4b766b3e875a] Start building networks asynchronously for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 03:49:31 user nova-compute[103546]: DEBUG nova.compute.manager [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: ddaf87db-e525-4839-a538-4b766b3e875a] Allocating IP information in the background. {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 03:49:31 user nova-compute[103546]: DEBUG nova.network.neutron [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: ddaf87db-e525-4839-a538-4b766b3e875a] allocate_for_instance() {{(pid=103546) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 03:49:31 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: ddaf87db-e525-4839-a538-4b766b3e875a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 03:49:31 user nova-compute[103546]: DEBUG nova.compute.manager [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: ddaf87db-e525-4839-a538-4b766b3e875a] Start building block device mappings for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 03:49:31 user nova-compute[103546]: DEBUG nova.policy [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7bf9f55ab03b4df38e0b35ed4c8967e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998b2147e8194af3a15fce90bc7063b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103546) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 03:49:31 user nova-compute[103546]: DEBUG nova.compute.manager [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: ddaf87db-e525-4839-a538-4b766b3e875a] Start spawning the instance on the hypervisor. {{(pid=103546) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 03:49:31 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: ddaf87db-e525-4839-a538-4b766b3e875a] Creating instance directory {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 03:49:31 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: ddaf87db-e525-4839-a538-4b766b3e875a] Creating image(s)
Nov 16 03:49:31 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Acquiring lock "/opt/stack/data/nova/instances/ddaf87db-e525-4839-a538-4b766b3e875a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:31 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Lock "/opt/stack/data/nova/instances/ddaf87db-e525-4839-a538-4b766b3e875a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:31 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Lock "/opt/stack/data/nova/instances/ddaf87db-e525-4839-a538-4b766b3e875a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:31 user nova-compute[103546]: DEBUG nova.network.neutron [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Updating instance_info_cache with network_info: [{"id": "e36fae5d-773f-47c0-b79a-5aadf6412cbc", "address": "fa:16:3e:9a:45:d0", "network": {"id": "ef471a6e-7bd1-4a61-aa01-fd7557bfae1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-865941926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76ca2da0c584a7382040eb113da4c2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape36fae5d-77", "ovs_interfaceid": "e36fae5d-773f-47c0-b79a-5aadf6412cbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:49:31 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Releasing lock "refresh_cache-51554aab-44ec-4161-b926-9c07a3f838a5" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:49:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.204s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:31 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Acquiring lock "8c9efafb670bfe5842ba1f4ce398924612164af7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:31 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:31 user nova-compute[103546]: DEBUG os_brick.utils [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:49:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:31 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[9087d261-0a61-490e-bff9-ef63aa932269]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af5c39b14ece\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:31 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a53c3de-1577-47ba-b526-4e86e4cd0bc8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:31 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e565d3-7f82-4cde-8849-dfd1f04d23c1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:31 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b73ef29-a829-4ff9-8e85-4c3109db9c55]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Running cmd (subprocess): nvme version {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] 'nvme version' failed. Not Retrying. {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:49:31 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] nvme not present on system {{(pid=103546) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 03:49:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.200s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/ddaf87db-e525-4839-a538-4b766b3e875a/disk 1073741824 {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:49:31 user nova-compute[103546]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 03:49:31 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[630da624-db29-4061-8bb2-173909e288c2]: (4, '') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:31 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=103546) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 03:49:31 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 03:49:31 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] LIGHTOS: no hostnqn found. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 03:49:31 user nova-compute[103546]: DEBUG os_brick.utils [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af5c39b14ece', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:49:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/ddaf87db-e525-4839-a538-4b766b3e875a/disk 1073741824" returned: 0 in 0.056s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:31 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:32 user nova-compute[103546]: DEBUG nova.network.neutron [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: ddaf87db-e525-4839-a538-4b766b3e875a] Successfully created port: 883ecc71-b87c-496d-8436-d3085c19dbc7 {{(pid=103546) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 03:49:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.222s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:32 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ddaf87db-e525-4839-a538-4b766b3e875a/disk. size=1073741824 {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 03:49:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddaf87db-e525-4839-a538-4b766b3e875a/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddaf87db-e525-4839-a538-4b766b3e875a/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:32 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Cannot resize image /opt/stack/data/nova/instances/ddaf87db-e525-4839-a538-4b766b3e875a/disk to a smaller size. {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 03:49:32 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: ddaf87db-e525-4839-a538-4b766b3e875a] Created local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 03:49:32 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: ddaf87db-e525-4839-a538-4b766b3e875a] Ensure instance console log exists: /opt/stack/data/nova/instances/ddaf87db-e525-4839-a538-4b766b3e875a/console.log {{(pid=103546) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 03:49:32 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:32 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:32 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:32 user nova-compute[103546]: DEBUG nova.network.neutron [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: ddaf87db-e525-4839-a538-4b766b3e875a] Successfully updated port: 883ecc71-b87c-496d-8436-d3085c19dbc7 {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 03:49:32 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Acquiring lock "refresh_cache-ddaf87db-e525-4839-a538-4b766b3e875a" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:49:32 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Acquired lock "refresh_cache-ddaf87db-e525-4839-a538-4b766b3e875a" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:49:32 user nova-compute[103546]: DEBUG nova.network.neutron [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: ddaf87db-e525-4839-a538-4b766b3e875a] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 03:49:32 user nova-compute[103546]: DEBUG nova.compute.manager [req-3e8d1b53-bea2-4a4f-a8be-dff03e876671 req-f3c4578c-47e8-4212-b9b5-0d0b2b179d3b service nova] [instance: ddaf87db-e525-4839-a538-4b766b3e875a] Received event network-changed-883ecc71-b87c-496d-8436-d3085c19dbc7 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:49:32 user nova-compute[103546]: DEBUG nova.compute.manager [req-3e8d1b53-bea2-4a4f-a8be-dff03e876671 req-f3c4578c-47e8-4212-b9b5-0d0b2b179d3b service nova] [instance: ddaf87db-e525-4839-a538-4b766b3e875a] Refreshing instance network info cache due to event network-changed-883ecc71-b87c-496d-8436-d3085c19dbc7. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:49:32 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3e8d1b53-bea2-4a4f-a8be-dff03e876671 req-f3c4578c-47e8-4212-b9b5-0d0b2b179d3b service nova] Acquiring lock "refresh_cache-ddaf87db-e525-4839-a538-4b766b3e875a" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:49:32 user nova-compute[103546]: DEBUG nova.network.neutron [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: ddaf87db-e525-4839-a538-4b766b3e875a] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG nova.network.neutron [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: ddaf87db-e525-4839-a538-4b766b3e875a] Updating instance_info_cache with network_info: [{"id": "883ecc71-b87c-496d-8436-d3085c19dbc7", "address": "fa:16:3e:1e:e2:36", "network": {"id": "1a48a5d8-8046-4baf-9b30-4505213d862a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1526890096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998b2147e8194af3a15fce90bc7063b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap883ecc71-b8", "ovs_interfaceid": "883ecc71-b87c-496d-8436-d3085c19dbc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Releasing lock "refresh_cache-ddaf87db-e525-4839-a538-4b766b3e875a" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG nova.compute.manager [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: ddaf87db-e525-4839-a538-4b766b3e875a] Instance network_info: |[{"id": "883ecc71-b87c-496d-8436-d3085c19dbc7", "address": "fa:16:3e:1e:e2:36", "network": {"id": "1a48a5d8-8046-4baf-9b30-4505213d862a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1526890096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998b2147e8194af3a15fce90bc7063b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap883ecc71-b8", "ovs_interfaceid": "883ecc71-b87c-496d-8436-d3085c19dbc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3e8d1b53-bea2-4a4f-a8be-dff03e876671 req-f3c4578c-47e8-4212-b9b5-0d0b2b179d3b service nova] Acquired lock "refresh_cache-ddaf87db-e525-4839-a538-4b766b3e875a" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG nova.network.neutron [req-3e8d1b53-bea2-4a4f-a8be-dff03e876671 req-f3c4578c-47e8-4212-b9b5-0d0b2b179d3b service nova] [instance: ddaf87db-e525-4839-a538-4b766b3e875a] Refreshing network info cache for port 883ecc71-b87c-496d-8436-d3085c19dbc7 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: ddaf87db-e525-4839-a538-4b766b3e875a] Start _get_guest_xml network_info=[{"id": "883ecc71-b87c-496d-8436-d3085c19dbc7", "address": "fa:16:3e:1e:e2:36", "network": {"id": "1a48a5d8-8046-4baf-9b30-4505213d862a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1526890096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998b2147e8194af3a15fce90bc7063b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap883ecc71-b8", "ovs_interfaceid": "883ecc71-b87c-496d-8436-d3085c19dbc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '5c6f539a-01e5-4478-bf8f-a14310b5d7dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 03:49:33 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:49:33 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:49:33 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:49:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1823420271',display_name='tempest-VolumesAdminNegativeTest-server-1823420271',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1823420271',id=13,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='998b2147e8194af3a15fce90bc7063b0',ramdisk_id='',reservation_id='r-lrith0cq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1034179231',owner_user_name='tempest-VolumesAdminNegativeTest-1034179231-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:49:31Z,user_data=None,user_id='7bf9f55ab03b4df38e0b35ed4c8967e8',uuid=ddaf87db-e525-4839-a538-4b766b3e875a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "883ecc71-b87c-496d-8436-d3085c19dbc7", "address": "fa:16:3e:1e:e2:36", "network": {"id": "1a48a5d8-8046-4baf-9b30-4505213d862a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1526890096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998b2147e8194af3a15fce90bc7063b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap883ecc71-b8", "ovs_interfaceid": "883ecc71-b87c-496d-8436-d3085c19dbc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Converting VIF {"id": "883ecc71-b87c-496d-8436-d3085c19dbc7", "address": "fa:16:3e:1e:e2:36", "network": {"id": "1a48a5d8-8046-4baf-9b30-4505213d862a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1526890096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998b2147e8194af3a15fce90bc7063b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap883ecc71-b8", "ovs_interfaceid": "883ecc71-b87c-496d-8436-d3085c19dbc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:e2:36,bridge_name='br-int',has_traffic_filtering=True,id=883ecc71-b87c-496d-8436-d3085c19dbc7,network=Network(1a48a5d8-8046-4baf-9b30-4505213d862a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap883ecc71-b8') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG nova.objects.instance [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Lazy-loading 'pci_devices' on Instance uuid ddaf87db-e525-4839-a538-4b766b3e875a {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: ddaf87db-e525-4839-a538-4b766b3e875a] End _get_guest_xml xml=<domain type="kvm">
Nov 16 03:49:33 user nova-compute[103546]:   <uuid>ddaf87db-e525-4839-a538-4b766b3e875a</uuid>
Nov 16 03:49:33 user nova-compute[103546]:   <name>instance-0000000d</name>
Nov 16 03:49:33 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 03:49:33 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 03:49:33 user nova-compute[103546]:   <metadata>
Nov 16 03:49:33 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 03:49:33 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 03:49:33 user nova-compute[103546]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1823420271</nova:name>
Nov 16 03:49:33 user nova-compute[103546]:       <nova:creationTime>2023-11-16 03:49:33</nova:creationTime>
Nov 16 03:49:33 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 03:49:33 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 03:49:33 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 03:49:33 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 03:49:33 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 03:49:33 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 03:49:33 user nova-compute[103546]:       </nova:flavor>
Nov 16 03:49:33 user nova-compute[103546]:       <nova:owner>
Nov 16 03:49:33 user nova-compute[103546]:         <nova:user uuid="7bf9f55ab03b4df38e0b35ed4c8967e8">tempest-VolumesAdminNegativeTest-1034179231-project-member</nova:user>
Nov 16 03:49:33 user nova-compute[103546]:         <nova:project uuid="998b2147e8194af3a15fce90bc7063b0">tempest-VolumesAdminNegativeTest-1034179231</nova:project>
Nov 16 03:49:33 user nova-compute[103546]:       </nova:owner>
Nov 16 03:49:33 user nova-compute[103546]:       <nova:root type="image" uuid="5c6f539a-01e5-4478-bf8f-a14310b5d7dd"/>
Nov 16 03:49:33 user nova-compute[103546]:       <nova:ports>
Nov 16 03:49:33 user nova-compute[103546]:         <nova:port uuid="883ecc71-b87c-496d-8436-d3085c19dbc7">
Nov 16 03:49:33 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 16 03:49:33 user nova-compute[103546]:         </nova:port>
Nov 16 03:49:33 user nova-compute[103546]:       </nova:ports>
Nov 16 03:49:33 user nova-compute[103546]:     </nova:instance>
Nov 16 03:49:33 user nova-compute[103546]:   </metadata>
Nov 16 03:49:33 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 03:49:33 user nova-compute[103546]:     <system>
Nov 16 03:49:33 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 03:49:33 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 03:49:33 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 03:49:33 user nova-compute[103546]:       <entry name="serial">ddaf87db-e525-4839-a538-4b766b3e875a</entry>
Nov 16 03:49:33 user nova-compute[103546]:       <entry name="uuid">ddaf87db-e525-4839-a538-4b766b3e875a</entry>
Nov 16 03:49:33 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 03:49:33 user nova-compute[103546]:     </system>
Nov 16 03:49:33 user nova-compute[103546]:   </sysinfo>
Nov 16 03:49:33 user nova-compute[103546]:   <os>
Nov 16 03:49:33 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 03:49:33 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 03:49:33 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 03:49:33 user nova-compute[103546]:   </os>
Nov 16 03:49:33 user nova-compute[103546]:   <features>
Nov 16 03:49:33 user nova-compute[103546]:     <acpi/>
Nov 16 03:49:33 user nova-compute[103546]:     <apic/>
Nov 16 03:49:33 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 03:49:33 user nova-compute[103546]:   </features>
Nov 16 03:49:33 user nova-compute[103546]:   <clock offset="utc">
Nov 16 03:49:33 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 03:49:33 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 03:49:33 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 03:49:33 user nova-compute[103546]:   </clock>
Nov 16 03:49:33 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 03:49:33 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 03:49:33 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 03:49:33 user nova-compute[103546]:   </cpu>
Nov 16 03:49:33 user nova-compute[103546]:   <devices>
Nov 16 03:49:33 user nova-compute[103546]:     <disk type="file" device="disk">
Nov 16 03:49:33 user nova-compute[103546]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 03:49:33 user nova-compute[103546]:       <source file="/opt/stack/data/nova/instances/ddaf87db-e525-4839-a538-4b766b3e875a/disk"/>
Nov 16 03:49:33 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 03:49:33 user nova-compute[103546]:     </disk>
Nov 16 03:49:33 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 03:49:33 user nova-compute[103546]:       <mac address="fa:16:3e:1e:e2:36"/>
Nov 16 03:49:33 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:49:33 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 03:49:33 user nova-compute[103546]:       <target dev="tap883ecc71-b8"/>
Nov 16 03:49:33 user nova-compute[103546]:     </interface>
Nov 16 03:49:33 user nova-compute[103546]:     <serial type="pty">
Nov 16 03:49:33 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/ddaf87db-e525-4839-a538-4b766b3e875a/console.log" append="off"/>
Nov 16 03:49:33 user nova-compute[103546]:     </serial>
Nov 16 03:49:33 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 03:49:33 user nova-compute[103546]:     <video>
Nov 16 03:49:33 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:49:33 user nova-compute[103546]:     </video>
Nov 16 03:49:33 user nova-compute[103546]:     <rng model="virtio">
Nov 16 03:49:33 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 03:49:33 user nova-compute[103546]:     </rng>
Nov 16 03:49:33 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 03:49:33 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 03:49:33 user nova-compute[103546]:       <stats period="10"/>
Nov 16 03:49:33 user nova-compute[103546]:     </memballoon>
Nov 16 03:49:33 user nova-compute[103546]:   </devices>
Nov 16 03:49:33 user nova-compute[103546]: </domain>
Nov 16 03:49:33 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:49:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1823420271',display_name='tempest-VolumesAdminNegativeTest-server-1823420271',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1823420271',id=13,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='998b2147e8194af3a15fce90bc7063b0',ramdisk_id='',reservation_id='r-lrith0cq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1034179231',owner_user_name='tempest-VolumesAdminNegativeTest-1034179231-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:49:31Z,user_data=None,user_id='7bf9f55ab03b4df38e0b35ed4c8967e8',uuid=ddaf87db-e525-4839-a538-4b766b3e875a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "883ecc71-b87c-496d-8436-d3085c19dbc7", "address": "fa:16:3e:1e:e2:36", "network": {"id": "1a48a5d8-8046-4baf-9b30-4505213d862a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1526890096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998b2147e8194af3a15fce90bc7063b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap883ecc71-b8", "ovs_interfaceid": "883ecc71-b87c-496d-8436-d3085c19dbc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Converting VIF {"id": "883ecc71-b87c-496d-8436-d3085c19dbc7", "address": "fa:16:3e:1e:e2:36", "network": {"id": "1a48a5d8-8046-4baf-9b30-4505213d862a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1526890096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998b2147e8194af3a15fce90bc7063b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap883ecc71-b8", "ovs_interfaceid": "883ecc71-b87c-496d-8436-d3085c19dbc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:e2:36,bridge_name='br-int',has_traffic_filtering=True,id=883ecc71-b87c-496d-8436-d3085c19dbc7,network=Network(1a48a5d8-8046-4baf-9b30-4505213d862a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap883ecc71-b8') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG os_vif [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:e2:36,bridge_name='br-int',has_traffic_filtering=True,id=883ecc71-b87c-496d-8436-d3085c19dbc7,network=Network(1a48a5d8-8046-4baf-9b30-4505213d862a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap883ecc71-b8') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0365b46e-6530-5df6-a8af-23f8e4351303', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap883ecc71-b8, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap883ecc71-b8, col_values=(('qos', UUID('00ba81e7-0ec1-45aa-ae60-d29e401c9134')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap883ecc71-b8, col_values=(('external_ids', {'iface-id': '883ecc71-b87c-496d-8436-d3085c19dbc7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:e2:36', 'vm-uuid': 'ddaf87db-e525-4839-a538-4b766b3e875a'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:33 user nova-compute[103546]: INFO os_vif [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:e2:36,bridge_name='br-int',has_traffic_filtering=True,id=883ecc71-b87c-496d-8436-d3085c19dbc7,network=Network(1a48a5d8-8046-4baf-9b30-4505213d862a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap883ecc71-b8')
Nov 16 03:49:33 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-84452d7a-0352-4e49-83f7-f0c5ae6fd30b tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Waiting for libvirt event about the detach of device tapfe4680c0-c5 with device alias net1 from instance 549ee3db-0014-440f-bd3a-0d389f5eab88 is timed out.
Nov 16 03:49:33 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-84452d7a-0352-4e49-83f7-f0c5ae6fd30b tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:38:66:93"/><model type="virtio"/><mtu size="1442"/><target dev="tapfe4680c0-c5"/></interface> {{(pid=103546) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-84452d7a-0352-4e49-83f7-f0c5ae6fd30b tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:38:66:93"/><model type="virtio"/><mtu size="1442"/><target dev="tapfe4680c0-c5"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 16 03:49:33 user nova-compute[103546]:   <name>instance-00000007</name>
Nov 16 03:49:33 user nova-compute[103546]:   <uuid>549ee3db-0014-440f-bd3a-0d389f5eab88</uuid>
Nov 16 03:49:33 user nova-compute[103546]:   <metadata>
Nov 16 03:49:33 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 03:49:33 user nova-compute[103546]:   <nova:package version="0.0.0"/>
Nov 16 03:49:33 user nova-compute[103546]:   <nova:name>tempest-device-tagging-server-350344638</nova:name>
Nov 16 03:49:33 user nova-compute[103546]:   <nova:creationTime>2023-11-16 03:48:40</nova:creationTime>
Nov 16 03:49:33 user nova-compute[103546]:   <nova:flavor name="m1.tiny">
Nov 16 03:49:33 user nova-compute[103546]:     <nova:memory>512</nova:memory>
Nov 16 03:49:33 user nova-compute[103546]:     <nova:disk>1</nova:disk>
Nov 16 03:49:33 user nova-compute[103546]:     <nova:swap>0</nova:swap>
Nov 16 03:49:33 user nova-compute[103546]:     <nova:ephemeral>0</nova:ephemeral>
Nov 16 03:49:33 user nova-compute[103546]:     <nova:vcpus>1</nova:vcpus>
Nov 16 03:49:33 user nova-compute[103546]:   </nova:flavor>
Nov 16 03:49:33 user nova-compute[103546]:   <nova:owner>
Nov 16 03:49:33 user nova-compute[103546]:     <nova:user uuid="843e14f393d849a9abc7759907a303ea">tempest-TaggedAttachmentsTest-401054631-project-member</nova:user>
Nov 16 03:49:33 user nova-compute[103546]:     <nova:project uuid="4445eb24618042ab9d24c869de5ccaab">tempest-TaggedAttachmentsTest-401054631</nova:project>
Nov 16 03:49:33 user nova-compute[103546]:   </nova:owner>
Nov 16 03:49:33 user nova-compute[103546]:   <nova:root type="image" uuid="5c6f539a-01e5-4478-bf8f-a14310b5d7dd"/>
Nov 16 03:49:33 user nova-compute[103546]:   <nova:ports>
Nov 16 03:49:33 user nova-compute[103546]:     <nova:port uuid="48a6af37-c461-4721-b870-432cf404dcf7">
Nov 16 03:49:33 user nova-compute[103546]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 16 03:49:33 user nova-compute[103546]:     </nova:port>
Nov 16 03:49:33 user nova-compute[103546]:     <nova:port uuid="fe4680c0-c534-4f5b-8833-be40c2784953">
Nov 16 03:49:33 user nova-compute[103546]:       <nova:ip type="fixed" address="10.10.10.225" ipVersion="4"/>
Nov 16 03:49:33 user nova-compute[103546]:     </nova:port>
Nov 16 03:49:33 user nova-compute[103546]:   </nova:ports>
Nov 16 03:49:33 user nova-compute[103546]: </nova:instance>
Nov 16 03:49:33 user nova-compute[103546]:   </metadata>
Nov 16 03:49:33 user nova-compute[103546]:   <memory unit='KiB'>524288</memory>
Nov 16 03:49:33 user nova-compute[103546]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 16 03:49:33 user nova-compute[103546]:   <vcpu placement='static'>1</vcpu>
Nov 16 03:49:33 user nova-compute[103546]:   <resource>
Nov 16 03:49:33 user nova-compute[103546]:     <partition>/machine</partition>
Nov 16 03:49:33 user nova-compute[103546]:   </resource>
Nov 16 03:49:33 user nova-compute[103546]:   <sysinfo type='smbios'>
Nov 16 03:49:33 user nova-compute[103546]:     <system>
Nov 16 03:49:33 user nova-compute[103546]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 16 03:49:33 user nova-compute[103546]:       <entry name='product'>OpenStack Nova</entry>
Nov 16 03:49:33 user nova-compute[103546]:       <entry name='version'>0.0.0</entry>
Nov 16 03:49:33 user nova-compute[103546]:       <entry name='serial'>549ee3db-0014-440f-bd3a-0d389f5eab88</entry>
Nov 16 03:49:33 user nova-compute[103546]:       <entry name='uuid'>549ee3db-0014-440f-bd3a-0d389f5eab88</entry>
Nov 16 03:49:33 user nova-compute[103546]:       <entry name='family'>Virtual Machine</entry>
Nov 16 03:49:33 user nova-compute[103546]:     </system>
Nov 16 03:49:33 user nova-compute[103546]:   </sysinfo>
Nov 16 03:49:33 user nova-compute[103546]:   <os>
Nov 16 03:49:33 user nova-compute[103546]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 16 03:49:33 user nova-compute[103546]:     <boot dev='hd'/>
Nov 16 03:49:33 user nova-compute[103546]:     <smbios mode='sysinfo'/>
Nov 16 03:49:33 user nova-compute[103546]:   </os>
Nov 16 03:49:33 user nova-compute[103546]:   <features>
Nov 16 03:49:33 user nova-compute[103546]:     <acpi/>
Nov 16 03:49:33 user nova-compute[103546]:     <apic/>
Nov 16 03:49:33 user nova-compute[103546]:     <vmcoreinfo state='on'/>
Nov 16 03:49:33 user nova-compute[103546]:   </features>
Nov 16 03:49:33 user nova-compute[103546]:   <cpu mode='custom' match='exact' check='full'>
Nov 16 03:49:33 user nova-compute[103546]:     <model fallback='forbid'>Nehalem</model>
Nov 16 03:49:33 user nova-compute[103546]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 16 03:49:33 user nova-compute[103546]:     <feature policy='require' name='vme'/>
Nov 16 03:49:33 user nova-compute[103546]:     <feature policy='require' name='x2apic'/>
Nov 16 03:49:33 user nova-compute[103546]:     <feature policy='require' name='hypervisor'/>
Nov 16 03:49:33 user nova-compute[103546]:   </cpu>
Nov 16 03:49:33 user nova-compute[103546]:   <clock offset='utc'>
Nov 16 03:49:33 user nova-compute[103546]:     <timer name='pit' tickpolicy='delay'/>
Nov 16 03:49:33 user nova-compute[103546]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 16 03:49:33 user nova-compute[103546]:     <timer name='hpet' present='no'/>
Nov 16 03:49:33 user nova-compute[103546]:   </clock>
Nov 16 03:49:33 user nova-compute[103546]:   <on_poweroff>destroy</on_poweroff>
Nov 16 03:49:33 user nova-compute[103546]:   <on_reboot>restart</on_reboot>
Nov 16 03:49:33 user nova-compute[103546]:   <on_crash>destroy</on_crash>
Nov 16 03:49:33 user nova-compute[103546]:   <devices>
Nov 16 03:49:33 user nova-compute[103546]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 16 03:49:33 user nova-compute[103546]:     <disk type='file' device='disk'>
Nov 16 03:49:33 user nova-compute[103546]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 16 03:49:33 user nova-compute[103546]:       <source file='/opt/stack/data/nova/instances/549ee3db-0014-440f-bd3a-0d389f5eab88/disk' index='2'/>
Nov 16 03:49:33 user nova-compute[103546]:       <backingStore type='file' index='3'>
Nov 16 03:49:33 user nova-compute[103546]:         <format type='raw'/>
Nov 16 03:49:33 user nova-compute[103546]:         <source file='/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7'/>
Nov 16 03:49:33 user nova-compute[103546]:         <backingStore/>
Nov 16 03:49:33 user nova-compute[103546]:       </backingStore>
Nov 16 03:49:33 user nova-compute[103546]:       <target dev='vda' bus='virtio'/>
Nov 16 03:49:33 user nova-compute[103546]:       <alias name='virtio-disk0'/>
Nov 16 03:49:33 user nova-compute[103546]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 16 03:49:33 user nova-compute[103546]:     </disk>
Nov 16 03:49:33 user nova-compute[103546]:     <disk type='file' device='cdrom'>
Nov 16 03:49:33 user nova-compute[103546]:       <driver name='qemu' type='raw' cache='none'/>
Nov 16 03:49:33 user nova-compute[103546]:       <source file='/opt/stack/data/nova/instances/549ee3db-0014-440f-bd3a-0d389f5eab88/disk.config' index='1'/>
Nov 16 03:49:33 user nova-compute[103546]:       <backingStore/>
Nov 16 03:49:33 user nova-compute[103546]:       <target dev='hda' bus='ide'/>
Nov 16 03:49:33 user nova-compute[103546]:       <readonly/>
Nov 16 03:49:33 user nova-compute[103546]:       <alias name='ide0-0-0'/>
Nov 16 03:49:33 user nova-compute[103546]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 16 03:49:33 user nova-compute[103546]:     </disk>
Nov 16 03:49:33 user nova-compute[103546]:     <controller type='usb' index='0' model='none'>
Nov 16 03:49:33 user nova-compute[103546]:       <alias name='usb'/>
Nov 16 03:49:33 user nova-compute[103546]:     </controller>
Nov 16 03:49:33 user nova-compute[103546]:     <controller type='pci' index='0' model='pci-root'>
Nov 16 03:49:33 user nova-compute[103546]:       <alias name='pci.0'/>
Nov 16 03:49:33 user nova-compute[103546]:     </controller>
Nov 16 03:49:33 user nova-compute[103546]:     <controller type='ide' index='0'>
Nov 16 03:49:33 user nova-compute[103546]:       <alias name='ide'/>
Nov 16 03:49:33 user nova-compute[103546]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 16 03:49:33 user nova-compute[103546]:     </controller>
Nov 16 03:49:33 user nova-compute[103546]:     <interface type='ethernet'>
Nov 16 03:49:33 user nova-compute[103546]:       <mac address='fa:16:3e:5b:50:00'/>
Nov 16 03:49:33 user nova-compute[103546]:       <target dev='tap48a6af37-c4'/>
Nov 16 03:49:33 user nova-compute[103546]:       <model type='virtio'/>
Nov 16 03:49:33 user nova-compute[103546]:       <mtu size='1442'/>
Nov 16 03:49:33 user nova-compute[103546]:       <alias name='net0'/>
Nov 16 03:49:33 user nova-compute[103546]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 16 03:49:33 user nova-compute[103546]:     </interface>
Nov 16 03:49:33 user nova-compute[103546]:     <serial type='pty'>
Nov 16 03:49:33 user nova-compute[103546]:       <source path='/dev/pts/6'/>
Nov 16 03:49:33 user nova-compute[103546]:       <log file='/opt/stack/data/nova/instances/549ee3db-0014-440f-bd3a-0d389f5eab88/console.log' append='off'/>
Nov 16 03:49:33 user nova-compute[103546]:       <target type='isa-serial' port='0'>
Nov 16 03:49:33 user nova-compute[103546]:         <model name='isa-serial'/>
Nov 16 03:49:33 user nova-compute[103546]:       </target>
Nov 16 03:49:33 user nova-compute[103546]:       <alias name='serial0'/>
Nov 16 03:49:33 user nova-compute[103546]:     </serial>
Nov 16 03:49:33 user nova-compute[103546]:     <console type='pty' tty='/dev/pts/6'>
Nov 16 03:49:33 user nova-compute[103546]:       <source path='/dev/pts/6'/>
Nov 16 03:49:33 user nova-compute[103546]:       <log file='/opt/stack/data/nova/instances/549ee3db-0014-440f-bd3a-0d389f5eab88/console.log' append='off'/>
Nov 16 03:49:33 user nova-compute[103546]:       <target type='serial' port='0'/>
Nov 16 03:49:33 user nova-compute[103546]:       <alias name='serial0'/>
Nov 16 03:49:33 user nova-compute[103546]:     </console>
Nov 16 03:49:33 user nova-compute[103546]:     <input type='mouse' bus='ps2'>
Nov 16 03:49:33 user nova-compute[103546]:       <alias name='input0'/>
Nov 16 03:49:33 user nova-compute[103546]:     </input>
Nov 16 03:49:33 user nova-compute[103546]:     <input type='keyboard' bus='ps2'>
Nov 16 03:49:33 user nova-compute[103546]:       <alias name='input1'/>
Nov 16 03:49:33 user nova-compute[103546]:     </input>
Nov 16 03:49:33 user nova-compute[103546]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 16 03:49:33 user nova-compute[103546]:       <listen type='address' address='0.0.0.0'/>
Nov 16 03:49:33 user nova-compute[103546]:     </graphics>
Nov 16 03:49:33 user nova-compute[103546]:     <audio id='1' type='none'/>
Nov 16 03:49:33 user nova-compute[103546]:     <video>
Nov 16 03:49:33 user nova-compute[103546]:       <model type='virtio' heads='1' primary='yes'/>
Nov 16 03:49:33 user nova-compute[103546]:       <alias name='video0'/>
Nov 16 03:49:33 user nova-compute[103546]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 16 03:49:33 user nova-compute[103546]:     </video>
Nov 16 03:49:33 user nova-compute[103546]:     <memballoon model='virtio'>
Nov 16 03:49:33 user nova-compute[103546]:       <stats period='10'/>
Nov 16 03:49:33 user nova-compute[103546]:       <alias name='balloon0'/>
Nov 16 03:49:33 user nova-compute[103546]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 16 03:49:33 user nova-compute[103546]:     </memballoon>
Nov 16 03:49:33 user nova-compute[103546]:     <rng model='virtio'>
Nov 16 03:49:33 user nova-compute[103546]:       <backend model='random'>/dev/urandom</backend>
Nov 16 03:49:33 user nova-compute[103546]:       <alias name='rng0'/>
Nov 16 03:49:33 user nova-compute[103546]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 16 03:49:33 user nova-compute[103546]:     </rng>
Nov 16 03:49:33 user nova-compute[103546]:   </devices>
Nov 16 03:49:33 user nova-compute[103546]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 16 03:49:33 user nova-compute[103546]:     <label>libvirt-549ee3db-0014-440f-bd3a-0d389f5eab88</label>
Nov 16 03:49:33 user nova-compute[103546]:     <imagelabel>libvirt-549ee3db-0014-440f-bd3a-0d389f5eab88</imagelabel>
Nov 16 03:49:33 user nova-compute[103546]:   </seclabel>
Nov 16 03:49:33 user nova-compute[103546]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 16 03:49:33 user nova-compute[103546]:     <label>+64055:+108</label>
Nov 16 03:49:33 user nova-compute[103546]:     <imagelabel>+64055:+108</imagelabel>
Nov 16 03:49:33 user nova-compute[103546]:   </seclabel>
Nov 16 03:49:33 user nova-compute[103546]: </domain>
Nov 16 03:49:33 user nova-compute[103546]:  {{(pid=103546) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 16 03:49:33 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-84452d7a-0352-4e49-83f7-f0c5ae6fd30b tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Successfully detached device tapfe4680c0-c5 from instance 549ee3db-0014-440f-bd3a-0d389f5eab88 from the live domain config.
Nov 16 03:49:33 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-84452d7a-0352-4e49-83f7-f0c5ae6fd30b tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T03:46:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-350344638',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-350344638',id=7,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJC87S7hgP6v1mMgMgWP5mrEmsB7FxLODxvVGTyu4rK6Vav//N6bGlF4cB4wdjC5yBjD4JDskSZdj5aiBMflE+VUYysZErN4auZ89tuKfEpG07XZH2cPGYOTHxF0eBL3Dw==',key_name='tempest-keypair-83664986',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:46:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4445eb24618042ab9d24c869de5ccaab',ramdisk_id='',reservation_id='r-s6hqst93',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-401054631',owner_user_name='tempest-TaggedAttachmentsTest-401054631-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T03:46:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='843e14f393d849a9abc7759907a303ea',uuid=549ee3db-0014-440f-bd3a-0d389f5eab88,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe4680c0-c534-4f5b-8833-be40c2784953", "address": "fa:16:3e:38:66:93", "network": {"id": "45e450ee-a16a-4ae4-9e30-f5b3db0e6335", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-951951059", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4445eb24618042ab9d24c869de5ccaab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe4680c0-c5", "ovs_interfaceid": "fe4680c0-c534-4f5b-8833-be40c2784953", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-84452d7a-0352-4e49-83f7-f0c5ae6fd30b tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Converting VIF {"id": "fe4680c0-c534-4f5b-8833-be40c2784953", "address": "fa:16:3e:38:66:93", "network": {"id": "45e450ee-a16a-4ae4-9e30-f5b3db0e6335", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-951951059", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4445eb24618042ab9d24c869de5ccaab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe4680c0-c5", "ovs_interfaceid": "fe4680c0-c534-4f5b-8833-be40c2784953", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-84452d7a-0352-4e49-83f7-f0c5ae6fd30b tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:66:93,bridge_name='br-int',has_traffic_filtering=True,id=fe4680c0-c534-4f5b-8833-be40c2784953,network=Network(45e450ee-a16a-4ae4-9e30-f5b3db0e6335),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe4680c0-c5') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG os_vif [None req-84452d7a-0352-4e49-83f7-f0c5ae6fd30b tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:66:93,bridge_name='br-int',has_traffic_filtering=True,id=fe4680c0-c534-4f5b-8833-be40c2784953,network=Network(45e450ee-a16a-4ae4-9e30-f5b3db0e6335),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe4680c0-c5') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe4680c0-c5, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fcc5168d-76f6-4f71-b547-a814f947d67f) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:33 user nova-compute[103546]: INFO os_vif [None req-84452d7a-0352-4e49-83f7-f0c5ae6fd30b tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:66:93,bridge_name='br-int',has_traffic_filtering=True,id=fe4680c0-c534-4f5b-8833-be40c2784953,network=Network(45e450ee-a16a-4ae4-9e30-f5b3db0e6335),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe4680c0-c5')
Nov 16 03:49:33 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-84452d7a-0352-4e49-83f7-f0c5ae6fd30b tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 03:49:33 user nova-compute[103546]:   <nova:package version="0.0.0"/>
Nov 16 03:49:33 user nova-compute[103546]:   <nova:name>tempest-device-tagging-server-350344638</nova:name>
Nov 16 03:49:33 user nova-compute[103546]:   <nova:creationTime>2023-11-16 03:49:33</nova:creationTime>
Nov 16 03:49:33 user nova-compute[103546]:   <nova:flavor name="m1.tiny">
Nov 16 03:49:33 user nova-compute[103546]:     <nova:memory>512</nova:memory>
Nov 16 03:49:33 user nova-compute[103546]:     <nova:disk>1</nova:disk>
Nov 16 03:49:33 user nova-compute[103546]:     <nova:swap>0</nova:swap>
Nov 16 03:49:33 user nova-compute[103546]:     <nova:ephemeral>0</nova:ephemeral>
Nov 16 03:49:33 user nova-compute[103546]:     <nova:vcpus>1</nova:vcpus>
Nov 16 03:49:33 user nova-compute[103546]:   </nova:flavor>
Nov 16 03:49:33 user nova-compute[103546]:   <nova:owner>
Nov 16 03:49:33 user nova-compute[103546]:     <nova:user uuid="843e14f393d849a9abc7759907a303ea">tempest-TaggedAttachmentsTest-401054631-project-member</nova:user>
Nov 16 03:49:33 user nova-compute[103546]:     <nova:project uuid="4445eb24618042ab9d24c869de5ccaab">tempest-TaggedAttachmentsTest-401054631</nova:project>
Nov 16 03:49:33 user nova-compute[103546]:   </nova:owner>
Nov 16 03:49:33 user nova-compute[103546]:   <nova:root type="image" uuid="5c6f539a-01e5-4478-bf8f-a14310b5d7dd"/>
Nov 16 03:49:33 user nova-compute[103546]:   <nova:ports>
Nov 16 03:49:33 user nova-compute[103546]:     <nova:port uuid="48a6af37-c461-4721-b870-432cf404dcf7">
Nov 16 03:49:33 user nova-compute[103546]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 16 03:49:33 user nova-compute[103546]:     </nova:port>
Nov 16 03:49:33 user nova-compute[103546]:   </nova:ports>
Nov 16 03:49:33 user nova-compute[103546]: </nova:instance>
Nov 16 03:49:33 user nova-compute[103546]:  {{(pid=103546) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] No VIF found with MAC fa:16:3e:1e:e2:36, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG nova.network.neutron [req-3e8d1b53-bea2-4a4f-a8be-dff03e876671 req-f3c4578c-47e8-4212-b9b5-0d0b2b179d3b service nova] [instance: ddaf87db-e525-4839-a538-4b766b3e875a] Updated VIF entry in instance network info cache for port 883ecc71-b87c-496d-8436-d3085c19dbc7. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG nova.network.neutron [req-3e8d1b53-bea2-4a4f-a8be-dff03e876671 req-f3c4578c-47e8-4212-b9b5-0d0b2b179d3b service nova] [instance: ddaf87db-e525-4839-a538-4b766b3e875a] Updating instance_info_cache with network_info: [{"id": "883ecc71-b87c-496d-8436-d3085c19dbc7", "address": "fa:16:3e:1e:e2:36", "network": {"id": "1a48a5d8-8046-4baf-9b30-4505213d862a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1526890096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998b2147e8194af3a15fce90bc7063b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap883ecc71-b8", "ovs_interfaceid": "883ecc71-b87c-496d-8436-d3085c19dbc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3e8d1b53-bea2-4a4f-a8be-dff03e876671 req-f3c4578c-47e8-4212-b9b5-0d0b2b179d3b service nova] Releasing lock "refresh_cache-ddaf87db-e525-4839-a538-4b766b3e875a" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG nova.compute.manager [req-fbf278df-12cc-42e6-85bd-c35d2aa59aad req-fe68cc39-cc92-455d-af19-9cc5f8bbf026 service nova] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Received event network-vif-deleted-fe4680c0-c534-4f5b-8833-be40c2784953 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:49:33 user nova-compute[103546]: INFO nova.compute.manager [req-fbf278df-12cc-42e6-85bd-c35d2aa59aad req-fe68cc39-cc92-455d-af19-9cc5f8bbf026 service nova] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Neutron deleted interface fe4680c0-c534-4f5b-8833-be40c2784953; detaching it from the instance and deleting it from the info cache
Nov 16 03:49:33 user nova-compute[103546]: DEBUG nova.network.neutron [req-fbf278df-12cc-42e6-85bd-c35d2aa59aad req-fe68cc39-cc92-455d-af19-9cc5f8bbf026 service nova] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Updating instance_info_cache with network_info: [{"id": "48a6af37-c461-4721-b870-432cf404dcf7", "address": "fa:16:3e:5b:50:00", "network": {"id": "4c04adce-4d50-4cc1-8c17-5cebba34fbec", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-399866268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4445eb24618042ab9d24c869de5ccaab", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48a6af37-c4", "ovs_interfaceid": "48a6af37-c461-4721-b870-432cf404dcf7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-84452d7a-0352-4e49-83f7-f0c5ae6fd30b tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Acquiring lock "refresh_cache-549ee3db-0014-440f-bd3a-0d389f5eab88" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-84452d7a-0352-4e49-83f7-f0c5ae6fd30b tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Acquired lock "refresh_cache-549ee3db-0014-440f-bd3a-0d389f5eab88" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG nova.network.neutron [None req-84452d7a-0352-4e49-83f7-f0c5ae6fd30b tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG nova.objects.instance [req-fbf278df-12cc-42e6-85bd-c35d2aa59aad req-fe68cc39-cc92-455d-af19-9cc5f8bbf026 service nova] Lazy-loading 'system_metadata' on Instance uuid 549ee3db-0014-440f-bd3a-0d389f5eab88 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:49:33 user nova-compute[103546]: DEBUG nova.objects.instance [req-fbf278df-12cc-42e6-85bd-c35d2aa59aad req-fe68cc39-cc92-455d-af19-9cc5f8bbf026 service nova] Lazy-loading 'flavor' on Instance uuid 549ee3db-0014-440f-bd3a-0d389f5eab88 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:49:34 user nova-compute[103546]: DEBUG nova.objects.base [req-fbf278df-12cc-42e6-85bd-c35d2aa59aad req-fe68cc39-cc92-455d-af19-9cc5f8bbf026 service nova] Object Instance<549ee3db-0014-440f-bd3a-0d389f5eab88> lazy-loaded attributes: system_metadata,flavor {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 03:49:34 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [req-fbf278df-12cc-42e6-85bd-c35d2aa59aad req-fe68cc39-cc92-455d-af19-9cc5f8bbf026 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T03:46:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-350344638',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-350344638',id=7,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJC87S7hgP6v1mMgMgWP5mrEmsB7FxLODxvVGTyu4rK6Vav//N6bGlF4cB4wdjC5yBjD4JDskSZdj5aiBMflE+VUYysZErN4auZ89tuKfEpG07XZH2cPGYOTHxF0eBL3Dw==',key_name='tempest-keypair-83664986',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:46:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4445eb24618042ab9d24c869de5ccaab',ramdisk_id='',reservation_id='r-s6hqst93',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-401054631',owner_user_name='tempest-TaggedAttachmentsTest-401054631-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T03:46:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='843e14f393d849a9abc7759907a303ea',uuid=549ee3db-0014-440f-bd3a-0d389f5eab88,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe4680c0-c534-4f5b-8833-be40c2784953", "address": "fa:16:3e:38:66:93", "network": {"id": "45e450ee-a16a-4ae4-9e30-f5b3db0e6335", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-951951059", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4445eb24618042ab9d24c869de5ccaab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe4680c0-c5", "ovs_interfaceid": "fe4680c0-c534-4f5b-8833-be40c2784953", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 03:49:34 user nova-compute[103546]: DEBUG nova.network.os_vif_util [req-fbf278df-12cc-42e6-85bd-c35d2aa59aad req-fe68cc39-cc92-455d-af19-9cc5f8bbf026 service nova] Converting VIF {"id": "fe4680c0-c534-4f5b-8833-be40c2784953", "address": "fa:16:3e:38:66:93", "network": {"id": "45e450ee-a16a-4ae4-9e30-f5b3db0e6335", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-951951059", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4445eb24618042ab9d24c869de5ccaab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe4680c0-c5", "ovs_interfaceid": "fe4680c0-c534-4f5b-8833-be40c2784953", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:49:34 user nova-compute[103546]: DEBUG nova.network.os_vif_util [req-fbf278df-12cc-42e6-85bd-c35d2aa59aad req-fe68cc39-cc92-455d-af19-9cc5f8bbf026 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:66:93,bridge_name='br-int',has_traffic_filtering=True,id=fe4680c0-c534-4f5b-8833-be40c2784953,network=Network(45e450ee-a16a-4ae4-9e30-f5b3db0e6335),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe4680c0-c5') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:49:34 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [req-fbf278df-12cc-42e6-85bd-c35d2aa59aad req-fe68cc39-cc92-455d-af19-9cc5f8bbf026 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:38:66:93"/><model type="virtio"/><mtu size="1442"/><target dev="tapfe4680c0-c5"/></interface> {{(pid=103546) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 16 03:49:34 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [req-fbf278df-12cc-42e6-85bd-c35d2aa59aad req-fe68cc39-cc92-455d-af19-9cc5f8bbf026 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:38:66:93"/><model type="virtio"/><mtu size="1442"/><target dev="tapfe4680c0-c5"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 16 03:49:34 user nova-compute[103546]:   <name>instance-00000007</name>
Nov 16 03:49:34 user nova-compute[103546]:   <uuid>549ee3db-0014-440f-bd3a-0d389f5eab88</uuid>
Nov 16 03:49:34 user nova-compute[103546]:   <metadata>
Nov 16 03:49:34 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 03:49:34 user nova-compute[103546]:   <nova:package version="0.0.0"/>
Nov 16 03:49:34 user nova-compute[103546]:   <nova:name>tempest-device-tagging-server-350344638</nova:name>
Nov 16 03:49:34 user nova-compute[103546]:   <nova:creationTime>2023-11-16 03:49:33</nova:creationTime>
Nov 16 03:49:34 user nova-compute[103546]:   <nova:flavor name="m1.tiny">
Nov 16 03:49:34 user nova-compute[103546]:     <nova:memory>512</nova:memory>
Nov 16 03:49:34 user nova-compute[103546]:     <nova:disk>1</nova:disk>
Nov 16 03:49:34 user nova-compute[103546]:     <nova:swap>0</nova:swap>
Nov 16 03:49:34 user nova-compute[103546]:     <nova:ephemeral>0</nova:ephemeral>
Nov 16 03:49:34 user nova-compute[103546]:     <nova:vcpus>1</nova:vcpus>
Nov 16 03:49:34 user nova-compute[103546]:   </nova:flavor>
Nov 16 03:49:34 user nova-compute[103546]:   <nova:owner>
Nov 16 03:49:34 user nova-compute[103546]:     <nova:user uuid="843e14f393d849a9abc7759907a303ea">tempest-TaggedAttachmentsTest-401054631-project-member</nova:user>
Nov 16 03:49:34 user nova-compute[103546]:     <nova:project uuid="4445eb24618042ab9d24c869de5ccaab">tempest-TaggedAttachmentsTest-401054631</nova:project>
Nov 16 03:49:34 user nova-compute[103546]:   </nova:owner>
Nov 16 03:49:34 user nova-compute[103546]:   <nova:root type="image" uuid="5c6f539a-01e5-4478-bf8f-a14310b5d7dd"/>
Nov 16 03:49:34 user nova-compute[103546]:   <nova:ports>
Nov 16 03:49:34 user nova-compute[103546]:     <nova:port uuid="48a6af37-c461-4721-b870-432cf404dcf7">
Nov 16 03:49:34 user nova-compute[103546]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 16 03:49:34 user nova-compute[103546]:     </nova:port>
Nov 16 03:49:34 user nova-compute[103546]:   </nova:ports>
Nov 16 03:49:34 user nova-compute[103546]: </nova:instance>
Nov 16 03:49:34 user nova-compute[103546]:   </metadata>
Nov 16 03:49:34 user nova-compute[103546]:   <memory unit='KiB'>524288</memory>
Nov 16 03:49:34 user nova-compute[103546]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 16 03:49:34 user nova-compute[103546]:   <vcpu placement='static'>1</vcpu>
Nov 16 03:49:34 user nova-compute[103546]:   <resource>
Nov 16 03:49:34 user nova-compute[103546]:     <partition>/machine</partition>
Nov 16 03:49:34 user nova-compute[103546]:   </resource>
Nov 16 03:49:34 user nova-compute[103546]:   <sysinfo type='smbios'>
Nov 16 03:49:34 user nova-compute[103546]:     <system>
Nov 16 03:49:34 user nova-compute[103546]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 16 03:49:34 user nova-compute[103546]:       <entry name='product'>OpenStack Nova</entry>
Nov 16 03:49:34 user nova-compute[103546]:       <entry name='version'>0.0.0</entry>
Nov 16 03:49:34 user nova-compute[103546]:       <entry name='serial'>549ee3db-0014-440f-bd3a-0d389f5eab88</entry>
Nov 16 03:49:34 user nova-compute[103546]:       <entry name='uuid'>549ee3db-0014-440f-bd3a-0d389f5eab88</entry>
Nov 16 03:49:34 user nova-compute[103546]:       <entry name='family'>Virtual Machine</entry>
Nov 16 03:49:34 user nova-compute[103546]:     </system>
Nov 16 03:49:34 user nova-compute[103546]:   </sysinfo>
Nov 16 03:49:34 user nova-compute[103546]:   <os>
Nov 16 03:49:34 user nova-compute[103546]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 16 03:49:34 user nova-compute[103546]:     <boot dev='hd'/>
Nov 16 03:49:34 user nova-compute[103546]:     <smbios mode='sysinfo'/>
Nov 16 03:49:34 user nova-compute[103546]:   </os>
Nov 16 03:49:34 user nova-compute[103546]:   <features>
Nov 16 03:49:34 user nova-compute[103546]:     <acpi/>
Nov 16 03:49:34 user nova-compute[103546]:     <apic/>
Nov 16 03:49:34 user nova-compute[103546]:     <vmcoreinfo state='on'/>
Nov 16 03:49:34 user nova-compute[103546]:   </features>
Nov 16 03:49:34 user nova-compute[103546]:   <cpu mode='custom' match='exact' check='full'>
Nov 16 03:49:34 user nova-compute[103546]:     <model fallback='forbid'>Nehalem</model>
Nov 16 03:49:34 user nova-compute[103546]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 16 03:49:34 user nova-compute[103546]:     <feature policy='require' name='vme'/>
Nov 16 03:49:34 user nova-compute[103546]:     <feature policy='require' name='x2apic'/>
Nov 16 03:49:34 user nova-compute[103546]:     <feature policy='require' name='hypervisor'/>
Nov 16 03:49:34 user nova-compute[103546]:   </cpu>
Nov 16 03:49:34 user nova-compute[103546]:   <clock offset='utc'>
Nov 16 03:49:34 user nova-compute[103546]:     <timer name='pit' tickpolicy='delay'/>
Nov 16 03:49:34 user nova-compute[103546]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 16 03:49:34 user nova-compute[103546]:     <timer name='hpet' present='no'/>
Nov 16 03:49:34 user nova-compute[103546]:   </clock>
Nov 16 03:49:34 user nova-compute[103546]:   <on_poweroff>destroy</on_poweroff>
Nov 16 03:49:34 user nova-compute[103546]:   <on_reboot>restart</on_reboot>
Nov 16 03:49:34 user nova-compute[103546]:   <on_crash>destroy</on_crash>
Nov 16 03:49:34 user nova-compute[103546]:   <devices>
Nov 16 03:49:34 user nova-compute[103546]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 16 03:49:34 user nova-compute[103546]:     <disk type='file' device='disk'>
Nov 16 03:49:34 user nova-compute[103546]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 16 03:49:34 user nova-compute[103546]:       <source file='/opt/stack/data/nova/instances/549ee3db-0014-440f-bd3a-0d389f5eab88/disk' index='2'/>
Nov 16 03:49:34 user nova-compute[103546]:       <backingStore type='file' index='3'>
Nov 16 03:49:34 user nova-compute[103546]:         <format type='raw'/>
Nov 16 03:49:34 user nova-compute[103546]:         <source file='/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7'/>
Nov 16 03:49:34 user nova-compute[103546]:         <backingStore/>
Nov 16 03:49:34 user nova-compute[103546]:       </backingStore>
Nov 16 03:49:34 user nova-compute[103546]:       <target dev='vda' bus='virtio'/>
Nov 16 03:49:34 user nova-compute[103546]:       <alias name='virtio-disk0'/>
Nov 16 03:49:34 user nova-compute[103546]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 16 03:49:34 user nova-compute[103546]:     </disk>
Nov 16 03:49:34 user nova-compute[103546]:     <disk type='file' device='cdrom'>
Nov 16 03:49:34 user nova-compute[103546]:       <driver name='qemu' type='raw' cache='none'/>
Nov 16 03:49:34 user nova-compute[103546]:       <source file='/opt/stack/data/nova/instances/549ee3db-0014-440f-bd3a-0d389f5eab88/disk.config' index='1'/>
Nov 16 03:49:34 user nova-compute[103546]:       <backingStore/>
Nov 16 03:49:34 user nova-compute[103546]:       <target dev='hda' bus='ide'/>
Nov 16 03:49:34 user nova-compute[103546]:       <readonly/>
Nov 16 03:49:34 user nova-compute[103546]:       <alias name='ide0-0-0'/>
Nov 16 03:49:34 user nova-compute[103546]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 16 03:49:34 user nova-compute[103546]:     </disk>
Nov 16 03:49:34 user nova-compute[103546]:     <controller type='usb' index='0' model='none'>
Nov 16 03:49:34 user nova-compute[103546]:       <alias name='usb'/>
Nov 16 03:49:34 user nova-compute[103546]:     </controller>
Nov 16 03:49:34 user nova-compute[103546]:     <controller type='pci' index='0' model='pci-root'>
Nov 16 03:49:34 user nova-compute[103546]:       <alias name='pci.0'/>
Nov 16 03:49:34 user nova-compute[103546]:     </controller>
Nov 16 03:49:34 user nova-compute[103546]:     <controller type='ide' index='0'>
Nov 16 03:49:34 user nova-compute[103546]:       <alias name='ide'/>
Nov 16 03:49:34 user nova-compute[103546]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 16 03:49:34 user nova-compute[103546]:     </controller>
Nov 16 03:49:34 user nova-compute[103546]:     <interface type='ethernet'>
Nov 16 03:49:34 user nova-compute[103546]:       <mac address='fa:16:3e:5b:50:00'/>
Nov 16 03:49:34 user nova-compute[103546]:       <target dev='tap48a6af37-c4'/>
Nov 16 03:49:34 user nova-compute[103546]:       <model type='virtio'/>
Nov 16 03:49:34 user nova-compute[103546]:       <mtu size='1442'/>
Nov 16 03:49:34 user nova-compute[103546]:       <alias name='net0'/>
Nov 16 03:49:34 user nova-compute[103546]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 16 03:49:34 user nova-compute[103546]:     </interface>
Nov 16 03:49:34 user nova-compute[103546]:     <serial type='pty'>
Nov 16 03:49:34 user nova-compute[103546]:       <source path='/dev/pts/6'/>
Nov 16 03:49:34 user nova-compute[103546]:       <log file='/opt/stack/data/nova/instances/549ee3db-0014-440f-bd3a-0d389f5eab88/console.log' append='off'/>
Nov 16 03:49:34 user nova-compute[103546]:       <target type='isa-serial' port='0'>
Nov 16 03:49:34 user nova-compute[103546]:         <model name='isa-serial'/>
Nov 16 03:49:34 user nova-compute[103546]:       </target>
Nov 16 03:49:34 user nova-compute[103546]:       <alias name='serial0'/>
Nov 16 03:49:34 user nova-compute[103546]:     </serial>
Nov 16 03:49:34 user nova-compute[103546]:     <console type='pty' tty='/dev/pts/6'>
Nov 16 03:49:34 user nova-compute[103546]:       <source path='/dev/pts/6'/>
Nov 16 03:49:34 user nova-compute[103546]:       <log file='/opt/stack/data/nova/instances/549ee3db-0014-440f-bd3a-0d389f5eab88/console.log' append='off'/>
Nov 16 03:49:34 user nova-compute[103546]:       <target type='serial' port='0'/>
Nov 16 03:49:34 user nova-compute[103546]:       <alias name='serial0'/>
Nov 16 03:49:34 user nova-compute[103546]:     </console>
Nov 16 03:49:34 user nova-compute[103546]:     <input type='mouse' bus='ps2'>
Nov 16 03:49:34 user nova-compute[103546]:       <alias name='input0'/>
Nov 16 03:49:34 user nova-compute[103546]:     </input>
Nov 16 03:49:34 user nova-compute[103546]:     <input type='keyboard' bus='ps2'>
Nov 16 03:49:34 user nova-compute[103546]:       <alias name='input1'/>
Nov 16 03:49:34 user nova-compute[103546]:     </input>
Nov 16 03:49:34 user nova-compute[103546]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 16 03:49:34 user nova-compute[103546]:       <listen type='address' address='0.0.0.0'/>
Nov 16 03:49:34 user nova-compute[103546]:     </graphics>
Nov 16 03:49:34 user nova-compute[103546]:     <audio id='1' type='none'/>
Nov 16 03:49:34 user nova-compute[103546]:     <video>
Nov 16 03:49:34 user nova-compute[103546]:       <model type='virtio' heads='1' primary='yes'/>
Nov 16 03:49:34 user nova-compute[103546]:       <alias name='video0'/>
Nov 16 03:49:34 user nova-compute[103546]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 16 03:49:34 user nova-compute[103546]:     </video>
Nov 16 03:49:34 user nova-compute[103546]:     <memballoon model='virtio'>
Nov 16 03:49:34 user nova-compute[103546]:       <stats period='10'/>
Nov 16 03:49:34 user nova-compute[103546]:       <alias name='balloon0'/>
Nov 16 03:49:34 user nova-compute[103546]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 16 03:49:34 user nova-compute[103546]:     </memballoon>
Nov 16 03:49:34 user nova-compute[103546]:     <rng model='virtio'>
Nov 16 03:49:34 user nova-compute[103546]:       <backend model='random'>/dev/urandom</backend>
Nov 16 03:49:34 user nova-compute[103546]:       <alias name='rng0'/>
Nov 16 03:49:34 user nova-compute[103546]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 16 03:49:34 user nova-compute[103546]:     </rng>
Nov 16 03:49:34 user nova-compute[103546]:   </devices>
Nov 16 03:49:34 user nova-compute[103546]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 16 03:49:34 user nova-compute[103546]:     <label>libvirt-549ee3db-0014-440f-bd3a-0d389f5eab88</label>
Nov 16 03:49:34 user nova-compute[103546]:     <imagelabel>libvirt-549ee3db-0014-440f-bd3a-0d389f5eab88</imagelabel>
Nov 16 03:49:34 user nova-compute[103546]:   </seclabel>
Nov 16 03:49:34 user nova-compute[103546]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 16 03:49:34 user nova-compute[103546]:     <label>+64055:+108</label>
Nov 16 03:49:34 user nova-compute[103546]:     <imagelabel>+64055:+108</imagelabel>
Nov 16 03:49:34 user nova-compute[103546]:   </seclabel>
Nov 16 03:49:34 user nova-compute[103546]: </domain>
Nov 16 03:49:34 user nova-compute[103546]:  {{(pid=103546) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 16 03:49:34 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [req-fbf278df-12cc-42e6-85bd-c35d2aa59aad req-fe68cc39-cc92-455d-af19-9cc5f8bbf026 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:38:66:93"/><model type="virtio"/><mtu size="1442"/><target dev="tapfe4680c0-c5"/></interface> {{(pid=103546) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 16 03:49:34 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [req-fbf278df-12cc-42e6-85bd-c35d2aa59aad req-fe68cc39-cc92-455d-af19-9cc5f8bbf026 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:38:66:93"/><model type="virtio"/><mtu size="1442"/><target dev="tapfe4680c0-c5"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 16 03:49:34 user nova-compute[103546]:   <name>instance-00000007</name>
Nov 16 03:49:34 user nova-compute[103546]:   <uuid>549ee3db-0014-440f-bd3a-0d389f5eab88</uuid>
Nov 16 03:49:34 user nova-compute[103546]:   <metadata>
Nov 16 03:49:34 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 03:49:34 user nova-compute[103546]:   <nova:package version="0.0.0"/>
Nov 16 03:49:34 user nova-compute[103546]:   <nova:name>tempest-device-tagging-server-350344638</nova:name>
Nov 16 03:49:34 user nova-compute[103546]:   <nova:creationTime>2023-11-16 03:49:33</nova:creationTime>
Nov 16 03:49:34 user nova-compute[103546]:   <nova:flavor name="m1.tiny">
Nov 16 03:49:34 user nova-compute[103546]:     <nova:memory>512</nova:memory>
Nov 16 03:49:34 user nova-compute[103546]:     <nova:disk>1</nova:disk>
Nov 16 03:49:34 user nova-compute[103546]:     <nova:swap>0</nova:swap>
Nov 16 03:49:34 user nova-compute[103546]:     <nova:ephemeral>0</nova:ephemeral>
Nov 16 03:49:34 user nova-compute[103546]:     <nova:vcpus>1</nova:vcpus>
Nov 16 03:49:34 user nova-compute[103546]:   </nova:flavor>
Nov 16 03:49:34 user nova-compute[103546]:   <nova:owner>
Nov 16 03:49:34 user nova-compute[103546]:     <nova:user uuid="843e14f393d849a9abc7759907a303ea">tempest-TaggedAttachmentsTest-401054631-project-member</nova:user>
Nov 16 03:49:34 user nova-compute[103546]:     <nova:project uuid="4445eb24618042ab9d24c869de5ccaab">tempest-TaggedAttachmentsTest-401054631</nova:project>
Nov 16 03:49:34 user nova-compute[103546]:   </nova:owner>
Nov 16 03:49:34 user nova-compute[103546]:   <nova:root type="image" uuid="5c6f539a-01e5-4478-bf8f-a14310b5d7dd"/>
Nov 16 03:49:34 user nova-compute[103546]:   <nova:ports>
Nov 16 03:49:34 user nova-compute[103546]:     <nova:port uuid="48a6af37-c461-4721-b870-432cf404dcf7">
Nov 16 03:49:34 user nova-compute[103546]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 16 03:49:34 user nova-compute[103546]:     </nova:port>
Nov 16 03:49:34 user nova-compute[103546]:   </nova:ports>
Nov 16 03:49:34 user nova-compute[103546]: </nova:instance>
Nov 16 03:49:34 user nova-compute[103546]:   </metadata>
Nov 16 03:49:34 user nova-compute[103546]:   <memory unit='KiB'>524288</memory>
Nov 16 03:49:34 user nova-compute[103546]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 16 03:49:34 user nova-compute[103546]:   <vcpu placement='static'>1</vcpu>
Nov 16 03:49:34 user nova-compute[103546]:   <resource>
Nov 16 03:49:34 user nova-compute[103546]:     <partition>/machine</partition>
Nov 16 03:49:34 user nova-compute[103546]:   </resource>
Nov 16 03:49:34 user nova-compute[103546]:   <sysinfo type='smbios'>
Nov 16 03:49:34 user nova-compute[103546]:     <system>
Nov 16 03:49:34 user nova-compute[103546]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 16 03:49:34 user nova-compute[103546]:       <entry name='product'>OpenStack Nova</entry>
Nov 16 03:49:34 user nova-compute[103546]:       <entry name='version'>0.0.0</entry>
Nov 16 03:49:34 user nova-compute[103546]:       <entry name='serial'>549ee3db-0014-440f-bd3a-0d389f5eab88</entry>
Nov 16 03:49:34 user nova-compute[103546]:       <entry name='uuid'>549ee3db-0014-440f-bd3a-0d389f5eab88</entry>
Nov 16 03:49:34 user nova-compute[103546]:       <entry name='family'>Virtual Machine</entry>
Nov 16 03:49:34 user nova-compute[103546]:     </system>
Nov 16 03:49:34 user nova-compute[103546]:   </sysinfo>
Nov 16 03:49:34 user nova-compute[103546]:   <os>
Nov 16 03:49:34 user nova-compute[103546]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 16 03:49:34 user nova-compute[103546]:     <boot dev='hd'/>
Nov 16 03:49:34 user nova-compute[103546]:     <smbios mode='sysinfo'/>
Nov 16 03:49:34 user nova-compute[103546]:   </os>
Nov 16 03:49:34 user nova-compute[103546]:   <features>
Nov 16 03:49:34 user nova-compute[103546]:     <acpi/>
Nov 16 03:49:34 user nova-compute[103546]:     <apic/>
Nov 16 03:49:34 user nova-compute[103546]:     <vmcoreinfo state='on'/>
Nov 16 03:49:34 user nova-compute[103546]:   </features>
Nov 16 03:49:34 user nova-compute[103546]:   <cpu mode='custom' match='exact' check='full'>
Nov 16 03:49:34 user nova-compute[103546]:     <model fallback='forbid'>Nehalem</model>
Nov 16 03:49:34 user nova-compute[103546]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 16 03:49:34 user nova-compute[103546]:     <feature policy='require' name='vme'/>
Nov 16 03:49:34 user nova-compute[103546]:     <feature policy='require' name='x2apic'/>
Nov 16 03:49:34 user nova-compute[103546]:     <feature policy='require' name='hypervisor'/>
Nov 16 03:49:34 user nova-compute[103546]:   </cpu>
Nov 16 03:49:34 user nova-compute[103546]:   <clock offset='utc'>
Nov 16 03:49:34 user nova-compute[103546]:     <timer name='pit' tickpolicy='delay'/>
Nov 16 03:49:34 user nova-compute[103546]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 16 03:49:34 user nova-compute[103546]:     <timer name='hpet' present='no'/>
Nov 16 03:49:34 user nova-compute[103546]:   </clock>
Nov 16 03:49:34 user nova-compute[103546]:   <on_poweroff>destroy</on_poweroff>
Nov 16 03:49:34 user nova-compute[103546]:   <on_reboot>restart</on_reboot>
Nov 16 03:49:34 user nova-compute[103546]:   <on_crash>destroy</on_crash>
Nov 16 03:49:34 user nova-compute[103546]:   <devices>
Nov 16 03:49:34 user nova-compute[103546]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 16 03:49:34 user nova-compute[103546]:     <disk type='file' device='disk'>
Nov 16 03:49:34 user nova-compute[103546]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 16 03:49:34 user nova-compute[103546]:       <source file='/opt/stack/data/nova/instances/549ee3db-0014-440f-bd3a-0d389f5eab88/disk' index='2'/>
Nov 16 03:49:34 user nova-compute[103546]:       <backingStore type='file' index='3'>
Nov 16 03:49:34 user nova-compute[103546]:         <format type='raw'/>
Nov 16 03:49:34 user nova-compute[103546]:         <source file='/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7'/>
Nov 16 03:49:34 user nova-compute[103546]:         <backingStore/>
Nov 16 03:49:34 user nova-compute[103546]:       </backingStore>
Nov 16 03:49:34 user nova-compute[103546]:       <target dev='vda' bus='virtio'/>
Nov 16 03:49:34 user nova-compute[103546]:       <alias name='virtio-disk0'/>
Nov 16 03:49:34 user nova-compute[103546]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 16 03:49:34 user nova-compute[103546]:     </disk>
Nov 16 03:49:34 user nova-compute[103546]:     <disk type='file' device='cdrom'>
Nov 16 03:49:34 user nova-compute[103546]:       <driver name='qemu' type='raw' cache='none'/>
Nov 16 03:49:34 user nova-compute[103546]:       <source file='/opt/stack/data/nova/instances/549ee3db-0014-440f-bd3a-0d389f5eab88/disk.config' index='1'/>
Nov 16 03:49:34 user nova-compute[103546]:       <backingStore/>
Nov 16 03:49:34 user nova-compute[103546]:       <target dev='hda' bus='ide'/>
Nov 16 03:49:34 user nova-compute[103546]:       <readonly/>
Nov 16 03:49:34 user nova-compute[103546]:       <alias name='ide0-0-0'/>
Nov 16 03:49:34 user nova-compute[103546]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 16 03:49:34 user nova-compute[103546]:     </disk>
Nov 16 03:49:34 user nova-compute[103546]:     <controller type='usb' index='0' model='none'>
Nov 16 03:49:34 user nova-compute[103546]:       <alias name='usb'/>
Nov 16 03:49:34 user nova-compute[103546]:     </controller>
Nov 16 03:49:34 user nova-compute[103546]:     <controller type='pci' index='0' model='pci-root'>
Nov 16 03:49:34 user nova-compute[103546]:       <alias name='pci.0'/>
Nov 16 03:49:34 user nova-compute[103546]:     </controller>
Nov 16 03:49:34 user nova-compute[103546]:     <controller type='ide' index='0'>
Nov 16 03:49:34 user nova-compute[103546]:       <alias name='ide'/>
Nov 16 03:49:34 user nova-compute[103546]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 16 03:49:34 user nova-compute[103546]:     </controller>
Nov 16 03:49:34 user nova-compute[103546]:     <interface type='ethernet'>
Nov 16 03:49:34 user nova-compute[103546]:       <mac address='fa:16:3e:5b:50:00'/>
Nov 16 03:49:34 user nova-compute[103546]:       <target dev='tap48a6af37-c4'/>
Nov 16 03:49:34 user nova-compute[103546]:       <model type='virtio'/>
Nov 16 03:49:34 user nova-compute[103546]:       <mtu size='1442'/>
Nov 16 03:49:34 user nova-compute[103546]:       <alias name='net0'/>
Nov 16 03:49:34 user nova-compute[103546]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 16 03:49:34 user nova-compute[103546]:     </interface>
Nov 16 03:49:34 user nova-compute[103546]:     <serial type='pty'>
Nov 16 03:49:34 user nova-compute[103546]:       <source path='/dev/pts/6'/>
Nov 16 03:49:34 user nova-compute[103546]:       <log file='/opt/stack/data/nova/instances/549ee3db-0014-440f-bd3a-0d389f5eab88/console.log' append='off'/>
Nov 16 03:49:34 user nova-compute[103546]:       <target type='isa-serial' port='0'>
Nov 16 03:49:34 user nova-compute[103546]:         <model name='isa-serial'/>
Nov 16 03:49:34 user nova-compute[103546]:       </target>
Nov 16 03:49:34 user nova-compute[103546]:       <alias name='serial0'/>
Nov 16 03:49:34 user nova-compute[103546]:     </serial>
Nov 16 03:49:34 user nova-compute[103546]:     <console type='pty' tty='/dev/pts/6'>
Nov 16 03:49:34 user nova-compute[103546]:       <source path='/dev/pts/6'/>
Nov 16 03:49:34 user nova-compute[103546]:       <log file='/opt/stack/data/nova/instances/549ee3db-0014-440f-bd3a-0d389f5eab88/console.log' append='off'/>
Nov 16 03:49:34 user nova-compute[103546]:       <target type='serial' port='0'/>
Nov 16 03:49:34 user nova-compute[103546]:       <alias name='serial0'/>
Nov 16 03:49:34 user nova-compute[103546]:     </console>
Nov 16 03:49:34 user nova-compute[103546]:     <input type='mouse' bus='ps2'>
Nov 16 03:49:34 user nova-compute[103546]:       <alias name='input0'/>
Nov 16 03:49:34 user nova-compute[103546]:     </input>
Nov 16 03:49:34 user nova-compute[103546]:     <input type='keyboard' bus='ps2'>
Nov 16 03:49:34 user nova-compute[103546]:       <alias name='input1'/>
Nov 16 03:49:34 user nova-compute[103546]:     </input>
Nov 16 03:49:34 user nova-compute[103546]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 16 03:49:34 user nova-compute[103546]:       <listen type='address' address='0.0.0.0'/>
Nov 16 03:49:34 user nova-compute[103546]:     </graphics>
Nov 16 03:49:34 user nova-compute[103546]:     <audio id='1' type='none'/>
Nov 16 03:49:34 user nova-compute[103546]:     <video>
Nov 16 03:49:34 user nova-compute[103546]:       <model type='virtio' heads='1' primary='yes'/>
Nov 16 03:49:34 user nova-compute[103546]:       <alias name='video0'/>
Nov 16 03:49:34 user nova-compute[103546]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 16 03:49:34 user nova-compute[103546]:     </video>
Nov 16 03:49:34 user nova-compute[103546]:     <memballoon model='virtio'>
Nov 16 03:49:34 user nova-compute[103546]:       <stats period='10'/>
Nov 16 03:49:34 user nova-compute[103546]:       <alias name='balloon0'/>
Nov 16 03:49:34 user nova-compute[103546]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 16 03:49:34 user nova-compute[103546]:     </memballoon>
Nov 16 03:49:34 user nova-compute[103546]:     <rng model='virtio'>
Nov 16 03:49:34 user nova-compute[103546]:       <backend model='random'>/dev/urandom</backend>
Nov 16 03:49:34 user nova-compute[103546]:       <alias name='rng0'/>
Nov 16 03:49:34 user nova-compute[103546]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 16 03:49:34 user nova-compute[103546]:     </rng>
Nov 16 03:49:34 user nova-compute[103546]:   </devices>
Nov 16 03:49:34 user nova-compute[103546]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 16 03:49:34 user nova-compute[103546]:     <label>libvirt-549ee3db-0014-440f-bd3a-0d389f5eab88</label>
Nov 16 03:49:34 user nova-compute[103546]:     <imagelabel>libvirt-549ee3db-0014-440f-bd3a-0d389f5eab88</imagelabel>
Nov 16 03:49:34 user nova-compute[103546]:   </seclabel>
Nov 16 03:49:34 user nova-compute[103546]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 16 03:49:34 user nova-compute[103546]:     <label>+64055:+108</label>
Nov 16 03:49:34 user nova-compute[103546]:     <imagelabel>+64055:+108</imagelabel>
Nov 16 03:49:34 user nova-compute[103546]:   </seclabel>
Nov 16 03:49:34 user nova-compute[103546]: </domain>
Nov 16 03:49:34 user nova-compute[103546]:  {{(pid=103546) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 16 03:49:34 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [req-fbf278df-12cc-42e6-85bd-c35d2aa59aad req-fe68cc39-cc92-455d-af19-9cc5f8bbf026 service nova] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Detaching interface fa:16:3e:38:66:93 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapfe4680c0-c5' not found.
Nov 16 03:49:34 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [req-fbf278df-12cc-42e6-85bd-c35d2aa59aad req-fe68cc39-cc92-455d-af19-9cc5f8bbf026 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T03:46:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-350344638',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-350344638',id=7,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJC87S7hgP6v1mMgMgWP5mrEmsB7FxLODxvVGTyu4rK6Vav//N6bGlF4cB4wdjC5yBjD4JDskSZdj5aiBMflE+VUYysZErN4auZ89tuKfEpG07XZH2cPGYOTHxF0eBL3Dw==',key_name='tempest-keypair-83664986',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:46:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4445eb24618042ab9d24c869de5ccaab',ramdisk_id='',reservation_id='r-s6hqst93',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-401054631',owner_user_name='tempest-TaggedAttachmentsTest-401054631-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T03:46:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='843e14f393d849a9abc7759907a303ea',uuid=549ee3db-0014-440f-bd3a-0d389f5eab88,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe4680c0-c534-4f5b-8833-be40c2784953", "address": "fa:16:3e:38:66:93", "network": {"id": "45e450ee-a16a-4ae4-9e30-f5b3db0e6335", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-951951059", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4445eb24618042ab9d24c869de5ccaab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe4680c0-c5", "ovs_interfaceid": "fe4680c0-c534-4f5b-8833-be40c2784953", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 03:49:34 user nova-compute[103546]: DEBUG nova.network.os_vif_util [req-fbf278df-12cc-42e6-85bd-c35d2aa59aad req-fe68cc39-cc92-455d-af19-9cc5f8bbf026 service nova] Converting VIF {"id": "fe4680c0-c534-4f5b-8833-be40c2784953", "address": "fa:16:3e:38:66:93", "network": {"id": "45e450ee-a16a-4ae4-9e30-f5b3db0e6335", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-951951059", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4445eb24618042ab9d24c869de5ccaab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe4680c0-c5", "ovs_interfaceid": "fe4680c0-c534-4f5b-8833-be40c2784953", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:49:34 user nova-compute[103546]: DEBUG nova.network.os_vif_util [req-fbf278df-12cc-42e6-85bd-c35d2aa59aad req-fe68cc39-cc92-455d-af19-9cc5f8bbf026 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:66:93,bridge_name='br-int',has_traffic_filtering=True,id=fe4680c0-c534-4f5b-8833-be40c2784953,network=Network(45e450ee-a16a-4ae4-9e30-f5b3db0e6335),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe4680c0-c5') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:49:34 user nova-compute[103546]: DEBUG os_vif [req-fbf278df-12cc-42e6-85bd-c35d2aa59aad req-fe68cc39-cc92-455d-af19-9cc5f8bbf026 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:66:93,bridge_name='br-int',has_traffic_filtering=True,id=fe4680c0-c534-4f5b-8833-be40c2784953,network=Network(45e450ee-a16a-4ae4-9e30-f5b3db0e6335),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe4680c0-c5') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 03:49:34 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:34 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe4680c0-c5, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:49:34 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 03:49:34 user nova-compute[103546]: INFO os_vif [req-fbf278df-12cc-42e6-85bd-c35d2aa59aad req-fe68cc39-cc92-455d-af19-9cc5f8bbf026 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:66:93,bridge_name='br-int',has_traffic_filtering=True,id=fe4680c0-c534-4f5b-8833-be40c2784953,network=Network(45e450ee-a16a-4ae4-9e30-f5b3db0e6335),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe4680c0-c5')
Nov 16 03:49:34 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [req-fbf278df-12cc-42e6-85bd-c35d2aa59aad req-fe68cc39-cc92-455d-af19-9cc5f8bbf026 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 03:49:34 user nova-compute[103546]:   <nova:package version="0.0.0"/>
Nov 16 03:49:34 user nova-compute[103546]:   <nova:name>tempest-device-tagging-server-350344638</nova:name>
Nov 16 03:49:34 user nova-compute[103546]:   <nova:creationTime>2023-11-16 03:49:34</nova:creationTime>
Nov 16 03:49:34 user nova-compute[103546]:   <nova:flavor name="m1.tiny">
Nov 16 03:49:34 user nova-compute[103546]:     <nova:memory>512</nova:memory>
Nov 16 03:49:34 user nova-compute[103546]:     <nova:disk>1</nova:disk>
Nov 16 03:49:34 user nova-compute[103546]:     <nova:swap>0</nova:swap>
Nov 16 03:49:34 user nova-compute[103546]:     <nova:ephemeral>0</nova:ephemeral>
Nov 16 03:49:34 user nova-compute[103546]:     <nova:vcpus>1</nova:vcpus>
Nov 16 03:49:34 user nova-compute[103546]:   </nova:flavor>
Nov 16 03:49:34 user nova-compute[103546]:   <nova:owner>
Nov 16 03:49:34 user nova-compute[103546]:     <nova:user uuid="843e14f393d849a9abc7759907a303ea">tempest-TaggedAttachmentsTest-401054631-project-member</nova:user>
Nov 16 03:49:34 user nova-compute[103546]:     <nova:project uuid="4445eb24618042ab9d24c869de5ccaab">tempest-TaggedAttachmentsTest-401054631</nova:project>
Nov 16 03:49:34 user nova-compute[103546]:   </nova:owner>
Nov 16 03:49:34 user nova-compute[103546]:   <nova:root type="image" uuid="5c6f539a-01e5-4478-bf8f-a14310b5d7dd"/>
Nov 16 03:49:34 user nova-compute[103546]:   <nova:ports>
Nov 16 03:49:34 user nova-compute[103546]:     <nova:port uuid="48a6af37-c461-4721-b870-432cf404dcf7">
Nov 16 03:49:34 user nova-compute[103546]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 16 03:49:34 user nova-compute[103546]:     </nova:port>
Nov 16 03:49:34 user nova-compute[103546]:   </nova:ports>
Nov 16 03:49:34 user nova-compute[103546]: </nova:instance>
Nov 16 03:49:34 user nova-compute[103546]:  {{(pid=103546) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 16 03:49:34 user nova-compute[103546]: DEBUG nova.network.neutron [None req-84452d7a-0352-4e49-83f7-f0c5ae6fd30b tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Updating instance_info_cache with network_info: [{"id": "48a6af37-c461-4721-b870-432cf404dcf7", "address": "fa:16:3e:5b:50:00", "network": {"id": "4c04adce-4d50-4cc1-8c17-5cebba34fbec", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-399866268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4445eb24618042ab9d24c869de5ccaab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48a6af37-c4", "ovs_interfaceid": "48a6af37-c461-4721-b870-432cf404dcf7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:49:34 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-84452d7a-0352-4e49-83f7-f0c5ae6fd30b tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Releasing lock "refresh_cache-549ee3db-0014-440f-bd3a-0d389f5eab88" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:49:34 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-84452d7a-0352-4e49-83f7-f0c5ae6fd30b tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Lock "interface-549ee3db-0014-440f-bd3a-0d389f5eab88-fe4680c0-c534-4f5b-8833-be40c2784953" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.441s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:34 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:34 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:34 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:34 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:34 user nova-compute[103546]: DEBUG nova.compute.manager [req-5829c742-856d-4257-98c0-d0678d7fcbcc req-ceb84cc9-9e21-4a52-9f48-00a92ca52386 service nova] [instance: ddaf87db-e525-4839-a538-4b766b3e875a] Received event network-vif-plugged-883ecc71-b87c-496d-8436-d3085c19dbc7 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:49:34 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-5829c742-856d-4257-98c0-d0678d7fcbcc req-ceb84cc9-9e21-4a52-9f48-00a92ca52386 service nova] Acquiring lock "ddaf87db-e525-4839-a538-4b766b3e875a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:34 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-5829c742-856d-4257-98c0-d0678d7fcbcc req-ceb84cc9-9e21-4a52-9f48-00a92ca52386 service nova] Lock "ddaf87db-e525-4839-a538-4b766b3e875a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:34 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-5829c742-856d-4257-98c0-d0678d7fcbcc req-ceb84cc9-9e21-4a52-9f48-00a92ca52386 service nova] Lock "ddaf87db-e525-4839-a538-4b766b3e875a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:34 user nova-compute[103546]: DEBUG nova.compute.manager [req-5829c742-856d-4257-98c0-d0678d7fcbcc req-ceb84cc9-9e21-4a52-9f48-00a92ca52386 service nova] [instance: ddaf87db-e525-4839-a538-4b766b3e875a] No waiting events found dispatching network-vif-plugged-883ecc71-b87c-496d-8436-d3085c19dbc7 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:49:34 user nova-compute[103546]: WARNING nova.compute.manager [req-5829c742-856d-4257-98c0-d0678d7fcbcc req-ceb84cc9-9e21-4a52-9f48-00a92ca52386 service nova] [instance: ddaf87db-e525-4839-a538-4b766b3e875a] Received unexpected event network-vif-plugged-883ecc71-b87c-496d-8436-d3085c19dbc7 for instance with vm_state building and task_state spawning.
Nov 16 03:49:34 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:34 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:36 user nova-compute[103546]: DEBUG nova.compute.manager [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: ddaf87db-e525-4839-a538-4b766b3e875a] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 03:49:36 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: ddaf87db-e525-4839-a538-4b766b3e875a] Guest created on hypervisor {{(pid=103546) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 03:49:36 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: ddaf87db-e525-4839-a538-4b766b3e875a] Instance spawned successfully.
Nov 16 03:49:36 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: ddaf87db-e525-4839-a538-4b766b3e875a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 03:49:36 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Starting finish_migration {{(pid=103546) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 16 03:49:36 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Instance directory exists: not creating {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 16 03:49:36 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Creating image(s)
Nov 16 03:49:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:36 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: ddaf87db-e525-4839-a538-4b766b3e875a] Found default for hw_cdrom_bus of ide {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:49:36 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: ddaf87db-e525-4839-a538-4b766b3e875a] Found default for hw_disk_bus of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:49:36 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: ddaf87db-e525-4839-a538-4b766b3e875a] Found default for hw_input_bus of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:49:36 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: ddaf87db-e525-4839-a538-4b766b3e875a] Found default for hw_pointer_model of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:49:36 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: ddaf87db-e525-4839-a538-4b766b3e875a] Found default for hw_video_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:49:36 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: ddaf87db-e525-4839-a538-4b766b3e875a] Found default for hw_vif_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:49:36 user nova-compute[103546]: DEBUG nova.compute.manager [req-5e3d51fc-b0b5-4a29-9109-bc3e0b7dd835 req-afd86163-34a2-4128-9dd2-56988e63a1b7 service nova] [instance: ddaf87db-e525-4839-a538-4b766b3e875a] Received event network-vif-plugged-883ecc71-b87c-496d-8436-d3085c19dbc7 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:49:36 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-5e3d51fc-b0b5-4a29-9109-bc3e0b7dd835 req-afd86163-34a2-4128-9dd2-56988e63a1b7 service nova] Acquiring lock "ddaf87db-e525-4839-a538-4b766b3e875a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:36 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-5e3d51fc-b0b5-4a29-9109-bc3e0b7dd835 req-afd86163-34a2-4128-9dd2-56988e63a1b7 service nova] Lock "ddaf87db-e525-4839-a538-4b766b3e875a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:36 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-5e3d51fc-b0b5-4a29-9109-bc3e0b7dd835 req-afd86163-34a2-4128-9dd2-56988e63a1b7 service nova] Lock "ddaf87db-e525-4839-a538-4b766b3e875a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:36 user nova-compute[103546]: DEBUG nova.compute.manager [req-5e3d51fc-b0b5-4a29-9109-bc3e0b7dd835 req-afd86163-34a2-4128-9dd2-56988e63a1b7 service nova] [instance: ddaf87db-e525-4839-a538-4b766b3e875a] No waiting events found dispatching network-vif-plugged-883ecc71-b87c-496d-8436-d3085c19dbc7 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:49:36 user nova-compute[103546]: WARNING nova.compute.manager [req-5e3d51fc-b0b5-4a29-9109-bc3e0b7dd835 req-afd86163-34a2-4128-9dd2-56988e63a1b7 service nova] [instance: ddaf87db-e525-4839-a538-4b766b3e875a] Received unexpected event network-vif-plugged-883ecc71-b87c-496d-8436-d3085c19dbc7 for instance with vm_state building and task_state spawning.
Nov 16 03:49:37 user nova-compute[103546]: INFO nova.compute.manager [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: ddaf87db-e525-4839-a538-4b766b3e875a] Took 5.65 seconds to spawn the instance on the hypervisor.
Nov 16 03:49:37 user nova-compute[103546]: DEBUG nova.compute.manager [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: ddaf87db-e525-4839-a538-4b766b3e875a] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.172s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Checking if we can resize image /opt/stack/data/nova/instances/51554aab-44ec-4161-b926-9c07a3f838a5/disk. size=21474836480 {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51554aab-44ec-4161-b926-9c07a3f838a5/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:37 user nova-compute[103546]: INFO nova.compute.manager [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: ddaf87db-e525-4839-a538-4b766b3e875a] Took 6.46 seconds to build instance.
Nov 16 03:49:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-6fcc7b2a-2e1c-4cd2-b6f1-39cc8c248295 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Lock "ddaf87db-e525-4839-a538-4b766b3e875a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.550s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51554aab-44ec-4161-b926-9c07a3f838a5/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/51554aab-44ec-4161-b926-9c07a3f838a5/disk 21474836480 {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/51554aab-44ec-4161-b926-9c07a3f838a5/disk 21474836480" returned: 0 in 0.346s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Did not create local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Ensure instance console log exists: /opt/stack/data/nova/instances/51554aab-44ec-4161-b926-9c07a3f838a5/console.log {{(pid=103546) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Start _get_guest_xml network_info=[{"id": "e36fae5d-773f-47c0-b79a-5aadf6412cbc", "address": "fa:16:3e:9a:45:d0", "network": {"id": "ef471a6e-7bd1-4a61-aa01-fd7557bfae1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-865941926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-865941926-network", "vif_mac": "fa:16:3e:9a:45:d0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76ca2da0c584a7382040eb113da4c2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape36fae5d-77", "ovs_interfaceid": "e36fae5d-773f-47c0-b79a-5aadf6412cbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '5c6f539a-01e5-4478-bf8f-a14310b5d7dd'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YukJztTB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '51554aab-44ec-4161-b926-9c07a3f838a5', 'attached_at': '2023-11-16T03:49:37.000000', 'detached_at': '', 'volume_id': '4156a8b3-4b47-48ef-ad34-1ace6437b49c', 'serial': '4156a8b3-4b47-48ef-ad34-1ace6437b49c'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'attachment_id': '57507929-5a17-45a4-941e-b6ee580fecc7', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 03:49:37 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:49:37 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:49:37 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YukJztTB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:49:37 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:49:37 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:49:37 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:49:37 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:49:37 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 03:49:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ffb1367-0573-40da-bb38-ece861df374b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 03:49:37 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260 --interface default --op new {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[4252b210-0460-4e4b-b554-6f7e41c21d11]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c] added\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c] added
Nov 16 03:49:37 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7602e79-2ef6-4fa1-bb9f-0bd6e98ae9a6]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[894f6098-5b7a-4686-ad97-297f37f59059]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YukJztTB {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YukJztTB" returned: 0 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3018107c-d931-4427-82b0-df948d78ee74]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YukJztTB'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e882fc-b3e7-4d83-aec8-70845dd44af6]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc84968f-ffce-464b-9a9d-bc6a71ad0104]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 03:49:37 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 03:49:37 user nova-compute[103546]:  {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:49:37 user nova-compute[103546]: WARNING os_brick.initiator.connectors.iscsi [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 03:49:37 user nova-compute[103546]: 
Nov 16 03:49:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260 --login {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f86a900c-fe4b-4065-96c8-bf2c39c5f9ac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c, portal: 172.16.0.220,3260]
Nov 16 03:49:37 user nova-compute[103546]: Login to [iface: default, target: iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c, portal: 172.16.0.220,3260] successful.
Nov 16 03:49:37 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c527928-35cd-499e-a8be-f4ecd995ffda]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6432d41-2307-468e-aa97-2e9ada4d208f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)
Nov 16 03:49:37 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)
Nov 16 03:49:37 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[89312249-c2a9-418e-8fce-0457dd7c0ebd]: (4, ('- - 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 03:49:37 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YukJztTB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 03:49:38 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:38 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:38 user nova-compute[103546]: DEBUG nova.compute.manager [req-8f978801-0833-4a3d-93ae-4f65b37038e6 req-da84875a-086b-402c-a6b1-9df9806f6270 service nova] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Received event network-changed-1d1c7496-0480-45a7-8490-bc581314a4b5 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:49:38 user nova-compute[103546]: DEBUG nova.compute.manager [req-8f978801-0833-4a3d-93ae-4f65b37038e6 req-da84875a-086b-402c-a6b1-9df9806f6270 service nova] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Refreshing instance network info cache due to event network-changed-1d1c7496-0480-45a7-8490-bc581314a4b5. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:49:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8f978801-0833-4a3d-93ae-4f65b37038e6 req-da84875a-086b-402c-a6b1-9df9806f6270 service nova] Acquiring lock "refresh_cache-63b95121-b211-42c3-831e-0392d4abd09a" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:49:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8f978801-0833-4a3d-93ae-4f65b37038e6 req-da84875a-086b-402c-a6b1-9df9806f6270 service nova] Acquired lock "refresh_cache-63b95121-b211-42c3-831e-0392d4abd09a" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:49:38 user nova-compute[103546]: DEBUG nova.network.neutron [req-8f978801-0833-4a3d-93ae-4f65b37038e6 req-da84875a-086b-402c-a6b1-9df9806f6270 service nova] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Refreshing network info cache for port 1d1c7496-0480-45a7-8490-bc581314a4b5 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:49:38 user nova-compute[103546]: DEBUG nova.network.neutron [req-8f978801-0833-4a3d-93ae-4f65b37038e6 req-da84875a-086b-402c-a6b1-9df9806f6270 service nova] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Updated VIF entry in instance network info cache for port 1d1c7496-0480-45a7-8490-bc581314a4b5. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 03:49:38 user nova-compute[103546]: DEBUG nova.network.neutron [req-8f978801-0833-4a3d-93ae-4f65b37038e6 req-da84875a-086b-402c-a6b1-9df9806f6270 service nova] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Updating instance_info_cache with network_info: [{"id": "1d1c7496-0480-45a7-8490-bc581314a4b5", "address": "fa:16:3e:d0:5b:e1", "network": {"id": "532683c8-74f9-43bb-a60f-7240b52da4d7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-747146599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae61d862fd974779a8caf830313a724a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d1c7496-04", "ovs_interfaceid": "1d1c7496-0480-45a7-8490-bc581314a4b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:49:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8f978801-0833-4a3d-93ae-4f65b37038e6 req-da84875a-086b-402c-a6b1-9df9806f6270 service nova] Releasing lock "refresh_cache-63b95121-b211-42c3-831e-0392d4abd09a" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:49:38 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:49:38 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '23133393238633038', 'path': '/dev/sdb'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:49:38 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23133393238633038', 'path': '/dev/sdb'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 03:49:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:46:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1580842921',display_name='tempest-ServerActionsTestOtherB-server-1580842921',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1580842921',id=2,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4BC4cHDV2fbJoL15YFOsrL3Jj/txUDoSxREB28Izf7niUsDWNVN4I6jw0qVmlW7BvPaNCWUAskE06oeKsT+2XD63IEOwvY2xtSda7L7/qiL3VY46L9X29CD+3k2W4RoA==',key_name='tempest-keypair-857843108',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:46:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f76ca2da0c584a7382040eb113da4c2a',ramdisk_id='',reservation_id='r-kl1f6eox',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-648062424',owner_user_name='tempest-ServerActionsTestOtherB-648062424-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:49:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4bf11ccac9f4203808f8dca52cde36c',uuid=51554aab-44ec-4161-b926-9c07a3f838a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e36fae5d-773f-47c0-b79a-5aadf6412cbc", "address": "fa:16:3e:9a:45:d0", "network": {"id": "ef471a6e-7bd1-4a61-aa01-fd7557bfae1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-865941926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-865941926-network", "vif_mac": "fa:16:3e:9a:45:d0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76ca2da0c584a7382040eb113da4c2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape36fae5d-77", "ovs_interfaceid": "e36fae5d-773f-47c0-b79a-5aadf6412cbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 03:49:39 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Converting VIF {"id": "e36fae5d-773f-47c0-b79a-5aadf6412cbc", "address": "fa:16:3e:9a:45:d0", "network": {"id": "ef471a6e-7bd1-4a61-aa01-fd7557bfae1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-865941926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-865941926-network", "vif_mac": "fa:16:3e:9a:45:d0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76ca2da0c584a7382040eb113da4c2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape36fae5d-77", "ovs_interfaceid": "e36fae5d-773f-47c0-b79a-5aadf6412cbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:49:39 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:45:d0,bridge_name='br-int',has_traffic_filtering=True,id=e36fae5d-773f-47c0-b79a-5aadf6412cbc,network=Network(ef471a6e-7bd1-4a61-aa01-fd7557bfae1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape36fae5d-77') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:49:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] End _get_guest_xml xml=<domain type="kvm">
Nov 16 03:49:39 user nova-compute[103546]:   <uuid>51554aab-44ec-4161-b926-9c07a3f838a5</uuid>
Nov 16 03:49:39 user nova-compute[103546]:   <name>instance-00000002</name>
Nov 16 03:49:39 user nova-compute[103546]:   <memory>2097152</memory>
Nov 16 03:49:39 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 03:49:39 user nova-compute[103546]:   <metadata>
Nov 16 03:49:39 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 03:49:39 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 03:49:39 user nova-compute[103546]:       <nova:name>tempest-ServerActionsTestOtherB-server-1580842921</nova:name>
Nov 16 03:49:39 user nova-compute[103546]:       <nova:creationTime>2023-11-16 03:49:37</nova:creationTime>
Nov 16 03:49:39 user nova-compute[103546]:       <nova:flavor name="m1.small">
Nov 16 03:49:39 user nova-compute[103546]:         <nova:memory>2048</nova:memory>
Nov 16 03:49:39 user nova-compute[103546]:         <nova:disk>20</nova:disk>
Nov 16 03:49:39 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 03:49:39 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 03:49:39 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 03:49:39 user nova-compute[103546]:       </nova:flavor>
Nov 16 03:49:39 user nova-compute[103546]:       <nova:owner>
Nov 16 03:49:39 user nova-compute[103546]:         <nova:user uuid="d4bf11ccac9f4203808f8dca52cde36c">tempest-ServerActionsTestOtherB-648062424-project-member</nova:user>
Nov 16 03:49:39 user nova-compute[103546]:         <nova:project uuid="f76ca2da0c584a7382040eb113da4c2a">tempest-ServerActionsTestOtherB-648062424</nova:project>
Nov 16 03:49:39 user nova-compute[103546]:       </nova:owner>
Nov 16 03:49:39 user nova-compute[103546]:       <nova:root type="image" uuid="5c6f539a-01e5-4478-bf8f-a14310b5d7dd"/>
Nov 16 03:49:39 user nova-compute[103546]:       <nova:ports>
Nov 16 03:49:39 user nova-compute[103546]:         <nova:port uuid="e36fae5d-773f-47c0-b79a-5aadf6412cbc">
Nov 16 03:49:39 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 16 03:49:39 user nova-compute[103546]:         </nova:port>
Nov 16 03:49:39 user nova-compute[103546]:       </nova:ports>
Nov 16 03:49:39 user nova-compute[103546]:     </nova:instance>
Nov 16 03:49:39 user nova-compute[103546]:   </metadata>
Nov 16 03:49:39 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 03:49:39 user nova-compute[103546]:     <system>
Nov 16 03:49:39 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 03:49:39 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 03:49:39 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 03:49:39 user nova-compute[103546]:       <entry name="serial">51554aab-44ec-4161-b926-9c07a3f838a5</entry>
Nov 16 03:49:39 user nova-compute[103546]:       <entry name="uuid">51554aab-44ec-4161-b926-9c07a3f838a5</entry>
Nov 16 03:49:39 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 03:49:39 user nova-compute[103546]:     </system>
Nov 16 03:49:39 user nova-compute[103546]:   </sysinfo>
Nov 16 03:49:39 user nova-compute[103546]:   <os>
Nov 16 03:49:39 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 03:49:39 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 03:49:39 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 03:49:39 user nova-compute[103546]:   </os>
Nov 16 03:49:39 user nova-compute[103546]:   <features>
Nov 16 03:49:39 user nova-compute[103546]:     <acpi/>
Nov 16 03:49:39 user nova-compute[103546]:     <apic/>
Nov 16 03:49:39 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 03:49:39 user nova-compute[103546]:   </features>
Nov 16 03:49:39 user nova-compute[103546]:   <clock offset="utc">
Nov 16 03:49:39 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 03:49:39 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 03:49:39 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 03:49:39 user nova-compute[103546]:   </clock>
Nov 16 03:49:39 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 03:49:39 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 03:49:39 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 03:49:39 user nova-compute[103546]:   </cpu>
Nov 16 03:49:39 user nova-compute[103546]:   <devices>
Nov 16 03:49:39 user nova-compute[103546]:     <disk type="file" device="disk">
Nov 16 03:49:39 user nova-compute[103546]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 03:49:39 user nova-compute[103546]:       <source file="/opt/stack/data/nova/instances/51554aab-44ec-4161-b926-9c07a3f838a5/disk"/>
Nov 16 03:49:39 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 03:49:39 user nova-compute[103546]:     </disk>
Nov 16 03:49:39 user nova-compute[103546]:     <disk type="block" device="disk">
Nov 16 03:49:39 user nova-compute[103546]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 03:49:39 user nova-compute[103546]:       <source dev="/dev/sdb"/>
Nov 16 03:49:39 user nova-compute[103546]:       <target dev="vdb" bus="virtio"/>
Nov 16 03:49:39 user nova-compute[103546]:       <serial>4156a8b3-4b47-48ef-ad34-1ace6437b49c</serial>
Nov 16 03:49:39 user nova-compute[103546]:     </disk>
Nov 16 03:49:39 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 03:49:39 user nova-compute[103546]:       <mac address="fa:16:3e:9a:45:d0"/>
Nov 16 03:49:39 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:49:39 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 03:49:39 user nova-compute[103546]:       <target dev="tape36fae5d-77"/>
Nov 16 03:49:39 user nova-compute[103546]:     </interface>
Nov 16 03:49:39 user nova-compute[103546]:     <serial type="pty">
Nov 16 03:49:39 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/51554aab-44ec-4161-b926-9c07a3f838a5/console.log" append="off"/>
Nov 16 03:49:39 user nova-compute[103546]:     </serial>
Nov 16 03:49:39 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 03:49:39 user nova-compute[103546]:     <video>
Nov 16 03:49:39 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:49:39 user nova-compute[103546]:     </video>
Nov 16 03:49:39 user nova-compute[103546]:     <rng model="virtio">
Nov 16 03:49:39 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 03:49:39 user nova-compute[103546]:     </rng>
Nov 16 03:49:39 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 03:49:39 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 03:49:39 user nova-compute[103546]:       <stats period="10"/>
Nov 16 03:49:39 user nova-compute[103546]:     </memballoon>
Nov 16 03:49:39 user nova-compute[103546]:   </devices>
Nov 16 03:49:39 user nova-compute[103546]: </domain>
Nov 16 03:49:39 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 03:49:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:46:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1580842921',display_name='tempest-ServerActionsTestOtherB-server-1580842921',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1580842921',id=2,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4BC4cHDV2fbJoL15YFOsrL3Jj/txUDoSxREB28Izf7niUsDWNVN4I6jw0qVmlW7BvPaNCWUAskE06oeKsT+2XD63IEOwvY2xtSda7L7/qiL3VY46L9X29CD+3k2W4RoA==',key_name='tempest-keypair-857843108',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:46:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f76ca2da0c584a7382040eb113da4c2a',ramdisk_id='',reservation_id='r-kl1f6eox',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-648062424',owner_user_name='tempest-ServerActionsTestOtherB-648062424-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:49:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4bf11ccac9f4203808f8dca52cde36c',uuid=51554aab-44ec-4161-b926-9c07a3f838a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e36fae5d-773f-47c0-b79a-5aadf6412cbc", "address": "fa:16:3e:9a:45:d0", "network": {"id": "ef471a6e-7bd1-4a61-aa01-fd7557bfae1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-865941926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-865941926-network", "vif_mac": "fa:16:3e:9a:45:d0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76ca2da0c584a7382040eb113da4c2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape36fae5d-77", "ovs_interfaceid": "e36fae5d-773f-47c0-b79a-5aadf6412cbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 03:49:39 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Converting VIF {"id": "e36fae5d-773f-47c0-b79a-5aadf6412cbc", "address": "fa:16:3e:9a:45:d0", "network": {"id": "ef471a6e-7bd1-4a61-aa01-fd7557bfae1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-865941926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-865941926-network", "vif_mac": "fa:16:3e:9a:45:d0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76ca2da0c584a7382040eb113da4c2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape36fae5d-77", "ovs_interfaceid": "e36fae5d-773f-47c0-b79a-5aadf6412cbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:49:39 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:45:d0,bridge_name='br-int',has_traffic_filtering=True,id=e36fae5d-773f-47c0-b79a-5aadf6412cbc,network=Network(ef471a6e-7bd1-4a61-aa01-fd7557bfae1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape36fae5d-77') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:49:39 user nova-compute[103546]: DEBUG os_vif [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:45:d0,bridge_name='br-int',has_traffic_filtering=True,id=e36fae5d-773f-47c0-b79a-5aadf6412cbc,network=Network(ef471a6e-7bd1-4a61-aa01-fd7557bfae1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape36fae5d-77') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 03:49:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:49:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 03:49:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c8254de3-0ae2-54ca-9a2b-b650bc7f0d7f', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:49:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape36fae5d-77, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:49:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape36fae5d-77, col_values=(('qos', UUID('076913df-01b1-45e4-bcc5-8c9fb9e2bd66')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:49:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape36fae5d-77, col_values=(('external_ids', {'iface-id': 'e36fae5d-773f-47c0-b79a-5aadf6412cbc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:45:d0', 'vm-uuid': '51554aab-44ec-4161-b926-9c07a3f838a5'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:49:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:49:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:39 user nova-compute[103546]: INFO os_vif [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:45:d0,bridge_name='br-int',has_traffic_filtering=True,id=e36fae5d-773f-47c0-b79a-5aadf6412cbc,network=Network(ef471a6e-7bd1-4a61-aa01-fd7557bfae1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape36fae5d-77')
Nov 16 03:49:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:49:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] No BDM found with device name vdb, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:49:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] No VIF found with MAC fa:16:3e:9a:45:d0, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 03:49:40 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:40 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:40 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:40 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:40 user nova-compute[103546]: DEBUG nova.compute.manager [req-a0fe9c0f-4da8-4e9d-8f14-165a0dde04be req-cd951ae4-f4ff-498a-b989-9fdd89229451 service nova] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Received event network-vif-plugged-e36fae5d-773f-47c0-b79a-5aadf6412cbc {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:49:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a0fe9c0f-4da8-4e9d-8f14-165a0dde04be req-cd951ae4-f4ff-498a-b989-9fdd89229451 service nova] Acquiring lock "51554aab-44ec-4161-b926-9c07a3f838a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a0fe9c0f-4da8-4e9d-8f14-165a0dde04be req-cd951ae4-f4ff-498a-b989-9fdd89229451 service nova] Lock "51554aab-44ec-4161-b926-9c07a3f838a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a0fe9c0f-4da8-4e9d-8f14-165a0dde04be req-cd951ae4-f4ff-498a-b989-9fdd89229451 service nova] Lock "51554aab-44ec-4161-b926-9c07a3f838a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:40 user nova-compute[103546]: DEBUG nova.compute.manager [req-a0fe9c0f-4da8-4e9d-8f14-165a0dde04be req-cd951ae4-f4ff-498a-b989-9fdd89229451 service nova] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] No waiting events found dispatching network-vif-plugged-e36fae5d-773f-47c0-b79a-5aadf6412cbc {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:49:40 user nova-compute[103546]: WARNING nova.compute.manager [req-a0fe9c0f-4da8-4e9d-8f14-165a0dde04be req-cd951ae4-f4ff-498a-b989-9fdd89229451 service nova] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Received unexpected event network-vif-plugged-e36fae5d-773f-47c0-b79a-5aadf6412cbc for instance with vm_state active and task_state resize_finish.
Nov 16 03:49:41 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:41 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:42 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-67b23a3a-5c3b-4189-b010-f113ad0259cc tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Acquiring lock "63b95121-b211-42c3-831e-0392d4abd09a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:42 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-67b23a3a-5c3b-4189-b010-f113ad0259cc tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "63b95121-b211-42c3-831e-0392d4abd09a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:42 user nova-compute[103546]: DEBUG nova.objects.instance [None req-67b23a3a-5c3b-4189-b010-f113ad0259cc tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lazy-loading 'flavor' on Instance uuid 63b95121-b211-42c3-831e-0392d4abd09a {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:49:42 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-67b23a3a-5c3b-4189-b010-f113ad0259cc tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "63b95121-b211-42c3-831e-0392d4abd09a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:42 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-67b23a3a-5c3b-4189-b010-f113ad0259cc tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Acquiring lock "63b95121-b211-42c3-831e-0392d4abd09a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:42 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-67b23a3a-5c3b-4189-b010-f113ad0259cc tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "63b95121-b211-42c3-831e-0392d4abd09a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:42 user nova-compute[103546]: INFO nova.compute.manager [None req-67b23a3a-5c3b-4189-b010-f113ad0259cc tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Attaching volume 7119d272-a013-4b8f-b80a-6b64111c42f9 to /dev/vdb
Nov 16 03:49:42 user nova-compute[103546]: DEBUG os_brick.utils [None req-67b23a3a-5c3b-4189-b010-f113ad0259cc tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:49:42 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:42 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:42 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e44cab-0c42-455e-99e3-36027b1da8b7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af5c39b14ece\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:42 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:42 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:42 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d6d9cb-b198-4aaf-88ea-33351cf76d1f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:42 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:42 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:42 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d962132b-3b2b-47c5-9e93-bb389cef021f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:42 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[81641abb-0cad-49ad-952a-551447b24a66]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:42 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-67b23a3a-5c3b-4189-b010-f113ad0259cc tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Running cmd (subprocess): nvme version {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:42 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-67b23a3a-5c3b-4189-b010-f113ad0259cc tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] 'nvme version' failed. Not Retrying. {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:49:42 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.nvmeof [None req-67b23a3a-5c3b-4189-b010-f113ad0259cc tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] nvme not present on system {{(pid=103546) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 03:49:42 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:42 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:49:42 user nova-compute[103546]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 03:49:42 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90f34d7-742e-447d-9bb8-04722193ddc1]: (4, '') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:42 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-67b23a3a-5c3b-4189-b010-f113ad0259cc tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=103546) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 03:49:42 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-67b23a3a-5c3b-4189-b010-f113ad0259cc tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 03:49:42 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-67b23a3a-5c3b-4189-b010-f113ad0259cc tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] LIGHTOS: no hostnqn found. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 03:49:42 user nova-compute[103546]: DEBUG os_brick.utils [None req-67b23a3a-5c3b-4189-b010-f113ad0259cc tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af5c39b14ece', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:49:42 user nova-compute[103546]: DEBUG nova.virt.block_device [None req-67b23a3a-5c3b-4189-b010-f113ad0259cc tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Updating existing volume attachment record: cddfe319-8742-47f2-9a6a-96397f40f8ab {{(pid=103546) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 03:49:42 user nova-compute[103546]: DEBUG nova.compute.manager [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 03:49:42 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Instance running successfully.
Nov 16 03:49:42 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Failed to set time: agent not configured {{(pid=103546) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 16 03:49:42 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-8cb6c0c1-0cb2-4a0a-b3b4-111b7f637148 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] finish_migration finished successfully. {{(pid=103546) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 16 03:49:43 user nova-compute[103546]: DEBUG nova.compute.manager [req-b52fb50a-54ba-4132-965e-bc40843c63e7 req-4eb46fb6-d4f8-4471-b3b6-9539c571a950 service nova] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Received event network-vif-plugged-e36fae5d-773f-47c0-b79a-5aadf6412cbc {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:49:43 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-b52fb50a-54ba-4132-965e-bc40843c63e7 req-4eb46fb6-d4f8-4471-b3b6-9539c571a950 service nova] Acquiring lock "51554aab-44ec-4161-b926-9c07a3f838a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:43 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-b52fb50a-54ba-4132-965e-bc40843c63e7 req-4eb46fb6-d4f8-4471-b3b6-9539c571a950 service nova] Lock "51554aab-44ec-4161-b926-9c07a3f838a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:43 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-b52fb50a-54ba-4132-965e-bc40843c63e7 req-4eb46fb6-d4f8-4471-b3b6-9539c571a950 service nova] Lock "51554aab-44ec-4161-b926-9c07a3f838a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:43 user nova-compute[103546]: DEBUG nova.compute.manager [req-b52fb50a-54ba-4132-965e-bc40843c63e7 req-4eb46fb6-d4f8-4471-b3b6-9539c571a950 service nova] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] No waiting events found dispatching network-vif-plugged-e36fae5d-773f-47c0-b79a-5aadf6412cbc {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:49:43 user nova-compute[103546]: WARNING nova.compute.manager [req-b52fb50a-54ba-4132-965e-bc40843c63e7 req-4eb46fb6-d4f8-4471-b3b6-9539c571a950 service nova] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Received unexpected event network-vif-plugged-e36fae5d-773f-47c0-b79a-5aadf6412cbc for instance with vm_state active and task_state resize_finish.
Nov 16 03:49:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:44 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:47 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67b23a3a-5c3b-4189-b010-f113ad0259cc tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 03:49:47 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-67b23a3a-5c3b-4189-b010-f113ad0259cc tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7119d272-a013-4b8f-b80a-6b64111c42f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QgBiMYRo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:49:47 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-67b23a3a-5c3b-4189-b010-f113ad0259cc tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:49:47 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-67b23a3a-5c3b-4189-b010-f113ad0259cc tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:49:47 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-67b23a3a-5c3b-4189-b010-f113ad0259cc tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:49:47 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-67b23a3a-5c3b-4189-b010-f113ad0259cc tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:49:47 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-67b23a3a-5c3b-4189-b010-f113ad0259cc tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7119d272-a013-4b8f-b80a-6b64111c42f9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:49:47 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-67b23a3a-5c3b-4189-b010-f113ad0259cc tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7119d272-a013-4b8f-b80a-6b64111c42f9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:49:47 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-67b23a3a-5c3b-4189-b010-f113ad0259cc tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 03:49:47 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7119d272-a013-4b8f-b80a-6b64111c42f9 -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:47 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7119d272-a013-4b8f-b80a-6b64111c42f9 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:47 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[adda50d0-b561-40b1-bd8d-5e258db75ce5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:47 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-67b23a3a-5c3b-4189-b010-f113ad0259cc tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 03:49:47 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:49:47 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7119d272-a013-4b8f-b80a-6b64111c42f9 -p 172.16.0.220:3260 --interface default --op new {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:47 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7119d272-a013-4b8f-b80a-6b64111c42f9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:47 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaae7a36-6dc9-47e6-a171-f6797ea8234e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7119d272-a013-4b8f-b80a-6b64111c42f9] added\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:47 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-67b23a3a-5c3b-4189-b010-f113ad0259cc tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7119d272-a013-4b8f-b80a-6b64111c42f9] added
Nov 16 03:49:47 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:49:47 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7119d272-a013-4b8f-b80a-6b64111c42f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:47 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7119d272-a013-4b8f-b80a-6b64111c42f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:47 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[37602ff3-1c5f-4e2c-a2a7-43d54e4c1588]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:47 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-67b23a3a-5c3b-4189-b010-f113ad0259cc tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:49:47 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7119d272-a013-4b8f-b80a-6b64111c42f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:47 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7119d272-a013-4b8f-b80a-6b64111c42f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:47 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af6689a-ad9f-4ec6-b413-8834fd868320]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:47 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-67b23a3a-5c3b-4189-b010-f113ad0259cc tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:49:47 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7119d272-a013-4b8f-b80a-6b64111c42f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QgBiMYRo {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:47 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7119d272-a013-4b8f-b80a-6b64111c42f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QgBiMYRo" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:47 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c395c15-e4d8-40e8-84b2-b259229362ec]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:47 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-67b23a3a-5c3b-4189-b010-f113ad0259cc tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QgBiMYRo'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:49:47 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7119d272-a013-4b8f-b80a-6b64111c42f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:47 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7119d272-a013-4b8f-b80a-6b64111c42f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:47 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d871bb-5018-4fdb-966a-8ca011c216cd]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:47 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-67b23a3a-5c3b-4189-b010-f113ad0259cc tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:49:47 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:47 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:47 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[94bf6fbd-afad-4df5-9122-fd423ac739ea]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:47 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-67b23a3a-5c3b-4189-b010-f113ad0259cc tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)
Nov 16 03:49:47 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:49:47 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-67b23a3a-5c3b-4189-b010-f113ad0259cc tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)
Nov 16 03:49:47 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:49:47 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7119d272-a013-4b8f-b80a-6b64111c42f9 -p 172.16.0.220:3260 --login {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:47 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7119d272-a013-4b8f-b80a-6b64111c42f9 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:47 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d6d55a7-b398-4b77-84c3-d3f191d04d29]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7119d272-a013-4b8f-b80a-6b64111c42f9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7119d272-a013-4b8f-b80a-6b64111c42f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:47 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-67b23a3a-5c3b-4189-b010-f113ad0259cc tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7119d272-a013-4b8f-b80a-6b64111c42f9, portal: 172.16.0.220,3260]
Nov 16 03:49:47 user nova-compute[103546]: Login to [iface: default, target: iqn.2010-10.org.openstack:7119d272-a013-4b8f-b80a-6b64111c42f9, portal: 172.16.0.220,3260] successful.
Nov 16 03:49:47 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:49:47 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7119d272-a013-4b8f-b80a-6b64111c42f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:47 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7119d272-a013-4b8f-b80a-6b64111c42f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:47 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[42db3c23-4519-4150-9463-dbf6c320cc46]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:47 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-67b23a3a-5c3b-4189-b010-f113ad0259cc tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:49:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:48 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f1eebf-21dd-4d0c-b3a1-49251ac8b276]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7119d272-a013-4b8f-b80a-6b64111c42f9 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:48 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-67b23a3a-5c3b-4189-b010-f113ad0259cc tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)
Nov 16 03:49:48 user nova-compute[103546]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7119d272-a013-4b8f-b80a-6b64111c42f9 (non-flash)
Nov 16 03:49:48 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:49:48 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-67b23a3a-5c3b-4189-b010-f113ad0259cc tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)
Nov 16 03:49:48 user nova-compute[103546]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7119d272-a013-4b8f-b80a-6b64111c42f9 (non-flash)
Nov 16 03:49:48 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:49:48 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-67b23a3a-5c3b-4189-b010-f113ad0259cc tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7119d272-a013-4b8f-b80a-6b64111c42f9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:49:48 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-67b23a3a-5c3b-4189-b010-f113ad0259cc tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 03:49:48 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-67b23a3a-5c3b-4189-b010-f113ad0259cc tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 03:49:48 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-67b23a3a-5c3b-4189-b010-f113ad0259cc tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 03:49:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:49:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4d5519a1-252e-48d9-ac82-512cfebac650 tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Acquiring lock "ad9b2edb-15d7-4937-9461-15ce61f508a7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4d5519a1-252e-48d9-ac82-512cfebac650 tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Lock "ad9b2edb-15d7-4937-9461-15ce61f508a7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4d5519a1-252e-48d9-ac82-512cfebac650 tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Acquiring lock "ad9b2edb-15d7-4937-9461-15ce61f508a7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4d5519a1-252e-48d9-ac82-512cfebac650 tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Lock "ad9b2edb-15d7-4937-9461-15ce61f508a7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4d5519a1-252e-48d9-ac82-512cfebac650 tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Lock "ad9b2edb-15d7-4937-9461-15ce61f508a7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:48 user nova-compute[103546]: INFO nova.compute.manager [None req-4d5519a1-252e-48d9-ac82-512cfebac650 tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Terminating instance
Nov 16 03:49:48 user nova-compute[103546]: DEBUG nova.compute.manager [None req-4d5519a1-252e-48d9-ac82-512cfebac650 tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Start destroying the instance on the hypervisor. {{(pid=103546) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 03:49:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.032s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:49:48 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd79ac9e-945a-4aa6-a325-941967342eb9]: (4, ('- - 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:49:48 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-67b23a3a-5c3b-4189-b010-f113ad0259cc tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 03:49:48 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-67b23a3a-5c3b-4189-b010-f113ad0259cc tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7119d272-a013-4b8f-b80a-6b64111c42f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QgBiMYRo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 03:49:48 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:48 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:48 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:48 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:48 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:48 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:48 user nova-compute[103546]: DEBUG nova.compute.manager [req-72ceed27-2149-4c80-a69d-1280ab397644 req-2c86efb5-e025-446c-afb9-f83e05caedb7 service nova] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Received event network-vif-unplugged-0bf5e09d-1b54-48f7-bbbe-f133102ea245 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:49:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-72ceed27-2149-4c80-a69d-1280ab397644 req-2c86efb5-e025-446c-afb9-f83e05caedb7 service nova] Acquiring lock "ad9b2edb-15d7-4937-9461-15ce61f508a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-72ceed27-2149-4c80-a69d-1280ab397644 req-2c86efb5-e025-446c-afb9-f83e05caedb7 service nova] Lock "ad9b2edb-15d7-4937-9461-15ce61f508a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-72ceed27-2149-4c80-a69d-1280ab397644 req-2c86efb5-e025-446c-afb9-f83e05caedb7 service nova] Lock "ad9b2edb-15d7-4937-9461-15ce61f508a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:48 user nova-compute[103546]: DEBUG nova.compute.manager [req-72ceed27-2149-4c80-a69d-1280ab397644 req-2c86efb5-e025-446c-afb9-f83e05caedb7 service nova] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] No waiting events found dispatching network-vif-unplugged-0bf5e09d-1b54-48f7-bbbe-f133102ea245 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:49:48 user nova-compute[103546]: DEBUG nova.compute.manager [req-72ceed27-2149-4c80-a69d-1280ab397644 req-2c86efb5-e025-446c-afb9-f83e05caedb7 service nova] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Received event network-vif-unplugged-0bf5e09d-1b54-48f7-bbbe-f133102ea245 for instance with task_state deleting. {{(pid=103546) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 03:49:48 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:48 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:48 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Instance destroyed successfully.
Nov 16 03:49:48 user nova-compute[103546]: DEBUG nova.objects.instance [None req-4d5519a1-252e-48d9-ac82-512cfebac650 tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Lazy-loading 'resources' on Instance uuid ad9b2edb-15d7-4937-9461-15ce61f508a7 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:49:48 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-4d5519a1-252e-48d9-ac82-512cfebac650 tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:46:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-510323125',display_name='tempest-VolumesAssistedSnapshotsTest-server-510323125',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-510323125',id=8,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7ukVTEsQrfsx1V/Vv18Aroha3Ou7ipoh9GpWtMg3Zyt/L0IgUsE5cXN6eq+b3dsRGUaZsqSFxSb3zBUO7ATgClFJWXZFAj4/qan0bDxOk0jc+z13iSb6tABsLh5lNy/Q==',key_name='tempest-keypair-698143504',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:47:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8e2a4cdf0fe94227a70e9ecc30df0cf6',ramdisk_id='',reservation_id='r-i4qtsd8a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-866417016',owner_user_name='tempest-VolumesAssistedSnapshotsTest-866417016-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T03:47:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74dc927510f14b7ab10314605e74af64',uuid=ad9b2edb-15d7-4937-9461-15ce61f508a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0bf5e09d-1b54-48f7-bbbe-f133102ea245", "address": "fa:16:3e:2f:63:83", "network": {"id": "704209e4-4dd9-4e90-bc67-9843ae1d3340", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1483691372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e2a4cdf0fe94227a70e9ecc30df0cf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bf5e09d-1b", "ovs_interfaceid": "0bf5e09d-1b54-48f7-bbbe-f133102ea245", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 03:49:48 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-4d5519a1-252e-48d9-ac82-512cfebac650 tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Converting VIF {"id": "0bf5e09d-1b54-48f7-bbbe-f133102ea245", "address": "fa:16:3e:2f:63:83", "network": {"id": "704209e4-4dd9-4e90-bc67-9843ae1d3340", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1483691372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e2a4cdf0fe94227a70e9ecc30df0cf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bf5e09d-1b", "ovs_interfaceid": "0bf5e09d-1b54-48f7-bbbe-f133102ea245", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:49:48 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-4d5519a1-252e-48d9-ac82-512cfebac650 tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:63:83,bridge_name='br-int',has_traffic_filtering=True,id=0bf5e09d-1b54-48f7-bbbe-f133102ea245,network=Network(704209e4-4dd9-4e90-bc67-9843ae1d3340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bf5e09d-1b') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:49:48 user nova-compute[103546]: DEBUG os_vif [None req-4d5519a1-252e-48d9-ac82-512cfebac650 tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:63:83,bridge_name='br-int',has_traffic_filtering=True,id=0bf5e09d-1b54-48f7-bbbe-f133102ea245,network=Network(704209e4-4dd9-4e90-bc67-9843ae1d3340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bf5e09d-1b') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 03:49:48 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:48 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0bf5e09d-1b, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:49:48 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:48 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:49:48 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:48 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6d3c4fc8-2a8e-4dad-a325-63401c8f928e) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:49:48 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:48 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:48 user nova-compute[103546]: INFO os_vif [None req-4d5519a1-252e-48d9-ac82-512cfebac650 tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:63:83,bridge_name='br-int',has_traffic_filtering=True,id=0bf5e09d-1b54-48f7-bbbe-f133102ea245,network=Network(704209e4-4dd9-4e90-bc67-9843ae1d3340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bf5e09d-1b')
Nov 16 03:49:48 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-4d5519a1-252e-48d9-ac82-512cfebac650 tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Deleting instance files /opt/stack/data/nova/instances/ad9b2edb-15d7-4937-9461-15ce61f508a7_del
Nov 16 03:49:48 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-4d5519a1-252e-48d9-ac82-512cfebac650 tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Deletion of /opt/stack/data/nova/instances/ad9b2edb-15d7-4937-9461-15ce61f508a7_del complete
Nov 16 03:49:48 user nova-compute[103546]: INFO nova.compute.manager [None req-4d5519a1-252e-48d9-ac82-512cfebac650 tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 16 03:49:48 user nova-compute[103546]: DEBUG oslo.service.loopingcall [None req-4d5519a1-252e-48d9-ac82-512cfebac650 tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=103546) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 03:49:48 user nova-compute[103546]: DEBUG nova.compute.manager [-] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Deallocating network for instance {{(pid=103546) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 03:49:48 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] deallocate_for_instance() {{(pid=103546) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 03:49:49 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-67b23a3a-5c3b-4189-b010-f113ad0259cc tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:49:49 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-67b23a3a-5c3b-4189-b010-f113ad0259cc tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23137313336393333', 'path': '/dev/sdc'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:49:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67b23a3a-5c3b-4189-b010-f113ad0259cc tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23137313336393333', 'path': '/dev/sdc'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 03:49:49 user nova-compute[103546]: DEBUG nova.objects.instance [None req-67b23a3a-5c3b-4189-b010-f113ad0259cc tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lazy-loading 'flavor' on Instance uuid 63b95121-b211-42c3-831e-0392d4abd09a {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:49:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-67b23a3a-5c3b-4189-b010-f113ad0259cc tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 03:49:49 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 03:49:49 user nova-compute[103546]:   <source dev="/dev/sdc"/>
Nov 16 03:49:49 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 03:49:49 user nova-compute[103546]:   <serial>7119d272-a013-4b8f-b80a-6b64111c42f9</serial>
Nov 16 03:49:49 user nova-compute[103546]: </disk>
Nov 16 03:49:49 user nova-compute[103546]:  {{(pid=103546) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 03:49:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-67b23a3a-5c3b-4189-b010-f113ad0259cc tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:49:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-67b23a3a-5c3b-4189-b010-f113ad0259cc tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] No BDM found with device name vdb, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:49:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-67b23a3a-5c3b-4189-b010-f113ad0259cc tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] No VIF found with MAC fa:16:3e:d0:5b:e1, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 03:49:49 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-67b23a3a-5c3b-4189-b010-f113ad0259cc tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "63b95121-b211-42c3-831e-0392d4abd09a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.397s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:49 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:49:49 user nova-compute[103546]: INFO nova.compute.manager [-] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Took 0.79 seconds to deallocate network for instance.
Nov 16 03:49:49 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4d5519a1-252e-48d9-ac82-512cfebac650 tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:49 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4d5519a1-252e-48d9-ac82-512cfebac650 tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:50 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-4d5519a1-252e-48d9-ac82-512cfebac650 tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:49:50 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-4d5519a1-252e-48d9-ac82-512cfebac650 tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:49:50 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4d5519a1-252e-48d9-ac82-512cfebac650 tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.345s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:50 user nova-compute[103546]: INFO nova.scheduler.client.report [None req-4d5519a1-252e-48d9-ac82-512cfebac650 tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Deleted allocations for instance ad9b2edb-15d7-4937-9461-15ce61f508a7
Nov 16 03:49:50 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4d5519a1-252e-48d9-ac82-512cfebac650 tempest-VolumesAssistedSnapshotsTest-866417016 tempest-VolumesAssistedSnapshotsTest-866417016-project-member] Lock "ad9b2edb-15d7-4937-9461-15ce61f508a7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.178s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:50 user nova-compute[103546]: DEBUG nova.compute.manager [req-1e8cfb74-c2e2-47f9-a434-3e762cf22054 req-3b190cb8-2919-4192-adb3-6a09f1eb202e service nova] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Received event network-vif-plugged-0bf5e09d-1b54-48f7-bbbe-f133102ea245 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:49:50 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-1e8cfb74-c2e2-47f9-a434-3e762cf22054 req-3b190cb8-2919-4192-adb3-6a09f1eb202e service nova] Acquiring lock "ad9b2edb-15d7-4937-9461-15ce61f508a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:50 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-1e8cfb74-c2e2-47f9-a434-3e762cf22054 req-3b190cb8-2919-4192-adb3-6a09f1eb202e service nova] Lock "ad9b2edb-15d7-4937-9461-15ce61f508a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:50 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-1e8cfb74-c2e2-47f9-a434-3e762cf22054 req-3b190cb8-2919-4192-adb3-6a09f1eb202e service nova] Lock "ad9b2edb-15d7-4937-9461-15ce61f508a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:50 user nova-compute[103546]: DEBUG nova.compute.manager [req-1e8cfb74-c2e2-47f9-a434-3e762cf22054 req-3b190cb8-2919-4192-adb3-6a09f1eb202e service nova] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] No waiting events found dispatching network-vif-plugged-0bf5e09d-1b54-48f7-bbbe-f133102ea245 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:49:50 user nova-compute[103546]: WARNING nova.compute.manager [req-1e8cfb74-c2e2-47f9-a434-3e762cf22054 req-3b190cb8-2919-4192-adb3-6a09f1eb202e service nova] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Received unexpected event network-vif-plugged-0bf5e09d-1b54-48f7-bbbe-f133102ea245 for instance with vm_state deleted and task_state None.
Nov 16 03:49:50 user nova-compute[103546]: DEBUG nova.compute.manager [req-1e8cfb74-c2e2-47f9-a434-3e762cf22054 req-3b190cb8-2919-4192-adb3-6a09f1eb202e service nova] [instance: ad9b2edb-15d7-4937-9461-15ce61f508a7] Received event network-vif-deleted-0bf5e09d-1b54-48f7-bbbe-f133102ea245 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:49:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d21968b9-7a6c-4264-a2e5-e6e1b1e13bdf tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Acquiring lock "c24a386f-32f5-4095-b2b3-69a70a54ff66" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d21968b9-7a6c-4264-a2e5-e6e1b1e13bdf tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Lock "c24a386f-32f5-4095-b2b3-69a70a54ff66" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d21968b9-7a6c-4264-a2e5-e6e1b1e13bdf tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Acquiring lock "c24a386f-32f5-4095-b2b3-69a70a54ff66-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d21968b9-7a6c-4264-a2e5-e6e1b1e13bdf tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Lock "c24a386f-32f5-4095-b2b3-69a70a54ff66-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d21968b9-7a6c-4264-a2e5-e6e1b1e13bdf tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Lock "c24a386f-32f5-4095-b2b3-69a70a54ff66-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:54 user nova-compute[103546]: INFO nova.compute.manager [None req-d21968b9-7a6c-4264-a2e5-e6e1b1e13bdf tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Terminating instance
Nov 16 03:49:54 user nova-compute[103546]: DEBUG nova.compute.manager [None req-d21968b9-7a6c-4264-a2e5-e6e1b1e13bdf tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Start destroying the instance on the hypervisor. {{(pid=103546) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 03:49:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:55 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:55 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:55 user nova-compute[103546]: DEBUG nova.compute.manager [req-3420a1c2-e3a5-4bb1-9f0e-92cef875d108 req-bec39780-9b75-4a28-87af-907a19fb1aee service nova] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Received event network-vif-unplugged-38395643-bb34-441c-ab0e-c9201f35ec04 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:49:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3420a1c2-e3a5-4bb1-9f0e-92cef875d108 req-bec39780-9b75-4a28-87af-907a19fb1aee service nova] Acquiring lock "c24a386f-32f5-4095-b2b3-69a70a54ff66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3420a1c2-e3a5-4bb1-9f0e-92cef875d108 req-bec39780-9b75-4a28-87af-907a19fb1aee service nova] Lock "c24a386f-32f5-4095-b2b3-69a70a54ff66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3420a1c2-e3a5-4bb1-9f0e-92cef875d108 req-bec39780-9b75-4a28-87af-907a19fb1aee service nova] Lock "c24a386f-32f5-4095-b2b3-69a70a54ff66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:55 user nova-compute[103546]: DEBUG nova.compute.manager [req-3420a1c2-e3a5-4bb1-9f0e-92cef875d108 req-bec39780-9b75-4a28-87af-907a19fb1aee service nova] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] No waiting events found dispatching network-vif-unplugged-38395643-bb34-441c-ab0e-c9201f35ec04 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:49:55 user nova-compute[103546]: DEBUG nova.compute.manager [req-3420a1c2-e3a5-4bb1-9f0e-92cef875d108 req-bec39780-9b75-4a28-87af-907a19fb1aee service nova] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Received event network-vif-unplugged-38395643-bb34-441c-ab0e-c9201f35ec04 for instance with task_state deleting. {{(pid=103546) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 03:49:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-229b9502-3111-421d-9e76-e2b6de1a7baf tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Acquiring lock "7e347e48-0b4e-4ce6-a677-5d1dc099ac6c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-229b9502-3111-421d-9e76-e2b6de1a7baf tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Lock "7e347e48-0b4e-4ce6-a677-5d1dc099ac6c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-229b9502-3111-421d-9e76-e2b6de1a7baf tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Acquiring lock "7e347e48-0b4e-4ce6-a677-5d1dc099ac6c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-229b9502-3111-421d-9e76-e2b6de1a7baf tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Lock "7e347e48-0b4e-4ce6-a677-5d1dc099ac6c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-229b9502-3111-421d-9e76-e2b6de1a7baf tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Lock "7e347e48-0b4e-4ce6-a677-5d1dc099ac6c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:55 user nova-compute[103546]: INFO nova.compute.manager [None req-229b9502-3111-421d-9e76-e2b6de1a7baf tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c] Terminating instance
Nov 16 03:49:55 user nova-compute[103546]: DEBUG nova.compute.manager [None req-229b9502-3111-421d-9e76-e2b6de1a7baf tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c] Start destroying the instance on the hypervisor. {{(pid=103546) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 03:49:55 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:55 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:55 user nova-compute[103546]: DEBUG nova.compute.manager [req-5c8ee02f-fa15-4b11-925b-16b8b3b2a3be req-0dc98112-60d6-4295-adf6-d4f310bb99ee service nova] [instance: 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c] Received event network-vif-unplugged-b74c6e68-89ec-4fe2-abf4-7acf17214657 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:49:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-5c8ee02f-fa15-4b11-925b-16b8b3b2a3be req-0dc98112-60d6-4295-adf6-d4f310bb99ee service nova] Acquiring lock "7e347e48-0b4e-4ce6-a677-5d1dc099ac6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-5c8ee02f-fa15-4b11-925b-16b8b3b2a3be req-0dc98112-60d6-4295-adf6-d4f310bb99ee service nova] Lock "7e347e48-0b4e-4ce6-a677-5d1dc099ac6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-5c8ee02f-fa15-4b11-925b-16b8b3b2a3be req-0dc98112-60d6-4295-adf6-d4f310bb99ee service nova] Lock "7e347e48-0b4e-4ce6-a677-5d1dc099ac6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:55 user nova-compute[103546]: DEBUG nova.compute.manager [req-5c8ee02f-fa15-4b11-925b-16b8b3b2a3be req-0dc98112-60d6-4295-adf6-d4f310bb99ee service nova] [instance: 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c] No waiting events found dispatching network-vif-unplugged-b74c6e68-89ec-4fe2-abf4-7acf17214657 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:49:55 user nova-compute[103546]: DEBUG nova.compute.manager [req-5c8ee02f-fa15-4b11-925b-16b8b3b2a3be req-0dc98112-60d6-4295-adf6-d4f310bb99ee service nova] [instance: 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c] Received event network-vif-unplugged-b74c6e68-89ec-4fe2-abf4-7acf17214657 for instance with task_state deleting. {{(pid=103546) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 03:49:55 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:55 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:55 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:55 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:55 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:55 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:56 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Instance destroyed successfully.
Nov 16 03:49:56 user nova-compute[103546]: DEBUG nova.objects.instance [None req-d21968b9-7a6c-4264-a2e5-e6e1b1e13bdf tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Lazy-loading 'resources' on Instance uuid c24a386f-32f5-4095-b2b3-69a70a54ff66 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:49:56 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-d21968b9-7a6c-4264-a2e5-e6e1b1e13bdf tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:46:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-555718699',display_name='tempest-TestVolumeSwap-server-555718699',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-555718699',id=4,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEuw+Ud6gYkVB/a3/qfQ4x7OmkqGfXxlndBAEDrfbMlwY1hKcHk7J74zmAmjDgpSqSYm04d2UbF6A+W7zZq6MG+5AtTKVesRtPYw7lZ34jE8yaqOpJ1F1pMqLvCcYTOwRA==',key_name='tempest-keypair-676090845',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:46:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='24d430f3bdd040ed87450fa998e0a8b1',ramdisk_id='',reservation_id='r-p1rze5x9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-857315174',owner_user_name='tempest-TestVolumeSwap-857315174-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T03:46:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='186147c0885c4e6daf4c124dc54fe116',uuid=c24a386f-32f5-4095-b2b3-69a70a54ff66,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "38395643-bb34-441c-ab0e-c9201f35ec04", "address": "fa:16:3e:2e:8e:90", "network": {"id": "32de335d-6f62-41f6-8520-1cc09523ef83", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1595594660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24d430f3bdd040ed87450fa998e0a8b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38395643-bb", "ovs_interfaceid": "38395643-bb34-441c-ab0e-c9201f35ec04", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 03:49:56 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-d21968b9-7a6c-4264-a2e5-e6e1b1e13bdf tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Converting VIF {"id": "38395643-bb34-441c-ab0e-c9201f35ec04", "address": "fa:16:3e:2e:8e:90", "network": {"id": "32de335d-6f62-41f6-8520-1cc09523ef83", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1595594660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24d430f3bdd040ed87450fa998e0a8b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38395643-bb", "ovs_interfaceid": "38395643-bb34-441c-ab0e-c9201f35ec04", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:49:56 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-d21968b9-7a6c-4264-a2e5-e6e1b1e13bdf tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:8e:90,bridge_name='br-int',has_traffic_filtering=True,id=38395643-bb34-441c-ab0e-c9201f35ec04,network=Network(32de335d-6f62-41f6-8520-1cc09523ef83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38395643-bb') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:49:56 user nova-compute[103546]: DEBUG os_vif [None req-d21968b9-7a6c-4264-a2e5-e6e1b1e13bdf tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:8e:90,bridge_name='br-int',has_traffic_filtering=True,id=38395643-bb34-441c-ab0e-c9201f35ec04,network=Network(32de335d-6f62-41f6-8520-1cc09523ef83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38395643-bb') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 03:49:56 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:56 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap38395643-bb, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:49:56 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:56 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:49:56 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c] Instance destroyed successfully.
Nov 16 03:49:56 user nova-compute[103546]: DEBUG nova.objects.instance [None req-229b9502-3111-421d-9e76-e2b6de1a7baf tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Lazy-loading 'resources' on Instance uuid 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:49:56 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:56 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:56 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=415fc2a1-a96c-414f-b4ee-eebfa0fc96d8) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:49:56 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:56 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:49:56 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-229b9502-3111-421d-9e76-e2b6de1a7baf tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:48:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-248890376',display_name='tempest-ServersNegativeTestJSON-server-248890376',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-248890376',id=12,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:48:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c3f227c815224d55afdb3eba43e68757',ramdisk_id='',reservation_id='r-2a0425q3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-740287726',owner_user_name='tempest-ServersNegativeTestJSON-740287726-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T03:48:12Z,user_data=None,user_id='fe3fb261884b45b0bdc984b79bc1dc96',uuid=7e347e48-0b4e-4ce6-a677-5d1dc099ac6c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b74c6e68-89ec-4fe2-abf4-7acf17214657", "address": "fa:16:3e:fc:09:2f", "network": {"id": "56e4e469-bfda-4ab1-9fdd-e3aa1a0655fc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-669383710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f227c815224d55afdb3eba43e68757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb74c6e68-89", "ovs_interfaceid": "b74c6e68-89ec-4fe2-abf4-7acf17214657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 03:49:56 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-229b9502-3111-421d-9e76-e2b6de1a7baf tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Converting VIF {"id": "b74c6e68-89ec-4fe2-abf4-7acf17214657", "address": "fa:16:3e:fc:09:2f", "network": {"id": "56e4e469-bfda-4ab1-9fdd-e3aa1a0655fc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-669383710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f227c815224d55afdb3eba43e68757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb74c6e68-89", "ovs_interfaceid": "b74c6e68-89ec-4fe2-abf4-7acf17214657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:49:56 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-229b9502-3111-421d-9e76-e2b6de1a7baf tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:09:2f,bridge_name='br-int',has_traffic_filtering=True,id=b74c6e68-89ec-4fe2-abf4-7acf17214657,network=Network(56e4e469-bfda-4ab1-9fdd-e3aa1a0655fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb74c6e68-89') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:49:56 user nova-compute[103546]: DEBUG os_vif [None req-229b9502-3111-421d-9e76-e2b6de1a7baf tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:09:2f,bridge_name='br-int',has_traffic_filtering=True,id=b74c6e68-89ec-4fe2-abf4-7acf17214657,network=Network(56e4e469-bfda-4ab1-9fdd-e3aa1a0655fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb74c6e68-89') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 03:49:56 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:56 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:56 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb74c6e68-89, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:49:56 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:56 user nova-compute[103546]: INFO os_vif [None req-d21968b9-7a6c-4264-a2e5-e6e1b1e13bdf tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:8e:90,bridge_name='br-int',has_traffic_filtering=True,id=38395643-bb34-441c-ab0e-c9201f35ec04,network=Network(32de335d-6f62-41f6-8520-1cc09523ef83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38395643-bb')
Nov 16 03:49:56 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-d21968b9-7a6c-4264-a2e5-e6e1b1e13bdf tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Deleting instance files /opt/stack/data/nova/instances/c24a386f-32f5-4095-b2b3-69a70a54ff66_del
Nov 16 03:49:56 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-d21968b9-7a6c-4264-a2e5-e6e1b1e13bdf tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Deletion of /opt/stack/data/nova/instances/c24a386f-32f5-4095-b2b3-69a70a54ff66_del complete
Nov 16 03:49:56 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:56 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dde30abc-7345-4e96-a604-ac063858d5b6) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:49:56 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:56 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:49:56 user nova-compute[103546]: INFO os_vif [None req-229b9502-3111-421d-9e76-e2b6de1a7baf tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:09:2f,bridge_name='br-int',has_traffic_filtering=True,id=b74c6e68-89ec-4fe2-abf4-7acf17214657,network=Network(56e4e469-bfda-4ab1-9fdd-e3aa1a0655fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb74c6e68-89')
Nov 16 03:49:56 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-229b9502-3111-421d-9e76-e2b6de1a7baf tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c] Deleting instance files /opt/stack/data/nova/instances/7e347e48-0b4e-4ce6-a677-5d1dc099ac6c_del
Nov 16 03:49:56 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-229b9502-3111-421d-9e76-e2b6de1a7baf tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c] Deletion of /opt/stack/data/nova/instances/7e347e48-0b4e-4ce6-a677-5d1dc099ac6c_del complete
Nov 16 03:49:56 user nova-compute[103546]: INFO nova.compute.manager [None req-d21968b9-7a6c-4264-a2e5-e6e1b1e13bdf tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Took 1.50 seconds to destroy the instance on the hypervisor.
Nov 16 03:49:56 user nova-compute[103546]: DEBUG oslo.service.loopingcall [None req-d21968b9-7a6c-4264-a2e5-e6e1b1e13bdf tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=103546) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 03:49:56 user nova-compute[103546]: DEBUG nova.compute.manager [-] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Deallocating network for instance {{(pid=103546) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 03:49:56 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] deallocate_for_instance() {{(pid=103546) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 03:49:56 user nova-compute[103546]: INFO nova.compute.manager [None req-229b9502-3111-421d-9e76-e2b6de1a7baf tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c] Took 1.04 seconds to destroy the instance on the hypervisor.
Nov 16 03:49:56 user nova-compute[103546]: DEBUG oslo.service.loopingcall [None req-229b9502-3111-421d-9e76-e2b6de1a7baf tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=103546) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 03:49:56 user nova-compute[103546]: DEBUG nova.compute.manager [-] [instance: 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c] Deallocating network for instance {{(pid=103546) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 03:49:56 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c] deallocate_for_instance() {{(pid=103546) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 03:49:56 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:56 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:56 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:56 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:56 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:56 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:49:56 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:49:56 user nova-compute[103546]: INFO nova.compute.manager [-] [instance: 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c] Took 0.45 seconds to deallocate network for instance.
Nov 16 03:49:56 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-229b9502-3111-421d-9e76-e2b6de1a7baf tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:56 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-229b9502-3111-421d-9e76-e2b6de1a7baf tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:57 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-229b9502-3111-421d-9e76-e2b6de1a7baf tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:49:57 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-229b9502-3111-421d-9e76-e2b6de1a7baf tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:49:57 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:49:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-229b9502-3111-421d-9e76-e2b6de1a7baf tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.287s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:57 user nova-compute[103546]: INFO nova.compute.manager [-] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Took 0.81 seconds to deallocate network for instance.
Nov 16 03:49:57 user nova-compute[103546]: INFO nova.scheduler.client.report [None req-229b9502-3111-421d-9e76-e2b6de1a7baf tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Deleted allocations for instance 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c
Nov 16 03:49:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d21968b9-7a6c-4264-a2e5-e6e1b1e13bdf tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d21968b9-7a6c-4264-a2e5-e6e1b1e13bdf tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-229b9502-3111-421d-9e76-e2b6de1a7baf tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Lock "7e347e48-0b4e-4ce6-a677-5d1dc099ac6c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.964s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:57 user nova-compute[103546]: DEBUG nova.compute.manager [req-9b7e3d38-4827-4211-8f05-f68885ecdf12 req-0e039e27-74d5-4fbb-87af-2e7ef20aca3a service nova] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Received event network-vif-plugged-38395643-bb34-441c-ab0e-c9201f35ec04 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:49:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-9b7e3d38-4827-4211-8f05-f68885ecdf12 req-0e039e27-74d5-4fbb-87af-2e7ef20aca3a service nova] Acquiring lock "c24a386f-32f5-4095-b2b3-69a70a54ff66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-9b7e3d38-4827-4211-8f05-f68885ecdf12 req-0e039e27-74d5-4fbb-87af-2e7ef20aca3a service nova] Lock "c24a386f-32f5-4095-b2b3-69a70a54ff66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-9b7e3d38-4827-4211-8f05-f68885ecdf12 req-0e039e27-74d5-4fbb-87af-2e7ef20aca3a service nova] Lock "c24a386f-32f5-4095-b2b3-69a70a54ff66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:57 user nova-compute[103546]: DEBUG nova.compute.manager [req-9b7e3d38-4827-4211-8f05-f68885ecdf12 req-0e039e27-74d5-4fbb-87af-2e7ef20aca3a service nova] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] No waiting events found dispatching network-vif-plugged-38395643-bb34-441c-ab0e-c9201f35ec04 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:49:57 user nova-compute[103546]: WARNING nova.compute.manager [req-9b7e3d38-4827-4211-8f05-f68885ecdf12 req-0e039e27-74d5-4fbb-87af-2e7ef20aca3a service nova] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Received unexpected event network-vif-plugged-38395643-bb34-441c-ab0e-c9201f35ec04 for instance with vm_state deleted and task_state None.
Nov 16 03:49:57 user nova-compute[103546]: DEBUG nova.compute.manager [req-9b7e3d38-4827-4211-8f05-f68885ecdf12 req-0e039e27-74d5-4fbb-87af-2e7ef20aca3a service nova] [instance: c24a386f-32f5-4095-b2b3-69a70a54ff66] Received event network-vif-deleted-38395643-bb34-441c-ab0e-c9201f35ec04 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:49:57 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-d21968b9-7a6c-4264-a2e5-e6e1b1e13bdf tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:49:57 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-d21968b9-7a6c-4264-a2e5-e6e1b1e13bdf tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:49:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d21968b9-7a6c-4264-a2e5-e6e1b1e13bdf tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.279s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:57 user nova-compute[103546]: INFO nova.scheduler.client.report [None req-d21968b9-7a6c-4264-a2e5-e6e1b1e13bdf tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Deleted allocations for instance c24a386f-32f5-4095-b2b3-69a70a54ff66
Nov 16 03:49:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d21968b9-7a6c-4264-a2e5-e6e1b1e13bdf tempest-TestVolumeSwap-857315174 tempest-TestVolumeSwap-857315174-project-member] Lock "c24a386f-32f5-4095-b2b3-69a70a54ff66" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.783s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:57 user nova-compute[103546]: DEBUG nova.compute.manager [req-4c2c7140-b8ad-4912-bc5b-5fd09755a422 req-b70b257b-0fee-4c9b-9230-3dce89812408 service nova] [instance: 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c] Received event network-vif-plugged-b74c6e68-89ec-4fe2-abf4-7acf17214657 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:49:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-4c2c7140-b8ad-4912-bc5b-5fd09755a422 req-b70b257b-0fee-4c9b-9230-3dce89812408 service nova] Acquiring lock "7e347e48-0b4e-4ce6-a677-5d1dc099ac6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:49:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-4c2c7140-b8ad-4912-bc5b-5fd09755a422 req-b70b257b-0fee-4c9b-9230-3dce89812408 service nova] Lock "7e347e48-0b4e-4ce6-a677-5d1dc099ac6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:49:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-4c2c7140-b8ad-4912-bc5b-5fd09755a422 req-b70b257b-0fee-4c9b-9230-3dce89812408 service nova] Lock "7e347e48-0b4e-4ce6-a677-5d1dc099ac6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:49:57 user nova-compute[103546]: DEBUG nova.compute.manager [req-4c2c7140-b8ad-4912-bc5b-5fd09755a422 req-b70b257b-0fee-4c9b-9230-3dce89812408 service nova] [instance: 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c] No waiting events found dispatching network-vif-plugged-b74c6e68-89ec-4fe2-abf4-7acf17214657 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:49:57 user nova-compute[103546]: WARNING nova.compute.manager [req-4c2c7140-b8ad-4912-bc5b-5fd09755a422 req-b70b257b-0fee-4c9b-9230-3dce89812408 service nova] [instance: 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c] Received unexpected event network-vif-plugged-b74c6e68-89ec-4fe2-abf4-7acf17214657 for instance with vm_state deleted and task_state None.
Nov 16 03:49:57 user nova-compute[103546]: DEBUG nova.compute.manager [req-4c2c7140-b8ad-4912-bc5b-5fd09755a422 req-b70b257b-0fee-4c9b-9230-3dce89812408 service nova] [instance: 7e347e48-0b4e-4ce6-a677-5d1dc099ac6c] Received event network-vif-deleted-b74c6e68-89ec-4fe2-abf4-7acf17214657 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:49:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:00 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1ad3a246-a34e-46d3-9b6f-78db8935b5f9 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Acquiring lock "63b95121-b211-42c3-831e-0392d4abd09a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:50:00 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1ad3a246-a34e-46d3-9b6f-78db8935b5f9 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "63b95121-b211-42c3-831e-0392d4abd09a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:50:00 user nova-compute[103546]: INFO nova.compute.manager [None req-1ad3a246-a34e-46d3-9b6f-78db8935b5f9 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Detaching volume 7119d272-a013-4b8f-b80a-6b64111c42f9
Nov 16 03:50:00 user nova-compute[103546]: INFO nova.virt.block_device [None req-1ad3a246-a34e-46d3-9b6f-78db8935b5f9 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Attempting to driver detach volume 7119d272-a013-4b8f-b80a-6b64111c42f9 from mountpoint /dev/vdb
Nov 16 03:50:00 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1ad3a246-a34e-46d3-9b6f-78db8935b5f9 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Attempting to detach device vdb from instance 63b95121-b211-42c3-831e-0392d4abd09a from the persistent domain config. {{(pid=103546) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 03:50:00 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-1ad3a246-a34e-46d3-9b6f-78db8935b5f9 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 03:50:00 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 03:50:00 user nova-compute[103546]:   <source dev="/dev/sdc"/>
Nov 16 03:50:00 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 03:50:00 user nova-compute[103546]:   <serial>7119d272-a013-4b8f-b80a-6b64111c42f9</serial>
Nov 16 03:50:00 user nova-compute[103546]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 03:50:00 user nova-compute[103546]: </disk>
Nov 16 03:50:00 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 03:50:00 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-1ad3a246-a34e-46d3-9b6f-78db8935b5f9 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Successfully detached device vdb from instance 63b95121-b211-42c3-831e-0392d4abd09a from the persistent domain config.
Nov 16 03:50:00 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1ad3a246-a34e-46d3-9b6f-78db8935b5f9 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 63b95121-b211-42c3-831e-0392d4abd09a from the live domain config. {{(pid=103546) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 03:50:00 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-1ad3a246-a34e-46d3-9b6f-78db8935b5f9 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 03:50:00 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 03:50:00 user nova-compute[103546]:   <source dev="/dev/sdc"/>
Nov 16 03:50:00 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 03:50:00 user nova-compute[103546]:   <serial>7119d272-a013-4b8f-b80a-6b64111c42f9</serial>
Nov 16 03:50:00 user nova-compute[103546]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 03:50:00 user nova-compute[103546]: </disk>
Nov 16 03:50:00 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 03:50:00 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1ad3a246-a34e-46d3-9b6f-78db8935b5f9 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 63b95121-b211-42c3-831e-0392d4abd09a {{(pid=103546) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 03:50:01 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-8f4212df-bf40-4398-9b40-83f61d2f64d9 tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Acquiring lock "549ee3db-0014-440f-bd3a-0d389f5eab88" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:50:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-8f4212df-bf40-4398-9b40-83f61d2f64d9 tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Lock "549ee3db-0014-440f-bd3a-0d389f5eab88" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:50:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-8f4212df-bf40-4398-9b40-83f61d2f64d9 tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Acquiring lock "549ee3db-0014-440f-bd3a-0d389f5eab88-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:50:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-8f4212df-bf40-4398-9b40-83f61d2f64d9 tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Lock "549ee3db-0014-440f-bd3a-0d389f5eab88-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:50:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-8f4212df-bf40-4398-9b40-83f61d2f64d9 tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Lock "549ee3db-0014-440f-bd3a-0d389f5eab88-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:50:03 user nova-compute[103546]: INFO nova.compute.manager [None req-8f4212df-bf40-4398-9b40-83f61d2f64d9 tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Terminating instance
Nov 16 03:50:03 user nova-compute[103546]: DEBUG nova.compute.manager [None req-8f4212df-bf40-4398-9b40-83f61d2f64d9 tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Start destroying the instance on the hypervisor. {{(pid=103546) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 03:50:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:04 user nova-compute[103546]: DEBUG nova.compute.manager [req-8acb52bf-7cea-477d-872c-3a46bdcfae46 req-2ac50e48-aff0-4761-8b67-916e2467aa40 service nova] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Received event network-vif-unplugged-48a6af37-c461-4721-b870-432cf404dcf7 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:50:04 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8acb52bf-7cea-477d-872c-3a46bdcfae46 req-2ac50e48-aff0-4761-8b67-916e2467aa40 service nova] Acquiring lock "549ee3db-0014-440f-bd3a-0d389f5eab88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:50:04 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8acb52bf-7cea-477d-872c-3a46bdcfae46 req-2ac50e48-aff0-4761-8b67-916e2467aa40 service nova] Lock "549ee3db-0014-440f-bd3a-0d389f5eab88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:50:04 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8acb52bf-7cea-477d-872c-3a46bdcfae46 req-2ac50e48-aff0-4761-8b67-916e2467aa40 service nova] Lock "549ee3db-0014-440f-bd3a-0d389f5eab88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:50:04 user nova-compute[103546]: DEBUG nova.compute.manager [req-8acb52bf-7cea-477d-872c-3a46bdcfae46 req-2ac50e48-aff0-4761-8b67-916e2467aa40 service nova] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] No waiting events found dispatching network-vif-unplugged-48a6af37-c461-4721-b870-432cf404dcf7 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:50:04 user nova-compute[103546]: DEBUG nova.compute.manager [req-8acb52bf-7cea-477d-872c-3a46bdcfae46 req-2ac50e48-aff0-4761-8b67-916e2467aa40 service nova] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Received event network-vif-unplugged-48a6af37-c461-4721-b870-432cf404dcf7 for instance with task_state deleting. {{(pid=103546) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 03:50:04 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Instance destroyed successfully.
Nov 16 03:50:04 user nova-compute[103546]: DEBUG nova.objects.instance [None req-8f4212df-bf40-4398-9b40-83f61d2f64d9 tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Lazy-loading 'resources' on Instance uuid 549ee3db-0014-440f-bd3a-0d389f5eab88 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:50:04 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-8f4212df-bf40-4398-9b40-83f61d2f64d9 tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T03:46:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-350344638',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-350344638',id=7,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJC87S7hgP6v1mMgMgWP5mrEmsB7FxLODxvVGTyu4rK6Vav//N6bGlF4cB4wdjC5yBjD4JDskSZdj5aiBMflE+VUYysZErN4auZ89tuKfEpG07XZH2cPGYOTHxF0eBL3Dw==',key_name='tempest-keypair-83664986',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:46:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4445eb24618042ab9d24c869de5ccaab',ramdisk_id='',reservation_id='r-s6hqst93',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-401054631',owner_user_name='tempest-TaggedAttachmentsTest-401054631-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T03:46:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='843e14f393d849a9abc7759907a303ea',uuid=549ee3db-0014-440f-bd3a-0d389f5eab88,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "48a6af37-c461-4721-b870-432cf404dcf7", "address": "fa:16:3e:5b:50:00", "network": {"id": "4c04adce-4d50-4cc1-8c17-5cebba34fbec", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-399866268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4445eb24618042ab9d24c869de5ccaab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48a6af37-c4", "ovs_interfaceid": "48a6af37-c461-4721-b870-432cf404dcf7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 03:50:04 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-8f4212df-bf40-4398-9b40-83f61d2f64d9 tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Converting VIF {"id": "48a6af37-c461-4721-b870-432cf404dcf7", "address": "fa:16:3e:5b:50:00", "network": {"id": "4c04adce-4d50-4cc1-8c17-5cebba34fbec", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-399866268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4445eb24618042ab9d24c869de5ccaab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48a6af37-c4", "ovs_interfaceid": "48a6af37-c461-4721-b870-432cf404dcf7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:50:04 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-8f4212df-bf40-4398-9b40-83f61d2f64d9 tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:50:00,bridge_name='br-int',has_traffic_filtering=True,id=48a6af37-c461-4721-b870-432cf404dcf7,network=Network(4c04adce-4d50-4cc1-8c17-5cebba34fbec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48a6af37-c4') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:50:04 user nova-compute[103546]: DEBUG os_vif [None req-8f4212df-bf40-4398-9b40-83f61d2f64d9 tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:50:00,bridge_name='br-int',has_traffic_filtering=True,id=48a6af37-c461-4721-b870-432cf404dcf7,network=Network(4c04adce-4d50-4cc1-8c17-5cebba34fbec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48a6af37-c4') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 03:50:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap48a6af37-c4, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:50:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:50:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dc5fcd5f-5d3d-42f2-bfe9-d3b8f33e9dbe) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:50:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:04 user nova-compute[103546]: INFO os_vif [None req-8f4212df-bf40-4398-9b40-83f61d2f64d9 tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:50:00,bridge_name='br-int',has_traffic_filtering=True,id=48a6af37-c461-4721-b870-432cf404dcf7,network=Network(4c04adce-4d50-4cc1-8c17-5cebba34fbec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48a6af37-c4')
Nov 16 03:50:04 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-8f4212df-bf40-4398-9b40-83f61d2f64d9 tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Deleting instance files /opt/stack/data/nova/instances/549ee3db-0014-440f-bd3a-0d389f5eab88_del
Nov 16 03:50:04 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-8f4212df-bf40-4398-9b40-83f61d2f64d9 tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Deletion of /opt/stack/data/nova/instances/549ee3db-0014-440f-bd3a-0d389f5eab88_del complete
Nov 16 03:50:04 user nova-compute[103546]: INFO nova.compute.manager [None req-8f4212df-bf40-4398-9b40-83f61d2f64d9 tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 16 03:50:04 user nova-compute[103546]: DEBUG oslo.service.loopingcall [None req-8f4212df-bf40-4398-9b40-83f61d2f64d9 tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=103546) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 03:50:04 user nova-compute[103546]: DEBUG nova.compute.manager [-] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Deallocating network for instance {{(pid=103546) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 03:50:04 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] deallocate_for_instance() {{(pid=103546) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 03:50:05 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:50:05 user nova-compute[103546]: INFO nova.compute.manager [-] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Took 1.28 seconds to deallocate network for instance.
Nov 16 03:50:05 user nova-compute[103546]: DEBUG nova.compute.manager [req-4d041c53-93aa-4ee2-acd7-7d3333f157fd req-3755f315-20b0-4244-93f9-2fc624b4ebb9 service nova] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Received event network-vif-deleted-48a6af37-c461-4721-b870-432cf404dcf7 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:50:05 user nova-compute[103546]: INFO nova.compute.manager [req-4d041c53-93aa-4ee2-acd7-7d3333f157fd req-3755f315-20b0-4244-93f9-2fc624b4ebb9 service nova] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Neutron deleted interface 48a6af37-c461-4721-b870-432cf404dcf7; detaching it from the instance and deleting it from the info cache
Nov 16 03:50:05 user nova-compute[103546]: DEBUG nova.network.neutron [req-4d041c53-93aa-4ee2-acd7-7d3333f157fd req-3755f315-20b0-4244-93f9-2fc624b4ebb9 service nova] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:50:06 user nova-compute[103546]: DEBUG nova.compute.manager [req-4d041c53-93aa-4ee2-acd7-7d3333f157fd req-3755f315-20b0-4244-93f9-2fc624b4ebb9 service nova] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Detach interface failed, port_id=48a6af37-c461-4721-b870-432cf404dcf7, reason: Instance 549ee3db-0014-440f-bd3a-0d389f5eab88 could not be found. {{(pid=103546) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 03:50:06 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-8f4212df-bf40-4398-9b40-83f61d2f64d9 tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:50:06 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-8f4212df-bf40-4398-9b40-83f61d2f64d9 tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:50:06 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-8f4212df-bf40-4398-9b40-83f61d2f64d9 tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:50:06 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-8f4212df-bf40-4398-9b40-83f61d2f64d9 tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:50:06 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-8f4212df-bf40-4398-9b40-83f61d2f64d9 tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.274s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:50:06 user nova-compute[103546]: DEBUG nova.compute.manager [req-8b9a5f67-f505-4a48-80b8-6bd045a76b26 req-1538c13b-9ef5-4266-9f5e-ebbd58280f33 service nova] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Received event network-vif-plugged-48a6af37-c461-4721-b870-432cf404dcf7 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:50:06 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8b9a5f67-f505-4a48-80b8-6bd045a76b26 req-1538c13b-9ef5-4266-9f5e-ebbd58280f33 service nova] Acquiring lock "549ee3db-0014-440f-bd3a-0d389f5eab88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:50:06 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8b9a5f67-f505-4a48-80b8-6bd045a76b26 req-1538c13b-9ef5-4266-9f5e-ebbd58280f33 service nova] Lock "549ee3db-0014-440f-bd3a-0d389f5eab88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:50:06 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8b9a5f67-f505-4a48-80b8-6bd045a76b26 req-1538c13b-9ef5-4266-9f5e-ebbd58280f33 service nova] Lock "549ee3db-0014-440f-bd3a-0d389f5eab88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:50:06 user nova-compute[103546]: DEBUG nova.compute.manager [req-8b9a5f67-f505-4a48-80b8-6bd045a76b26 req-1538c13b-9ef5-4266-9f5e-ebbd58280f33 service nova] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] No waiting events found dispatching network-vif-plugged-48a6af37-c461-4721-b870-432cf404dcf7 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:50:06 user nova-compute[103546]: WARNING nova.compute.manager [req-8b9a5f67-f505-4a48-80b8-6bd045a76b26 req-1538c13b-9ef5-4266-9f5e-ebbd58280f33 service nova] [instance: 549ee3db-0014-440f-bd3a-0d389f5eab88] Received unexpected event network-vif-plugged-48a6af37-c461-4721-b870-432cf404dcf7 for instance with vm_state deleted and task_state None.
Nov 16 03:50:06 user nova-compute[103546]: INFO nova.scheduler.client.report [None req-8f4212df-bf40-4398-9b40-83f61d2f64d9 tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Deleted allocations for instance 549ee3db-0014-440f-bd3a-0d389f5eab88
Nov 16 03:50:06 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-8f4212df-bf40-4398-9b40-83f61d2f64d9 tempest-TaggedAttachmentsTest-401054631 tempest-TaggedAttachmentsTest-401054631-project-member] Lock "549ee3db-0014-440f-bd3a-0d389f5eab88" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.876s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:50:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:09 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Acquiring lock "7862d05d-4293-46a5-98aa-41967a572fe3" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:50:09 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "7862d05d-4293-46a5-98aa-41967a572fe3" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:50:09 user nova-compute[103546]: INFO nova.compute.manager [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Unshelving
Nov 16 03:50:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:09 user nova-compute[103546]: INFO nova.virt.block_device [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Booting with volume 17c96a71-8e3c-44ff-aaf7-ccadc227b7e9 at /dev/vdc
Nov 16 03:50:09 user nova-compute[103546]: DEBUG os_brick.utils [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:50:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:09 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b662b79-d23f-410c-b1cd-5fa20f9973d0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af5c39b14ece\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:50:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:09 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1b747c-26a4-465b-b686-93a7fafd4083]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:50:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:09 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[23dc7715-7a6b-4963-8d9d-3169abb04320]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:50:09 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b1a79c-64ae-49ad-a3c6-a66167198200]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:50:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Running cmd (subprocess): nvme version {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] 'nvme version' failed. Not Retrying. {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:50:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] nvme not present on system {{(pid=103546) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 03:50:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:50:09 user nova-compute[103546]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 03:50:09 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29c7bb3-c502-4671-a618-bf4f8e652ccd]: (4, '') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:50:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=103546) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 03:50:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 03:50:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] LIGHTOS: no hostnqn found. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 03:50:09 user nova-compute[103546]: DEBUG os_brick.utils [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af5c39b14ece', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:50:09 user nova-compute[103546]: DEBUG nova.virt.block_device [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Updating existing volume attachment record: fb7f878d-f30b-4539-80e7-9bc58f28f4cc {{(pid=103546) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 03:50:12 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:50:12 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:50:12 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:50:12 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Starting heal instance info cache {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 03:50:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "refresh_cache-05c929d5-2f1c-4be4-8864-6ec81625daac" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:50:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquired lock "refresh_cache-05c929d5-2f1c-4be4-8864-6ec81625daac" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:50:12 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Forcefully refreshing network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 03:50:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:13 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Updating instance_info_cache with network_info: [{"id": "6283c5fe-57f3-4552-b0cd-5d05b38e983c", "address": "fa:16:3e:4d:ec:83", "network": {"id": "1a48a5d8-8046-4baf-9b30-4505213d862a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1526890096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998b2147e8194af3a15fce90bc7063b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6283c5fe-57", "ovs_interfaceid": "6283c5fe-57f3-4552-b0cd-5d05b38e983c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:50:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Releasing lock "refresh_cache-05c929d5-2f1c-4be4-8864-6ec81625daac" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:50:13 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Updated the network info_cache for instance {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 03:50:13 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:50:13 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:50:13 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:50:13 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:50:13 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:50:13 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:50:13 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=103546) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 03:50:13 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager.update_available_resource {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:50:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:50:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:50:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:50:13 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Auditing locally available compute resources for user (node: user) {{(pid=103546) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 03:50:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63b95121-b211-42c3-831e-0392d4abd09a/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63b95121-b211-42c3-831e-0392d4abd09a/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63b95121-b211-42c3-831e-0392d4abd09a/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63b95121-b211-42c3-831e-0392d4abd09a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c929d5-2f1c-4be4-8864-6ec81625daac/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c929d5-2f1c-4be4-8864-6ec81625daac/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c929d5-2f1c-4be4-8864-6ec81625daac/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c929d5-2f1c-4be4-8864-6ec81625daac/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e2954-d786-4544-903d-8edc63646e2d/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e2954-d786-4544-903d-8edc63646e2d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e2954-d786-4544-903d-8edc63646e2d/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e2954-d786-4544-903d-8edc63646e2d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddaf87db-e525-4839-a538-4b766b3e875a/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddaf87db-e525-4839-a538-4b766b3e875a/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddaf87db-e525-4839-a538-4b766b3e875a/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:50:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.007s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:50:15 user nova-compute[103546]: DEBUG nova.objects.instance [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lazy-loading 'pci_requests' on Instance uuid 7862d05d-4293-46a5-98aa-41967a572fe3 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:50:15 user nova-compute[103546]: DEBUG nova.objects.instance [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lazy-loading 'numa_topology' on Instance uuid 7862d05d-4293-46a5-98aa-41967a572fe3 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:50:15 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=103546) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 03:50:15 user nova-compute[103546]: INFO nova.compute.claims [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Claim successful on node user
Nov 16 03:50:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddaf87db-e525-4839-a538-4b766b3e875a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51554aab-44ec-4161-b926-9c07a3f838a5/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51554aab-44ec-4161-b926-9c07a3f838a5/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51554aab-44ec-4161-b926-9c07a3f838a5/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:15 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:50:15 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:50:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51554aab-44ec-4161-b926-9c07a3f838a5/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:15 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 03:50:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.581s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:50:16 user nova-compute[103546]: INFO nova.network.neutron [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Updating port 26fd759d-5cb8-4798-ab59-c7f5cb7773e8 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 16 03:50:16 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:50:16 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:50:16 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Hypervisor/Node resource view: name=user free_ram=8080MB free_disk=25.53573226928711GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=103546) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 03:50:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:50:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:50:16 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Applying migration context for instance 51554aab-44ec-4161-b926-9c07a3f838a5 as it has an incoming, in-progress migration 3b29b254-f016-4d50-9bc9-d37b6945b409. Migration status is finished {{(pid=103546) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 16 03:50:16 user nova-compute[103546]: INFO nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Updating resource usage from migration 3b29b254-f016-4d50-9bc9-d37b6945b409
Nov 16 03:50:16 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 279e2954-d786-4544-903d-8edc63646e2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:50:16 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 05c929d5-2f1c-4be4-8864-6ec81625daac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:50:16 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 63b95121-b211-42c3-831e-0392d4abd09a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:50:16 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Migration 3b29b254-f016-4d50-9bc9-d37b6945b409 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 16 03:50:16 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 51554aab-44ec-4161-b926-9c07a3f838a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:50:16 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance ddaf87db-e525-4839-a538-4b766b3e875a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:50:16 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (0b01254b-dc4d-4d00-a9a7-dd4ef815de7a): {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Nov 16 03:50:16 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 03:50:16 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=25GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 03:50:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:16 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:50:16 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:50:16 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Compute_service record updated for user:user {{(pid=103546) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 03:50:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.529s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:50:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Acquiring lock "refresh_cache-7862d05d-4293-46a5-98aa-41967a572fe3" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:50:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Acquired lock "refresh_cache-7862d05d-4293-46a5-98aa-41967a572fe3" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:50:16 user nova-compute[103546]: DEBUG nova.network.neutron [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 03:50:16 user nova-compute[103546]: DEBUG nova.compute.manager [req-951647d1-d4b6-41a6-9629-c06ad7e56cce req-17de42fc-6324-4d8a-af74-d8eccffd0d8c service nova] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Received event network-changed-26fd759d-5cb8-4798-ab59-c7f5cb7773e8 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:50:16 user nova-compute[103546]: DEBUG nova.compute.manager [req-951647d1-d4b6-41a6-9629-c06ad7e56cce req-17de42fc-6324-4d8a-af74-d8eccffd0d8c service nova] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Refreshing instance network info cache due to event network-changed-26fd759d-5cb8-4798-ab59-c7f5cb7773e8. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:50:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-951647d1-d4b6-41a6-9629-c06ad7e56cce req-17de42fc-6324-4d8a-af74-d8eccffd0d8c service nova] Acquiring lock "refresh_cache-7862d05d-4293-46a5-98aa-41967a572fe3" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:50:17 user nova-compute[103546]: DEBUG nova.network.neutron [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Updating instance_info_cache with network_info: [{"id": "26fd759d-5cb8-4798-ab59-c7f5cb7773e8", "address": "fa:16:3e:a0:1a:6c", "network": {"id": "b2fca984-f1e9-4c86-a3a5-b8d5b9950555", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-172535633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63722fdf17e4408299de8c215c133812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26fd759d-5c", "ovs_interfaceid": "26fd759d-5cb8-4798-ab59-c7f5cb7773e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:50:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Releasing lock "refresh_cache-7862d05d-4293-46a5-98aa-41967a572fe3" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:50:17 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Creating instance directory {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 03:50:17 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Creating image(s)
Nov 16 03:50:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Acquiring lock "/opt/stack/data/nova/instances/7862d05d-4293-46a5-98aa-41967a572fe3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:50:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "/opt/stack/data/nova/instances/7862d05d-4293-46a5-98aa-41967a572fe3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:50:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "/opt/stack/data/nova/instances/7862d05d-4293-46a5-98aa-41967a572fe3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:50:17 user nova-compute[103546]: DEBUG nova.objects.instance [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7862d05d-4293-46a5-98aa-41967a572fe3 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:50:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-951647d1-d4b6-41a6-9629-c06ad7e56cce req-17de42fc-6324-4d8a-af74-d8eccffd0d8c service nova] Acquired lock "refresh_cache-7862d05d-4293-46a5-98aa-41967a572fe3" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:50:17 user nova-compute[103546]: DEBUG nova.network.neutron [req-951647d1-d4b6-41a6-9629-c06ad7e56cce req-17de42fc-6324-4d8a-af74-d8eccffd0d8c service nova] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Refreshing network info cache for port 26fd759d-5cb8-4798-ab59-c7f5cb7773e8 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:50:17 user nova-compute[103546]: DEBUG nova.objects.base [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Object Instance<7862d05d-4293-46a5-98aa-41967a572fe3> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 03:50:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Acquiring lock "9aacccc48d0fa1178106af598e9de8d7663e3e2d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:50:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "9aacccc48d0fa1178106af598e9de8d7663e3e2d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:50:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9aacccc48d0fa1178106af598e9de8d7663e3e2d.part --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:18 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9aacccc48d0fa1178106af598e9de8d7663e3e2d.part --force-share --output=json" returned: 0 in 0.201s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:18 user nova-compute[103546]: DEBUG nova.virt.images [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] 10327314-f1c6-4bb6-b137-cf23d91a2e92 was qcow2, converting to raw {{(pid=103546) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 03:50:18 user nova-compute[103546]: DEBUG nova.privsep.utils [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=103546) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 03:50:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9aacccc48d0fa1178106af598e9de8d7663e3e2d.part /opt/stack/data/nova/instances/_base/9aacccc48d0fa1178106af598e9de8d7663e3e2d.converted {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:18 user nova-compute[103546]: DEBUG nova.network.neutron [req-951647d1-d4b6-41a6-9629-c06ad7e56cce req-17de42fc-6324-4d8a-af74-d8eccffd0d8c service nova] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Updated VIF entry in instance network info cache for port 26fd759d-5cb8-4798-ab59-c7f5cb7773e8. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 03:50:18 user nova-compute[103546]: DEBUG nova.network.neutron [req-951647d1-d4b6-41a6-9629-c06ad7e56cce req-17de42fc-6324-4d8a-af74-d8eccffd0d8c service nova] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Updating instance_info_cache with network_info: [{"id": "26fd759d-5cb8-4798-ab59-c7f5cb7773e8", "address": "fa:16:3e:a0:1a:6c", "network": {"id": "b2fca984-f1e9-4c86-a3a5-b8d5b9950555", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-172535633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63722fdf17e4408299de8c215c133812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26fd759d-5c", "ovs_interfaceid": "26fd759d-5cb8-4798-ab59-c7f5cb7773e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:50:18 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-951647d1-d4b6-41a6-9629-c06ad7e56cce req-17de42fc-6324-4d8a-af74-d8eccffd0d8c service nova] Releasing lock "refresh_cache-7862d05d-4293-46a5-98aa-41967a572fe3" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:50:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9aacccc48d0fa1178106af598e9de8d7663e3e2d.part /opt/stack/data/nova/instances/_base/9aacccc48d0fa1178106af598e9de8d7663e3e2d.converted" returned: 0 in 0.407s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9aacccc48d0fa1178106af598e9de8d7663e3e2d.converted --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9aacccc48d0fa1178106af598e9de8d7663e3e2d.converted --force-share --output=json" returned: 0 in 0.231s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "9aacccc48d0fa1178106af598e9de8d7663e3e2d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.841s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:50:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9aacccc48d0fa1178106af598e9de8d7663e3e2d --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9aacccc48d0fa1178106af598e9de8d7663e3e2d --force-share --output=json" returned: 0 in 0.195s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Acquiring lock "9aacccc48d0fa1178106af598e9de8d7663e3e2d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:50:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "9aacccc48d0fa1178106af598e9de8d7663e3e2d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:50:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9aacccc48d0fa1178106af598e9de8d7663e3e2d --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:19 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9aacccc48d0fa1178106af598e9de8d7663e3e2d --force-share --output=json" returned: 0 in 0.181s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9aacccc48d0fa1178106af598e9de8d7663e3e2d,backing_fmt=raw /opt/stack/data/nova/instances/7862d05d-4293-46a5-98aa-41967a572fe3/disk 1073741824 {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9aacccc48d0fa1178106af598e9de8d7663e3e2d,backing_fmt=raw /opt/stack/data/nova/instances/7862d05d-4293-46a5-98aa-41967a572fe3/disk 1073741824" returned: 0 in 0.066s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "9aacccc48d0fa1178106af598e9de8d7663e3e2d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:50:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9aacccc48d0fa1178106af598e9de8d7663e3e2d --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9aacccc48d0fa1178106af598e9de8d7663e3e2d --force-share --output=json" returned: 0 in 0.202s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:19 user nova-compute[103546]: DEBUG nova.objects.instance [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lazy-loading 'migration_context' on Instance uuid 7862d05d-4293-46a5-98aa-41967a572fe3 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:50:19 user nova-compute[103546]: DEBUG nova.objects.base [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Object Instance<7862d05d-4293-46a5-98aa-41967a572fe3> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 03:50:19 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Rebasing disk image.
Nov 16 03:50:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.180s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 -F raw /opt/stack/data/nova/instances/7862d05d-4293-46a5-98aa-41967a572fe3/disk {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:20 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-1ad3a246-a34e-46d3-9b6f-78db8935b5f9 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 63b95121-b211-42c3-831e-0392d4abd09a is timed out.
Nov 16 03:50:20 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-1ad3a246-a34e-46d3-9b6f-78db8935b5f9 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Successfully detached device vdb from instance 63b95121-b211-42c3-831e-0392d4abd09a from the live domain config.
Nov 16 03:50:20 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ad3a246-a34e-46d3-9b6f-78db8935b5f9 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 03:50:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad3a246-a34e-46d3-9b6f-78db8935b5f9 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:7119d272-a013-4b8f-b80a-6b64111c42f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QgBiMYRo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:50:20 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-1ad3a246-a34e-46d3-9b6f-78db8935b5f9 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:50:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-1ad3a246-a34e-46d3-9b6f-78db8935b5f9 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:50:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-1ad3a246-a34e-46d3-9b6f-78db8935b5f9 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:50:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:20 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[dacf8232-9bec-4ceb-8e6e-c15a82c69488]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7119d272-a013-4b8f-b80a-6b64111c42f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:50:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad3a246-a34e-46d3-9b6f-78db8935b5f9 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 03:50:20 user nova-compute[103546]: No targets found.
Nov 16 03:50:20 user nova-compute[103546]: iSNS:
Nov 16 03:50:20 user nova-compute[103546]: No targets found.
Nov 16 03:50:20 user nova-compute[103546]: STATIC:
Nov 16 03:50:20 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:7119d272-a013-4b8f-b80a-6b64111c42f9
Nov 16 03:50:20 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:50:20 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:50:20 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c
Nov 16 03:50:20 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:50:20 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:50:20 user nova-compute[103546]: FIRMWARE:
Nov 16 03:50:20 user nova-compute[103546]: No targets found.
Nov 16 03:50:20 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:50:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad3a246-a34e-46d3-9b6f-78db8935b5f9 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 03:50:20 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 03:50:20 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 03:50:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad3a246-a34e-46d3-9b6f-78db8935b5f9 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7119d272-a013-4b8f-b80a-6b64111c42f9', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 03:50:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:20 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[79732836-a2a2-4c22-883a-211aa8b72c86]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7119d272-a013-4b8f-b80a-6b64111c42f9\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:50:20 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:20 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[156c270a-58d4-4f88-8c1e-d0d008c40438]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7119d272-a013-4b8f-b80a-6b64111c42f9 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:50:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad3a246-a34e-46d3-9b6f-78db8935b5f9 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)
Nov 16 03:50:20 user nova-compute[103546]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7119d272-a013-4b8f-b80a-6b64111c42f9 (non-flash)
Nov 16 03:50:20 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:50:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad3a246-a34e-46d3-9b6f-78db8935b5f9 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)
Nov 16 03:50:20 user nova-compute[103546]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7119d272-a013-4b8f-b80a-6b64111c42f9 (non-flash)
Nov 16 03:50:20 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:50:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad3a246-a34e-46d3-9b6f-78db8935b5f9 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60cc13c0d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7119d272-a013-4b8f-b80a-6b64111c42f9'): ({'sdc'}, set())}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 03:50:20 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-1ad3a246-a34e-46d3-9b6f-78db8935b5f9 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Removing single pathed devices sdc {{(pid=103546) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 03:50:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:20 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb51c93-4a98-4f44-a624-49d9d7851946]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:50:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:20 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[835e607e-8027-4340-9234-d91ef109d580]: (4, ('ok\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:50:20 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-1ad3a246-a34e-46d3-9b6f-78db8935b5f9 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Flushing IO for device /dev/sdc {{(pid=103546) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 03:50:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:20 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a8d976-04b7-4667-a307-ce427fab3d0a]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:50:20 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-1ad3a246-a34e-46d3-9b6f-78db8935b5f9 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=103546) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 03:50:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:20 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d65528-75e1-42ae-aa53-1cc6e32f8851]: (4, ('1', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:50:20 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-1ad3a246-a34e-46d3-9b6f-78db8935b5f9 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 03:50:20 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-1ad3a246-a34e-46d3-9b6f-78db8935b5f9 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] SCSI volumes sdc have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 03:50:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad3a246-a34e-46d3-9b6f-78db8935b5f9 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7119d272-a013-4b8f-b80a-6b64111c42f9')] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 03:50:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7119d272-a013-4b8f-b80a-6b64111c42f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7119d272-a013-4b8f-b80a-6b64111c42f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:20 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a7bc4a-b564-4fe1-91d4-a02bfcf3c90f]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:50:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad3a246-a34e-46d3-9b6f-78db8935b5f9 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:50:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7119d272-a013-4b8f-b80a-6b64111c42f9 -p 172.16.0.220:3260 --logout {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7119d272-a013-4b8f-b80a-6b64111c42f9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:20 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a2f1db-6e5e-48a8-841e-db7a4b223091]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:7119d272-a013-4b8f-b80a-6b64111c42f9, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:7119d272-a013-4b8f-b80a-6b64111c42f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:50:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad3a246-a34e-46d3-9b6f-78db8935b5f9 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:7119d272-a013-4b8f-b80a-6b64111c42f9, portal: 172.16.0.220,3260]
Nov 16 03:50:20 user nova-compute[103546]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:7119d272-a013-4b8f-b80a-6b64111c42f9, portal: 172.16.0.220,3260] successful.
Nov 16 03:50:20 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:50:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7119d272-a013-4b8f-b80a-6b64111c42f9 -p 172.16.0.220:3260 --op delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7119d272-a013-4b8f-b80a-6b64111c42f9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:20 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e85d4d-c970-493e-bfb1-ba76fa3eeebc]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:50:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad3a246-a34e-46d3-9b6f-78db8935b5f9 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:50:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-1ad3a246-a34e-46d3-9b6f-78db8935b5f9 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:50:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad3a246-a34e-46d3-9b6f-78db8935b5f9 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] <== disconnect_volume: return (309ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:50:20 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ad3a246-a34e-46d3-9b6f-78db8935b5f9 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 03:50:21 user nova-compute[103546]: DEBUG nova.objects.instance [None req-1ad3a246-a34e-46d3-9b6f-78db8935b5f9 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lazy-loading 'flavor' on Instance uuid 63b95121-b211-42c3-831e-0392d4abd09a {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:50:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1ad3a246-a34e-46d3-9b6f-78db8935b5f9 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "63b95121-b211-42c3-831e-0392d4abd09a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.857s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:50:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 -F raw /opt/stack/data/nova/instances/7862d05d-4293-46a5-98aa-41967a572fe3/disk" returned: 0 in 2.596s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:22 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Created local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 03:50:22 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Ensure instance console log exists: /opt/stack/data/nova/instances/7862d05d-4293-46a5-98aa-41967a572fe3/console.log {{(pid=103546) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 03:50:22 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:50:22 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:50:22 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:50:22 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Start _get_guest_xml network_info=[{"id": "26fd759d-5cb8-4798-ab59-c7f5cb7773e8", "address": "fa:16:3e:a0:1a:6c", "network": {"id": "b2fca984-f1e9-4c86-a3a5-b8d5b9950555", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-172535633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63722fdf17e4408299de8c215c133812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26fd759d-5c", "ovs_interfaceid": "26fd759d-5cb8-4798-ab59-c7f5cb7773e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='bbbaa57d7ca80c0991edef682f2e30f1',container_format='bare',created_at=2023-11-16T03:48:17Z,direct_url=<?>,disk_format='qcow2',id=10327314-f1c6-4bb6-b137-cf23d91a2e92,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1027244547-shelved',owner='63722fdf17e4408299de8c215c133812',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-16T03:48:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '5c6f539a-01e5-4478-bf8f-a14310b5d7dd'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FlujTcmh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '7862d05d-4293-46a5-98aa-41967a572fe3', 'attached_at': '', 'detached_at': '', 'volume_id': '17c96a71-8e3c-44ff-aaf7-ccadc227b7e9', 'serial': '17c96a71-8e3c-44ff-aaf7-ccadc227b7e9'}, 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'attachment_id': 'fb7f878d-f30b-4539-80e7-9bc58f28f4cc', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 03:50:22 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:50:22 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:50:22 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 03:50:22 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 03:50:22 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 03:50:22 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 03:50:22 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 03:50:22 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='bbbaa57d7ca80c0991edef682f2e30f1',container_format='bare',created_at=2023-11-16T03:48:17Z,direct_url=<?>,disk_format='qcow2',id=10327314-f1c6-4bb6-b137-cf23d91a2e92,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1027244547-shelved',owner='63722fdf17e4408299de8c215c133812',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-16T03:48:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 03:50:22 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 03:50:22 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 03:50:22 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 03:50:22 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 03:50:22 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 03:50:22 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 03:50:22 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 03:50:22 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 03:50:22 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 03:50:22 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 03:50:22 user nova-compute[103546]: DEBUG nova.objects.instance [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7862d05d-4293-46a5-98aa-41967a572fe3 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:50:22 user nova-compute[103546]: DEBUG nova.objects.base [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Object Instance<7862d05d-4293-46a5-98aa-41967a572fe3> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 03:50:22 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 03:50:22 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FlujTcmh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:50:22 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:50:22 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:50:22 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:50:22 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:50:22 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:50:22 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:50:22 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 03:50:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9 -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:22 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8b1fcc-b03e-4256-821e-2548a6d0086c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:50:22 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 03:50:22 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:50:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9 -p 172.16.0.220:3260 --interface default --op new {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:22 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28eaa8b-0982-4110-9cd4-8de427e35914]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9] added\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:50:22 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9] added
Nov 16 03:50:22 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:50:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:22 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2ac1eb-f331-45bd-92fc-e670bc26debb]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:50:22 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:50:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:22 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd4fc86-7cf2-43e6-97a7-f4613c7095bd]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:50:22 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:50:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FlujTcmh {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FlujTcmh" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:22 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd66c68-34c6-4a80-86df-12f463ba1ce2]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:50:22 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FlujTcmh'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:50:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:22 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c015004e-c37b-47e2-837e-4f6b85d89f10]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:50:22 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:50:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:22 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ed3122-8e32-4546-89a4-87c535164511]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:50:22 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)
Nov 16 03:50:22 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:50:22 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)
Nov 16 03:50:22 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:50:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9 -p 172.16.0.220:3260 --login {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:23 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[2032d99f-af22-48e7-9cd1-3a76f32828ca]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:50:23 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9, portal: 172.16.0.220,3260]
Nov 16 03:50:23 user nova-compute[103546]: Login to [iface: default, target: iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9, portal: 172.16.0.220,3260] successful.
Nov 16 03:50:23 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:50:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:23 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3471fd-a855-4377-8d47-dc06a5bdd574]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:50:23 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:50:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:23 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c970e7f-1ce6-4906-b38f-690958f682d1]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:50:23 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)
Nov 16 03:50:23 user nova-compute[103546]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9 (non-flash)
Nov 16 03:50:23 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:50:23 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)
Nov 16 03:50:23 user nova-compute[103546]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9 (non-flash)
Nov 16 03:50:23 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:50:23 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:50:23 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 03:50:23 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] HCTL ('34', '-', '-', 0) found on session 18 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 03:50:23 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 03:50:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:23 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f703b930-1fb8-4fb9-b0c2-d723549843e4]: (4, ('- - 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:50:23 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 03:50:23 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FlujTcmh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 03:50:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:50:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '26133383465333266', 'path': '/dev/sdc'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:50:24 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133383465333266', 'path': '/dev/sdc'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 03:50:24 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T03:46:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1027244547',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1027244547',id=3,image_ref='10327314-f1c6-4bb6-b137-cf23d91a2e92',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-494888',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:46:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='63722fdf17e4408299de8c215c133812',ramdisk_id='',reservation_id='r-l9s12mms',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1382373405',owner_user_name='tempest-AttachVolumeShelveTestJSON-1382373405-project-member',shelved_at='2023-11-16T03:48:22.217158',shelved_host='user',shelved_image_id='10327314-f1c6-4bb6-b137-cf23d91a2e92'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:50:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21d4e9052a614968bda331f028920ca7',uuid=7862d05d-4293-46a5-98aa-41967a572fe3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "26fd759d-5cb8-4798-ab59-c7f5cb7773e8", "address": "fa:16:3e:a0:1a:6c", "network": {"id": "b2fca984-f1e9-4c86-a3a5-b8d5b9950555", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-172535633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63722fdf17e4408299de8c215c133812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26fd759d-5c", "ovs_interfaceid": "26fd759d-5cb8-4798-ab59-c7f5cb7773e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 03:50:24 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Converting VIF {"id": "26fd759d-5cb8-4798-ab59-c7f5cb7773e8", "address": "fa:16:3e:a0:1a:6c", "network": {"id": "b2fca984-f1e9-4c86-a3a5-b8d5b9950555", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-172535633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63722fdf17e4408299de8c215c133812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26fd759d-5c", "ovs_interfaceid": "26fd759d-5cb8-4798-ab59-c7f5cb7773e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:50:24 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:1a:6c,bridge_name='br-int',has_traffic_filtering=True,id=26fd759d-5cb8-4798-ab59-c7f5cb7773e8,network=Network(b2fca984-f1e9-4c86-a3a5-b8d5b9950555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26fd759d-5c') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:50:24 user nova-compute[103546]: DEBUG nova.objects.instance [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lazy-loading 'pci_devices' on Instance uuid 7862d05d-4293-46a5-98aa-41967a572fe3 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:50:24 user nova-compute[103546]: DEBUG nova.objects.base [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Object Instance<7862d05d-4293-46a5-98aa-41967a572fe3> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 03:50:24 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] End _get_guest_xml xml=<domain type="kvm">
Nov 16 03:50:24 user nova-compute[103546]:   <uuid>7862d05d-4293-46a5-98aa-41967a572fe3</uuid>
Nov 16 03:50:24 user nova-compute[103546]:   <name>instance-00000003</name>
Nov 16 03:50:24 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 03:50:24 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 03:50:24 user nova-compute[103546]:   <metadata>
Nov 16 03:50:24 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 03:50:24 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 03:50:24 user nova-compute[103546]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1027244547</nova:name>
Nov 16 03:50:24 user nova-compute[103546]:       <nova:creationTime>2023-11-16 03:50:22</nova:creationTime>
Nov 16 03:50:24 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 03:50:24 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 03:50:24 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 03:50:24 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 03:50:24 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 03:50:24 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 03:50:24 user nova-compute[103546]:       </nova:flavor>
Nov 16 03:50:24 user nova-compute[103546]:       <nova:owner>
Nov 16 03:50:24 user nova-compute[103546]:         <nova:user uuid="21d4e9052a614968bda331f028920ca7">tempest-AttachVolumeShelveTestJSON-1382373405-project-member</nova:user>
Nov 16 03:50:24 user nova-compute[103546]:         <nova:project uuid="63722fdf17e4408299de8c215c133812">tempest-AttachVolumeShelveTestJSON-1382373405</nova:project>
Nov 16 03:50:24 user nova-compute[103546]:       </nova:owner>
Nov 16 03:50:24 user nova-compute[103546]:       <nova:root type="image" uuid="10327314-f1c6-4bb6-b137-cf23d91a2e92"/>
Nov 16 03:50:24 user nova-compute[103546]:       <nova:ports>
Nov 16 03:50:24 user nova-compute[103546]:         <nova:port uuid="26fd759d-5cb8-4798-ab59-c7f5cb7773e8">
Nov 16 03:50:24 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 16 03:50:24 user nova-compute[103546]:         </nova:port>
Nov 16 03:50:24 user nova-compute[103546]:       </nova:ports>
Nov 16 03:50:24 user nova-compute[103546]:     </nova:instance>
Nov 16 03:50:24 user nova-compute[103546]:   </metadata>
Nov 16 03:50:24 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 03:50:24 user nova-compute[103546]:     <system>
Nov 16 03:50:24 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 03:50:24 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 03:50:24 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 03:50:24 user nova-compute[103546]:       <entry name="serial">7862d05d-4293-46a5-98aa-41967a572fe3</entry>
Nov 16 03:50:24 user nova-compute[103546]:       <entry name="uuid">7862d05d-4293-46a5-98aa-41967a572fe3</entry>
Nov 16 03:50:24 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 03:50:24 user nova-compute[103546]:     </system>
Nov 16 03:50:24 user nova-compute[103546]:   </sysinfo>
Nov 16 03:50:24 user nova-compute[103546]:   <os>
Nov 16 03:50:24 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 03:50:24 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 03:50:24 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 03:50:24 user nova-compute[103546]:   </os>
Nov 16 03:50:24 user nova-compute[103546]:   <features>
Nov 16 03:50:24 user nova-compute[103546]:     <acpi/>
Nov 16 03:50:24 user nova-compute[103546]:     <apic/>
Nov 16 03:50:24 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 03:50:24 user nova-compute[103546]:   </features>
Nov 16 03:50:24 user nova-compute[103546]:   <clock offset="utc">
Nov 16 03:50:24 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 03:50:24 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 03:50:24 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 03:50:24 user nova-compute[103546]:   </clock>
Nov 16 03:50:24 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 03:50:24 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 03:50:24 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 03:50:24 user nova-compute[103546]:   </cpu>
Nov 16 03:50:24 user nova-compute[103546]:   <devices>
Nov 16 03:50:24 user nova-compute[103546]:     <disk type="file" device="disk">
Nov 16 03:50:24 user nova-compute[103546]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 03:50:24 user nova-compute[103546]:       <source file="/opt/stack/data/nova/instances/7862d05d-4293-46a5-98aa-41967a572fe3/disk"/>
Nov 16 03:50:24 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 03:50:24 user nova-compute[103546]:     </disk>
Nov 16 03:50:24 user nova-compute[103546]:     <disk type="block" device="disk">
Nov 16 03:50:24 user nova-compute[103546]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 03:50:24 user nova-compute[103546]:       <source dev="/dev/sdc"/>
Nov 16 03:50:24 user nova-compute[103546]:       <target dev="vdc" bus="virtio"/>
Nov 16 03:50:24 user nova-compute[103546]:       <serial>17c96a71-8e3c-44ff-aaf7-ccadc227b7e9</serial>
Nov 16 03:50:24 user nova-compute[103546]:     </disk>
Nov 16 03:50:24 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 03:50:24 user nova-compute[103546]:       <mac address="fa:16:3e:a0:1a:6c"/>
Nov 16 03:50:24 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:50:24 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 03:50:24 user nova-compute[103546]:       <target dev="tap26fd759d-5c"/>
Nov 16 03:50:24 user nova-compute[103546]:     </interface>
Nov 16 03:50:24 user nova-compute[103546]:     <serial type="pty">
Nov 16 03:50:24 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/7862d05d-4293-46a5-98aa-41967a572fe3/console.log" append="off"/>
Nov 16 03:50:24 user nova-compute[103546]:     </serial>
Nov 16 03:50:24 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 03:50:24 user nova-compute[103546]:     <video>
Nov 16 03:50:24 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:50:24 user nova-compute[103546]:     </video>
Nov 16 03:50:24 user nova-compute[103546]:     <rng model="virtio">
Nov 16 03:50:24 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 03:50:24 user nova-compute[103546]:     </rng>
Nov 16 03:50:24 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 03:50:24 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 03:50:24 user nova-compute[103546]:       <stats period="10"/>
Nov 16 03:50:24 user nova-compute[103546]:     </memballoon>
Nov 16 03:50:24 user nova-compute[103546]:   </devices>
Nov 16 03:50:24 user nova-compute[103546]: </domain>
Nov 16 03:50:24 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 03:50:24 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T03:46:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1027244547',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1027244547',id=3,image_ref='10327314-f1c6-4bb6-b137-cf23d91a2e92',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-494888',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:46:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='63722fdf17e4408299de8c215c133812',ramdisk_id='',reservation_id='r-l9s12mms',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1382373405',owner_user_name='tempest-AttachVolumeShelveTestJSON-1382373405-project-member',shelved_at='2023-11-16T03:48:22.217158',shelved_host='user',shelved_image_id='10327314-f1c6-4bb6-b137-cf23d91a2e92'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:50:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21d4e9052a614968bda331f028920ca7',uuid=7862d05d-4293-46a5-98aa-41967a572fe3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "26fd759d-5cb8-4798-ab59-c7f5cb7773e8", "address": "fa:16:3e:a0:1a:6c", "network": {"id": "b2fca984-f1e9-4c86-a3a5-b8d5b9950555", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-172535633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63722fdf17e4408299de8c215c133812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26fd759d-5c", "ovs_interfaceid": "26fd759d-5cb8-4798-ab59-c7f5cb7773e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 03:50:24 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Converting VIF {"id": "26fd759d-5cb8-4798-ab59-c7f5cb7773e8", "address": "fa:16:3e:a0:1a:6c", "network": {"id": "b2fca984-f1e9-4c86-a3a5-b8d5b9950555", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-172535633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63722fdf17e4408299de8c215c133812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26fd759d-5c", "ovs_interfaceid": "26fd759d-5cb8-4798-ab59-c7f5cb7773e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:50:24 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:1a:6c,bridge_name='br-int',has_traffic_filtering=True,id=26fd759d-5cb8-4798-ab59-c7f5cb7773e8,network=Network(b2fca984-f1e9-4c86-a3a5-b8d5b9950555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26fd759d-5c') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:50:24 user nova-compute[103546]: DEBUG os_vif [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:1a:6c,bridge_name='br-int',has_traffic_filtering=True,id=26fd759d-5cb8-4798-ab59-c7f5cb7773e8,network=Network(b2fca984-f1e9-4c86-a3a5-b8d5b9950555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26fd759d-5c') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 03:50:24 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:24 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:50:24 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 03:50:24 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:24 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'be84f374-dc49-5eb4-a303-0e41caf501f4', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:50:24 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:50:24 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:24 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26fd759d-5c, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:50:24 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap26fd759d-5c, col_values=(('qos', UUID('8903370e-a844-456d-b6ae-5f6d19f36310')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:50:24 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap26fd759d-5c, col_values=(('external_ids', {'iface-id': '26fd759d-5cb8-4798-ab59-c7f5cb7773e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:1a:6c', 'vm-uuid': '7862d05d-4293-46a5-98aa-41967a572fe3'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:50:24 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:50:24 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:24 user nova-compute[103546]: INFO os_vif [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:1a:6c,bridge_name='br-int',has_traffic_filtering=True,id=26fd759d-5cb8-4798-ab59-c7f5cb7773e8,network=Network(b2fca984-f1e9-4c86-a3a5-b8d5b9950555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26fd759d-5c')
Nov 16 03:50:24 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:50:24 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] No BDM found with device name vdc, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:50:24 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] No VIF found with MAC fa:16:3e:a0:1a:6c, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 03:50:25 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:25 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:25 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:25 user nova-compute[103546]: DEBUG nova.compute.manager [req-9c0a3a1c-08bd-4831-a25f-fa0505e0bbbe req-120995a3-5019-432f-bc96-fe0f716db586 service nova] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Received event network-vif-plugged-26fd759d-5cb8-4798-ab59-c7f5cb7773e8 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:50:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-9c0a3a1c-08bd-4831-a25f-fa0505e0bbbe req-120995a3-5019-432f-bc96-fe0f716db586 service nova] Acquiring lock "7862d05d-4293-46a5-98aa-41967a572fe3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:50:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-9c0a3a1c-08bd-4831-a25f-fa0505e0bbbe req-120995a3-5019-432f-bc96-fe0f716db586 service nova] Lock "7862d05d-4293-46a5-98aa-41967a572fe3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:50:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-9c0a3a1c-08bd-4831-a25f-fa0505e0bbbe req-120995a3-5019-432f-bc96-fe0f716db586 service nova] Lock "7862d05d-4293-46a5-98aa-41967a572fe3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:50:25 user nova-compute[103546]: DEBUG nova.compute.manager [req-9c0a3a1c-08bd-4831-a25f-fa0505e0bbbe req-120995a3-5019-432f-bc96-fe0f716db586 service nova] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] No waiting events found dispatching network-vif-plugged-26fd759d-5cb8-4798-ab59-c7f5cb7773e8 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:50:25 user nova-compute[103546]: WARNING nova.compute.manager [req-9c0a3a1c-08bd-4831-a25f-fa0505e0bbbe req-120995a3-5019-432f-bc96-fe0f716db586 service nova] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Received unexpected event network-vif-plugged-26fd759d-5cb8-4798-ab59-c7f5cb7773e8 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 16 03:50:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:27 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:27 user nova-compute[103546]: DEBUG nova.compute.manager [req-9758a7a8-cb36-4bb5-9b00-11493081e161 req-416e659b-dbc9-465e-b25d-237953547fc8 service nova] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Received event network-vif-plugged-26fd759d-5cb8-4798-ab59-c7f5cb7773e8 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:50:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-9758a7a8-cb36-4bb5-9b00-11493081e161 req-416e659b-dbc9-465e-b25d-237953547fc8 service nova] Acquiring lock "7862d05d-4293-46a5-98aa-41967a572fe3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:50:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-9758a7a8-cb36-4bb5-9b00-11493081e161 req-416e659b-dbc9-465e-b25d-237953547fc8 service nova] Lock "7862d05d-4293-46a5-98aa-41967a572fe3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:50:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-9758a7a8-cb36-4bb5-9b00-11493081e161 req-416e659b-dbc9-465e-b25d-237953547fc8 service nova] Lock "7862d05d-4293-46a5-98aa-41967a572fe3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:50:27 user nova-compute[103546]: DEBUG nova.compute.manager [req-9758a7a8-cb36-4bb5-9b00-11493081e161 req-416e659b-dbc9-465e-b25d-237953547fc8 service nova] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] No waiting events found dispatching network-vif-plugged-26fd759d-5cb8-4798-ab59-c7f5cb7773e8 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:50:27 user nova-compute[103546]: WARNING nova.compute.manager [req-9758a7a8-cb36-4bb5-9b00-11493081e161 req-416e659b-dbc9-465e-b25d-237953547fc8 service nova] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Received unexpected event network-vif-plugged-26fd759d-5cb8-4798-ab59-c7f5cb7773e8 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 16 03:50:28 user nova-compute[103546]: DEBUG nova.compute.manager [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 03:50:28 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Guest created on hypervisor {{(pid=103546) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 03:50:28 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Instance spawned successfully.
Nov 16 03:50:28 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:28 user nova-compute[103546]: DEBUG nova.compute.manager [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 03:50:28 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-dcb43028-dfa6-4f04-b8a1-78b9dc0efad0 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "7862d05d-4293-46a5-98aa-41967a572fe3" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 18.885s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:50:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:32 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Acquiring lock "9a89970b-fc61-4419-8ff9-b48013dccf9f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:50:32 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "9a89970b-fc61-4419-8ff9-b48013dccf9f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:50:32 user nova-compute[103546]: DEBUG nova.compute.manager [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Starting instance... {{(pid=103546) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 03:50:32 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:50:32 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:50:32 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=103546) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 03:50:32 user nova-compute[103546]: INFO nova.compute.claims [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Claim successful on node user
Nov 16 03:50:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:33 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:50:33 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:50:33 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.401s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:50:33 user nova-compute[103546]: DEBUG nova.compute.manager [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Start building networks asynchronously for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 03:50:33 user nova-compute[103546]: DEBUG nova.compute.manager [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Allocating IP information in the background. {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 03:50:33 user nova-compute[103546]: DEBUG nova.network.neutron [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] allocate_for_instance() {{(pid=103546) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 03:50:33 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 03:50:33 user nova-compute[103546]: DEBUG nova.compute.manager [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Start building block device mappings for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 03:50:33 user nova-compute[103546]: DEBUG nova.policy [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e471c69657c745bbbdfc82307a49946f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b30a015db444798ee72ff6fd14c69e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103546) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 03:50:33 user nova-compute[103546]: DEBUG nova.compute.manager [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Start spawning the instance on the hypervisor. {{(pid=103546) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 03:50:33 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Creating instance directory {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 03:50:33 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Creating image(s)
Nov 16 03:50:33 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Acquiring lock "/opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:50:33 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "/opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:50:33 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "/opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:50:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.185s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:33 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Acquiring lock "8c9efafb670bfe5842ba1f4ce398924612164af7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:50:33 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:50:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.192s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk 1073741824 {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk 1073741824" returned: 0 in 0.056s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:33 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:50:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.190s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:34 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk. size=1073741824 {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 03:50:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:34 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:34 user nova-compute[103546]: DEBUG nova.network.neutron [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Successfully created port: 5f4e3564-4185-44d2-93f6-2e3803aaf0f8 {{(pid=103546) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 03:50:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:34 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Cannot resize image /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk to a smaller size. {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 03:50:34 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Created local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 03:50:34 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Ensure instance console log exists: /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/console.log {{(pid=103546) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 03:50:34 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:50:34 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:50:34 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:50:35 user nova-compute[103546]: DEBUG nova.network.neutron [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Successfully updated port: 5f4e3564-4185-44d2-93f6-2e3803aaf0f8 {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 03:50:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Acquiring lock "refresh_cache-9a89970b-fc61-4419-8ff9-b48013dccf9f" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:50:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Acquired lock "refresh_cache-9a89970b-fc61-4419-8ff9-b48013dccf9f" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:50:35 user nova-compute[103546]: DEBUG nova.network.neutron [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 03:50:35 user nova-compute[103546]: DEBUG nova.compute.manager [req-ab71d4a0-a96d-4965-9432-41cc4ec4f54f req-736b6579-b9cf-4ef4-8a27-0b2b89efe5c3 service nova] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Received event network-changed-5f4e3564-4185-44d2-93f6-2e3803aaf0f8 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:50:35 user nova-compute[103546]: DEBUG nova.compute.manager [req-ab71d4a0-a96d-4965-9432-41cc4ec4f54f req-736b6579-b9cf-4ef4-8a27-0b2b89efe5c3 service nova] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Refreshing instance network info cache due to event network-changed-5f4e3564-4185-44d2-93f6-2e3803aaf0f8. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:50:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ab71d4a0-a96d-4965-9432-41cc4ec4f54f req-736b6579-b9cf-4ef4-8a27-0b2b89efe5c3 service nova] Acquiring lock "refresh_cache-9a89970b-fc61-4419-8ff9-b48013dccf9f" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:50:35 user nova-compute[103546]: DEBUG nova.network.neutron [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 03:50:35 user nova-compute[103546]: DEBUG nova.network.neutron [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Updating instance_info_cache with network_info: [{"id": "5f4e3564-4185-44d2-93f6-2e3803aaf0f8", "address": "fa:16:3e:56:e2:fb", "network": {"id": "29e9620f-313d-4679-89d7-459e7cf75b38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1690634205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72b30a015db444798ee72ff6fd14c69e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f4e3564-41", "ovs_interfaceid": "5f4e3564-4185-44d2-93f6-2e3803aaf0f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:50:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Releasing lock "refresh_cache-9a89970b-fc61-4419-8ff9-b48013dccf9f" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:50:35 user nova-compute[103546]: DEBUG nova.compute.manager [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Instance network_info: |[{"id": "5f4e3564-4185-44d2-93f6-2e3803aaf0f8", "address": "fa:16:3e:56:e2:fb", "network": {"id": "29e9620f-313d-4679-89d7-459e7cf75b38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1690634205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72b30a015db444798ee72ff6fd14c69e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f4e3564-41", "ovs_interfaceid": "5f4e3564-4185-44d2-93f6-2e3803aaf0f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 03:50:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ab71d4a0-a96d-4965-9432-41cc4ec4f54f req-736b6579-b9cf-4ef4-8a27-0b2b89efe5c3 service nova] Acquired lock "refresh_cache-9a89970b-fc61-4419-8ff9-b48013dccf9f" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:50:35 user nova-compute[103546]: DEBUG nova.network.neutron [req-ab71d4a0-a96d-4965-9432-41cc4ec4f54f req-736b6579-b9cf-4ef4-8a27-0b2b89efe5c3 service nova] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Refreshing network info cache for port 5f4e3564-4185-44d2-93f6-2e3803aaf0f8 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:50:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Start _get_guest_xml network_info=[{"id": "5f4e3564-4185-44d2-93f6-2e3803aaf0f8", "address": "fa:16:3e:56:e2:fb", "network": {"id": "29e9620f-313d-4679-89d7-459e7cf75b38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1690634205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72b30a015db444798ee72ff6fd14c69e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f4e3564-41", "ovs_interfaceid": "5f4e3564-4185-44d2-93f6-2e3803aaf0f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '5c6f539a-01e5-4478-bf8f-a14310b5d7dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 03:50:35 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:50:35 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:50:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 03:50:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 03:50:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 03:50:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 03:50:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 03:50:35 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 03:50:35 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 03:50:35 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 03:50:35 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 03:50:35 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 03:50:35 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 03:50:35 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 03:50:35 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 03:50:35 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 03:50:35 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 03:50:35 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 03:50:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:50:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-935129415',display_name='tempest-ServerActionsTestOtherA-server-935129415',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-935129415',id=14,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJeuDielSI+1QllPRU8TUZPfRtLhxXlgqD+oFHNsy0a0jxMp9PNqxCpWdXKas+7wQ5fSoPylsuLGE6eRSK8cr/wsGQFy4MbHJizJ+GnVBc6KD3RZeGBoD7tDLXSKWjtJbw==',key_name='tempest-keypair-205381596',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72b30a015db444798ee72ff6fd14c69e',ramdisk_id='',reservation_id='r-1550z15x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1488667220',owner_user_name='tempest-ServerActionsTestOtherA-1488667220-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:50:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e471c69657c745bbbdfc82307a49946f',uuid=9a89970b-fc61-4419-8ff9-b48013dccf9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f4e3564-4185-44d2-93f6-2e3803aaf0f8", "address": "fa:16:3e:56:e2:fb", "network": {"id": "29e9620f-313d-4679-89d7-459e7cf75b38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1690634205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72b30a015db444798ee72ff6fd14c69e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f4e3564-41", "ovs_interfaceid": "5f4e3564-4185-44d2-93f6-2e3803aaf0f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 03:50:35 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Converting VIF {"id": "5f4e3564-4185-44d2-93f6-2e3803aaf0f8", "address": "fa:16:3e:56:e2:fb", "network": {"id": "29e9620f-313d-4679-89d7-459e7cf75b38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1690634205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72b30a015db444798ee72ff6fd14c69e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f4e3564-41", "ovs_interfaceid": "5f4e3564-4185-44d2-93f6-2e3803aaf0f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:50:35 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:e2:fb,bridge_name='br-int',has_traffic_filtering=True,id=5f4e3564-4185-44d2-93f6-2e3803aaf0f8,network=Network(29e9620f-313d-4679-89d7-459e7cf75b38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f4e3564-41') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:50:35 user nova-compute[103546]: DEBUG nova.objects.instance [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lazy-loading 'pci_devices' on Instance uuid 9a89970b-fc61-4419-8ff9-b48013dccf9f {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:50:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] End _get_guest_xml xml=<domain type="kvm">
Nov 16 03:50:35 user nova-compute[103546]:   <uuid>9a89970b-fc61-4419-8ff9-b48013dccf9f</uuid>
Nov 16 03:50:35 user nova-compute[103546]:   <name>instance-0000000e</name>
Nov 16 03:50:35 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 03:50:35 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 03:50:35 user nova-compute[103546]:   <metadata>
Nov 16 03:50:35 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 03:50:35 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 03:50:35 user nova-compute[103546]:       <nova:name>tempest-ServerActionsTestOtherA-server-935129415</nova:name>
Nov 16 03:50:35 user nova-compute[103546]:       <nova:creationTime>2023-11-16 03:50:35</nova:creationTime>
Nov 16 03:50:35 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 03:50:35 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 03:50:35 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 03:50:35 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 03:50:35 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 03:50:35 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 03:50:35 user nova-compute[103546]:       </nova:flavor>
Nov 16 03:50:35 user nova-compute[103546]:       <nova:owner>
Nov 16 03:50:35 user nova-compute[103546]:         <nova:user uuid="e471c69657c745bbbdfc82307a49946f">tempest-ServerActionsTestOtherA-1488667220-project-member</nova:user>
Nov 16 03:50:35 user nova-compute[103546]:         <nova:project uuid="72b30a015db444798ee72ff6fd14c69e">tempest-ServerActionsTestOtherA-1488667220</nova:project>
Nov 16 03:50:35 user nova-compute[103546]:       </nova:owner>
Nov 16 03:50:35 user nova-compute[103546]:       <nova:root type="image" uuid="5c6f539a-01e5-4478-bf8f-a14310b5d7dd"/>
Nov 16 03:50:35 user nova-compute[103546]:       <nova:ports>
Nov 16 03:50:35 user nova-compute[103546]:         <nova:port uuid="5f4e3564-4185-44d2-93f6-2e3803aaf0f8">
Nov 16 03:50:35 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 03:50:35 user nova-compute[103546]:         </nova:port>
Nov 16 03:50:35 user nova-compute[103546]:       </nova:ports>
Nov 16 03:50:35 user nova-compute[103546]:     </nova:instance>
Nov 16 03:50:35 user nova-compute[103546]:   </metadata>
Nov 16 03:50:35 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 03:50:35 user nova-compute[103546]:     <system>
Nov 16 03:50:35 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 03:50:35 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 03:50:35 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 03:50:35 user nova-compute[103546]:       <entry name="serial">9a89970b-fc61-4419-8ff9-b48013dccf9f</entry>
Nov 16 03:50:35 user nova-compute[103546]:       <entry name="uuid">9a89970b-fc61-4419-8ff9-b48013dccf9f</entry>
Nov 16 03:50:35 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 03:50:35 user nova-compute[103546]:     </system>
Nov 16 03:50:35 user nova-compute[103546]:   </sysinfo>
Nov 16 03:50:35 user nova-compute[103546]:   <os>
Nov 16 03:50:35 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 03:50:35 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 03:50:35 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 03:50:35 user nova-compute[103546]:   </os>
Nov 16 03:50:35 user nova-compute[103546]:   <features>
Nov 16 03:50:35 user nova-compute[103546]:     <acpi/>
Nov 16 03:50:35 user nova-compute[103546]:     <apic/>
Nov 16 03:50:35 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 03:50:35 user nova-compute[103546]:   </features>
Nov 16 03:50:35 user nova-compute[103546]:   <clock offset="utc">
Nov 16 03:50:35 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 03:50:35 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 03:50:35 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 03:50:35 user nova-compute[103546]:   </clock>
Nov 16 03:50:35 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 03:50:35 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 03:50:35 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 03:50:35 user nova-compute[103546]:   </cpu>
Nov 16 03:50:35 user nova-compute[103546]:   <devices>
Nov 16 03:50:35 user nova-compute[103546]:     <disk type="file" device="disk">
Nov 16 03:50:35 user nova-compute[103546]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 03:50:35 user nova-compute[103546]:       <source file="/opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk"/>
Nov 16 03:50:35 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 03:50:35 user nova-compute[103546]:     </disk>
Nov 16 03:50:35 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 03:50:35 user nova-compute[103546]:       <mac address="fa:16:3e:56:e2:fb"/>
Nov 16 03:50:35 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:50:35 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 03:50:35 user nova-compute[103546]:       <target dev="tap5f4e3564-41"/>
Nov 16 03:50:35 user nova-compute[103546]:     </interface>
Nov 16 03:50:35 user nova-compute[103546]:     <serial type="pty">
Nov 16 03:50:35 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/console.log" append="off"/>
Nov 16 03:50:35 user nova-compute[103546]:     </serial>
Nov 16 03:50:35 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 03:50:35 user nova-compute[103546]:     <video>
Nov 16 03:50:35 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:50:35 user nova-compute[103546]:     </video>
Nov 16 03:50:35 user nova-compute[103546]:     <rng model="virtio">
Nov 16 03:50:35 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 03:50:35 user nova-compute[103546]:     </rng>
Nov 16 03:50:35 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 03:50:35 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 03:50:35 user nova-compute[103546]:       <stats period="10"/>
Nov 16 03:50:35 user nova-compute[103546]:     </memballoon>
Nov 16 03:50:35 user nova-compute[103546]:   </devices>
Nov 16 03:50:35 user nova-compute[103546]: </domain>
Nov 16 03:50:35 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 03:50:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:50:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-935129415',display_name='tempest-ServerActionsTestOtherA-server-935129415',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-935129415',id=14,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJeuDielSI+1QllPRU8TUZPfRtLhxXlgqD+oFHNsy0a0jxMp9PNqxCpWdXKas+7wQ5fSoPylsuLGE6eRSK8cr/wsGQFy4MbHJizJ+GnVBc6KD3RZeGBoD7tDLXSKWjtJbw==',key_name='tempest-keypair-205381596',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72b30a015db444798ee72ff6fd14c69e',ramdisk_id='',reservation_id='r-1550z15x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1488667220',owner_user_name='tempest-ServerActionsTestOtherA-1488667220-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:50:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e471c69657c745bbbdfc82307a49946f',uuid=9a89970b-fc61-4419-8ff9-b48013dccf9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f4e3564-4185-44d2-93f6-2e3803aaf0f8", "address": "fa:16:3e:56:e2:fb", "network": {"id": "29e9620f-313d-4679-89d7-459e7cf75b38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1690634205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72b30a015db444798ee72ff6fd14c69e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f4e3564-41", "ovs_interfaceid": "5f4e3564-4185-44d2-93f6-2e3803aaf0f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 03:50:35 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Converting VIF {"id": "5f4e3564-4185-44d2-93f6-2e3803aaf0f8", "address": "fa:16:3e:56:e2:fb", "network": {"id": "29e9620f-313d-4679-89d7-459e7cf75b38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1690634205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72b30a015db444798ee72ff6fd14c69e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f4e3564-41", "ovs_interfaceid": "5f4e3564-4185-44d2-93f6-2e3803aaf0f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:50:35 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:e2:fb,bridge_name='br-int',has_traffic_filtering=True,id=5f4e3564-4185-44d2-93f6-2e3803aaf0f8,network=Network(29e9620f-313d-4679-89d7-459e7cf75b38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f4e3564-41') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:50:35 user nova-compute[103546]: DEBUG os_vif [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:e2:fb,bridge_name='br-int',has_traffic_filtering=True,id=5f4e3564-4185-44d2-93f6-2e3803aaf0f8,network=Network(29e9620f-313d-4679-89d7-459e7cf75b38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f4e3564-41') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 03:50:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:50:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 03:50:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '08b82f65-a39f-5445-9873-c130907adbdd', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:50:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5f4e3564-41, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:50:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5f4e3564-41, col_values=(('qos', UUID('52967c1d-4507-4228-9ee2-585b5f4fff71')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:50:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5f4e3564-41, col_values=(('external_ids', {'iface-id': '5f4e3564-4185-44d2-93f6-2e3803aaf0f8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:e2:fb', 'vm-uuid': '9a89970b-fc61-4419-8ff9-b48013dccf9f'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:50:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:50:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:35 user nova-compute[103546]: INFO os_vif [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:e2:fb,bridge_name='br-int',has_traffic_filtering=True,id=5f4e3564-4185-44d2-93f6-2e3803aaf0f8,network=Network(29e9620f-313d-4679-89d7-459e7cf75b38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f4e3564-41')
Nov 16 03:50:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:50:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] No VIF found with MAC fa:16:3e:56:e2:fb, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 03:50:35 user nova-compute[103546]: DEBUG nova.network.neutron [req-ab71d4a0-a96d-4965-9432-41cc4ec4f54f req-736b6579-b9cf-4ef4-8a27-0b2b89efe5c3 service nova] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Updated VIF entry in instance network info cache for port 5f4e3564-4185-44d2-93f6-2e3803aaf0f8. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 03:50:35 user nova-compute[103546]: DEBUG nova.network.neutron [req-ab71d4a0-a96d-4965-9432-41cc4ec4f54f req-736b6579-b9cf-4ef4-8a27-0b2b89efe5c3 service nova] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Updating instance_info_cache with network_info: [{"id": "5f4e3564-4185-44d2-93f6-2e3803aaf0f8", "address": "fa:16:3e:56:e2:fb", "network": {"id": "29e9620f-313d-4679-89d7-459e7cf75b38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1690634205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72b30a015db444798ee72ff6fd14c69e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f4e3564-41", "ovs_interfaceid": "5f4e3564-4185-44d2-93f6-2e3803aaf0f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:50:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ab71d4a0-a96d-4965-9432-41cc4ec4f54f req-736b6579-b9cf-4ef4-8a27-0b2b89efe5c3 service nova] Releasing lock "refresh_cache-9a89970b-fc61-4419-8ff9-b48013dccf9f" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:50:36 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:36 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:36 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:36 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:37 user nova-compute[103546]: DEBUG nova.compute.manager [req-6742b1bb-04f9-4d22-9c00-9b39344aae11 req-ee6e78b3-17ec-41da-b17d-5d7755ca506d service nova] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Received event network-vif-plugged-5f4e3564-4185-44d2-93f6-2e3803aaf0f8 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:50:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6742b1bb-04f9-4d22-9c00-9b39344aae11 req-ee6e78b3-17ec-41da-b17d-5d7755ca506d service nova] Acquiring lock "9a89970b-fc61-4419-8ff9-b48013dccf9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:50:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6742b1bb-04f9-4d22-9c00-9b39344aae11 req-ee6e78b3-17ec-41da-b17d-5d7755ca506d service nova] Lock "9a89970b-fc61-4419-8ff9-b48013dccf9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:50:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6742b1bb-04f9-4d22-9c00-9b39344aae11 req-ee6e78b3-17ec-41da-b17d-5d7755ca506d service nova] Lock "9a89970b-fc61-4419-8ff9-b48013dccf9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:50:37 user nova-compute[103546]: DEBUG nova.compute.manager [req-6742b1bb-04f9-4d22-9c00-9b39344aae11 req-ee6e78b3-17ec-41da-b17d-5d7755ca506d service nova] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] No waiting events found dispatching network-vif-plugged-5f4e3564-4185-44d2-93f6-2e3803aaf0f8 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:50:37 user nova-compute[103546]: WARNING nova.compute.manager [req-6742b1bb-04f9-4d22-9c00-9b39344aae11 req-ee6e78b3-17ec-41da-b17d-5d7755ca506d service nova] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Received unexpected event network-vif-plugged-5f4e3564-4185-44d2-93f6-2e3803aaf0f8 for instance with vm_state building and task_state spawning.
Nov 16 03:50:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:38 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:39 user nova-compute[103546]: DEBUG nova.compute.manager [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 03:50:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Guest created on hypervisor {{(pid=103546) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 03:50:39 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Instance spawned successfully.
Nov 16 03:50:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 03:50:39 user nova-compute[103546]: DEBUG nova.compute.manager [req-2e1fe3e5-0cd4-42e8-ac2e-5dc764357f81 req-b05ead0f-2f1e-4910-8d67-68926dc15b30 service nova] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Received event network-vif-plugged-5f4e3564-4185-44d2-93f6-2e3803aaf0f8 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:50:39 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-2e1fe3e5-0cd4-42e8-ac2e-5dc764357f81 req-b05ead0f-2f1e-4910-8d67-68926dc15b30 service nova] Acquiring lock "9a89970b-fc61-4419-8ff9-b48013dccf9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:50:39 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-2e1fe3e5-0cd4-42e8-ac2e-5dc764357f81 req-b05ead0f-2f1e-4910-8d67-68926dc15b30 service nova] Lock "9a89970b-fc61-4419-8ff9-b48013dccf9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:50:39 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-2e1fe3e5-0cd4-42e8-ac2e-5dc764357f81 req-b05ead0f-2f1e-4910-8d67-68926dc15b30 service nova] Lock "9a89970b-fc61-4419-8ff9-b48013dccf9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:50:39 user nova-compute[103546]: DEBUG nova.compute.manager [req-2e1fe3e5-0cd4-42e8-ac2e-5dc764357f81 req-b05ead0f-2f1e-4910-8d67-68926dc15b30 service nova] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] No waiting events found dispatching network-vif-plugged-5f4e3564-4185-44d2-93f6-2e3803aaf0f8 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:50:39 user nova-compute[103546]: WARNING nova.compute.manager [req-2e1fe3e5-0cd4-42e8-ac2e-5dc764357f81 req-b05ead0f-2f1e-4910-8d67-68926dc15b30 service nova] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Received unexpected event network-vif-plugged-5f4e3564-4185-44d2-93f6-2e3803aaf0f8 for instance with vm_state building and task_state spawning.
Nov 16 03:50:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Found default for hw_cdrom_bus of ide {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:50:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Found default for hw_disk_bus of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:50:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Found default for hw_input_bus of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:50:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Found default for hw_pointer_model of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:50:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Found default for hw_video_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:50:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Found default for hw_vif_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:50:39 user nova-compute[103546]: INFO nova.compute.manager [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Took 5.98 seconds to spawn the instance on the hypervisor.
Nov 16 03:50:39 user nova-compute[103546]: DEBUG nova.compute.manager [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 03:50:39 user nova-compute[103546]: INFO nova.compute.manager [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Took 6.75 seconds to build instance.
Nov 16 03:50:39 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0155d561-2578-4f87-b49b-5103a2bc7af4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "9a89970b-fc61-4419-8ff9-b48013dccf9f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.868s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:50:40 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:41 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:44 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:45 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:45 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:48 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:48 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:50 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:52 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Acquiring lock "24b48ca5-a0df-4713-bd32-6b62a9ee8367" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:50:52 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Lock "24b48ca5-a0df-4713-bd32-6b62a9ee8367" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:50:52 user nova-compute[103546]: DEBUG nova.compute.manager [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] Starting instance... {{(pid=103546) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 03:50:52 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:50:52 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:50:52 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=103546) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 03:50:52 user nova-compute[103546]: INFO nova.compute.claims [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] Claim successful on node user
Nov 16 03:50:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:53 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:50:53 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:50:53 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.446s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:50:53 user nova-compute[103546]: DEBUG nova.compute.manager [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] Start building networks asynchronously for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 03:50:53 user nova-compute[103546]: DEBUG nova.compute.manager [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] Allocating IP information in the background. {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 03:50:53 user nova-compute[103546]: DEBUG nova.network.neutron [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] allocate_for_instance() {{(pid=103546) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 03:50:53 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 03:50:53 user nova-compute[103546]: DEBUG nova.compute.manager [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] Start building block device mappings for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 03:50:53 user nova-compute[103546]: DEBUG nova.policy [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '29f86d0d50ff44e79cf3c37416a5b632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db9ce0a02204d269a3beac9459f5c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103546) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 03:50:53 user nova-compute[103546]: DEBUG nova.compute.manager [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] Start spawning the instance on the hypervisor. {{(pid=103546) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 03:50:53 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] Creating instance directory {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 03:50:53 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] Creating image(s)
Nov 16 03:50:53 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Acquiring lock "/opt/stack/data/nova/instances/24b48ca5-a0df-4713-bd32-6b62a9ee8367/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:50:53 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Lock "/opt/stack/data/nova/instances/24b48ca5-a0df-4713-bd32-6b62a9ee8367/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:50:53 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Lock "/opt/stack/data/nova/instances/24b48ca5-a0df-4713-bd32-6b62a9ee8367/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:50:53 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:53 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d0714b48-0f5f-4823-912c-6d0ecd9c4469 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Acquiring lock "63b95121-b211-42c3-831e-0392d4abd09a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:50:53 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d0714b48-0f5f-4823-912c-6d0ecd9c4469 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "63b95121-b211-42c3-831e-0392d4abd09a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:50:53 user nova-compute[103546]: DEBUG nova.objects.instance [None req-d0714b48-0f5f-4823-912c-6d0ecd9c4469 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lazy-loading 'flavor' on Instance uuid 63b95121-b211-42c3-831e-0392d4abd09a {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:50:53 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d0714b48-0f5f-4823-912c-6d0ecd9c4469 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "63b95121-b211-42c3-831e-0392d4abd09a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:50:53 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.203s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:53 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Acquiring lock "8c9efafb670bfe5842ba1f4ce398924612164af7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:50:53 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:50:53 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:53 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d0714b48-0f5f-4823-912c-6d0ecd9c4469 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Acquiring lock "63b95121-b211-42c3-831e-0392d4abd09a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:50:53 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d0714b48-0f5f-4823-912c-6d0ecd9c4469 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "63b95121-b211-42c3-831e-0392d4abd09a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:50:53 user nova-compute[103546]: INFO nova.compute.manager [None req-d0714b48-0f5f-4823-912c-6d0ecd9c4469 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Attaching volume 7eff0073-6dd7-49ac-9520-557cb575b8b5 to /dev/vdb
Nov 16 03:50:53 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.191s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:53 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/24b48ca5-a0df-4713-bd32-6b62a9ee8367/disk 1073741824 {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:53 user nova-compute[103546]: DEBUG os_brick.utils [None req-d0714b48-0f5f-4823-912c-6d0ecd9c4469 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:50:53 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:53 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/24b48ca5-a0df-4713-bd32-6b62a9ee8367/disk 1073741824" returned: 0 in 0.050s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:53 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:50:53 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:53 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:53 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aee0043-ea94-45bf-8e52-5ca5cd331734]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af5c39b14ece\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:50:53 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:53 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:53 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf82378-07cb-4406-babe-3813a91d21c5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:50:53 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:53 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:53 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8aafb3d-b6a2-49cf-a108-6f1e5f5859d5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:50:53 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[dceb8fb6-d1b1-410d-95cc-a88f4626b92b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:50:53 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-d0714b48-0f5f-4823-912c-6d0ecd9c4469 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Running cmd (subprocess): nvme version {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:54 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-d0714b48-0f5f-4823-912c-6d0ecd9c4469 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] 'nvme version' failed. Not Retrying. {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:50:54 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d0714b48-0f5f-4823-912c-6d0ecd9c4469 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] nvme not present on system {{(pid=103546) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 03:50:54 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:54 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:50:54 user nova-compute[103546]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 03:50:54 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[0722766f-008a-45e5-b194-9ad2e4559eb4]: (4, '') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:50:54 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-d0714b48-0f5f-4823-912c-6d0ecd9c4469 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=103546) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 03:50:54 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-d0714b48-0f5f-4823-912c-6d0ecd9c4469 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 03:50:54 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-d0714b48-0f5f-4823-912c-6d0ecd9c4469 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] LIGHTOS: no hostnqn found. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 03:50:54 user nova-compute[103546]: DEBUG os_brick.utils [None req-d0714b48-0f5f-4823-912c-6d0ecd9c4469 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af5c39b14ece', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:50:54 user nova-compute[103546]: DEBUG nova.virt.block_device [None req-d0714b48-0f5f-4823-912c-6d0ecd9c4469 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Updating existing volume attachment record: a2205917-9f2e-479b-9265-139282684d8a {{(pid=103546) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 03:50:54 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.186s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:54 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Checking if we can resize image /opt/stack/data/nova/instances/24b48ca5-a0df-4713-bd32-6b62a9ee8367/disk. size=1073741824 {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 03:50:54 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24b48ca5-a0df-4713-bd32-6b62a9ee8367/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:54 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24b48ca5-a0df-4713-bd32-6b62a9ee8367/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:54 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Cannot resize image /opt/stack/data/nova/instances/24b48ca5-a0df-4713-bd32-6b62a9ee8367/disk to a smaller size. {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 03:50:54 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] Created local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 03:50:54 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] Ensure instance console log exists: /opt/stack/data/nova/instances/24b48ca5-a0df-4713-bd32-6b62a9ee8367/console.log {{(pid=103546) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 03:50:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:50:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:50:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.003s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:50:54 user nova-compute[103546]: DEBUG nova.network.neutron [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] Successfully created port: 606892d8-a634-4999-8682-4966006bfb09 {{(pid=103546) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 03:50:55 user nova-compute[103546]: DEBUG nova.network.neutron [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] Successfully updated port: 606892d8-a634-4999-8682-4966006bfb09 {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 03:50:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Acquiring lock "refresh_cache-24b48ca5-a0df-4713-bd32-6b62a9ee8367" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:50:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Acquired lock "refresh_cache-24b48ca5-a0df-4713-bd32-6b62a9ee8367" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:50:55 user nova-compute[103546]: DEBUG nova.network.neutron [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 03:50:55 user nova-compute[103546]: DEBUG nova.compute.manager [req-e8e2b165-616d-4e0f-9044-f4f7a4408d2c req-249259fb-f983-4de4-ac4f-99e7281254a5 service nova] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] Received event network-changed-606892d8-a634-4999-8682-4966006bfb09 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:50:55 user nova-compute[103546]: DEBUG nova.compute.manager [req-e8e2b165-616d-4e0f-9044-f4f7a4408d2c req-249259fb-f983-4de4-ac4f-99e7281254a5 service nova] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] Refreshing instance network info cache due to event network-changed-606892d8-a634-4999-8682-4966006bfb09. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:50:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-e8e2b165-616d-4e0f-9044-f4f7a4408d2c req-249259fb-f983-4de4-ac4f-99e7281254a5 service nova] Acquiring lock "refresh_cache-24b48ca5-a0df-4713-bd32-6b62a9ee8367" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:50:55 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:55 user nova-compute[103546]: DEBUG nova.network.neutron [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 03:50:55 user nova-compute[103546]: DEBUG nova.network.neutron [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] Updating instance_info_cache with network_info: [{"id": "606892d8-a634-4999-8682-4966006bfb09", "address": "fa:16:3e:12:e0:cd", "network": {"id": "f27a9ae1-0635-4b3b-858d-fa6524d15c2d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-73312216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8db9ce0a02204d269a3beac9459f5c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap606892d8-a6", "ovs_interfaceid": "606892d8-a634-4999-8682-4966006bfb09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:50:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Releasing lock "refresh_cache-24b48ca5-a0df-4713-bd32-6b62a9ee8367" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:50:55 user nova-compute[103546]: DEBUG nova.compute.manager [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] Instance network_info: |[{"id": "606892d8-a634-4999-8682-4966006bfb09", "address": "fa:16:3e:12:e0:cd", "network": {"id": "f27a9ae1-0635-4b3b-858d-fa6524d15c2d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-73312216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8db9ce0a02204d269a3beac9459f5c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap606892d8-a6", "ovs_interfaceid": "606892d8-a634-4999-8682-4966006bfb09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 03:50:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-e8e2b165-616d-4e0f-9044-f4f7a4408d2c req-249259fb-f983-4de4-ac4f-99e7281254a5 service nova] Acquired lock "refresh_cache-24b48ca5-a0df-4713-bd32-6b62a9ee8367" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:50:55 user nova-compute[103546]: DEBUG nova.network.neutron [req-e8e2b165-616d-4e0f-9044-f4f7a4408d2c req-249259fb-f983-4de4-ac4f-99e7281254a5 service nova] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] Refreshing network info cache for port 606892d8-a634-4999-8682-4966006bfb09 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:50:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] Start _get_guest_xml network_info=[{"id": "606892d8-a634-4999-8682-4966006bfb09", "address": "fa:16:3e:12:e0:cd", "network": {"id": "f27a9ae1-0635-4b3b-858d-fa6524d15c2d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-73312216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8db9ce0a02204d269a3beac9459f5c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap606892d8-a6", "ovs_interfaceid": "606892d8-a634-4999-8682-4966006bfb09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '5c6f539a-01e5-4478-bf8f-a14310b5d7dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 03:50:55 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:50:55 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:50:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 03:50:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 03:50:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 03:50:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 03:50:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 03:50:55 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 03:50:55 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 03:50:55 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 03:50:55 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 03:50:55 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 03:50:55 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 03:50:55 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 03:50:55 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 03:50:55 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 03:50:55 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 03:50:55 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 03:50:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:50:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-753705400',display_name='tempest-VolumesActionsTest-instance-753705400',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-753705400',id=15,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8db9ce0a02204d269a3beac9459f5c8a',ramdisk_id='',reservation_id='r-6rm7fv5c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1514502681',owner_user_name='tempest-VolumesActionsTest-1514502681-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:50:53Z,user_data=None,user_id='29f86d0d50ff44e79cf3c37416a5b632',uuid=24b48ca5-a0df-4713-bd32-6b62a9ee8367,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "606892d8-a634-4999-8682-4966006bfb09", "address": "fa:16:3e:12:e0:cd", "network": {"id": "f27a9ae1-0635-4b3b-858d-fa6524d15c2d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-73312216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8db9ce0a02204d269a3beac9459f5c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap606892d8-a6", "ovs_interfaceid": "606892d8-a634-4999-8682-4966006bfb09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 03:50:55 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Converting VIF {"id": "606892d8-a634-4999-8682-4966006bfb09", "address": "fa:16:3e:12:e0:cd", "network": {"id": "f27a9ae1-0635-4b3b-858d-fa6524d15c2d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-73312216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8db9ce0a02204d269a3beac9459f5c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap606892d8-a6", "ovs_interfaceid": "606892d8-a634-4999-8682-4966006bfb09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:50:55 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:e0:cd,bridge_name='br-int',has_traffic_filtering=True,id=606892d8-a634-4999-8682-4966006bfb09,network=Network(f27a9ae1-0635-4b3b-858d-fa6524d15c2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap606892d8-a6') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:50:55 user nova-compute[103546]: DEBUG nova.objects.instance [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Lazy-loading 'pci_devices' on Instance uuid 24b48ca5-a0df-4713-bd32-6b62a9ee8367 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:50:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] End _get_guest_xml xml=<domain type="kvm">
Nov 16 03:50:55 user nova-compute[103546]:   <uuid>24b48ca5-a0df-4713-bd32-6b62a9ee8367</uuid>
Nov 16 03:50:55 user nova-compute[103546]:   <name>instance-0000000f</name>
Nov 16 03:50:55 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 03:50:55 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 03:50:55 user nova-compute[103546]:   <metadata>
Nov 16 03:50:55 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 03:50:55 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 03:50:55 user nova-compute[103546]:       <nova:name>tempest-VolumesActionsTest-instance-753705400</nova:name>
Nov 16 03:50:55 user nova-compute[103546]:       <nova:creationTime>2023-11-16 03:50:55</nova:creationTime>
Nov 16 03:50:55 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 03:50:55 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 03:50:55 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 03:50:55 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 03:50:55 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 03:50:55 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 03:50:55 user nova-compute[103546]:       </nova:flavor>
Nov 16 03:50:55 user nova-compute[103546]:       <nova:owner>
Nov 16 03:50:55 user nova-compute[103546]:         <nova:user uuid="29f86d0d50ff44e79cf3c37416a5b632">tempest-VolumesActionsTest-1514502681-project-member</nova:user>
Nov 16 03:50:55 user nova-compute[103546]:         <nova:project uuid="8db9ce0a02204d269a3beac9459f5c8a">tempest-VolumesActionsTest-1514502681</nova:project>
Nov 16 03:50:55 user nova-compute[103546]:       </nova:owner>
Nov 16 03:50:55 user nova-compute[103546]:       <nova:root type="image" uuid="5c6f539a-01e5-4478-bf8f-a14310b5d7dd"/>
Nov 16 03:50:55 user nova-compute[103546]:       <nova:ports>
Nov 16 03:50:55 user nova-compute[103546]:         <nova:port uuid="606892d8-a634-4999-8682-4966006bfb09">
Nov 16 03:50:55 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 03:50:55 user nova-compute[103546]:         </nova:port>
Nov 16 03:50:55 user nova-compute[103546]:       </nova:ports>
Nov 16 03:50:55 user nova-compute[103546]:     </nova:instance>
Nov 16 03:50:55 user nova-compute[103546]:   </metadata>
Nov 16 03:50:55 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 03:50:55 user nova-compute[103546]:     <system>
Nov 16 03:50:55 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 03:50:55 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 03:50:55 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 03:50:55 user nova-compute[103546]:       <entry name="serial">24b48ca5-a0df-4713-bd32-6b62a9ee8367</entry>
Nov 16 03:50:55 user nova-compute[103546]:       <entry name="uuid">24b48ca5-a0df-4713-bd32-6b62a9ee8367</entry>
Nov 16 03:50:55 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 03:50:55 user nova-compute[103546]:     </system>
Nov 16 03:50:55 user nova-compute[103546]:   </sysinfo>
Nov 16 03:50:55 user nova-compute[103546]:   <os>
Nov 16 03:50:55 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 03:50:55 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 03:50:55 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 03:50:55 user nova-compute[103546]:   </os>
Nov 16 03:50:55 user nova-compute[103546]:   <features>
Nov 16 03:50:55 user nova-compute[103546]:     <acpi/>
Nov 16 03:50:55 user nova-compute[103546]:     <apic/>
Nov 16 03:50:55 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 03:50:55 user nova-compute[103546]:   </features>
Nov 16 03:50:55 user nova-compute[103546]:   <clock offset="utc">
Nov 16 03:50:55 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 03:50:55 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 03:50:55 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 03:50:55 user nova-compute[103546]:   </clock>
Nov 16 03:50:55 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 03:50:55 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 03:50:55 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 03:50:55 user nova-compute[103546]:   </cpu>
Nov 16 03:50:55 user nova-compute[103546]:   <devices>
Nov 16 03:50:55 user nova-compute[103546]:     <disk type="file" device="disk">
Nov 16 03:50:55 user nova-compute[103546]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 03:50:55 user nova-compute[103546]:       <source file="/opt/stack/data/nova/instances/24b48ca5-a0df-4713-bd32-6b62a9ee8367/disk"/>
Nov 16 03:50:55 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 03:50:55 user nova-compute[103546]:     </disk>
Nov 16 03:50:55 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 03:50:55 user nova-compute[103546]:       <mac address="fa:16:3e:12:e0:cd"/>
Nov 16 03:50:55 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:50:55 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 03:50:55 user nova-compute[103546]:       <target dev="tap606892d8-a6"/>
Nov 16 03:50:55 user nova-compute[103546]:     </interface>
Nov 16 03:50:55 user nova-compute[103546]:     <serial type="pty">
Nov 16 03:50:55 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/24b48ca5-a0df-4713-bd32-6b62a9ee8367/console.log" append="off"/>
Nov 16 03:50:55 user nova-compute[103546]:     </serial>
Nov 16 03:50:55 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 03:50:55 user nova-compute[103546]:     <video>
Nov 16 03:50:55 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:50:55 user nova-compute[103546]:     </video>
Nov 16 03:50:55 user nova-compute[103546]:     <rng model="virtio">
Nov 16 03:50:55 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 03:50:55 user nova-compute[103546]:     </rng>
Nov 16 03:50:55 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 03:50:55 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 03:50:55 user nova-compute[103546]:       <stats period="10"/>
Nov 16 03:50:55 user nova-compute[103546]:     </memballoon>
Nov 16 03:50:55 user nova-compute[103546]:   </devices>
Nov 16 03:50:55 user nova-compute[103546]: </domain>
Nov 16 03:50:55 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 03:50:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:50:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-753705400',display_name='tempest-VolumesActionsTest-instance-753705400',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-753705400',id=15,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8db9ce0a02204d269a3beac9459f5c8a',ramdisk_id='',reservation_id='r-6rm7fv5c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1514502681',owner_user_name='tempest-VolumesActionsTest-1514502681-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:50:53Z,user_data=None,user_id='29f86d0d50ff44e79cf3c37416a5b632',uuid=24b48ca5-a0df-4713-bd32-6b62a9ee8367,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "606892d8-a634-4999-8682-4966006bfb09", "address": "fa:16:3e:12:e0:cd", "network": {"id": "f27a9ae1-0635-4b3b-858d-fa6524d15c2d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-73312216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8db9ce0a02204d269a3beac9459f5c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap606892d8-a6", "ovs_interfaceid": "606892d8-a634-4999-8682-4966006bfb09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 03:50:55 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Converting VIF {"id": "606892d8-a634-4999-8682-4966006bfb09", "address": "fa:16:3e:12:e0:cd", "network": {"id": "f27a9ae1-0635-4b3b-858d-fa6524d15c2d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-73312216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8db9ce0a02204d269a3beac9459f5c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap606892d8-a6", "ovs_interfaceid": "606892d8-a634-4999-8682-4966006bfb09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:50:55 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:e0:cd,bridge_name='br-int',has_traffic_filtering=True,id=606892d8-a634-4999-8682-4966006bfb09,network=Network(f27a9ae1-0635-4b3b-858d-fa6524d15c2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap606892d8-a6') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:50:55 user nova-compute[103546]: DEBUG os_vif [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:e0:cd,bridge_name='br-int',has_traffic_filtering=True,id=606892d8-a634-4999-8682-4966006bfb09,network=Network(f27a9ae1-0635-4b3b-858d-fa6524d15c2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap606892d8-a6') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 03:50:55 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:55 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:50:55 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 03:50:55 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:55 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9c1d1e0b-3a18-5f75-ad54-5a2c48725be7', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:50:55 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:50:55 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:55 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap606892d8-a6, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:50:55 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap606892d8-a6, col_values=(('qos', UUID('2c1e1f8a-9100-46e3-a9e7-8ad6fe6932d8')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:50:55 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap606892d8-a6, col_values=(('external_ids', {'iface-id': '606892d8-a634-4999-8682-4966006bfb09', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:e0:cd', 'vm-uuid': '24b48ca5-a0df-4713-bd32-6b62a9ee8367'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:50:55 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:50:55 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:55 user nova-compute[103546]: INFO os_vif [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:e0:cd,bridge_name='br-int',has_traffic_filtering=True,id=606892d8-a634-4999-8682-4966006bfb09,network=Network(f27a9ae1-0635-4b3b-858d-fa6524d15c2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap606892d8-a6')
Nov 16 03:50:56 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:50:56 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] No VIF found with MAC fa:16:3e:12:e0:cd, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 03:50:56 user nova-compute[103546]: DEBUG nova.network.neutron [req-e8e2b165-616d-4e0f-9044-f4f7a4408d2c req-249259fb-f983-4de4-ac4f-99e7281254a5 service nova] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] Updated VIF entry in instance network info cache for port 606892d8-a634-4999-8682-4966006bfb09. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 03:50:56 user nova-compute[103546]: DEBUG nova.network.neutron [req-e8e2b165-616d-4e0f-9044-f4f7a4408d2c req-249259fb-f983-4de4-ac4f-99e7281254a5 service nova] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] Updating instance_info_cache with network_info: [{"id": "606892d8-a634-4999-8682-4966006bfb09", "address": "fa:16:3e:12:e0:cd", "network": {"id": "f27a9ae1-0635-4b3b-858d-fa6524d15c2d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-73312216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8db9ce0a02204d269a3beac9459f5c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap606892d8-a6", "ovs_interfaceid": "606892d8-a634-4999-8682-4966006bfb09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:50:56 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-e8e2b165-616d-4e0f-9044-f4f7a4408d2c req-249259fb-f983-4de4-ac4f-99e7281254a5 service nova] Releasing lock "refresh_cache-24b48ca5-a0df-4713-bd32-6b62a9ee8367" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:50:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:57 user nova-compute[103546]: DEBUG nova.compute.manager [req-16f450e0-ab14-42b2-9a30-73e28d3553dd req-833d3f7c-7505-427c-a316-328ea6779be7 service nova] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] Received event network-vif-plugged-606892d8-a634-4999-8682-4966006bfb09 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:50:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-16f450e0-ab14-42b2-9a30-73e28d3553dd req-833d3f7c-7505-427c-a316-328ea6779be7 service nova] Acquiring lock "24b48ca5-a0df-4713-bd32-6b62a9ee8367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:50:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-16f450e0-ab14-42b2-9a30-73e28d3553dd req-833d3f7c-7505-427c-a316-328ea6779be7 service nova] Lock "24b48ca5-a0df-4713-bd32-6b62a9ee8367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:50:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-16f450e0-ab14-42b2-9a30-73e28d3553dd req-833d3f7c-7505-427c-a316-328ea6779be7 service nova] Lock "24b48ca5-a0df-4713-bd32-6b62a9ee8367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:50:57 user nova-compute[103546]: DEBUG nova.compute.manager [req-16f450e0-ab14-42b2-9a30-73e28d3553dd req-833d3f7c-7505-427c-a316-328ea6779be7 service nova] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] No waiting events found dispatching network-vif-plugged-606892d8-a634-4999-8682-4966006bfb09 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:50:57 user nova-compute[103546]: WARNING nova.compute.manager [req-16f450e0-ab14-42b2-9a30-73e28d3553dd req-833d3f7c-7505-427c-a316-328ea6779be7 service nova] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] Received unexpected event network-vif-plugged-606892d8-a634-4999-8682-4966006bfb09 for instance with vm_state building and task_state spawning.
Nov 16 03:50:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:50:59 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0714b48-0f5f-4823-912c-6d0ecd9c4469 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 03:50:59 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0714b48-0f5f-4823-912c-6d0ecd9c4469 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7eff0073-6dd7-49ac-9520-557cb575b8b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CDuEMKkO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:50:59 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-d0714b48-0f5f-4823-912c-6d0ecd9c4469 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:50:59 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-d0714b48-0f5f-4823-912c-6d0ecd9c4469 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:50:59 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-d0714b48-0f5f-4823-912c-6d0ecd9c4469 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:50:59 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-d0714b48-0f5f-4823-912c-6d0ecd9c4469 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:50:59 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-d0714b48-0f5f-4823-912c-6d0ecd9c4469 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7eff0073-6dd7-49ac-9520-557cb575b8b5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:50:59 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-d0714b48-0f5f-4823-912c-6d0ecd9c4469 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7eff0073-6dd7-49ac-9520-557cb575b8b5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:50:59 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-d0714b48-0f5f-4823-912c-6d0ecd9c4469 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 03:50:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eff0073-6dd7-49ac-9520-557cb575b8b5 -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eff0073-6dd7-49ac-9520-557cb575b8b5 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:59 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef5a130-9101-4631-9580-2a2081f0c4fd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:50:59 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0714b48-0f5f-4823-912c-6d0ecd9c4469 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 03:50:59 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:50:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eff0073-6dd7-49ac-9520-557cb575b8b5 -p 172.16.0.220:3260 --interface default --op new {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eff0073-6dd7-49ac-9520-557cb575b8b5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:59 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa525b7-d709-49d5-9ca4-1fab61898a3c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7eff0073-6dd7-49ac-9520-557cb575b8b5] added\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:50:59 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0714b48-0f5f-4823-912c-6d0ecd9c4469 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7eff0073-6dd7-49ac-9520-557cb575b8b5] added
Nov 16 03:50:59 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:50:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eff0073-6dd7-49ac-9520-557cb575b8b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eff0073-6dd7-49ac-9520-557cb575b8b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:59 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e673042e-db4f-482c-bcc6-5b3af206ad02]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:50:59 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0714b48-0f5f-4823-912c-6d0ecd9c4469 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:50:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eff0073-6dd7-49ac-9520-557cb575b8b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eff0073-6dd7-49ac-9520-557cb575b8b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:59 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6c34d1-5a29-4abc-88fc-0ed771fde74e]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:50:59 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0714b48-0f5f-4823-912c-6d0ecd9c4469 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:50:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eff0073-6dd7-49ac-9520-557cb575b8b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CDuEMKkO {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eff0073-6dd7-49ac-9520-557cb575b8b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CDuEMKkO" returned: 0 in 0.049s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:59 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e4770d-626c-4592-9148-e8dd495ca675]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:50:59 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0714b48-0f5f-4823-912c-6d0ecd9c4469 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CDuEMKkO'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:50:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eff0073-6dd7-49ac-9520-557cb575b8b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eff0073-6dd7-49ac-9520-557cb575b8b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:59 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e9ce3f-b985-4a32-8073-d3d3e20a82b0]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:50:59 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0714b48-0f5f-4823-912c-6d0ecd9c4469 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:50:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:59 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97d643e-1f09-45ef-8597-e33ce7d74e95]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:50:59 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0714b48-0f5f-4823-912c-6d0ecd9c4469 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)
Nov 16 03:50:59 user nova-compute[103546]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9 (non-flash)
Nov 16 03:50:59 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:50:59 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0714b48-0f5f-4823-912c-6d0ecd9c4469 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)
Nov 16 03:50:59 user nova-compute[103546]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9 (non-flash)
Nov 16 03:50:59 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:50:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eff0073-6dd7-49ac-9520-557cb575b8b5 -p 172.16.0.220:3260 --login {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eff0073-6dd7-49ac-9520-557cb575b8b5 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:59 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ed8762-0d51-45ef-b6d7-045a3cae47b4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7eff0073-6dd7-49ac-9520-557cb575b8b5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7eff0073-6dd7-49ac-9520-557cb575b8b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:50:59 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0714b48-0f5f-4823-912c-6d0ecd9c4469 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7eff0073-6dd7-49ac-9520-557cb575b8b5, portal: 172.16.0.220,3260]
Nov 16 03:50:59 user nova-compute[103546]: Login to [iface: default, target: iqn.2010-10.org.openstack:7eff0073-6dd7-49ac-9520-557cb575b8b5, portal: 172.16.0.220,3260] successful.
Nov 16 03:50:59 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:50:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eff0073-6dd7-49ac-9520-557cb575b8b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eff0073-6dd7-49ac-9520-557cb575b8b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:59 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[9059fdc7-06ec-4d73-bd40-11aa9cebfbe1]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:50:59 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0714b48-0f5f-4823-912c-6d0ecd9c4469 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:50:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:59 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ffcf13-7065-4c65-8bfb-22de42a0b550]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff0073-6dd7-49ac-9520-557cb575b8b5 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:50:59 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0714b48-0f5f-4823-912c-6d0ecd9c4469 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)
Nov 16 03:50:59 user nova-compute[103546]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9 (non-flash)
Nov 16 03:50:59 user nova-compute[103546]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff0073-6dd7-49ac-9520-557cb575b8b5 (non-flash)
Nov 16 03:50:59 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:50:59 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0714b48-0f5f-4823-912c-6d0ecd9c4469 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)
Nov 16 03:50:59 user nova-compute[103546]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9 (non-flash)
Nov 16 03:50:59 user nova-compute[103546]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff0073-6dd7-49ac-9520-557cb575b8b5 (non-flash)
Nov 16 03:50:59 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:50:59 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-d0714b48-0f5f-4823-912c-6d0ecd9c4469 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7eff0073-6dd7-49ac-9520-557cb575b8b5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.351s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:50:59 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0714b48-0f5f-4823-912c-6d0ecd9c4469 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 03:50:59 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-d0714b48-0f5f-4823-912c-6d0ecd9c4469 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] HCTL ('35', '-', '-', 0) found on session 19 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 03:50:59 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-d0714b48-0f5f-4823-912c-6d0ecd9c4469 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 03:50:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:50:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:50:59 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef2381a-9cfa-4aa5-9f17-14bc35eadcd5]: (4, ('- - 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:50:59 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-d0714b48-0f5f-4823-912c-6d0ecd9c4469 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 03:50:59 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0714b48-0f5f-4823-912c-6d0ecd9c4469 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:7eff0073-6dd7-49ac-9520-557cb575b8b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CDuEMKkO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 03:50:59 user nova-compute[103546]: DEBUG nova.compute.manager [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 03:50:59 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] Guest created on hypervisor {{(pid=103546) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 03:50:59 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] Instance spawned successfully.
Nov 16 03:50:59 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 03:51:00 user nova-compute[103546]: DEBUG nova.compute.manager [req-d75eab69-f674-4132-a8de-d6a99793924f req-03fcf6b1-ac95-4b0d-8872-fd055a6fcc57 service nova] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] Received event network-vif-plugged-606892d8-a634-4999-8682-4966006bfb09 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:51:00 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d75eab69-f674-4132-a8de-d6a99793924f req-03fcf6b1-ac95-4b0d-8872-fd055a6fcc57 service nova] Acquiring lock "24b48ca5-a0df-4713-bd32-6b62a9ee8367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:51:00 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d75eab69-f674-4132-a8de-d6a99793924f req-03fcf6b1-ac95-4b0d-8872-fd055a6fcc57 service nova] Lock "24b48ca5-a0df-4713-bd32-6b62a9ee8367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:51:00 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d75eab69-f674-4132-a8de-d6a99793924f req-03fcf6b1-ac95-4b0d-8872-fd055a6fcc57 service nova] Lock "24b48ca5-a0df-4713-bd32-6b62a9ee8367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:51:00 user nova-compute[103546]: DEBUG nova.compute.manager [req-d75eab69-f674-4132-a8de-d6a99793924f req-03fcf6b1-ac95-4b0d-8872-fd055a6fcc57 service nova] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] No waiting events found dispatching network-vif-plugged-606892d8-a634-4999-8682-4966006bfb09 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:51:00 user nova-compute[103546]: WARNING nova.compute.manager [req-d75eab69-f674-4132-a8de-d6a99793924f req-03fcf6b1-ac95-4b0d-8872-fd055a6fcc57 service nova] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] Received unexpected event network-vif-plugged-606892d8-a634-4999-8682-4966006bfb09 for instance with vm_state building and task_state spawning.
Nov 16 03:51:00 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] Found default for hw_cdrom_bus of ide {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:51:00 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] Found default for hw_disk_bus of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:51:00 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] Found default for hw_input_bus of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:51:00 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] Found default for hw_pointer_model of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:51:00 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] Found default for hw_video_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:51:00 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] Found default for hw_vif_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:51:00 user nova-compute[103546]: INFO nova.compute.manager [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] Took 6.69 seconds to spawn the instance on the hypervisor.
Nov 16 03:51:00 user nova-compute[103546]: DEBUG nova.compute.manager [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 03:51:00 user nova-compute[103546]: INFO nova.compute.manager [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] Took 7.49 seconds to build instance.
Nov 16 03:51:00 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-69c00181-1983-4c26-9b6f-9df214450f30 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Lock "24b48ca5-a0df-4713-bd32-6b62a9ee8367" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.623s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:51:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-d0714b48-0f5f-4823-912c-6d0ecd9c4469 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.407s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:51:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0714b48-0f5f-4823-912c-6d0ecd9c4469 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] <== connect_volume: return (1408ms) {'type': 'block', 'scsi_wwn': '23631396530343562', 'path': '/dev/sdd'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:51:00 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0714b48-0f5f-4823-912c-6d0ecd9c4469 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631396530343562', 'path': '/dev/sdd'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 03:51:00 user nova-compute[103546]: DEBUG nova.objects.instance [None req-d0714b48-0f5f-4823-912c-6d0ecd9c4469 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lazy-loading 'flavor' on Instance uuid 63b95121-b211-42c3-831e-0392d4abd09a {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:51:00 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-d0714b48-0f5f-4823-912c-6d0ecd9c4469 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 03:51:00 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 03:51:00 user nova-compute[103546]:   <source dev="/dev/sdd"/>
Nov 16 03:51:00 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 03:51:00 user nova-compute[103546]:   <serial>7eff0073-6dd7-49ac-9520-557cb575b8b5</serial>
Nov 16 03:51:00 user nova-compute[103546]: </disk>
Nov 16 03:51:00 user nova-compute[103546]:  {{(pid=103546) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 03:51:00 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:01 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d0714b48-0f5f-4823-912c-6d0ecd9c4469 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:51:01 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d0714b48-0f5f-4823-912c-6d0ecd9c4469 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] No BDM found with device name vdb, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:51:01 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d0714b48-0f5f-4823-912c-6d0ecd9c4469 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] No VIF found with MAC fa:16:3e:d0:5b:e1, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 03:51:01 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:01 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d0714b48-0f5f-4823-912c-6d0ecd9c4469 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "63b95121-b211-42c3-831e-0392d4abd09a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.681s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:51:02 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:02 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Acquiring lock "04101512-7333-4581-add3-7af3821e335b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:51:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "04101512-7333-4581-add3-7af3821e335b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:51:03 user nova-compute[103546]: DEBUG nova.compute.manager [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 04101512-7333-4581-add3-7af3821e335b] Starting instance... {{(pid=103546) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 03:51:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:51:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:51:03 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=103546) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 03:51:03 user nova-compute[103546]: INFO nova.compute.claims [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 04101512-7333-4581-add3-7af3821e335b] Claim successful on node user
Nov 16 03:51:03 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:51:03 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:51:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.543s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:51:03 user nova-compute[103546]: DEBUG nova.compute.manager [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 04101512-7333-4581-add3-7af3821e335b] Start building networks asynchronously for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 03:51:03 user nova-compute[103546]: DEBUG nova.compute.manager [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 04101512-7333-4581-add3-7af3821e335b] Allocating IP information in the background. {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 03:51:03 user nova-compute[103546]: DEBUG nova.network.neutron [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 04101512-7333-4581-add3-7af3821e335b] allocate_for_instance() {{(pid=103546) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 03:51:03 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 04101512-7333-4581-add3-7af3821e335b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 03:51:03 user nova-compute[103546]: DEBUG nova.compute.manager [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 04101512-7333-4581-add3-7af3821e335b] Start building block device mappings for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 03:51:04 user nova-compute[103546]: DEBUG nova.compute.manager [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 04101512-7333-4581-add3-7af3821e335b] Start spawning the instance on the hypervisor. {{(pid=103546) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 03:51:04 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 04101512-7333-4581-add3-7af3821e335b] Creating instance directory {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 03:51:04 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 04101512-7333-4581-add3-7af3821e335b] Creating image(s)
Nov 16 03:51:04 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Acquiring lock "/opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:51:04 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "/opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:51:04 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "/opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:51:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:04 user nova-compute[103546]: DEBUG nova.policy [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e1176a2817ef428ea81e2fb18299a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2a38a5eb514ce8a7569c8322657eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103546) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 03:51:04 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-961d71de-211a-46aa-af47-d86a1c55a25a tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Acquiring lock "63b95121-b211-42c3-831e-0392d4abd09a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:51:04 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-961d71de-211a-46aa-af47-d86a1c55a25a tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "63b95121-b211-42c3-831e-0392d4abd09a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:51:04 user nova-compute[103546]: INFO nova.compute.manager [None req-961d71de-211a-46aa-af47-d86a1c55a25a tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Detaching volume 7eff0073-6dd7-49ac-9520-557cb575b8b5
Nov 16 03:51:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.200s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:04 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Acquiring lock "8c9efafb670bfe5842ba1f4ce398924612164af7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:51:04 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:51:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:04 user nova-compute[103546]: INFO nova.virt.block_device [None req-961d71de-211a-46aa-af47-d86a1c55a25a tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Attempting to driver detach volume 7eff0073-6dd7-49ac-9520-557cb575b8b5 from mountpoint /dev/vdb
Nov 16 03:51:04 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-961d71de-211a-46aa-af47-d86a1c55a25a tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Attempting to detach device vdb from instance 63b95121-b211-42c3-831e-0392d4abd09a from the persistent domain config. {{(pid=103546) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 03:51:04 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-961d71de-211a-46aa-af47-d86a1c55a25a tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 03:51:04 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 03:51:04 user nova-compute[103546]:   <source dev="/dev/sdd"/>
Nov 16 03:51:04 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 03:51:04 user nova-compute[103546]:   <serial>7eff0073-6dd7-49ac-9520-557cb575b8b5</serial>
Nov 16 03:51:04 user nova-compute[103546]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 03:51:04 user nova-compute[103546]: </disk>
Nov 16 03:51:04 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 03:51:04 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-961d71de-211a-46aa-af47-d86a1c55a25a tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Successfully detached device vdb from instance 63b95121-b211-42c3-831e-0392d4abd09a from the persistent domain config.
Nov 16 03:51:04 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-961d71de-211a-46aa-af47-d86a1c55a25a tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 63b95121-b211-42c3-831e-0392d4abd09a from the live domain config. {{(pid=103546) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 03:51:04 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-961d71de-211a-46aa-af47-d86a1c55a25a tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 03:51:04 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 03:51:04 user nova-compute[103546]:   <source dev="/dev/sdd"/>
Nov 16 03:51:04 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 03:51:04 user nova-compute[103546]:   <serial>7eff0073-6dd7-49ac-9520-557cb575b8b5</serial>
Nov 16 03:51:04 user nova-compute[103546]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 03:51:04 user nova-compute[103546]: </disk>
Nov 16 03:51:04 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 03:51:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.195s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk 1073741824 {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk 1073741824" returned: 0 in 0.089s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:04 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:51:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.191s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:04 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Checking if we can resize image /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk. size=1073741824 {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 03:51:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:04 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-961d71de-211a-46aa-af47-d86a1c55a25a tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 63b95121-b211-42c3-831e-0392d4abd09a {{(pid=103546) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 03:51:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:05 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Cannot resize image /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk to a smaller size. {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 03:51:05 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 04101512-7333-4581-add3-7af3821e335b] Created local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 03:51:05 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 04101512-7333-4581-add3-7af3821e335b] Ensure instance console log exists: /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/console.log {{(pid=103546) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 03:51:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:51:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:51:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:51:05 user nova-compute[103546]: DEBUG nova.network.neutron [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 04101512-7333-4581-add3-7af3821e335b] Successfully created port: 20bc48cc-9db0-49c8-8dd5-246c685c6884 {{(pid=103546) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 03:51:05 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:06 user nova-compute[103546]: DEBUG nova.network.neutron [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 04101512-7333-4581-add3-7af3821e335b] Successfully updated port: 20bc48cc-9db0-49c8-8dd5-246c685c6884 {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 03:51:06 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Acquiring lock "refresh_cache-04101512-7333-4581-add3-7af3821e335b" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:51:06 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Acquired lock "refresh_cache-04101512-7333-4581-add3-7af3821e335b" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:51:06 user nova-compute[103546]: DEBUG nova.network.neutron [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 04101512-7333-4581-add3-7af3821e335b] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 03:51:06 user nova-compute[103546]: DEBUG nova.compute.manager [req-f9178d8d-22fd-4dda-ab57-f6bad2e0f730 req-efac1646-dfea-4567-b38e-5d1e8814edb1 service nova] [instance: 04101512-7333-4581-add3-7af3821e335b] Received event network-changed-20bc48cc-9db0-49c8-8dd5-246c685c6884 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:51:06 user nova-compute[103546]: DEBUG nova.compute.manager [req-f9178d8d-22fd-4dda-ab57-f6bad2e0f730 req-efac1646-dfea-4567-b38e-5d1e8814edb1 service nova] [instance: 04101512-7333-4581-add3-7af3821e335b] Refreshing instance network info cache due to event network-changed-20bc48cc-9db0-49c8-8dd5-246c685c6884. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:51:06 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-f9178d8d-22fd-4dda-ab57-f6bad2e0f730 req-efac1646-dfea-4567-b38e-5d1e8814edb1 service nova] Acquiring lock "refresh_cache-04101512-7333-4581-add3-7af3821e335b" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:51:06 user nova-compute[103546]: DEBUG nova.network.neutron [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 04101512-7333-4581-add3-7af3821e335b] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 03:51:06 user nova-compute[103546]: DEBUG nova.network.neutron [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 04101512-7333-4581-add3-7af3821e335b] Updating instance_info_cache with network_info: [{"id": "20bc48cc-9db0-49c8-8dd5-246c685c6884", "address": "fa:16:3e:a5:d9:dc", "network": {"id": "fdbb2d2c-9a54-4517-b33a-cf27ce7570b1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79661471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2a38a5eb514ce8a7569c8322657eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20bc48cc-9d", "ovs_interfaceid": "20bc48cc-9db0-49c8-8dd5-246c685c6884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:51:06 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Releasing lock "refresh_cache-04101512-7333-4581-add3-7af3821e335b" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:51:06 user nova-compute[103546]: DEBUG nova.compute.manager [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 04101512-7333-4581-add3-7af3821e335b] Instance network_info: |[{"id": "20bc48cc-9db0-49c8-8dd5-246c685c6884", "address": "fa:16:3e:a5:d9:dc", "network": {"id": "fdbb2d2c-9a54-4517-b33a-cf27ce7570b1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79661471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2a38a5eb514ce8a7569c8322657eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20bc48cc-9d", "ovs_interfaceid": "20bc48cc-9db0-49c8-8dd5-246c685c6884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 03:51:06 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-f9178d8d-22fd-4dda-ab57-f6bad2e0f730 req-efac1646-dfea-4567-b38e-5d1e8814edb1 service nova] Acquired lock "refresh_cache-04101512-7333-4581-add3-7af3821e335b" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:51:06 user nova-compute[103546]: DEBUG nova.network.neutron [req-f9178d8d-22fd-4dda-ab57-f6bad2e0f730 req-efac1646-dfea-4567-b38e-5d1e8814edb1 service nova] [instance: 04101512-7333-4581-add3-7af3821e335b] Refreshing network info cache for port 20bc48cc-9db0-49c8-8dd5-246c685c6884 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:51:06 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 04101512-7333-4581-add3-7af3821e335b] Start _get_guest_xml network_info=[{"id": "20bc48cc-9db0-49c8-8dd5-246c685c6884", "address": "fa:16:3e:a5:d9:dc", "network": {"id": "fdbb2d2c-9a54-4517-b33a-cf27ce7570b1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79661471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2a38a5eb514ce8a7569c8322657eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20bc48cc-9d", "ovs_interfaceid": "20bc48cc-9db0-49c8-8dd5-246c685c6884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '5c6f539a-01e5-4478-bf8f-a14310b5d7dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 03:51:06 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:51:06 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:51:06 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 03:51:06 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 03:51:06 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 03:51:06 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 03:51:06 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 03:51:06 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 03:51:06 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 03:51:06 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 03:51:06 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 03:51:06 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 03:51:06 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 03:51:06 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 03:51:06 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 03:51:06 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 03:51:06 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 03:51:06 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 03:51:06 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:51:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-999070143',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-999070143',id=16,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f2a38a5eb514ce8a7569c8322657eac',ramdisk_id='',reservation_id='r-deszru9j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1634874924',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:51:04Z,user_data=None,user_id='e1176a2817ef428ea81e2fb18299a306',uuid=04101512-7333-4581-add3-7af3821e335b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20bc48cc-9db0-49c8-8dd5-246c685c6884", "address": "fa:16:3e:a5:d9:dc", "network": {"id": "fdbb2d2c-9a54-4517-b33a-cf27ce7570b1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79661471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2a38a5eb514ce8a7569c8322657eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20bc48cc-9d", "ovs_interfaceid": "20bc48cc-9db0-49c8-8dd5-246c685c6884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 03:51:06 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Converting VIF {"id": "20bc48cc-9db0-49c8-8dd5-246c685c6884", "address": "fa:16:3e:a5:d9:dc", "network": {"id": "fdbb2d2c-9a54-4517-b33a-cf27ce7570b1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79661471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2a38a5eb514ce8a7569c8322657eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20bc48cc-9d", "ovs_interfaceid": "20bc48cc-9db0-49c8-8dd5-246c685c6884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:51:06 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:d9:dc,bridge_name='br-int',has_traffic_filtering=True,id=20bc48cc-9db0-49c8-8dd5-246c685c6884,network=Network(fdbb2d2c-9a54-4517-b33a-cf27ce7570b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20bc48cc-9d') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:51:06 user nova-compute[103546]: DEBUG nova.objects.instance [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lazy-loading 'pci_devices' on Instance uuid 04101512-7333-4581-add3-7af3821e335b {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:51:06 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 04101512-7333-4581-add3-7af3821e335b] End _get_guest_xml xml=<domain type="kvm">
Nov 16 03:51:06 user nova-compute[103546]:   <uuid>04101512-7333-4581-add3-7af3821e335b</uuid>
Nov 16 03:51:06 user nova-compute[103546]:   <name>instance-00000010</name>
Nov 16 03:51:06 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 03:51:06 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 03:51:06 user nova-compute[103546]:   <metadata>
Nov 16 03:51:06 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 03:51:06 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 03:51:06 user nova-compute[103546]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-999070143</nova:name>
Nov 16 03:51:06 user nova-compute[103546]:       <nova:creationTime>2023-11-16 03:51:06</nova:creationTime>
Nov 16 03:51:06 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 03:51:06 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 03:51:06 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 03:51:06 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 03:51:06 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 03:51:06 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 03:51:06 user nova-compute[103546]:       </nova:flavor>
Nov 16 03:51:06 user nova-compute[103546]:       <nova:owner>
Nov 16 03:51:06 user nova-compute[103546]:         <nova:user uuid="e1176a2817ef428ea81e2fb18299a306">tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member</nova:user>
Nov 16 03:51:06 user nova-compute[103546]:         <nova:project uuid="6f2a38a5eb514ce8a7569c8322657eac">tempest-ServerBootFromVolumeStableRescueTest-1634874924</nova:project>
Nov 16 03:51:06 user nova-compute[103546]:       </nova:owner>
Nov 16 03:51:06 user nova-compute[103546]:       <nova:root type="image" uuid="5c6f539a-01e5-4478-bf8f-a14310b5d7dd"/>
Nov 16 03:51:06 user nova-compute[103546]:       <nova:ports>
Nov 16 03:51:06 user nova-compute[103546]:         <nova:port uuid="20bc48cc-9db0-49c8-8dd5-246c685c6884">
Nov 16 03:51:06 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 16 03:51:06 user nova-compute[103546]:         </nova:port>
Nov 16 03:51:06 user nova-compute[103546]:       </nova:ports>
Nov 16 03:51:06 user nova-compute[103546]:     </nova:instance>
Nov 16 03:51:06 user nova-compute[103546]:   </metadata>
Nov 16 03:51:06 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 03:51:06 user nova-compute[103546]:     <system>
Nov 16 03:51:06 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 03:51:06 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 03:51:06 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 03:51:06 user nova-compute[103546]:       <entry name="serial">04101512-7333-4581-add3-7af3821e335b</entry>
Nov 16 03:51:06 user nova-compute[103546]:       <entry name="uuid">04101512-7333-4581-add3-7af3821e335b</entry>
Nov 16 03:51:06 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 03:51:06 user nova-compute[103546]:     </system>
Nov 16 03:51:06 user nova-compute[103546]:   </sysinfo>
Nov 16 03:51:06 user nova-compute[103546]:   <os>
Nov 16 03:51:06 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 03:51:06 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 03:51:06 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 03:51:06 user nova-compute[103546]:   </os>
Nov 16 03:51:06 user nova-compute[103546]:   <features>
Nov 16 03:51:06 user nova-compute[103546]:     <acpi/>
Nov 16 03:51:06 user nova-compute[103546]:     <apic/>
Nov 16 03:51:06 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 03:51:06 user nova-compute[103546]:   </features>
Nov 16 03:51:06 user nova-compute[103546]:   <clock offset="utc">
Nov 16 03:51:06 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 03:51:06 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 03:51:06 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 03:51:06 user nova-compute[103546]:   </clock>
Nov 16 03:51:06 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 03:51:06 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 03:51:06 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 03:51:06 user nova-compute[103546]:   </cpu>
Nov 16 03:51:06 user nova-compute[103546]:   <devices>
Nov 16 03:51:06 user nova-compute[103546]:     <disk type="file" device="disk">
Nov 16 03:51:06 user nova-compute[103546]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 03:51:06 user nova-compute[103546]:       <source file="/opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk"/>
Nov 16 03:51:06 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 03:51:06 user nova-compute[103546]:     </disk>
Nov 16 03:51:06 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 03:51:06 user nova-compute[103546]:       <mac address="fa:16:3e:a5:d9:dc"/>
Nov 16 03:51:06 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:51:06 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 03:51:06 user nova-compute[103546]:       <target dev="tap20bc48cc-9d"/>
Nov 16 03:51:06 user nova-compute[103546]:     </interface>
Nov 16 03:51:06 user nova-compute[103546]:     <serial type="pty">
Nov 16 03:51:06 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/console.log" append="off"/>
Nov 16 03:51:06 user nova-compute[103546]:     </serial>
Nov 16 03:51:06 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 03:51:06 user nova-compute[103546]:     <video>
Nov 16 03:51:06 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:51:06 user nova-compute[103546]:     </video>
Nov 16 03:51:06 user nova-compute[103546]:     <rng model="virtio">
Nov 16 03:51:06 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 03:51:06 user nova-compute[103546]:     </rng>
Nov 16 03:51:06 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 03:51:06 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 03:51:06 user nova-compute[103546]:       <stats period="10"/>
Nov 16 03:51:06 user nova-compute[103546]:     </memballoon>
Nov 16 03:51:06 user nova-compute[103546]:   </devices>
Nov 16 03:51:06 user nova-compute[103546]: </domain>
Nov 16 03:51:06 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 03:51:06 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:51:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-999070143',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-999070143',id=16,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f2a38a5eb514ce8a7569c8322657eac',ramdisk_id='',reservation_id='r-deszru9j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1634874924',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:51:04Z,user_data=None,user_id='e1176a2817ef428ea81e2fb18299a306',uuid=04101512-7333-4581-add3-7af3821e335b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20bc48cc-9db0-49c8-8dd5-246c685c6884", "address": "fa:16:3e:a5:d9:dc", "network": {"id": "fdbb2d2c-9a54-4517-b33a-cf27ce7570b1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79661471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2a38a5eb514ce8a7569c8322657eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20bc48cc-9d", "ovs_interfaceid": "20bc48cc-9db0-49c8-8dd5-246c685c6884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 03:51:06 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Converting VIF {"id": "20bc48cc-9db0-49c8-8dd5-246c685c6884", "address": "fa:16:3e:a5:d9:dc", "network": {"id": "fdbb2d2c-9a54-4517-b33a-cf27ce7570b1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79661471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2a38a5eb514ce8a7569c8322657eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20bc48cc-9d", "ovs_interfaceid": "20bc48cc-9db0-49c8-8dd5-246c685c6884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:51:06 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:d9:dc,bridge_name='br-int',has_traffic_filtering=True,id=20bc48cc-9db0-49c8-8dd5-246c685c6884,network=Network(fdbb2d2c-9a54-4517-b33a-cf27ce7570b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20bc48cc-9d') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:51:06 user nova-compute[103546]: DEBUG os_vif [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:d9:dc,bridge_name='br-int',has_traffic_filtering=True,id=20bc48cc-9db0-49c8-8dd5-246c685c6884,network=Network(fdbb2d2c-9a54-4517-b33a-cf27ce7570b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20bc48cc-9d') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 03:51:06 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:06 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:51:06 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 03:51:06 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:06 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '84dc7854-37f6-5436-966d-b1f9babec29f', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:51:06 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:06 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:51:06 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:06 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap20bc48cc-9d, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:51:06 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap20bc48cc-9d, col_values=(('qos', UUID('5aac755b-94e1-45b3-8c4a-ac84bed5536e')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:51:06 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap20bc48cc-9d, col_values=(('external_ids', {'iface-id': '20bc48cc-9db0-49c8-8dd5-246c685c6884', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:d9:dc', 'vm-uuid': '04101512-7333-4581-add3-7af3821e335b'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:51:06 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:06 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:51:06 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:06 user nova-compute[103546]: INFO os_vif [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:d9:dc,bridge_name='br-int',has_traffic_filtering=True,id=20bc48cc-9db0-49c8-8dd5-246c685c6884,network=Network(fdbb2d2c-9a54-4517-b33a-cf27ce7570b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20bc48cc-9d')
Nov 16 03:51:06 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:51:06 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] No VIF found with MAC fa:16:3e:a5:d9:dc, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 03:51:06 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:06 user nova-compute[103546]: DEBUG nova.network.neutron [req-f9178d8d-22fd-4dda-ab57-f6bad2e0f730 req-efac1646-dfea-4567-b38e-5d1e8814edb1 service nova] [instance: 04101512-7333-4581-add3-7af3821e335b] Updated VIF entry in instance network info cache for port 20bc48cc-9db0-49c8-8dd5-246c685c6884. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 03:51:06 user nova-compute[103546]: DEBUG nova.network.neutron [req-f9178d8d-22fd-4dda-ab57-f6bad2e0f730 req-efac1646-dfea-4567-b38e-5d1e8814edb1 service nova] [instance: 04101512-7333-4581-add3-7af3821e335b] Updating instance_info_cache with network_info: [{"id": "20bc48cc-9db0-49c8-8dd5-246c685c6884", "address": "fa:16:3e:a5:d9:dc", "network": {"id": "fdbb2d2c-9a54-4517-b33a-cf27ce7570b1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79661471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2a38a5eb514ce8a7569c8322657eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20bc48cc-9d", "ovs_interfaceid": "20bc48cc-9db0-49c8-8dd5-246c685c6884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:51:06 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-f9178d8d-22fd-4dda-ab57-f6bad2e0f730 req-efac1646-dfea-4567-b38e-5d1e8814edb1 service nova] Releasing lock "refresh_cache-04101512-7333-4581-add3-7af3821e335b" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:51:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:08 user nova-compute[103546]: DEBUG nova.compute.manager [req-ebf686d3-b2a4-402e-8942-66b130f30065 req-2ef55408-846f-4a98-98ba-8dcb70fac13f service nova] [instance: 04101512-7333-4581-add3-7af3821e335b] Received event network-vif-plugged-20bc48cc-9db0-49c8-8dd5-246c685c6884 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:51:08 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ebf686d3-b2a4-402e-8942-66b130f30065 req-2ef55408-846f-4a98-98ba-8dcb70fac13f service nova] Acquiring lock "04101512-7333-4581-add3-7af3821e335b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:51:08 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ebf686d3-b2a4-402e-8942-66b130f30065 req-2ef55408-846f-4a98-98ba-8dcb70fac13f service nova] Lock "04101512-7333-4581-add3-7af3821e335b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:51:08 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ebf686d3-b2a4-402e-8942-66b130f30065 req-2ef55408-846f-4a98-98ba-8dcb70fac13f service nova] Lock "04101512-7333-4581-add3-7af3821e335b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:51:08 user nova-compute[103546]: DEBUG nova.compute.manager [req-ebf686d3-b2a4-402e-8942-66b130f30065 req-2ef55408-846f-4a98-98ba-8dcb70fac13f service nova] [instance: 04101512-7333-4581-add3-7af3821e335b] No waiting events found dispatching network-vif-plugged-20bc48cc-9db0-49c8-8dd5-246c685c6884 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:51:08 user nova-compute[103546]: WARNING nova.compute.manager [req-ebf686d3-b2a4-402e-8942-66b130f30065 req-2ef55408-846f-4a98-98ba-8dcb70fac13f service nova] [instance: 04101512-7333-4581-add3-7af3821e335b] Received unexpected event network-vif-plugged-20bc48cc-9db0-49c8-8dd5-246c685c6884 for instance with vm_state building and task_state spawning.
Nov 16 03:51:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:10 user nova-compute[103546]: DEBUG nova.compute.manager [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 04101512-7333-4581-add3-7af3821e335b] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 03:51:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 04101512-7333-4581-add3-7af3821e335b] Guest created on hypervisor {{(pid=103546) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 03:51:10 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 04101512-7333-4581-add3-7af3821e335b] Instance spawned successfully.
Nov 16 03:51:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 04101512-7333-4581-add3-7af3821e335b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 03:51:10 user nova-compute[103546]: DEBUG nova.compute.manager [req-7c5a1eb3-f43f-4db8-8dbe-3a0bc424cd85 req-1262ea46-9b79-4887-abf4-45d0b48590e8 service nova] [instance: 04101512-7333-4581-add3-7af3821e335b] Received event network-vif-plugged-20bc48cc-9db0-49c8-8dd5-246c685c6884 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:51:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-7c5a1eb3-f43f-4db8-8dbe-3a0bc424cd85 req-1262ea46-9b79-4887-abf4-45d0b48590e8 service nova] Acquiring lock "04101512-7333-4581-add3-7af3821e335b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:51:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-7c5a1eb3-f43f-4db8-8dbe-3a0bc424cd85 req-1262ea46-9b79-4887-abf4-45d0b48590e8 service nova] Lock "04101512-7333-4581-add3-7af3821e335b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:51:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-7c5a1eb3-f43f-4db8-8dbe-3a0bc424cd85 req-1262ea46-9b79-4887-abf4-45d0b48590e8 service nova] Lock "04101512-7333-4581-add3-7af3821e335b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:51:10 user nova-compute[103546]: DEBUG nova.compute.manager [req-7c5a1eb3-f43f-4db8-8dbe-3a0bc424cd85 req-1262ea46-9b79-4887-abf4-45d0b48590e8 service nova] [instance: 04101512-7333-4581-add3-7af3821e335b] No waiting events found dispatching network-vif-plugged-20bc48cc-9db0-49c8-8dd5-246c685c6884 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:51:10 user nova-compute[103546]: WARNING nova.compute.manager [req-7c5a1eb3-f43f-4db8-8dbe-3a0bc424cd85 req-1262ea46-9b79-4887-abf4-45d0b48590e8 service nova] [instance: 04101512-7333-4581-add3-7af3821e335b] Received unexpected event network-vif-plugged-20bc48cc-9db0-49c8-8dd5-246c685c6884 for instance with vm_state building and task_state spawning.
Nov 16 03:51:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 04101512-7333-4581-add3-7af3821e335b] Found default for hw_cdrom_bus of ide {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:51:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 04101512-7333-4581-add3-7af3821e335b] Found default for hw_disk_bus of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:51:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 04101512-7333-4581-add3-7af3821e335b] Found default for hw_input_bus of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:51:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 04101512-7333-4581-add3-7af3821e335b] Found default for hw_pointer_model of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:51:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 04101512-7333-4581-add3-7af3821e335b] Found default for hw_video_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:51:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 04101512-7333-4581-add3-7af3821e335b] Found default for hw_vif_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:51:10 user nova-compute[103546]: INFO nova.compute.manager [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 04101512-7333-4581-add3-7af3821e335b] Took 6.68 seconds to spawn the instance on the hypervisor.
Nov 16 03:51:10 user nova-compute[103546]: DEBUG nova.compute.manager [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 04101512-7333-4581-add3-7af3821e335b] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 03:51:10 user nova-compute[103546]: INFO nova.compute.manager [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 04101512-7333-4581-add3-7af3821e335b] Took 7.72 seconds to build instance.
Nov 16 03:51:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-932efe6e-9e21-412a-8128-5fae49034a50 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "04101512-7333-4581-add3-7af3821e335b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.831s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:51:11 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:11 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Acquiring lock "6a9afa69-2674-46fc-8e30-e196928ff07c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:51:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Lock "6a9afa69-2674-46fc-8e30-e196928ff07c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:51:13 user nova-compute[103546]: DEBUG nova.compute.manager [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] Starting instance... {{(pid=103546) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 03:51:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:51:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:51:13 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=103546) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 03:51:13 user nova-compute[103546]: INFO nova.compute.claims [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] Claim successful on node user
Nov 16 03:51:14 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:51:14 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:51:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.493s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:51:14 user nova-compute[103546]: DEBUG nova.compute.manager [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] Start building networks asynchronously for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 03:51:14 user nova-compute[103546]: DEBUG nova.compute.manager [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] Allocating IP information in the background. {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 03:51:14 user nova-compute[103546]: DEBUG nova.network.neutron [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] allocate_for_instance() {{(pid=103546) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 03:51:14 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 03:51:14 user nova-compute[103546]: DEBUG nova.compute.manager [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] Start building block device mappings for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 03:51:14 user nova-compute[103546]: DEBUG nova.policy [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0041f0189e09484481d362f3108e47f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fbb710b153d435da880b41ad2a8f1bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103546) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 03:51:14 user nova-compute[103546]: DEBUG nova.compute.manager [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] Start spawning the instance on the hypervisor. {{(pid=103546) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 03:51:14 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] Creating instance directory {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 03:51:14 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] Creating image(s)
Nov 16 03:51:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Acquiring lock "/opt/stack/data/nova/instances/6a9afa69-2674-46fc-8e30-e196928ff07c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:51:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Lock "/opt/stack/data/nova/instances/6a9afa69-2674-46fc-8e30-e196928ff07c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:51:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Lock "/opt/stack/data/nova/instances/6a9afa69-2674-46fc-8e30-e196928ff07c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:51:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.240s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Acquiring lock "8c9efafb670bfe5842ba1f4ce398924612164af7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:51:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:51:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.225s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/6a9afa69-2674-46fc-8e30-e196928ff07c/disk 1073741824 {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/6a9afa69-2674-46fc-8e30-e196928ff07c/disk 1073741824" returned: 0 in 0.049s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:51:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:15 user nova-compute[103546]: DEBUG nova.network.neutron [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] Successfully created port: efdedcd3-0071-412e-bd4a-e2a518ee4bf9 {{(pid=103546) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 03:51:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.207s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:15 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6a9afa69-2674-46fc-8e30-e196928ff07c/disk. size=1073741824 {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 03:51:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9afa69-2674-46fc-8e30-e196928ff07c/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9afa69-2674-46fc-8e30-e196928ff07c/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:15 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Cannot resize image /opt/stack/data/nova/instances/6a9afa69-2674-46fc-8e30-e196928ff07c/disk to a smaller size. {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 03:51:15 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] Created local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 03:51:15 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] Ensure instance console log exists: /opt/stack/data/nova/instances/6a9afa69-2674-46fc-8e30-e196928ff07c/console.log {{(pid=103546) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 03:51:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:51:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:51:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG nova.network.neutron [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] Successfully updated port: efdedcd3-0071-412e-bd4a-e2a518ee4bf9 {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Acquiring lock "refresh_cache-6a9afa69-2674-46fc-8e30-e196928ff07c" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Acquired lock "refresh_cache-6a9afa69-2674-46fc-8e30-e196928ff07c" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG nova.network.neutron [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG nova.compute.manager [req-ae3a7a8c-233c-4f87-90e9-3a898ed72f5a req-8f6876e2-66df-4804-a61d-d50101f7dce6 service nova] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] Received event network-changed-efdedcd3-0071-412e-bd4a-e2a518ee4bf9 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG nova.compute.manager [req-ae3a7a8c-233c-4f87-90e9-3a898ed72f5a req-8f6876e2-66df-4804-a61d-d50101f7dce6 service nova] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] Refreshing instance network info cache due to event network-changed-efdedcd3-0071-412e-bd4a-e2a518ee4bf9. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ae3a7a8c-233c-4f87-90e9-3a898ed72f5a req-8f6876e2-66df-4804-a61d-d50101f7dce6 service nova] Acquiring lock "refresh_cache-6a9afa69-2674-46fc-8e30-e196928ff07c" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG nova.network.neutron [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG nova.network.neutron [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] Updating instance_info_cache with network_info: [{"id": "efdedcd3-0071-412e-bd4a-e2a518ee4bf9", "address": "fa:16:3e:e5:1d:2e", "network": {"id": "7ed01459-90d0-4fe4-863b-fe90be1d41a0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1311268077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fbb710b153d435da880b41ad2a8f1bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefdedcd3-00", "ovs_interfaceid": "efdedcd3-0071-412e-bd4a-e2a518ee4bf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Releasing lock "refresh_cache-6a9afa69-2674-46fc-8e30-e196928ff07c" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG nova.compute.manager [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] Instance network_info: |[{"id": "efdedcd3-0071-412e-bd4a-e2a518ee4bf9", "address": "fa:16:3e:e5:1d:2e", "network": {"id": "7ed01459-90d0-4fe4-863b-fe90be1d41a0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1311268077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fbb710b153d435da880b41ad2a8f1bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefdedcd3-00", "ovs_interfaceid": "efdedcd3-0071-412e-bd4a-e2a518ee4bf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ae3a7a8c-233c-4f87-90e9-3a898ed72f5a req-8f6876e2-66df-4804-a61d-d50101f7dce6 service nova] Acquired lock "refresh_cache-6a9afa69-2674-46fc-8e30-e196928ff07c" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG nova.network.neutron [req-ae3a7a8c-233c-4f87-90e9-3a898ed72f5a req-8f6876e2-66df-4804-a61d-d50101f7dce6 service nova] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] Refreshing network info cache for port efdedcd3-0071-412e-bd4a-e2a518ee4bf9 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] Start _get_guest_xml network_info=[{"id": "efdedcd3-0071-412e-bd4a-e2a518ee4bf9", "address": "fa:16:3e:e5:1d:2e", "network": {"id": "7ed01459-90d0-4fe4-863b-fe90be1d41a0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1311268077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fbb710b153d435da880b41ad2a8f1bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefdedcd3-00", "ovs_interfaceid": "efdedcd3-0071-412e-bd4a-e2a518ee4bf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '5c6f539a-01e5-4478-bf8f-a14310b5d7dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 03:51:16 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:51:16 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:51:16 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:51:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-606707385',display_name='tempest-DeleteServersTestJSON-server-606707385',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-606707385',id=17,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fbb710b153d435da880b41ad2a8f1bd',ramdisk_id='',reservation_id='r-rd9nw473',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-750089832',owner_user_name='tempest-DeleteServersTestJSON-750089832-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:51:14Z,user_data=None,user_id='0041f0189e09484481d362f3108e47f2',uuid=6a9afa69-2674-46fc-8e30-e196928ff07c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "efdedcd3-0071-412e-bd4a-e2a518ee4bf9", "address": "fa:16:3e:e5:1d:2e", "network": {"id": "7ed01459-90d0-4fe4-863b-fe90be1d41a0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1311268077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fbb710b153d435da880b41ad2a8f1bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefdedcd3-00", "ovs_interfaceid": "efdedcd3-0071-412e-bd4a-e2a518ee4bf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Converting VIF {"id": "efdedcd3-0071-412e-bd4a-e2a518ee4bf9", "address": "fa:16:3e:e5:1d:2e", "network": {"id": "7ed01459-90d0-4fe4-863b-fe90be1d41a0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1311268077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fbb710b153d435da880b41ad2a8f1bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefdedcd3-00", "ovs_interfaceid": "efdedcd3-0071-412e-bd4a-e2a518ee4bf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:1d:2e,bridge_name='br-int',has_traffic_filtering=True,id=efdedcd3-0071-412e-bd4a-e2a518ee4bf9,network=Network(7ed01459-90d0-4fe4-863b-fe90be1d41a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefdedcd3-00') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG nova.objects.instance [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Lazy-loading 'pci_devices' on Instance uuid 6a9afa69-2674-46fc-8e30-e196928ff07c {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] End _get_guest_xml xml=<domain type="kvm">
Nov 16 03:51:16 user nova-compute[103546]:   <uuid>6a9afa69-2674-46fc-8e30-e196928ff07c</uuid>
Nov 16 03:51:16 user nova-compute[103546]:   <name>instance-00000011</name>
Nov 16 03:51:16 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 03:51:16 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 03:51:16 user nova-compute[103546]:   <metadata>
Nov 16 03:51:16 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 03:51:16 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 03:51:16 user nova-compute[103546]:       <nova:name>tempest-DeleteServersTestJSON-server-606707385</nova:name>
Nov 16 03:51:16 user nova-compute[103546]:       <nova:creationTime>2023-11-16 03:51:16</nova:creationTime>
Nov 16 03:51:16 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 03:51:16 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 03:51:16 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 03:51:16 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 03:51:16 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 03:51:16 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 03:51:16 user nova-compute[103546]:       </nova:flavor>
Nov 16 03:51:16 user nova-compute[103546]:       <nova:owner>
Nov 16 03:51:16 user nova-compute[103546]:         <nova:user uuid="0041f0189e09484481d362f3108e47f2">tempest-DeleteServersTestJSON-750089832-project-member</nova:user>
Nov 16 03:51:16 user nova-compute[103546]:         <nova:project uuid="5fbb710b153d435da880b41ad2a8f1bd">tempest-DeleteServersTestJSON-750089832</nova:project>
Nov 16 03:51:16 user nova-compute[103546]:       </nova:owner>
Nov 16 03:51:16 user nova-compute[103546]:       <nova:root type="image" uuid="5c6f539a-01e5-4478-bf8f-a14310b5d7dd"/>
Nov 16 03:51:16 user nova-compute[103546]:       <nova:ports>
Nov 16 03:51:16 user nova-compute[103546]:         <nova:port uuid="efdedcd3-0071-412e-bd4a-e2a518ee4bf9">
Nov 16 03:51:16 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 03:51:16 user nova-compute[103546]:         </nova:port>
Nov 16 03:51:16 user nova-compute[103546]:       </nova:ports>
Nov 16 03:51:16 user nova-compute[103546]:     </nova:instance>
Nov 16 03:51:16 user nova-compute[103546]:   </metadata>
Nov 16 03:51:16 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 03:51:16 user nova-compute[103546]:     <system>
Nov 16 03:51:16 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 03:51:16 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 03:51:16 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 03:51:16 user nova-compute[103546]:       <entry name="serial">6a9afa69-2674-46fc-8e30-e196928ff07c</entry>
Nov 16 03:51:16 user nova-compute[103546]:       <entry name="uuid">6a9afa69-2674-46fc-8e30-e196928ff07c</entry>
Nov 16 03:51:16 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 03:51:16 user nova-compute[103546]:     </system>
Nov 16 03:51:16 user nova-compute[103546]:   </sysinfo>
Nov 16 03:51:16 user nova-compute[103546]:   <os>
Nov 16 03:51:16 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 03:51:16 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 03:51:16 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 03:51:16 user nova-compute[103546]:   </os>
Nov 16 03:51:16 user nova-compute[103546]:   <features>
Nov 16 03:51:16 user nova-compute[103546]:     <acpi/>
Nov 16 03:51:16 user nova-compute[103546]:     <apic/>
Nov 16 03:51:16 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 03:51:16 user nova-compute[103546]:   </features>
Nov 16 03:51:16 user nova-compute[103546]:   <clock offset="utc">
Nov 16 03:51:16 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 03:51:16 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 03:51:16 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 03:51:16 user nova-compute[103546]:   </clock>
Nov 16 03:51:16 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 03:51:16 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 03:51:16 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 03:51:16 user nova-compute[103546]:   </cpu>
Nov 16 03:51:16 user nova-compute[103546]:   <devices>
Nov 16 03:51:16 user nova-compute[103546]:     <disk type="file" device="disk">
Nov 16 03:51:16 user nova-compute[103546]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 03:51:16 user nova-compute[103546]:       <source file="/opt/stack/data/nova/instances/6a9afa69-2674-46fc-8e30-e196928ff07c/disk"/>
Nov 16 03:51:16 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 03:51:16 user nova-compute[103546]:     </disk>
Nov 16 03:51:16 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 03:51:16 user nova-compute[103546]:       <mac address="fa:16:3e:e5:1d:2e"/>
Nov 16 03:51:16 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:51:16 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 03:51:16 user nova-compute[103546]:       <target dev="tapefdedcd3-00"/>
Nov 16 03:51:16 user nova-compute[103546]:     </interface>
Nov 16 03:51:16 user nova-compute[103546]:     <serial type="pty">
Nov 16 03:51:16 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/6a9afa69-2674-46fc-8e30-e196928ff07c/console.log" append="off"/>
Nov 16 03:51:16 user nova-compute[103546]:     </serial>
Nov 16 03:51:16 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 03:51:16 user nova-compute[103546]:     <video>
Nov 16 03:51:16 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:51:16 user nova-compute[103546]:     </video>
Nov 16 03:51:16 user nova-compute[103546]:     <rng model="virtio">
Nov 16 03:51:16 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 03:51:16 user nova-compute[103546]:     </rng>
Nov 16 03:51:16 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 03:51:16 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 03:51:16 user nova-compute[103546]:       <stats period="10"/>
Nov 16 03:51:16 user nova-compute[103546]:     </memballoon>
Nov 16 03:51:16 user nova-compute[103546]:   </devices>
Nov 16 03:51:16 user nova-compute[103546]: </domain>
Nov 16 03:51:16 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:51:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-606707385',display_name='tempest-DeleteServersTestJSON-server-606707385',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-606707385',id=17,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fbb710b153d435da880b41ad2a8f1bd',ramdisk_id='',reservation_id='r-rd9nw473',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-750089832',owner_user_name='tempest-DeleteServersTestJSON-750089832-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:51:14Z,user_data=None,user_id='0041f0189e09484481d362f3108e47f2',uuid=6a9afa69-2674-46fc-8e30-e196928ff07c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "efdedcd3-0071-412e-bd4a-e2a518ee4bf9", "address": "fa:16:3e:e5:1d:2e", "network": {"id": "7ed01459-90d0-4fe4-863b-fe90be1d41a0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1311268077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fbb710b153d435da880b41ad2a8f1bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefdedcd3-00", "ovs_interfaceid": "efdedcd3-0071-412e-bd4a-e2a518ee4bf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Converting VIF {"id": "efdedcd3-0071-412e-bd4a-e2a518ee4bf9", "address": "fa:16:3e:e5:1d:2e", "network": {"id": "7ed01459-90d0-4fe4-863b-fe90be1d41a0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1311268077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fbb710b153d435da880b41ad2a8f1bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefdedcd3-00", "ovs_interfaceid": "efdedcd3-0071-412e-bd4a-e2a518ee4bf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:1d:2e,bridge_name='br-int',has_traffic_filtering=True,id=efdedcd3-0071-412e-bd4a-e2a518ee4bf9,network=Network(7ed01459-90d0-4fe4-863b-fe90be1d41a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefdedcd3-00') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG os_vif [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:1d:2e,bridge_name='br-int',has_traffic_filtering=True,id=efdedcd3-0071-412e-bd4a-e2a518ee4bf9,network=Network(7ed01459-90d0-4fe4-863b-fe90be1d41a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefdedcd3-00') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b433cadd-d6d6-5a26-a74b-39b327595adf', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapefdedcd3-00, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapefdedcd3-00, col_values=(('qos', UUID('759315f7-a568-4aec-be28-f4f163467dbc')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapefdedcd3-00, col_values=(('external_ids', {'iface-id': 'efdedcd3-0071-412e-bd4a-e2a518ee4bf9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:1d:2e', 'vm-uuid': '6a9afa69-2674-46fc-8e30-e196928ff07c'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:16 user nova-compute[103546]: INFO os_vif [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:1d:2e,bridge_name='br-int',has_traffic_filtering=True,id=efdedcd3-0071-412e-bd4a-e2a518ee4bf9,network=Network(7ed01459-90d0-4fe4-863b-fe90be1d41a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefdedcd3-00')
Nov 16 03:51:16 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] No VIF found with MAC fa:16:3e:e5:1d:2e, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Starting heal instance info cache {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Didn't find any instances for network info cache update. {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=103546) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager.update_available_resource {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:51:16 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Auditing locally available compute resources for user (node: user) {{(pid=103546) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 03:51:17 user nova-compute[103546]: DEBUG nova.network.neutron [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Port e36fae5d-773f-47c0-b79a-5aadf6412cbc binding to destination host user is already ACTIVE {{(pid=103546) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 16 03:51:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Acquiring lock "refresh_cache-51554aab-44ec-4161-b926-9c07a3f838a5" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:51:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Acquired lock "refresh_cache-51554aab-44ec-4161-b926-9c07a3f838a5" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:51:17 user nova-compute[103546]: DEBUG nova.network.neutron [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 03:51:17 user nova-compute[103546]: DEBUG nova.network.neutron [req-ae3a7a8c-233c-4f87-90e9-3a898ed72f5a req-8f6876e2-66df-4804-a61d-d50101f7dce6 service nova] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] Updated VIF entry in instance network info cache for port efdedcd3-0071-412e-bd4a-e2a518ee4bf9. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 03:51:17 user nova-compute[103546]: DEBUG nova.network.neutron [req-ae3a7a8c-233c-4f87-90e9-3a898ed72f5a req-8f6876e2-66df-4804-a61d-d50101f7dce6 service nova] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] Updating instance_info_cache with network_info: [{"id": "efdedcd3-0071-412e-bd4a-e2a518ee4bf9", "address": "fa:16:3e:e5:1d:2e", "network": {"id": "7ed01459-90d0-4fe4-863b-fe90be1d41a0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1311268077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fbb710b153d435da880b41ad2a8f1bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefdedcd3-00", "ovs_interfaceid": "efdedcd3-0071-412e-bd4a-e2a518ee4bf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:51:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ae3a7a8c-233c-4f87-90e9-3a898ed72f5a req-8f6876e2-66df-4804-a61d-d50101f7dce6 service nova] Releasing lock "refresh_cache-6a9afa69-2674-46fc-8e30-e196928ff07c" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:51:17 user nova-compute[103546]: DEBUG nova.network.neutron [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Updating instance_info_cache with network_info: [{"id": "e36fae5d-773f-47c0-b79a-5aadf6412cbc", "address": "fa:16:3e:9a:45:d0", "network": {"id": "ef471a6e-7bd1-4a61-aa01-fd7557bfae1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-865941926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76ca2da0c584a7382040eb113da4c2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape36fae5d-77", "ovs_interfaceid": "e36fae5d-773f-47c0-b79a-5aadf6412cbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:51:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Releasing lock "refresh_cache-51554aab-44ec-4161-b926-9c07a3f838a5" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:51:17 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Creating tmpfile /opt/stack/data/nova/instances/51554aab-44ec-4161-b926-9c07a3f838a5/tmpmraphg3l to verify with other compute node that the instance is on the same shared storage. {{(pid=103546) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 16 03:51:18 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:18 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:18 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:18 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:18 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:18 user nova-compute[103546]: DEBUG nova.compute.manager [req-18e6d0a4-bbd4-46d7-abd2-80022b9b8411 req-8e84ecc2-54a5-49ae-a3cd-7e9e00f730eb service nova] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Received event network-vif-unplugged-e36fae5d-773f-47c0-b79a-5aadf6412cbc {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:51:18 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-18e6d0a4-bbd4-46d7-abd2-80022b9b8411 req-8e84ecc2-54a5-49ae-a3cd-7e9e00f730eb service nova] Acquiring lock "51554aab-44ec-4161-b926-9c07a3f838a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:51:18 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-18e6d0a4-bbd4-46d7-abd2-80022b9b8411 req-8e84ecc2-54a5-49ae-a3cd-7e9e00f730eb service nova] Lock "51554aab-44ec-4161-b926-9c07a3f838a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:51:18 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-18e6d0a4-bbd4-46d7-abd2-80022b9b8411 req-8e84ecc2-54a5-49ae-a3cd-7e9e00f730eb service nova] Lock "51554aab-44ec-4161-b926-9c07a3f838a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:51:18 user nova-compute[103546]: DEBUG nova.compute.manager [req-18e6d0a4-bbd4-46d7-abd2-80022b9b8411 req-8e84ecc2-54a5-49ae-a3cd-7e9e00f730eb service nova] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] No waiting events found dispatching network-vif-unplugged-e36fae5d-773f-47c0-b79a-5aadf6412cbc {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:51:18 user nova-compute[103546]: WARNING nova.compute.manager [req-18e6d0a4-bbd4-46d7-abd2-80022b9b8411 req-8e84ecc2-54a5-49ae-a3cd-7e9e00f730eb service nova] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Received unexpected event network-vif-unplugged-e36fae5d-773f-47c0-b79a-5aadf6412cbc for instance with vm_state resized and task_state resize_reverting.
Nov 16 03:51:18 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:18 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:18 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:18 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:18 user nova-compute[103546]: DEBUG nova.compute.manager [req-544478de-c58f-4d70-86bc-8ea7fc0059c8 req-3003d9cd-89df-4da2-b42a-b914b30c7220 service nova] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] Received event network-vif-plugged-efdedcd3-0071-412e-bd4a-e2a518ee4bf9 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:51:18 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-544478de-c58f-4d70-86bc-8ea7fc0059c8 req-3003d9cd-89df-4da2-b42a-b914b30c7220 service nova] Acquiring lock "6a9afa69-2674-46fc-8e30-e196928ff07c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:51:18 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-544478de-c58f-4d70-86bc-8ea7fc0059c8 req-3003d9cd-89df-4da2-b42a-b914b30c7220 service nova] Lock "6a9afa69-2674-46fc-8e30-e196928ff07c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:51:18 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-544478de-c58f-4d70-86bc-8ea7fc0059c8 req-3003d9cd-89df-4da2-b42a-b914b30c7220 service nova] Lock "6a9afa69-2674-46fc-8e30-e196928ff07c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:51:18 user nova-compute[103546]: DEBUG nova.compute.manager [req-544478de-c58f-4d70-86bc-8ea7fc0059c8 req-3003d9cd-89df-4da2-b42a-b914b30c7220 service nova] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] No waiting events found dispatching network-vif-plugged-efdedcd3-0071-412e-bd4a-e2a518ee4bf9 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:51:18 user nova-compute[103546]: WARNING nova.compute.manager [req-544478de-c58f-4d70-86bc-8ea7fc0059c8 req-3003d9cd-89df-4da2-b42a-b914b30c7220 service nova] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] Received unexpected event network-vif-plugged-efdedcd3-0071-412e-bd4a-e2a518ee4bf9 for instance with vm_state building and task_state spawning.
Nov 16 03:51:18 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:18 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:18 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:19 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Instance destroyed successfully.
Nov 16 03:51:19 user nova-compute[103546]: DEBUG nova.objects.instance [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Lazy-loading 'resources' on Instance uuid 51554aab-44ec-4161-b926-9c07a3f838a5 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:46:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1580842921',display_name='tempest-ServerActionsTestOtherB-server-1580842921',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1580842921',id=2,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4BC4cHDV2fbJoL15YFOsrL3Jj/txUDoSxREB28Izf7niUsDWNVN4I6jw0qVmlW7BvPaNCWUAskE06oeKsT+2XD63IEOwvY2xtSda7L7/qiL3VY46L9X29CD+3k2W4RoA==',key_name='tempest-keypair-857843108',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:49:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f76ca2da0c584a7382040eb113da4c2a',ramdisk_id='',reservation_id='r-kl1f6eox',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-648062424',owner_user_name='tempest-ServerActionsTestOtherB-648062424-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T03:49:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4bf11ccac9f4203808f8dca52cde36c',uuid=51554aab-44ec-4161-b926-9c07a3f838a5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "e36fae5d-773f-47c0-b79a-5aadf6412cbc", "address": "fa:16:3e:9a:45:d0", "network": {"id": "ef471a6e-7bd1-4a61-aa01-fd7557bfae1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-865941926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76ca2da0c584a7382040eb113da4c2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape36fae5d-77", "ovs_interfaceid": "e36fae5d-773f-47c0-b79a-5aadf6412cbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Converting VIF {"id": "e36fae5d-773f-47c0-b79a-5aadf6412cbc", "address": "fa:16:3e:9a:45:d0", "network": {"id": "ef471a6e-7bd1-4a61-aa01-fd7557bfae1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-865941926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76ca2da0c584a7382040eb113da4c2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape36fae5d-77", "ovs_interfaceid": "e36fae5d-773f-47c0-b79a-5aadf6412cbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:45:d0,bridge_name='br-int',has_traffic_filtering=True,id=e36fae5d-773f-47c0-b79a-5aadf6412cbc,network=Network(ef471a6e-7bd1-4a61-aa01-fd7557bfae1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape36fae5d-77') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG os_vif [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:45:d0,bridge_name='br-int',has_traffic_filtering=True,id=e36fae5d-773f-47c0-b79a-5aadf6412cbc,network=Network(ef471a6e-7bd1-4a61-aa01-fd7557bfae1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape36fae5d-77') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape36fae5d-77, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=076913df-01b1-45e4-bcc5-8c9fb9e2bd66) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:19 user nova-compute[103546]: INFO os_vif [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:45:d0,bridge_name='br-int',has_traffic_filtering=True,id=e36fae5d-773f-47c0-b79a-5aadf6412cbc,network=Network(ef471a6e-7bd1-4a61-aa01-fd7557bfae1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape36fae5d-77')
Nov 16 03:51:19 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YukJztTB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:51:19 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:51:19 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bdfaffa-4f99-4fc0-afc5-7f31598894a7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7eff0073-6dd7-49ac-9520-557cb575b8b5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 03:51:19 user nova-compute[103546]: No targets found.
Nov 16 03:51:19 user nova-compute[103546]: iSNS:
Nov 16 03:51:19 user nova-compute[103546]: No targets found.
Nov 16 03:51:19 user nova-compute[103546]: STATIC:
Nov 16 03:51:19 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c
Nov 16 03:51:19 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:51:19 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:51:19 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:7eff0073-6dd7-49ac-9520-557cb575b8b5
Nov 16 03:51:19 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:51:19 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:51:19 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9
Nov 16 03:51:19 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:51:19 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:51:19 user nova-compute[103546]: FIRMWARE:
Nov 16 03:51:19 user nova-compute[103546]: No targets found.
Nov 16 03:51:19 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 03:51:19 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 03:51:19 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12f264c-2bb3-4154-a4fa-e4c9ca939866]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7eff0073-6dd7-49ac-9520-557cb575b8b5\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3975109-c2f8-48ee-8ef7-7a0ed1dd2841]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff0073-6dd7-49ac-9520-557cb575b8b5 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)
Nov 16 03:51:19 user nova-compute[103546]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9 (non-flash)
Nov 16 03:51:19 user nova-compute[103546]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff0073-6dd7-49ac-9520-557cb575b8b5 (non-flash)
Nov 16 03:51:19 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)
Nov 16 03:51:19 user nova-compute[103546]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9 (non-flash)
Nov 16 03:51:19 user nova-compute[103546]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff0073-6dd7-49ac-9520-557cb575b8b5 (non-flash)
Nov 16 03:51:19 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60cc290c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c'): ({'sdb'}, set())}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Removing single pathed devices sdb {{(pid=103546) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2cb68d-92b4-46ed-a2a5-919d4c94292c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91110fc-0e84-4a07-871f-08d06dc29f16]: (4, ('ok\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Flushing IO for device /dev/sdb {{(pid=103546) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8be1178-f161-40fa-beb1-ef9122464c07]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=103546) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63b95121-b211-42c3-831e-0392d4abd09a/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c43258-a6ed-491e-b30f-2dbfee7fb85b]: (4, ('1', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] SCSI volumes sdb have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c')] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bfbb7d5-e884-4d03-b225-1cdb3cc82c6d]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260 --logout {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e2e272-93c6-4325-9726-94d63914aa50]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c, portal: 172.16.0.220,3260]
Nov 16 03:51:19 user nova-compute[103546]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c, portal: 172.16.0.220,3260] successful.
Nov 16 03:51:19 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260 --op delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c220682-a3cf-4b82-9e5b-e31f5145e4c9]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] <== disconnect_volume: return (353ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63b95121-b211-42c3-831e-0392d4abd09a/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63b95121-b211-42c3-831e-0392d4abd09a/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63b95121-b211-42c3-831e-0392d4abd09a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c929d5-2f1c-4be4-8864-6ec81625daac/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c929d5-2f1c-4be4-8864-6ec81625daac/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c929d5-2f1c-4be4-8864-6ec81625daac/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c929d5-2f1c-4be4-8864-6ec81625daac/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24b48ca5-a0df-4713-bd32-6b62a9ee8367/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24b48ca5-a0df-4713-bd32-6b62a9ee8367/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24b48ca5-a0df-4713-bd32-6b62a9ee8367/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:20 user nova-compute[103546]: DEBUG nova.compute.manager [req-fa4021cf-337d-426b-b876-601516f99dd6 req-e1055e99-0fa5-40dd-8a45-1835a4fb142c service nova] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Received event network-vif-plugged-e36fae5d-773f-47c0-b79a-5aadf6412cbc {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:51:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-fa4021cf-337d-426b-b876-601516f99dd6 req-e1055e99-0fa5-40dd-8a45-1835a4fb142c service nova] Acquiring lock "51554aab-44ec-4161-b926-9c07a3f838a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:51:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-fa4021cf-337d-426b-b876-601516f99dd6 req-e1055e99-0fa5-40dd-8a45-1835a4fb142c service nova] Lock "51554aab-44ec-4161-b926-9c07a3f838a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:51:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-fa4021cf-337d-426b-b876-601516f99dd6 req-e1055e99-0fa5-40dd-8a45-1835a4fb142c service nova] Lock "51554aab-44ec-4161-b926-9c07a3f838a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:51:20 user nova-compute[103546]: DEBUG nova.compute.manager [req-fa4021cf-337d-426b-b876-601516f99dd6 req-e1055e99-0fa5-40dd-8a45-1835a4fb142c service nova] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] No waiting events found dispatching network-vif-plugged-e36fae5d-773f-47c0-b79a-5aadf6412cbc {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:51:20 user nova-compute[103546]: WARNING nova.compute.manager [req-fa4021cf-337d-426b-b876-601516f99dd6 req-e1055e99-0fa5-40dd-8a45-1835a4fb142c service nova] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Received unexpected event network-vif-plugged-e36fae5d-773f-47c0-b79a-5aadf6412cbc for instance with vm_state resized and task_state resize_reverting.
Nov 16 03:51:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:51:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:51:20 user nova-compute[103546]: DEBUG nova.objects.instance [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Lazy-loading 'migration_context' on Instance uuid 51554aab-44ec-4161-b926-9c07a3f838a5 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:51:20 user nova-compute[103546]: DEBUG nova.objects.base [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Object Instance<51554aab-44ec-4161-b926-9c07a3f838a5> lazy-loaded attributes: resources,migration_context {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 03:51:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24b48ca5-a0df-4713-bd32-6b62a9ee8367/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e2954-d786-4544-903d-8edc63646e2d/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e2954-d786-4544-903d-8edc63646e2d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e2954-d786-4544-903d-8edc63646e2d/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:20 user nova-compute[103546]: DEBUG nova.compute.manager [req-71603e8d-eaaf-49fd-b719-94dbe19fa1b3 req-5b3bf175-bbdb-4292-b2d2-42439f742d2b service nova] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] Received event network-vif-plugged-efdedcd3-0071-412e-bd4a-e2a518ee4bf9 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:51:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-71603e8d-eaaf-49fd-b719-94dbe19fa1b3 req-5b3bf175-bbdb-4292-b2d2-42439f742d2b service nova] Acquiring lock "6a9afa69-2674-46fc-8e30-e196928ff07c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:51:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-71603e8d-eaaf-49fd-b719-94dbe19fa1b3 req-5b3bf175-bbdb-4292-b2d2-42439f742d2b service nova] Lock "6a9afa69-2674-46fc-8e30-e196928ff07c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:51:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-71603e8d-eaaf-49fd-b719-94dbe19fa1b3 req-5b3bf175-bbdb-4292-b2d2-42439f742d2b service nova] Lock "6a9afa69-2674-46fc-8e30-e196928ff07c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:51:20 user nova-compute[103546]: DEBUG nova.compute.manager [req-71603e8d-eaaf-49fd-b719-94dbe19fa1b3 req-5b3bf175-bbdb-4292-b2d2-42439f742d2b service nova] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] No waiting events found dispatching network-vif-plugged-efdedcd3-0071-412e-bd4a-e2a518ee4bf9 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:51:20 user nova-compute[103546]: WARNING nova.compute.manager [req-71603e8d-eaaf-49fd-b719-94dbe19fa1b3 req-5b3bf175-bbdb-4292-b2d2-42439f742d2b service nova] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] Received unexpected event network-vif-plugged-efdedcd3-0071-412e-bd4a-e2a518ee4bf9 for instance with vm_state building and task_state spawning.
Nov 16 03:51:20 user nova-compute[103546]: DEBUG nova.compute.manager [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 03:51:20 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] Guest created on hypervisor {{(pid=103546) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 03:51:20 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] Instance spawned successfully.
Nov 16 03:51:20 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 03:51:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e2954-d786-4544-903d-8edc63646e2d/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:20 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] Found default for hw_cdrom_bus of ide {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:51:20 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] Found default for hw_disk_bus of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:51:20 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] Found default for hw_input_bus of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:51:20 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] Found default for hw_pointer_model of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:51:20 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] Found default for hw_video_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:51:20 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] Found default for hw_vif_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:51:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddaf87db-e525-4839-a538-4b766b3e875a/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:20 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:51:20 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:51:21 user nova-compute[103546]: INFO nova.compute.manager [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] Took 6.57 seconds to spawn the instance on the hypervisor.
Nov 16 03:51:21 user nova-compute[103546]: DEBUG nova.compute.manager [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 03:51:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.705s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:51:21 user nova-compute[103546]: INFO nova.compute.manager [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] Took 7.46 seconds to build instance.
Nov 16 03:51:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddaf87db-e525-4839-a538-4b766b3e875a/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddaf87db-e525-4839-a538-4b766b3e875a/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-2882ad2e-0a73-43f3-9a1f-d329dd584cfc tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Lock "6a9afa69-2674-46fc-8e30-e196928ff07c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.636s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:51:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddaf87db-e525-4839-a538-4b766b3e875a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:21 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Error from libvirt while getting description of instance-00000002: [Error Code 42] Domain not found: no domain with matching uuid '51554aab-44ec-4161-b926-9c07a3f838a5' (instance-00000002): libvirt.libvirtError: Domain not found: no domain with matching uuid '51554aab-44ec-4161-b926-9c07a3f838a5' (instance-00000002)
Nov 16 03:51:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:21 user nova-compute[103546]: INFO nova.compute.manager [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Swapping old allocation on dict_keys(['0b01254b-dc4d-4d00-a9a7-dd4ef815de7a']) held by migration 3b29b254-f016-4d50-9bc9-d37b6945b409 for instance
Nov 16 03:51:21 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Overwriting current allocation {'allocations': {'0b01254b-dc4d-4d00-a9a7-dd4ef815de7a': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 22}}, 'project_id': 'f76ca2da0c584a7382040eb113da4c2a', 'user_id': 'd4bf11ccac9f4203808f8dca52cde36c', 'consumer_generation': 1} on consumer 51554aab-44ec-4161-b926-9c07a3f838a5 {{(pid=103546) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 16 03:51:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json" returned: 0 in 0.413s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Acquiring lock "refresh_cache-51554aab-44ec-4161-b926-9c07a3f838a5" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:51:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Acquired lock "refresh_cache-51554aab-44ec-4161-b926-9c07a3f838a5" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:51:21 user nova-compute[103546]: DEBUG nova.network.neutron [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 03:51:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7862d05d-4293-46a5-98aa-41967a572fe3/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7862d05d-4293-46a5-98aa-41967a572fe3/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7862d05d-4293-46a5-98aa-41967a572fe3/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7862d05d-4293-46a5-98aa-41967a572fe3/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:22 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 03:51:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:22 user nova-compute[103546]: DEBUG nova.network.neutron [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Updating instance_info_cache with network_info: [{"id": "e36fae5d-773f-47c0-b79a-5aadf6412cbc", "address": "fa:16:3e:9a:45:d0", "network": {"id": "ef471a6e-7bd1-4a61-aa01-fd7557bfae1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-865941926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76ca2da0c584a7382040eb113da4c2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape36fae5d-77", "ovs_interfaceid": "e36fae5d-773f-47c0-b79a-5aadf6412cbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:51:22 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Releasing lock "refresh_cache-51554aab-44ec-4161-b926-9c07a3f838a5" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:51:22 user nova-compute[103546]: DEBUG os_brick.utils [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:51:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:22 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad41ccc8-f378-4ac6-8c05-e76909cb2827]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af5c39b14ece\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:51:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:22 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf42bc8a-fd70-40db-a882-1e076fb89c87]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:51:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:22 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[859af45b-f172-4b59-9245-eb2ea5694235]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:51:22 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[db443de6-7b35-4e50-9041-c78d15c355e9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:51:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Running cmd (subprocess): nvme version {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] 'nvme version' failed. Not Retrying. {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:51:22 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.nvmeof [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] nvme not present on system {{(pid=103546) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 03:51:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json" returned: 0 in 0.304s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:51:22 user nova-compute[103546]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 03:51:22 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b36d6c-229f-47fa-92f7-9a63ba53e8ec]: (4, '') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:51:22 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=103546) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 03:51:22 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 03:51:22 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] LIGHTOS: no hostnqn found. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 03:51:22 user nova-compute[103546]: DEBUG os_brick.utils [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] <== get_connector_properties: return (196ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af5c39b14ece', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:51:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9afa69-2674-46fc-8e30-e196928ff07c/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9afa69-2674-46fc-8e30-e196928ff07c/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9afa69-2674-46fc-8e30-e196928ff07c/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:23 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9afa69-2674-46fc-8e30-e196928ff07c/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:24 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:51:24 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:51:24 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Hypervisor/Node resource view: name=user free_ram=7626MB free_disk=25.419837951660156GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=103546) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 03:51:24 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:51:24 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:51:24 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:24 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 279e2954-d786-4544-903d-8edc63646e2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:51:24 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 05c929d5-2f1c-4be4-8864-6ec81625daac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:51:24 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 63b95121-b211-42c3-831e-0392d4abd09a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:51:24 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 51554aab-44ec-4161-b926-9c07a3f838a5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:51:24 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance ddaf87db-e525-4839-a538-4b766b3e875a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:51:24 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 7862d05d-4293-46a5-98aa-41967a572fe3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:51:24 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 9a89970b-fc61-4419-8ff9-b48013dccf9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:51:24 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 24b48ca5-a0df-4713-bd32-6b62a9ee8367 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:51:24 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 04101512-7333-4581-add3-7af3821e335b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:51:24 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 6a9afa69-2674-46fc-8e30-e196928ff07c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:51:24 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 03:51:24 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 03:51:24 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:24 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:51:24 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:51:24 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Compute_service record updated for user:user {{(pid=103546) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 03:51:24 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.616s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:51:24 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-961d71de-211a-46aa-af47-d86a1c55a25a tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 63b95121-b211-42c3-831e-0392d4abd09a is timed out.
Nov 16 03:51:24 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-961d71de-211a-46aa-af47-d86a1c55a25a tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Successfully detached device vdb from instance 63b95121-b211-42c3-831e-0392d4abd09a from the live domain config.
Nov 16 03:51:24 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-961d71de-211a-46aa-af47-d86a1c55a25a tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 03:51:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-961d71de-211a-46aa-af47-d86a1c55a25a tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:7eff0073-6dd7-49ac-9520-557cb575b8b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CDuEMKkO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:51:24 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-961d71de-211a-46aa-af47-d86a1c55a25a tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:51:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-961d71de-211a-46aa-af47-d86a1c55a25a tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:51:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-961d71de-211a-46aa-af47-d86a1c55a25a tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:51:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:24 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[46428910-e633-4fbe-891f-41f85fac1846]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7eff0073-6dd7-49ac-9520-557cb575b8b5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:51:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-961d71de-211a-46aa-af47-d86a1c55a25a tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 03:51:24 user nova-compute[103546]: No targets found.
Nov 16 03:51:24 user nova-compute[103546]: iSNS:
Nov 16 03:51:24 user nova-compute[103546]: No targets found.
Nov 16 03:51:24 user nova-compute[103546]: STATIC:
Nov 16 03:51:24 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:7eff0073-6dd7-49ac-9520-557cb575b8b5
Nov 16 03:51:24 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:51:24 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:51:24 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9
Nov 16 03:51:24 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:51:24 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:51:24 user nova-compute[103546]: FIRMWARE:
Nov 16 03:51:24 user nova-compute[103546]: No targets found.
Nov 16 03:51:24 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:51:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-961d71de-211a-46aa-af47-d86a1c55a25a tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 03:51:24 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 03:51:24 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 03:51:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-961d71de-211a-46aa-af47-d86a1c55a25a tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7eff0073-6dd7-49ac-9520-557cb575b8b5', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 03:51:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:25 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fdf1204-fd4b-4be7-a0b9-ea66a7665e28]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7eff0073-6dd7-49ac-9520-557cb575b8b5\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:51:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:25 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[097a6498-6375-43ef-839d-409e8e20fb78]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff0073-6dd7-49ac-9520-557cb575b8b5 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:51:25 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-961d71de-211a-46aa-af47-d86a1c55a25a tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9 (non-flash)
Nov 16 03:51:25 user nova-compute[103546]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff0073-6dd7-49ac-9520-557cb575b8b5 (non-flash)
Nov 16 03:51:25 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:51:25 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-961d71de-211a-46aa-af47-d86a1c55a25a tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9 (non-flash)
Nov 16 03:51:25 user nova-compute[103546]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eff0073-6dd7-49ac-9520-557cb575b8b5 (non-flash)
Nov 16 03:51:25 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:51:25 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-961d71de-211a-46aa-af47-d86a1c55a25a tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60ac5af370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7eff0073-6dd7-49ac-9520-557cb575b8b5'): ({'sdd'}, set())}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 03:51:25 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-961d71de-211a-46aa-af47-d86a1c55a25a tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Removing single pathed devices sdd {{(pid=103546) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 03:51:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:25 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[187d64e9-8432-455e-a7eb-54b995d7d32f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:51:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.030s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:25 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41b73b9-3a43-4930-ae22-e88eb20d60fd]: (4, ('ok\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:51:25 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-961d71de-211a-46aa-af47-d86a1c55a25a tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Flushing IO for device /dev/sdd {{(pid=103546) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 03:51:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:25 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c20c71c-647e-4a2b-9454-a488f2e7ab93]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:51:25 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-961d71de-211a-46aa-af47-d86a1c55a25a tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=103546) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 03:51:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.060s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:25 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8aa7bdd-dcbd-46ec-96e0-263fefe71625]: (4, ('1', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:51:25 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-961d71de-211a-46aa-af47-d86a1c55a25a tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 03:51:25 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-961d71de-211a-46aa-af47-d86a1c55a25a tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] SCSI volumes sdd have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 03:51:25 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-961d71de-211a-46aa-af47-d86a1c55a25a tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7eff0073-6dd7-49ac-9520-557cb575b8b5')] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 03:51:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eff0073-6dd7-49ac-9520-557cb575b8b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eff0073-6dd7-49ac-9520-557cb575b8b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:25 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1cc1a7-fb6a-4082-aa3b-9d14ece2e4b9]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:51:25 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-961d71de-211a-46aa-af47-d86a1c55a25a tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:51:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eff0073-6dd7-49ac-9520-557cb575b8b5 -p 172.16.0.220:3260 --logout {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eff0073-6dd7-49ac-9520-557cb575b8b5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:25 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[9767e216-f8a7-4bb2-b8f8-0cfbfece0938]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:7eff0073-6dd7-49ac-9520-557cb575b8b5, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:7eff0073-6dd7-49ac-9520-557cb575b8b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:51:25 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-961d71de-211a-46aa-af47-d86a1c55a25a tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:7eff0073-6dd7-49ac-9520-557cb575b8b5, portal: 172.16.0.220,3260]
Nov 16 03:51:25 user nova-compute[103546]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:7eff0073-6dd7-49ac-9520-557cb575b8b5, portal: 172.16.0.220,3260] successful.
Nov 16 03:51:25 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:51:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eff0073-6dd7-49ac-9520-557cb575b8b5 -p 172.16.0.220:3260 --op delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eff0073-6dd7-49ac-9520-557cb575b8b5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:25 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7155c18-839b-4119-8f4d-339e2dcc6b72]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:51:25 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-961d71de-211a-46aa-af47-d86a1c55a25a tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:51:25 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-961d71de-211a-46aa-af47-d86a1c55a25a tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.403s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:51:25 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-961d71de-211a-46aa-af47-d86a1c55a25a tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] <== disconnect_volume: return (406ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:51:25 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-961d71de-211a-46aa-af47-d86a1c55a25a tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 03:51:26 user nova-compute[103546]: DEBUG nova.objects.instance [None req-961d71de-211a-46aa-af47-d86a1c55a25a tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lazy-loading 'flavor' on Instance uuid 63b95121-b211-42c3-831e-0392d4abd09a {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:51:26 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-961d71de-211a-46aa-af47-d86a1c55a25a tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "63b95121-b211-42c3-831e-0392d4abd09a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.148s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:51:26 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-5301705c-137a-44aa-8a9e-628dcdb6f83a tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Acquiring lock "ddaf87db-e525-4839-a538-4b766b3e875a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:51:26 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-5301705c-137a-44aa-8a9e-628dcdb6f83a tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Lock "ddaf87db-e525-4839-a538-4b766b3e875a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:51:26 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-5301705c-137a-44aa-8a9e-628dcdb6f83a tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Acquiring lock "ddaf87db-e525-4839-a538-4b766b3e875a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:51:26 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-5301705c-137a-44aa-8a9e-628dcdb6f83a tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Lock "ddaf87db-e525-4839-a538-4b766b3e875a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:51:26 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-5301705c-137a-44aa-8a9e-628dcdb6f83a tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Lock "ddaf87db-e525-4839-a538-4b766b3e875a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:51:26 user nova-compute[103546]: INFO nova.compute.manager [None req-5301705c-137a-44aa-8a9e-628dcdb6f83a tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: ddaf87db-e525-4839-a538-4b766b3e875a] Terminating instance
Nov 16 03:51:26 user nova-compute[103546]: DEBUG nova.compute.manager [None req-5301705c-137a-44aa-8a9e-628dcdb6f83a tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: ddaf87db-e525-4839-a538-4b766b3e875a] Start destroying the instance on the hypervisor. {{(pid=103546) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 03:51:27 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:27 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:27 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:27 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:27 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: ddaf87db-e525-4839-a538-4b766b3e875a] Instance destroyed successfully.
Nov 16 03:51:27 user nova-compute[103546]: DEBUG nova.objects.instance [None req-5301705c-137a-44aa-8a9e-628dcdb6f83a tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Lazy-loading 'resources' on Instance uuid ddaf87db-e525-4839-a538-4b766b3e875a {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:51:27 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-5301705c-137a-44aa-8a9e-628dcdb6f83a tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:49:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1823420271',display_name='tempest-VolumesAdminNegativeTest-server-1823420271',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1823420271',id=13,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:49:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='998b2147e8194af3a15fce90bc7063b0',ramdisk_id='',reservation_id='r-lrith0cq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1034179231',owner_user_name='tempest-VolumesAdminNegativeTest-1034179231-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T03:49:37Z,user_data=None,user_id='7bf9f55ab03b4df38e0b35ed4c8967e8',uuid=ddaf87db-e525-4839-a538-4b766b3e875a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "883ecc71-b87c-496d-8436-d3085c19dbc7", "address": "fa:16:3e:1e:e2:36", "network": {"id": "1a48a5d8-8046-4baf-9b30-4505213d862a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1526890096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998b2147e8194af3a15fce90bc7063b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap883ecc71-b8", "ovs_interfaceid": "883ecc71-b87c-496d-8436-d3085c19dbc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 03:51:27 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-5301705c-137a-44aa-8a9e-628dcdb6f83a tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Converting VIF {"id": "883ecc71-b87c-496d-8436-d3085c19dbc7", "address": "fa:16:3e:1e:e2:36", "network": {"id": "1a48a5d8-8046-4baf-9b30-4505213d862a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1526890096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998b2147e8194af3a15fce90bc7063b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap883ecc71-b8", "ovs_interfaceid": "883ecc71-b87c-496d-8436-d3085c19dbc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:51:27 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-5301705c-137a-44aa-8a9e-628dcdb6f83a tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:e2:36,bridge_name='br-int',has_traffic_filtering=True,id=883ecc71-b87c-496d-8436-d3085c19dbc7,network=Network(1a48a5d8-8046-4baf-9b30-4505213d862a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap883ecc71-b8') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:51:27 user nova-compute[103546]: DEBUG os_vif [None req-5301705c-137a-44aa-8a9e-628dcdb6f83a tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:e2:36,bridge_name='br-int',has_traffic_filtering=True,id=883ecc71-b87c-496d-8436-d3085c19dbc7,network=Network(1a48a5d8-8046-4baf-9b30-4505213d862a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap883ecc71-b8') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 03:51:27 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:27 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap883ecc71-b8, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:51:27 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:27 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:51:27 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:27 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:27 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=00ba81e7-0ec1-45aa-ae60-d29e401c9134) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:51:27 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:27 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:51:27 user nova-compute[103546]: INFO os_vif [None req-5301705c-137a-44aa-8a9e-628dcdb6f83a tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:e2:36,bridge_name='br-int',has_traffic_filtering=True,id=883ecc71-b87c-496d-8436-d3085c19dbc7,network=Network(1a48a5d8-8046-4baf-9b30-4505213d862a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap883ecc71-b8')
Nov 16 03:51:27 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-5301705c-137a-44aa-8a9e-628dcdb6f83a tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: ddaf87db-e525-4839-a538-4b766b3e875a] Deleting instance files /opt/stack/data/nova/instances/ddaf87db-e525-4839-a538-4b766b3e875a_del
Nov 16 03:51:27 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-5301705c-137a-44aa-8a9e-628dcdb6f83a tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: ddaf87db-e525-4839-a538-4b766b3e875a] Deletion of /opt/stack/data/nova/instances/ddaf87db-e525-4839-a538-4b766b3e875a_del complete
Nov 16 03:51:27 user nova-compute[103546]: INFO nova.compute.manager [None req-5301705c-137a-44aa-8a9e-628dcdb6f83a tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: ddaf87db-e525-4839-a538-4b766b3e875a] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 16 03:51:27 user nova-compute[103546]: DEBUG oslo.service.loopingcall [None req-5301705c-137a-44aa-8a9e-628dcdb6f83a tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=103546) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 03:51:27 user nova-compute[103546]: DEBUG nova.compute.manager [-] [instance: ddaf87db-e525-4839-a538-4b766b3e875a] Deallocating network for instance {{(pid=103546) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 03:51:27 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: ddaf87db-e525-4839-a538-4b766b3e875a] deallocate_for_instance() {{(pid=103546) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Starting finish_revert_migration {{(pid=103546) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Start _get_guest_xml network_info=[{"id": "e36fae5d-773f-47c0-b79a-5aadf6412cbc", "address": "fa:16:3e:9a:45:d0", "network": {"id": "ef471a6e-7bd1-4a61-aa01-fd7557bfae1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-865941926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76ca2da0c584a7382040eb113da4c2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape36fae5d-77", "ovs_interfaceid": "e36fae5d-773f-47c0-b79a-5aadf6412cbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '5c6f539a-01e5-4478-bf8f-a14310b5d7dd'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YukJztTB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '51554aab-44ec-4161-b926-9c07a3f838a5', 'attached_at': '2023-11-16T03:51:28.000000', 'detached_at': '', 'volume_id': '4156a8b3-4b47-48ef-ad34-1ace6437b49c', 'serial': '4156a8b3-4b47-48ef-ad34-1ace6437b49c'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'attachment_id': '4630954a-0930-482c-8ff2-9a909405cf75', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 03:51:28 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:51:28 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:51:28 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG nova.objects.instance [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Lazy-loading 'vcpu_model' on Instance uuid 51554aab-44ec-4161-b926-9c07a3f838a5 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YukJztTB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:51:28 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:51:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:51:28 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:51:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:51:28 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 03:51:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[051620a8-55b0-4526-8557-3f854a9f8904]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 03:51:28 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260 --interface default --op new {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b273200-e3d4-4921-91ce-f83dbeb8cbfb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c] added\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c] added
Nov 16 03:51:28 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9cd8b8b-9827-418d-b2ec-d96edb583e0f]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ec7e5b-c03c-458d-8849-b83778e62a15]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YukJztTB {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YukJztTB" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[49829a4d-da46-436f-a5b2-32c314302140]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YukJztTB'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea10869-43a7-4873-bad3-0e1a0374196d]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7e69a1-a42e-4e4e-aca5-abbbb066f60c]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9 (non-flash)
Nov 16 03:51:28 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9 (non-flash)
Nov 16 03:51:28 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260 --login {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb4e68d-e954-44db-b9d9-1989e3ffc648]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c, portal: 172.16.0.220,3260]
Nov 16 03:51:28 user nova-compute[103546]: Login to [iface: default, target: iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c, portal: 172.16.0.220,3260] successful.
Nov 16 03:51:28 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e5b15c-4d4c-4d42-b35a-346024a57ac9]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e623afe6-6fc6-484c-bbab-6e84a7bc0582]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9 (non-flash)
Nov 16 03:51:28 user nova-compute[103546]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)
Nov 16 03:51:28 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9 (non-flash)
Nov 16 03:51:28 user nova-compute[103546]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)
Nov 16 03:51:28 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[17431bf2-9c0b-4b66-9252-75427e66cf5a]: (4, ('- - 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YukJztTB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: ddaf87db-e525-4839-a538-4b766b3e875a] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:51:28 user nova-compute[103546]: INFO nova.compute.manager [-] [instance: ddaf87db-e525-4839-a538-4b766b3e875a] Took 1.01 seconds to deallocate network for instance.
Nov 16 03:51:28 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-5301705c-137a-44aa-8a9e-628dcdb6f83a tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:51:28 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-5301705c-137a-44aa-8a9e-628dcdb6f83a tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:51:29 user nova-compute[103546]: DEBUG nova.compute.manager [req-f8886800-19f6-448c-9066-dad0899a2986 req-bd4094f7-01e6-4d18-8eca-fc04933629e7 service nova] [instance: ddaf87db-e525-4839-a538-4b766b3e875a] Received event network-vif-deleted-883ecc71-b87c-496d-8436-d3085c19dbc7 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:51:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:29 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-5301705c-137a-44aa-8a9e-628dcdb6f83a tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:51:29 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-5301705c-137a-44aa-8a9e-628dcdb6f83a tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:51:29 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-5301705c-137a-44aa-8a9e-628dcdb6f83a tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.446s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:51:29 user nova-compute[103546]: INFO nova.scheduler.client.report [None req-5301705c-137a-44aa-8a9e-628dcdb6f83a tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Deleted allocations for instance ddaf87db-e525-4839-a538-4b766b3e875a
Nov 16 03:51:29 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-5301705c-137a-44aa-8a9e-628dcdb6f83a tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Lock "ddaf87db-e525-4839-a538-4b766b3e875a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.589s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:51:29 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:51:29 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23133393238633038', 'path': '/dev/sdb'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:51:29 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23133393238633038', 'path': '/dev/sdb'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 03:51:29 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:46:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1580842921',display_name='tempest-ServerActionsTestOtherB-server-1580842921',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1580842921',id=2,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4BC4cHDV2fbJoL15YFOsrL3Jj/txUDoSxREB28Izf7niUsDWNVN4I6jw0qVmlW7BvPaNCWUAskE06oeKsT+2XD63IEOwvY2xtSda7L7/qiL3VY46L9X29CD+3k2W4RoA==',key_name='tempest-keypair-857843108',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:49:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f76ca2da0c584a7382040eb113da4c2a',ramdisk_id='',reservation_id='r-kl1f6eox',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-648062424',owner_user_name='tempest-ServerActionsTestOtherB-648062424-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T03:51:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4bf11ccac9f4203808f8dca52cde36c',uuid=51554aab-44ec-4161-b926-9c07a3f838a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "e36fae5d-773f-47c0-b79a-5aadf6412cbc", "address": "fa:16:3e:9a:45:d0", "network": {"id": "ef471a6e-7bd1-4a61-aa01-fd7557bfae1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-865941926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76ca2da0c584a7382040eb113da4c2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape36fae5d-77", "ovs_interfaceid": "e36fae5d-773f-47c0-b79a-5aadf6412cbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 03:51:29 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Converting VIF {"id": "e36fae5d-773f-47c0-b79a-5aadf6412cbc", "address": "fa:16:3e:9a:45:d0", "network": {"id": "ef471a6e-7bd1-4a61-aa01-fd7557bfae1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-865941926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76ca2da0c584a7382040eb113da4c2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape36fae5d-77", "ovs_interfaceid": "e36fae5d-773f-47c0-b79a-5aadf6412cbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:51:29 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:45:d0,bridge_name='br-int',has_traffic_filtering=True,id=e36fae5d-773f-47c0-b79a-5aadf6412cbc,network=Network(ef471a6e-7bd1-4a61-aa01-fd7557bfae1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape36fae5d-77') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:51:29 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] End _get_guest_xml xml=<domain type="kvm">
Nov 16 03:51:29 user nova-compute[103546]:   <uuid>51554aab-44ec-4161-b926-9c07a3f838a5</uuid>
Nov 16 03:51:29 user nova-compute[103546]:   <name>instance-00000002</name>
Nov 16 03:51:29 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 03:51:29 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 03:51:29 user nova-compute[103546]:   <metadata>
Nov 16 03:51:29 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 03:51:29 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 03:51:29 user nova-compute[103546]:       <nova:name>tempest-ServerActionsTestOtherB-server-1580842921</nova:name>
Nov 16 03:51:29 user nova-compute[103546]:       <nova:creationTime>2023-11-16 03:51:28</nova:creationTime>
Nov 16 03:51:29 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 03:51:29 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 03:51:29 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 03:51:29 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 03:51:29 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 03:51:29 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 03:51:29 user nova-compute[103546]:       </nova:flavor>
Nov 16 03:51:29 user nova-compute[103546]:       <nova:owner>
Nov 16 03:51:29 user nova-compute[103546]:         <nova:user uuid="d4bf11ccac9f4203808f8dca52cde36c">tempest-ServerActionsTestOtherB-648062424-project-member</nova:user>
Nov 16 03:51:29 user nova-compute[103546]:         <nova:project uuid="f76ca2da0c584a7382040eb113da4c2a">tempest-ServerActionsTestOtherB-648062424</nova:project>
Nov 16 03:51:29 user nova-compute[103546]:       </nova:owner>
Nov 16 03:51:29 user nova-compute[103546]:       <nova:root type="image" uuid="5c6f539a-01e5-4478-bf8f-a14310b5d7dd"/>
Nov 16 03:51:29 user nova-compute[103546]:       <nova:ports>
Nov 16 03:51:29 user nova-compute[103546]:         <nova:port uuid="e36fae5d-773f-47c0-b79a-5aadf6412cbc">
Nov 16 03:51:29 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 16 03:51:29 user nova-compute[103546]:         </nova:port>
Nov 16 03:51:29 user nova-compute[103546]:       </nova:ports>
Nov 16 03:51:29 user nova-compute[103546]:     </nova:instance>
Nov 16 03:51:29 user nova-compute[103546]:   </metadata>
Nov 16 03:51:29 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 03:51:29 user nova-compute[103546]:     <system>
Nov 16 03:51:29 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 03:51:29 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 03:51:29 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 03:51:29 user nova-compute[103546]:       <entry name="serial">51554aab-44ec-4161-b926-9c07a3f838a5</entry>
Nov 16 03:51:29 user nova-compute[103546]:       <entry name="uuid">51554aab-44ec-4161-b926-9c07a3f838a5</entry>
Nov 16 03:51:29 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 03:51:29 user nova-compute[103546]:     </system>
Nov 16 03:51:29 user nova-compute[103546]:   </sysinfo>
Nov 16 03:51:29 user nova-compute[103546]:   <os>
Nov 16 03:51:29 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 03:51:29 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 03:51:29 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 03:51:29 user nova-compute[103546]:   </os>
Nov 16 03:51:29 user nova-compute[103546]:   <features>
Nov 16 03:51:29 user nova-compute[103546]:     <acpi/>
Nov 16 03:51:29 user nova-compute[103546]:     <apic/>
Nov 16 03:51:29 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 03:51:29 user nova-compute[103546]:   </features>
Nov 16 03:51:29 user nova-compute[103546]:   <clock offset="utc">
Nov 16 03:51:29 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 03:51:29 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 03:51:29 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 03:51:29 user nova-compute[103546]:   </clock>
Nov 16 03:51:29 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 03:51:29 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 03:51:29 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 03:51:29 user nova-compute[103546]:   </cpu>
Nov 16 03:51:29 user nova-compute[103546]:   <devices>
Nov 16 03:51:29 user nova-compute[103546]:     <disk type="file" device="disk">
Nov 16 03:51:29 user nova-compute[103546]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 03:51:29 user nova-compute[103546]:       <source file="/opt/stack/data/nova/instances/51554aab-44ec-4161-b926-9c07a3f838a5/disk"/>
Nov 16 03:51:29 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 03:51:29 user nova-compute[103546]:     </disk>
Nov 16 03:51:29 user nova-compute[103546]:     <disk type="block" device="disk">
Nov 16 03:51:29 user nova-compute[103546]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 03:51:29 user nova-compute[103546]:       <source dev="/dev/sdb"/>
Nov 16 03:51:29 user nova-compute[103546]:       <target dev="vdb" bus="virtio"/>
Nov 16 03:51:29 user nova-compute[103546]:       <serial>4156a8b3-4b47-48ef-ad34-1ace6437b49c</serial>
Nov 16 03:51:29 user nova-compute[103546]:     </disk>
Nov 16 03:51:29 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 03:51:29 user nova-compute[103546]:       <mac address="fa:16:3e:9a:45:d0"/>
Nov 16 03:51:29 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:51:29 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 03:51:29 user nova-compute[103546]:       <target dev="tape36fae5d-77"/>
Nov 16 03:51:29 user nova-compute[103546]:     </interface>
Nov 16 03:51:29 user nova-compute[103546]:     <serial type="pty">
Nov 16 03:51:29 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/51554aab-44ec-4161-b926-9c07a3f838a5/console.log" append="off"/>
Nov 16 03:51:29 user nova-compute[103546]:     </serial>
Nov 16 03:51:29 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 03:51:29 user nova-compute[103546]:     <video>
Nov 16 03:51:29 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:51:29 user nova-compute[103546]:     </video>
Nov 16 03:51:29 user nova-compute[103546]:     <rng model="virtio">
Nov 16 03:51:29 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 03:51:29 user nova-compute[103546]:     </rng>
Nov 16 03:51:29 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 03:51:29 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 03:51:29 user nova-compute[103546]:       <stats period="10"/>
Nov 16 03:51:29 user nova-compute[103546]:     </memballoon>
Nov 16 03:51:29 user nova-compute[103546]:   </devices>
Nov 16 03:51:29 user nova-compute[103546]: </domain>
Nov 16 03:51:29 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 03:51:29 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:46:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1580842921',display_name='tempest-ServerActionsTestOtherB-server-1580842921',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1580842921',id=2,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4BC4cHDV2fbJoL15YFOsrL3Jj/txUDoSxREB28Izf7niUsDWNVN4I6jw0qVmlW7BvPaNCWUAskE06oeKsT+2XD63IEOwvY2xtSda7L7/qiL3VY46L9X29CD+3k2W4RoA==',key_name='tempest-keypair-857843108',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:49:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f76ca2da0c584a7382040eb113da4c2a',ramdisk_id='',reservation_id='r-kl1f6eox',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-648062424',owner_user_name='tempest-ServerActionsTestOtherB-648062424-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T03:51:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4bf11ccac9f4203808f8dca52cde36c',uuid=51554aab-44ec-4161-b926-9c07a3f838a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "e36fae5d-773f-47c0-b79a-5aadf6412cbc", "address": "fa:16:3e:9a:45:d0", "network": {"id": "ef471a6e-7bd1-4a61-aa01-fd7557bfae1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-865941926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76ca2da0c584a7382040eb113da4c2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape36fae5d-77", "ovs_interfaceid": "e36fae5d-773f-47c0-b79a-5aadf6412cbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 03:51:29 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Converting VIF {"id": "e36fae5d-773f-47c0-b79a-5aadf6412cbc", "address": "fa:16:3e:9a:45:d0", "network": {"id": "ef471a6e-7bd1-4a61-aa01-fd7557bfae1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-865941926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76ca2da0c584a7382040eb113da4c2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape36fae5d-77", "ovs_interfaceid": "e36fae5d-773f-47c0-b79a-5aadf6412cbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:51:29 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:45:d0,bridge_name='br-int',has_traffic_filtering=True,id=e36fae5d-773f-47c0-b79a-5aadf6412cbc,network=Network(ef471a6e-7bd1-4a61-aa01-fd7557bfae1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape36fae5d-77') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:51:29 user nova-compute[103546]: DEBUG os_vif [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:45:d0,bridge_name='br-int',has_traffic_filtering=True,id=e36fae5d-773f-47c0-b79a-5aadf6412cbc,network=Network(ef471a6e-7bd1-4a61-aa01-fd7557bfae1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape36fae5d-77') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 03:51:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:51:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 03:51:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c8254de3-0ae2-54ca-9a2b-b650bc7f0d7f', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:51:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:51:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape36fae5d-77, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:51:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape36fae5d-77, col_values=(('qos', UUID('7f354419-fdc4-473f-97ed-85b5c78694c2')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:51:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape36fae5d-77, col_values=(('external_ids', {'iface-id': 'e36fae5d-773f-47c0-b79a-5aadf6412cbc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:45:d0', 'vm-uuid': '51554aab-44ec-4161-b926-9c07a3f838a5'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:51:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:51:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:29 user nova-compute[103546]: INFO os_vif [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:45:d0,bridge_name='br-int',has_traffic_filtering=True,id=e36fae5d-773f-47c0-b79a-5aadf6412cbc,network=Network(ef471a6e-7bd1-4a61-aa01-fd7557bfae1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape36fae5d-77')
Nov 16 03:51:31 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:31 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:31 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:31 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:31 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:32 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:32 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:33 user nova-compute[103546]: DEBUG nova.compute.manager [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 03:51:33 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Instance running successfully.
Nov 16 03:51:33 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] finish_revert_migration finished successfully. {{(pid=103546) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 16 03:51:34 user nova-compute[103546]: INFO nova.compute.manager [None req-89ca9b42-065a-4f40-892d-62ab9a8f970b tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Updating instance to original state: 'active'
Nov 16 03:51:34 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:36 user nova-compute[103546]: DEBUG nova.compute.manager [req-9e0c46dd-5285-4299-9e1b-14135b83f367 req-6f5deea0-7d88-40de-981e-f935680f8f91 service nova] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Received event network-vif-plugged-e36fae5d-773f-47c0-b79a-5aadf6412cbc {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:51:36 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-9e0c46dd-5285-4299-9e1b-14135b83f367 req-6f5deea0-7d88-40de-981e-f935680f8f91 service nova] Acquiring lock "51554aab-44ec-4161-b926-9c07a3f838a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:51:36 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-9e0c46dd-5285-4299-9e1b-14135b83f367 req-6f5deea0-7d88-40de-981e-f935680f8f91 service nova] Lock "51554aab-44ec-4161-b926-9c07a3f838a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:51:36 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-9e0c46dd-5285-4299-9e1b-14135b83f367 req-6f5deea0-7d88-40de-981e-f935680f8f91 service nova] Lock "51554aab-44ec-4161-b926-9c07a3f838a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:51:36 user nova-compute[103546]: DEBUG nova.compute.manager [req-9e0c46dd-5285-4299-9e1b-14135b83f367 req-6f5deea0-7d88-40de-981e-f935680f8f91 service nova] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] No waiting events found dispatching network-vif-plugged-e36fae5d-773f-47c0-b79a-5aadf6412cbc {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:51:36 user nova-compute[103546]: WARNING nova.compute.manager [req-9e0c46dd-5285-4299-9e1b-14135b83f367 req-6f5deea0-7d88-40de-981e-f935680f8f91 service nova] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Received unexpected event network-vif-plugged-e36fae5d-773f-47c0-b79a-5aadf6412cbc for instance with vm_state active and task_state None.
Nov 16 03:51:38 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:38 user nova-compute[103546]: DEBUG nova.compute.manager [req-a290bcd3-982a-47ac-ad8f-97c2f7254b3e req-48a8c002-247c-4eb0-82b5-6c43370d997e service nova] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Received event network-vif-plugged-e36fae5d-773f-47c0-b79a-5aadf6412cbc {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:51:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a290bcd3-982a-47ac-ad8f-97c2f7254b3e req-48a8c002-247c-4eb0-82b5-6c43370d997e service nova] Acquiring lock "51554aab-44ec-4161-b926-9c07a3f838a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:51:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a290bcd3-982a-47ac-ad8f-97c2f7254b3e req-48a8c002-247c-4eb0-82b5-6c43370d997e service nova] Lock "51554aab-44ec-4161-b926-9c07a3f838a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:51:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a290bcd3-982a-47ac-ad8f-97c2f7254b3e req-48a8c002-247c-4eb0-82b5-6c43370d997e service nova] Lock "51554aab-44ec-4161-b926-9c07a3f838a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:51:38 user nova-compute[103546]: DEBUG nova.compute.manager [req-a290bcd3-982a-47ac-ad8f-97c2f7254b3e req-48a8c002-247c-4eb0-82b5-6c43370d997e service nova] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] No waiting events found dispatching network-vif-plugged-e36fae5d-773f-47c0-b79a-5aadf6412cbc {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:51:38 user nova-compute[103546]: WARNING nova.compute.manager [req-a290bcd3-982a-47ac-ad8f-97c2f7254b3e req-48a8c002-247c-4eb0-82b5-6c43370d997e service nova] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Received unexpected event network-vif-plugged-e36fae5d-773f-47c0-b79a-5aadf6412cbc for instance with vm_state active and task_state None.
Nov 16 03:51:39 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquiring lock "58e02332-2918-4744-a8f7-90e28391d391" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:51:39 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "58e02332-2918-4744-a8f7-90e28391d391" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:51:39 user nova-compute[103546]: DEBUG nova.compute.manager [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Starting instance... {{(pid=103546) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 03:51:39 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:51:39 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:51:39 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=103546) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 03:51:39 user nova-compute[103546]: INFO nova.compute.claims [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Claim successful on node user
Nov 16 03:51:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:39 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:51:39 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:51:39 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.491s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:51:39 user nova-compute[103546]: DEBUG nova.compute.manager [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Start building networks asynchronously for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 03:51:39 user nova-compute[103546]: DEBUG nova.compute.manager [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Allocating IP information in the background. {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 03:51:39 user nova-compute[103546]: DEBUG nova.network.neutron [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 58e02332-2918-4744-a8f7-90e28391d391] allocate_for_instance() {{(pid=103546) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 03:51:39 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 03:51:39 user nova-compute[103546]: DEBUG nova.compute.manager [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Start building block device mappings for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 03:51:39 user nova-compute[103546]: DEBUG nova.policy [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ab77040a7b9846d28dc08852d678d1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ce50192a9743b59a9430163dd6a51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103546) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 03:51:39 user nova-compute[103546]: INFO nova.virt.block_device [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Booting with volume snapshot 9b7193dc-b49d-409d-a74c-b32cf198ac6e at /dev/vda
Nov 16 03:51:40 user nova-compute[103546]: DEBUG nova.network.neutron [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Successfully created port: e889fe81-2735-4713-907e-44c70f25a06b {{(pid=103546) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 03:51:41 user nova-compute[103546]: DEBUG nova.network.neutron [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Successfully updated port: e889fe81-2735-4713-907e-44c70f25a06b {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 03:51:41 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquiring lock "refresh_cache-58e02332-2918-4744-a8f7-90e28391d391" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:51:41 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquired lock "refresh_cache-58e02332-2918-4744-a8f7-90e28391d391" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:51:41 user nova-compute[103546]: DEBUG nova.network.neutron [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 03:51:41 user nova-compute[103546]: DEBUG nova.compute.manager [req-d01ec6eb-1453-4fce-8b04-8fc95043b8d7 req-96ca4aba-953b-4fc0-b102-953510a335c6 service nova] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Received event network-changed-e889fe81-2735-4713-907e-44c70f25a06b {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:51:41 user nova-compute[103546]: DEBUG nova.compute.manager [req-d01ec6eb-1453-4fce-8b04-8fc95043b8d7 req-96ca4aba-953b-4fc0-b102-953510a335c6 service nova] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Refreshing instance network info cache due to event network-changed-e889fe81-2735-4713-907e-44c70f25a06b. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:51:41 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d01ec6eb-1453-4fce-8b04-8fc95043b8d7 req-96ca4aba-953b-4fc0-b102-953510a335c6 service nova] Acquiring lock "refresh_cache-58e02332-2918-4744-a8f7-90e28391d391" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:51:41 user nova-compute[103546]: DEBUG nova.network.neutron [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 03:51:42 user nova-compute[103546]: DEBUG nova.network.neutron [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Updating instance_info_cache with network_info: [{"id": "e889fe81-2735-4713-907e-44c70f25a06b", "address": "fa:16:3e:c8:1f:ad", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape889fe81-27", "ovs_interfaceid": "e889fe81-2735-4713-907e-44c70f25a06b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:51:42 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Releasing lock "refresh_cache-58e02332-2918-4744-a8f7-90e28391d391" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:51:42 user nova-compute[103546]: DEBUG nova.compute.manager [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Instance network_info: |[{"id": "e889fe81-2735-4713-907e-44c70f25a06b", "address": "fa:16:3e:c8:1f:ad", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape889fe81-27", "ovs_interfaceid": "e889fe81-2735-4713-907e-44c70f25a06b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 03:51:42 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d01ec6eb-1453-4fce-8b04-8fc95043b8d7 req-96ca4aba-953b-4fc0-b102-953510a335c6 service nova] Acquired lock "refresh_cache-58e02332-2918-4744-a8f7-90e28391d391" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:51:42 user nova-compute[103546]: DEBUG nova.network.neutron [req-d01ec6eb-1453-4fce-8b04-8fc95043b8d7 req-96ca4aba-953b-4fc0-b102-953510a335c6 service nova] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Refreshing network info cache for port e889fe81-2735-4713-907e-44c70f25a06b {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:51:42 user nova-compute[103546]: DEBUG nova.network.neutron [req-d01ec6eb-1453-4fce-8b04-8fc95043b8d7 req-96ca4aba-953b-4fc0-b102-953510a335c6 service nova] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Updated VIF entry in instance network info cache for port e889fe81-2735-4713-907e-44c70f25a06b. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 03:51:42 user nova-compute[103546]: DEBUG nova.network.neutron [req-d01ec6eb-1453-4fce-8b04-8fc95043b8d7 req-96ca4aba-953b-4fc0-b102-953510a335c6 service nova] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Updating instance_info_cache with network_info: [{"id": "e889fe81-2735-4713-907e-44c70f25a06b", "address": "fa:16:3e:c8:1f:ad", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape889fe81-27", "ovs_interfaceid": "e889fe81-2735-4713-907e-44c70f25a06b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:51:42 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d01ec6eb-1453-4fce-8b04-8fc95043b8d7 req-96ca4aba-953b-4fc0-b102-953510a335c6 service nova] Releasing lock "refresh_cache-58e02332-2918-4744-a8f7-90e28391d391" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:51:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:44 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:45 user nova-compute[103546]: DEBUG os_brick.utils [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:51:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:45 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[18885a6d-c643-4641-8b14-417d15520076]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af5c39b14ece\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:51:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:45 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1f97cc-f4cb-493c-aad6-fad251818e26]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:51:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:45 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff7565fd-cc7f-49ba-9ede-bb02830c3c58]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:51:45 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c7deac-4827-42ab-898e-576ab07a7d9b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:51:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Running cmd (subprocess): nvme version {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] 'nvme version' failed. Not Retrying. {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:51:45 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] nvme not present on system {{(pid=103546) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 03:51:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:51:45 user nova-compute[103546]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 03:51:45 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c566f54-6471-4d5d-9e9d-410f1f39ee7d]: (4, '') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:51:45 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=103546) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 03:51:45 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 03:51:45 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] LIGHTOS: no hostnqn found. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 03:51:45 user nova-compute[103546]: DEBUG os_brick.utils [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af5c39b14ece', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:51:45 user nova-compute[103546]: DEBUG nova.virt.block_device [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Updating existing volume attachment record: d499044d-1ccc-4222-b450-97cfe7fd785d {{(pid=103546) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 03:51:48 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:50 user nova-compute[103546]: DEBUG nova.compute.manager [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Start spawning the instance on the hypervisor. {{(pid=103546) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 03:51:50 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Creating instance directory {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 03:51:50 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Creating image(s)
Nov 16 03:51:50 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Did not create local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 03:51:50 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Ensure instance console log exists: /opt/stack/data/nova/instances/58e02332-2918-4744-a8f7-90e28391d391/console.log {{(pid=103546) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 03:51:50 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:51:50 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:51:50 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:51:50 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Start _get_guest_xml network_info=[{"id": "e889fe81-2735-4713-907e-44c70f25a06b", "address": "fa:16:3e:c8:1f:ad", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape889fe81-27", "ovs_interfaceid": "e889fe81-2735-4713-907e-44c70f25a06b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kjVUvHxt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '58e02332-2918-4744-a8f7-90e28391d391', 'attached_at': '', 'detached_at': '', 'volume_id': 'de115f8d-692c-40cc-96ba-2adc6acaa54f', 'serial': 'de115f8d-692c-40cc-96ba-2adc6acaa54f'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': 'd499044d-1ccc-4222-b450-97cfe7fd785d', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 03:51:50 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:51:50 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:51:50 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 03:51:50 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 03:51:50 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 03:51:50 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 03:51:50 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 03:51:50 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 03:51:50 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 03:51:50 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 03:51:50 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 03:51:50 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 03:51:50 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 03:51:50 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 03:51:50 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 03:51:50 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 03:51:50 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 03:51:50 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 03:51:51 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 03:51:51 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kjVUvHxt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:51:51 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:51:51 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:51:51 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:51:51 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:51:51 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:51:51 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:51:51 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 03:51:51 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:51 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:51 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4c7804-ee78-48d5-baaa-2df8bd91fd54]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:51:51 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 03:51:51 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:51:51 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f -p 172.16.0.220:3260 --interface default --op new {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:51 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:51 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bad863c-bbcb-4ef2-8861-3ce7a48d0b75]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f] added\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:51:51 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f] added
Nov 16 03:51:51 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:51:51 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:51 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:51 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b709721-7fde-4736-b803-07b79e1b45e2]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:51:51 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:51:51 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:51 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:51 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[884af33a-6a4d-4196-9ee4-204d0477f44e]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:51:51 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:51:51 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kjVUvHxt {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:51 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kjVUvHxt" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:51 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b96acc-ef47-40c5-88cc-04f3b8801600]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:51:51 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kjVUvHxt'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:51:51 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:51 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.044s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:51 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4759c1-fcd0-4a30-ab81-d71071af3878]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:51:51 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:51:51 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:51 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:51 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0a6817-e2b3-4589-a735-e669d38420ee]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:51:51 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9 (non-flash)
Nov 16 03:51:51 user nova-compute[103546]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)
Nov 16 03:51:51 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:51:51 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9 (non-flash)
Nov 16 03:51:51 user nova-compute[103546]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)
Nov 16 03:51:51 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:51:51 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f -p 172.16.0.220:3260 --login {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:51 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:51 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2f3544-4fb0-4b85-b80f-96dc743cab41]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:51:51 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f, portal: 172.16.0.220,3260]
Nov 16 03:51:51 user nova-compute[103546]: Login to [iface: default, target: iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f, portal: 172.16.0.220,3260] successful.
Nov 16 03:51:51 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:51:51 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:51 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:51 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54413e2-6490-4f70-bf0f-7373ebb7d1f1]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:51:51 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:51:51 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:51 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:51 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c45274-0680-48c5-8879-2bf972fdb3b5]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:51:51 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9 (non-flash)
Nov 16 03:51:51 user nova-compute[103546]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)
Nov 16 03:51:51 user nova-compute[103546]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f (non-flash)
Nov 16 03:51:51 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:51:51 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9 (non-flash)
Nov 16 03:51:51 user nova-compute[103546]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)
Nov 16 03:51:51 user nova-compute[103546]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f (non-flash)
Nov 16 03:51:51 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:51:51 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:51:51 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 03:51:51 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] HCTL ('35', '-', '-', 0) found on session 21 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 03:51:51 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 03:51:51 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:51 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:51 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5135acc8-f3cb-4b52-99a6-04db670b7d1b]: (4, ('- - 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:51:51 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 03:51:51 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kjVUvHxt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 03:51:52 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:51:52 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23365336338613336', 'path': '/dev/sdd'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:51:52 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365336338613336', 'path': '/dev/sdd'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 03:51:52 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:51:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-345528758',display_name='tempest-TestVolumeBootPattern-server-345528758',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-345528758',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40ce50192a9743b59a9430163dd6a51c',ramdisk_id='',reservation_id='r-7ksw0p8n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1283031547',owner_user_name='tempest-TestVolumeBootPattern-1283031547-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:51:40Z,user_data=None,user_id='ab77040a7b9846d28dc08852d678d1ed',uuid=58e02332-2918-4744-a8f7-90e28391d391,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e889fe81-2735-4713-907e-44c70f25a06b", "address": "fa:16:3e:c8:1f:ad", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape889fe81-27", "ovs_interfaceid": "e889fe81-2735-4713-907e-44c70f25a06b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 03:51:52 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Converting VIF {"id": "e889fe81-2735-4713-907e-44c70f25a06b", "address": "fa:16:3e:c8:1f:ad", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape889fe81-27", "ovs_interfaceid": "e889fe81-2735-4713-907e-44c70f25a06b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:51:52 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:1f:ad,bridge_name='br-int',has_traffic_filtering=True,id=e889fe81-2735-4713-907e-44c70f25a06b,network=Network(a13f532d-a30d-4c06-83fe-760bcffae183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape889fe81-27') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:51:52 user nova-compute[103546]: DEBUG nova.objects.instance [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lazy-loading 'pci_devices' on Instance uuid 58e02332-2918-4744-a8f7-90e28391d391 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:51:52 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 58e02332-2918-4744-a8f7-90e28391d391] End _get_guest_xml xml=<domain type="kvm">
Nov 16 03:51:52 user nova-compute[103546]:   <uuid>58e02332-2918-4744-a8f7-90e28391d391</uuid>
Nov 16 03:51:52 user nova-compute[103546]:   <name>instance-00000012</name>
Nov 16 03:51:52 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 03:51:52 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 03:51:52 user nova-compute[103546]:   <metadata>
Nov 16 03:51:52 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 03:51:52 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 03:51:52 user nova-compute[103546]:       <nova:name>tempest-TestVolumeBootPattern-server-345528758</nova:name>
Nov 16 03:51:52 user nova-compute[103546]:       <nova:creationTime>2023-11-16 03:51:50</nova:creationTime>
Nov 16 03:51:52 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 03:51:52 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 03:51:52 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 03:51:52 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 03:51:52 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 03:51:52 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 03:51:52 user nova-compute[103546]:       </nova:flavor>
Nov 16 03:51:52 user nova-compute[103546]:       <nova:owner>
Nov 16 03:51:52 user nova-compute[103546]:         <nova:user uuid="ab77040a7b9846d28dc08852d678d1ed">tempest-TestVolumeBootPattern-1283031547-project-member</nova:user>
Nov 16 03:51:52 user nova-compute[103546]:         <nova:project uuid="40ce50192a9743b59a9430163dd6a51c">tempest-TestVolumeBootPattern-1283031547</nova:project>
Nov 16 03:51:52 user nova-compute[103546]:       </nova:owner>
Nov 16 03:51:52 user nova-compute[103546]:       <nova:ports>
Nov 16 03:51:52 user nova-compute[103546]:         <nova:port uuid="e889fe81-2735-4713-907e-44c70f25a06b">
Nov 16 03:51:52 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 16 03:51:52 user nova-compute[103546]:         </nova:port>
Nov 16 03:51:52 user nova-compute[103546]:       </nova:ports>
Nov 16 03:51:52 user nova-compute[103546]:     </nova:instance>
Nov 16 03:51:52 user nova-compute[103546]:   </metadata>
Nov 16 03:51:52 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 03:51:52 user nova-compute[103546]:     <system>
Nov 16 03:51:52 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 03:51:52 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 03:51:52 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 03:51:52 user nova-compute[103546]:       <entry name="serial">58e02332-2918-4744-a8f7-90e28391d391</entry>
Nov 16 03:51:52 user nova-compute[103546]:       <entry name="uuid">58e02332-2918-4744-a8f7-90e28391d391</entry>
Nov 16 03:51:52 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 03:51:52 user nova-compute[103546]:     </system>
Nov 16 03:51:52 user nova-compute[103546]:   </sysinfo>
Nov 16 03:51:52 user nova-compute[103546]:   <os>
Nov 16 03:51:52 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 03:51:52 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 03:51:52 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 03:51:52 user nova-compute[103546]:   </os>
Nov 16 03:51:52 user nova-compute[103546]:   <features>
Nov 16 03:51:52 user nova-compute[103546]:     <acpi/>
Nov 16 03:51:52 user nova-compute[103546]:     <apic/>
Nov 16 03:51:52 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 03:51:52 user nova-compute[103546]:   </features>
Nov 16 03:51:52 user nova-compute[103546]:   <clock offset="utc">
Nov 16 03:51:52 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 03:51:52 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 03:51:52 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 03:51:52 user nova-compute[103546]:   </clock>
Nov 16 03:51:52 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 03:51:52 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 03:51:52 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 03:51:52 user nova-compute[103546]:   </cpu>
Nov 16 03:51:52 user nova-compute[103546]:   <devices>
Nov 16 03:51:52 user nova-compute[103546]:     <disk type="block" device="disk">
Nov 16 03:51:52 user nova-compute[103546]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 03:51:52 user nova-compute[103546]:       <source dev="/dev/sdd"/>
Nov 16 03:51:52 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 03:51:52 user nova-compute[103546]:       <serial>de115f8d-692c-40cc-96ba-2adc6acaa54f</serial>
Nov 16 03:51:52 user nova-compute[103546]:     </disk>
Nov 16 03:51:52 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 03:51:52 user nova-compute[103546]:       <mac address="fa:16:3e:c8:1f:ad"/>
Nov 16 03:51:52 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:51:52 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 03:51:52 user nova-compute[103546]:       <target dev="tape889fe81-27"/>
Nov 16 03:51:52 user nova-compute[103546]:     </interface>
Nov 16 03:51:52 user nova-compute[103546]:     <serial type="pty">
Nov 16 03:51:52 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/58e02332-2918-4744-a8f7-90e28391d391/console.log" append="off"/>
Nov 16 03:51:52 user nova-compute[103546]:     </serial>
Nov 16 03:51:52 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 03:51:52 user nova-compute[103546]:     <video>
Nov 16 03:51:52 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:51:52 user nova-compute[103546]:     </video>
Nov 16 03:51:52 user nova-compute[103546]:     <rng model="virtio">
Nov 16 03:51:52 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 03:51:52 user nova-compute[103546]:     </rng>
Nov 16 03:51:52 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 03:51:52 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 03:51:52 user nova-compute[103546]:       <stats period="10"/>
Nov 16 03:51:52 user nova-compute[103546]:     </memballoon>
Nov 16 03:51:52 user nova-compute[103546]:   </devices>
Nov 16 03:51:52 user nova-compute[103546]: </domain>
Nov 16 03:51:52 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 03:51:52 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:51:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-345528758',display_name='tempest-TestVolumeBootPattern-server-345528758',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-345528758',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40ce50192a9743b59a9430163dd6a51c',ramdisk_id='',reservation_id='r-7ksw0p8n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1283031547',owner_user_name='tempest-TestVolumeBootPattern-1283031547-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:51:40Z,user_data=None,user_id='ab77040a7b9846d28dc08852d678d1ed',uuid=58e02332-2918-4744-a8f7-90e28391d391,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e889fe81-2735-4713-907e-44c70f25a06b", "address": "fa:16:3e:c8:1f:ad", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape889fe81-27", "ovs_interfaceid": "e889fe81-2735-4713-907e-44c70f25a06b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 03:51:52 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Converting VIF {"id": "e889fe81-2735-4713-907e-44c70f25a06b", "address": "fa:16:3e:c8:1f:ad", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape889fe81-27", "ovs_interfaceid": "e889fe81-2735-4713-907e-44c70f25a06b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:51:52 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:1f:ad,bridge_name='br-int',has_traffic_filtering=True,id=e889fe81-2735-4713-907e-44c70f25a06b,network=Network(a13f532d-a30d-4c06-83fe-760bcffae183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape889fe81-27') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:51:52 user nova-compute[103546]: DEBUG os_vif [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:1f:ad,bridge_name='br-int',has_traffic_filtering=True,id=e889fe81-2735-4713-907e-44c70f25a06b,network=Network(a13f532d-a30d-4c06-83fe-760bcffae183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape889fe81-27') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 03:51:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:51:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 03:51:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fc948be4-2f2a-5bfa-8a11-7a630b803957', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:51:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:51:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape889fe81-27, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:51:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape889fe81-27, col_values=(('qos', UUID('97b67cb7-6458-4340-bd66-3a93a9111c46')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:51:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape889fe81-27, col_values=(('external_ids', {'iface-id': 'e889fe81-2735-4713-907e-44c70f25a06b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:1f:ad', 'vm-uuid': '58e02332-2918-4744-a8f7-90e28391d391'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:51:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:51:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:52 user nova-compute[103546]: INFO os_vif [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:1f:ad,bridge_name='br-int',has_traffic_filtering=True,id=e889fe81-2735-4713-907e-44c70f25a06b,network=Network(a13f532d-a30d-4c06-83fe-760bcffae183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape889fe81-27')
Nov 16 03:51:52 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:51:52 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] No VIF found with MAC fa:16:3e:c8:1f:ad, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 03:51:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:53 user nova-compute[103546]: DEBUG nova.compute.manager [req-2a39e99f-16be-4ed4-a155-4e321d7c0f6e req-27eebe61-91e4-4023-a14a-fe6e0fe9146d service nova] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Received event network-vif-plugged-e889fe81-2735-4713-907e-44c70f25a06b {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:51:53 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-2a39e99f-16be-4ed4-a155-4e321d7c0f6e req-27eebe61-91e4-4023-a14a-fe6e0fe9146d service nova] Acquiring lock "58e02332-2918-4744-a8f7-90e28391d391-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:51:53 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-2a39e99f-16be-4ed4-a155-4e321d7c0f6e req-27eebe61-91e4-4023-a14a-fe6e0fe9146d service nova] Lock "58e02332-2918-4744-a8f7-90e28391d391-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:51:53 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-2a39e99f-16be-4ed4-a155-4e321d7c0f6e req-27eebe61-91e4-4023-a14a-fe6e0fe9146d service nova] Lock "58e02332-2918-4744-a8f7-90e28391d391-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:51:53 user nova-compute[103546]: DEBUG nova.compute.manager [req-2a39e99f-16be-4ed4-a155-4e321d7c0f6e req-27eebe61-91e4-4023-a14a-fe6e0fe9146d service nova] [instance: 58e02332-2918-4744-a8f7-90e28391d391] No waiting events found dispatching network-vif-plugged-e889fe81-2735-4713-907e-44c70f25a06b {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:51:53 user nova-compute[103546]: WARNING nova.compute.manager [req-2a39e99f-16be-4ed4-a155-4e321d7c0f6e req-27eebe61-91e4-4023-a14a-fe6e0fe9146d service nova] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Received unexpected event network-vif-plugged-e889fe81-2735-4713-907e-44c70f25a06b for instance with vm_state building and task_state spawning.
Nov 16 03:51:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:55 user nova-compute[103546]: DEBUG nova.compute.manager [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 03:51:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Guest created on hypervisor {{(pid=103546) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 03:51:55 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Instance spawned successfully.
Nov 16 03:51:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 03:51:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Found default for hw_cdrom_bus of ide {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:51:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Found default for hw_disk_bus of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:51:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Found default for hw_input_bus of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:51:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Found default for hw_pointer_model of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:51:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Found default for hw_video_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:51:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Found default for hw_vif_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:51:55 user nova-compute[103546]: INFO nova.compute.manager [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Took 5.00 seconds to spawn the instance on the hypervisor.
Nov 16 03:51:55 user nova-compute[103546]: DEBUG nova.compute.manager [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 03:51:55 user nova-compute[103546]: DEBUG nova.compute.manager [req-12d1e2ef-bede-4352-a3f0-7b7036df235b req-89567fe4-9f6e-4ec4-a38e-39bc6606eb77 service nova] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Received event network-vif-plugged-e889fe81-2735-4713-907e-44c70f25a06b {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:51:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-12d1e2ef-bede-4352-a3f0-7b7036df235b req-89567fe4-9f6e-4ec4-a38e-39bc6606eb77 service nova] Acquiring lock "58e02332-2918-4744-a8f7-90e28391d391-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:51:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-12d1e2ef-bede-4352-a3f0-7b7036df235b req-89567fe4-9f6e-4ec4-a38e-39bc6606eb77 service nova] Lock "58e02332-2918-4744-a8f7-90e28391d391-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:51:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-12d1e2ef-bede-4352-a3f0-7b7036df235b req-89567fe4-9f6e-4ec4-a38e-39bc6606eb77 service nova] Lock "58e02332-2918-4744-a8f7-90e28391d391-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:51:55 user nova-compute[103546]: DEBUG nova.compute.manager [req-12d1e2ef-bede-4352-a3f0-7b7036df235b req-89567fe4-9f6e-4ec4-a38e-39bc6606eb77 service nova] [instance: 58e02332-2918-4744-a8f7-90e28391d391] No waiting events found dispatching network-vif-plugged-e889fe81-2735-4713-907e-44c70f25a06b {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:51:55 user nova-compute[103546]: WARNING nova.compute.manager [req-12d1e2ef-bede-4352-a3f0-7b7036df235b req-89567fe4-9f6e-4ec4-a38e-39bc6606eb77 service nova] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Received unexpected event network-vif-plugged-e889fe81-2735-4713-907e-44c70f25a06b for instance with vm_state building and task_state spawning.
Nov 16 03:51:56 user nova-compute[103546]: INFO nova.compute.manager [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Took 16.78 seconds to build instance.
Nov 16 03:51:56 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-3a6049c6-a903-474c-b173-1b1295d85668 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "58e02332-2918-4744-a8f7-90e28391d391" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.875s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:51:56 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cee511ad-b744-4cc5-95c8-a9795a8f59f7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Acquiring lock "63b95121-b211-42c3-831e-0392d4abd09a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:51:56 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cee511ad-b744-4cc5-95c8-a9795a8f59f7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "63b95121-b211-42c3-831e-0392d4abd09a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:51:56 user nova-compute[103546]: DEBUG nova.objects.instance [None req-cee511ad-b744-4cc5-95c8-a9795a8f59f7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lazy-loading 'flavor' on Instance uuid 63b95121-b211-42c3-831e-0392d4abd09a {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:51:56 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cee511ad-b744-4cc5-95c8-a9795a8f59f7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "63b95121-b211-42c3-831e-0392d4abd09a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:51:56 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cee511ad-b744-4cc5-95c8-a9795a8f59f7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Acquiring lock "63b95121-b211-42c3-831e-0392d4abd09a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:51:56 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cee511ad-b744-4cc5-95c8-a9795a8f59f7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "63b95121-b211-42c3-831e-0392d4abd09a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:51:56 user nova-compute[103546]: INFO nova.compute.manager [None req-cee511ad-b744-4cc5-95c8-a9795a8f59f7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Attaching volume bc7fa9af-8224-4503-8b59-e374f8b1b00c to /dev/vdb
Nov 16 03:51:56 user nova-compute[103546]: DEBUG os_brick.utils [None req-cee511ad-b744-4cc5-95c8-a9795a8f59f7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:51:56 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:56 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:56 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5c939e-a04b-4a5f-aa1e-9aba26b22ed1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af5c39b14ece\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:51:56 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:56 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.036s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:56 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[000c3cc4-af40-4b8e-9909-9a6100cfb76a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:51:56 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:56 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:51:56 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb3f6c4-c64a-49b3-a7b3-0e19df37895b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:51:56 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[63756516-c951-4619-9257-0182fdaf61ea]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:51:56 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-cee511ad-b744-4cc5-95c8-a9795a8f59f7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Running cmd (subprocess): nvme version {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:56 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-cee511ad-b744-4cc5-95c8-a9795a8f59f7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] 'nvme version' failed. Not Retrying. {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:51:56 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cee511ad-b744-4cc5-95c8-a9795a8f59f7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] nvme not present on system {{(pid=103546) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 03:51:56 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:51:56 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:51:56 user nova-compute[103546]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 03:51:56 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89698c1-252b-4cba-9937-f5f3bd2edcdc]: (4, '') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:51:56 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-cee511ad-b744-4cc5-95c8-a9795a8f59f7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=103546) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 03:51:56 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-cee511ad-b744-4cc5-95c8-a9795a8f59f7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 03:51:56 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-cee511ad-b744-4cc5-95c8-a9795a8f59f7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] LIGHTOS: no hostnqn found. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 03:51:56 user nova-compute[103546]: DEBUG os_brick.utils [None req-cee511ad-b744-4cc5-95c8-a9795a8f59f7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] <== get_connector_properties: return (167ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af5c39b14ece', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:51:56 user nova-compute[103546]: DEBUG nova.virt.block_device [None req-cee511ad-b744-4cc5-95c8-a9795a8f59f7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Updating existing volume attachment record: ee5ba530-efa1-4ad6-8a1e-a654da9399ba {{(pid=103546) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 03:51:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:51:59 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cfb3011c-1670-4b71-9e17-bffa476d1a00 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Acquiring lock "7862d05d-4293-46a5-98aa-41967a572fe3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:51:59 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cfb3011c-1670-4b71-9e17-bffa476d1a00 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "7862d05d-4293-46a5-98aa-41967a572fe3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:51:59 user nova-compute[103546]: INFO nova.compute.manager [None req-cfb3011c-1670-4b71-9e17-bffa476d1a00 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Detaching volume 17c96a71-8e3c-44ff-aaf7-ccadc227b7e9
Nov 16 03:52:00 user nova-compute[103546]: INFO nova.virt.block_device [None req-cfb3011c-1670-4b71-9e17-bffa476d1a00 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Attempting to driver detach volume 17c96a71-8e3c-44ff-aaf7-ccadc227b7e9 from mountpoint /dev/vdc
Nov 16 03:52:00 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-cfb3011c-1670-4b71-9e17-bffa476d1a00 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Attempting to detach device vdc from instance 7862d05d-4293-46a5-98aa-41967a572fe3 from the persistent domain config. {{(pid=103546) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 03:52:00 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-cfb3011c-1670-4b71-9e17-bffa476d1a00 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 03:52:00 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 03:52:00 user nova-compute[103546]:   <source dev="/dev/sdc"/>
Nov 16 03:52:00 user nova-compute[103546]:   <target dev="vdc" bus="virtio"/>
Nov 16 03:52:00 user nova-compute[103546]:   <serial>17c96a71-8e3c-44ff-aaf7-ccadc227b7e9</serial>
Nov 16 03:52:00 user nova-compute[103546]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 03:52:00 user nova-compute[103546]: </disk>
Nov 16 03:52:00 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 03:52:00 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-cfb3011c-1670-4b71-9e17-bffa476d1a00 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Successfully detached device vdc from instance 7862d05d-4293-46a5-98aa-41967a572fe3 from the persistent domain config.
Nov 16 03:52:00 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-cfb3011c-1670-4b71-9e17-bffa476d1a00 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 7862d05d-4293-46a5-98aa-41967a572fe3 from the live domain config. {{(pid=103546) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 03:52:00 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-cfb3011c-1670-4b71-9e17-bffa476d1a00 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 03:52:00 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 03:52:00 user nova-compute[103546]:   <source dev="/dev/sdc"/>
Nov 16 03:52:00 user nova-compute[103546]:   <target dev="vdc" bus="virtio"/>
Nov 16 03:52:00 user nova-compute[103546]:   <serial>17c96a71-8e3c-44ff-aaf7-ccadc227b7e9</serial>
Nov 16 03:52:00 user nova-compute[103546]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 03:52:00 user nova-compute[103546]: </disk>
Nov 16 03:52:00 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 03:52:00 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-cfb3011c-1670-4b71-9e17-bffa476d1a00 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 7862d05d-4293-46a5-98aa-41967a572fe3 {{(pid=103546) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 03:52:01 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cee511ad-b744-4cc5-95c8-a9795a8f59f7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 03:52:01 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-cee511ad-b744-4cc5-95c8-a9795a8f59f7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bc7fa9af-8224-4503-8b59-e374f8b1b00c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xYXiVcPw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:52:01 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-cee511ad-b744-4cc5-95c8-a9795a8f59f7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:52:01 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-cee511ad-b744-4cc5-95c8-a9795a8f59f7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:52:01 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-cee511ad-b744-4cc5-95c8-a9795a8f59f7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:52:01 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-cee511ad-b744-4cc5-95c8-a9795a8f59f7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:52:01 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-cee511ad-b744-4cc5-95c8-a9795a8f59f7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc7fa9af-8224-4503-8b59-e374f8b1b00c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:52:01 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-cee511ad-b744-4cc5-95c8-a9795a8f59f7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc7fa9af-8224-4503-8b59-e374f8b1b00c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:52:01 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-cee511ad-b744-4cc5-95c8-a9795a8f59f7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 03:52:01 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc7fa9af-8224-4503-8b59-e374f8b1b00c -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:01 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc7fa9af-8224-4503-8b59-e374f8b1b00c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:52:01 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa0ead3-45da-48e9-8f0b-00ba4170fecb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:52:01 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-cee511ad-b744-4cc5-95c8-a9795a8f59f7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 03:52:01 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:52:01 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc7fa9af-8224-4503-8b59-e374f8b1b00c -p 172.16.0.220:3260 --interface default --op new {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:01 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc7fa9af-8224-4503-8b59-e374f8b1b00c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:52:01 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[00715715-caa2-4333-b238-c9c99c524821]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc7fa9af-8224-4503-8b59-e374f8b1b00c] added\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:52:01 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-cee511ad-b744-4cc5-95c8-a9795a8f59f7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc7fa9af-8224-4503-8b59-e374f8b1b00c] added
Nov 16 03:52:01 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:52:01 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc7fa9af-8224-4503-8b59-e374f8b1b00c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:01 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc7fa9af-8224-4503-8b59-e374f8b1b00c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:52:01 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[239ea3ba-b1a3-437c-a4d9-ae093670c8ba]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:52:01 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-cee511ad-b744-4cc5-95c8-a9795a8f59f7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:52:01 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc7fa9af-8224-4503-8b59-e374f8b1b00c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:01 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc7fa9af-8224-4503-8b59-e374f8b1b00c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:52:01 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34edb6c-6aa2-4671-a09a-9a8748b5d2f6]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:52:01 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-cee511ad-b744-4cc5-95c8-a9795a8f59f7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:52:01 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc7fa9af-8224-4503-8b59-e374f8b1b00c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xYXiVcPw {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:01 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc7fa9af-8224-4503-8b59-e374f8b1b00c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xYXiVcPw" returned: 0 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:52:01 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b21e0f9-7363-477b-8cdf-7e9709631e54]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:52:01 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-cee511ad-b744-4cc5-95c8-a9795a8f59f7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xYXiVcPw'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:52:01 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc7fa9af-8224-4503-8b59-e374f8b1b00c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc7fa9af-8224-4503-8b59-e374f8b1b00c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:52:02 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c8cb12-fe51-4071-8bf5-a540e3588636]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:52:02 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-cee511ad-b744-4cc5-95c8-a9795a8f59f7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:52:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:52:02 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[844420c0-1a0b-4eab-8d3f-c304ce70c83f]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:52:02 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-cee511ad-b744-4cc5-95c8-a9795a8f59f7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9 (non-flash)
Nov 16 03:52:02 user nova-compute[103546]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)
Nov 16 03:52:02 user nova-compute[103546]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f (non-flash)
Nov 16 03:52:02 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:52:02 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-cee511ad-b744-4cc5-95c8-a9795a8f59f7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9 (non-flash)
Nov 16 03:52:02 user nova-compute[103546]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)
Nov 16 03:52:02 user nova-compute[103546]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f (non-flash)
Nov 16 03:52:02 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:52:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc7fa9af-8224-4503-8b59-e374f8b1b00c -p 172.16.0.220:3260 --login {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc7fa9af-8224-4503-8b59-e374f8b1b00c -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:52:02 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ca8b94-0f0c-44af-a3bf-8922f06fe311]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc7fa9af-8224-4503-8b59-e374f8b1b00c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bc7fa9af-8224-4503-8b59-e374f8b1b00c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:52:02 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-cee511ad-b744-4cc5-95c8-a9795a8f59f7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc7fa9af-8224-4503-8b59-e374f8b1b00c, portal: 172.16.0.220,3260]
Nov 16 03:52:02 user nova-compute[103546]: Login to [iface: default, target: iqn.2010-10.org.openstack:bc7fa9af-8224-4503-8b59-e374f8b1b00c, portal: 172.16.0.220,3260] successful.
Nov 16 03:52:02 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:52:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc7fa9af-8224-4503-8b59-e374f8b1b00c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc7fa9af-8224-4503-8b59-e374f8b1b00c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:52:02 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b2c7eb-327b-4c16-9c2d-c67c09b1502e]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:52:02 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-cee511ad-b744-4cc5-95c8-a9795a8f59f7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:52:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:52:02 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6e4962-ee09-45ac-8526-9e6804b50882]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc7fa9af-8224-4503-8b59-e374f8b1b00c (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:52:02 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-cee511ad-b744-4cc5-95c8-a9795a8f59f7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9 (non-flash)
Nov 16 03:52:02 user nova-compute[103546]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)
Nov 16 03:52:02 user nova-compute[103546]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f (non-flash)
Nov 16 03:52:02 user nova-compute[103546]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc7fa9af-8224-4503-8b59-e374f8b1b00c (non-flash)
Nov 16 03:52:02 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:52:02 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-cee511ad-b744-4cc5-95c8-a9795a8f59f7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9 (non-flash)
Nov 16 03:52:02 user nova-compute[103546]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)
Nov 16 03:52:02 user nova-compute[103546]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f (non-flash)
Nov 16 03:52:02 user nova-compute[103546]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc7fa9af-8224-4503-8b59-e374f8b1b00c (non-flash)
Nov 16 03:52:02 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:52:02 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-cee511ad-b744-4cc5-95c8-a9795a8f59f7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc7fa9af-8224-4503-8b59-e374f8b1b00c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:52:02 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-cee511ad-b744-4cc5-95c8-a9795a8f59f7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 03:52:02 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-cee511ad-b744-4cc5-95c8-a9795a8f59f7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] HCTL ('36', '-', '-', 0) found on session 22 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 03:52:02 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-cee511ad-b744-4cc5-95c8-a9795a8f59f7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 03:52:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:52:02 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b17c78c-b8b2-413a-9f57-be0a605609b6]: (4, ('- - 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:52:02 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-cee511ad-b744-4cc5-95c8-a9795a8f59f7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Searching for a device in session 22 and hctl ['36', '*', '*', 0] yield: sde {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 03:52:02 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-cee511ad-b744-4cc5-95c8-a9795a8f59f7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:bc7fa9af-8224-4503-8b59-e374f8b1b00c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xYXiVcPw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 03:52:02 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:52:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-cee511ad-b744-4cc5-95c8-a9795a8f59f7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:52:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-cee511ad-b744-4cc5-95c8-a9795a8f59f7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23937353266373039', 'path': '/dev/sde'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:52:03 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cee511ad-b744-4cc5-95c8-a9795a8f59f7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937353266373039', 'path': '/dev/sde'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 03:52:03 user nova-compute[103546]: DEBUG nova.objects.instance [None req-cee511ad-b744-4cc5-95c8-a9795a8f59f7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lazy-loading 'flavor' on Instance uuid 63b95121-b211-42c3-831e-0392d4abd09a {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:52:03 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-cee511ad-b744-4cc5-95c8-a9795a8f59f7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 03:52:03 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 03:52:03 user nova-compute[103546]:   <source dev="/dev/sde"/>
Nov 16 03:52:03 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 03:52:03 user nova-compute[103546]:   <serial>bc7fa9af-8224-4503-8b59-e374f8b1b00c</serial>
Nov 16 03:52:03 user nova-compute[103546]: </disk>
Nov 16 03:52:03 user nova-compute[103546]:  {{(pid=103546) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 03:52:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:52:03 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-cee511ad-b744-4cc5-95c8-a9795a8f59f7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:52:03 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-cee511ad-b744-4cc5-95c8-a9795a8f59f7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] No BDM found with device name vdb, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:52:03 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-cee511ad-b744-4cc5-95c8-a9795a8f59f7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] No VIF found with MAC fa:16:3e:d0:5b:e1, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 03:52:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cee511ad-b744-4cc5-95c8-a9795a8f59f7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "63b95121-b211-42c3-831e-0392d4abd09a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.402s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:52:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-872f33cf-c405-45b0-8afe-6953ce4bfd66 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Acquiring lock "63b95121-b211-42c3-831e-0392d4abd09a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:52:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-872f33cf-c405-45b0-8afe-6953ce4bfd66 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "63b95121-b211-42c3-831e-0392d4abd09a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:52:05 user nova-compute[103546]: INFO nova.compute.manager [None req-872f33cf-c405-45b0-8afe-6953ce4bfd66 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Detaching volume bc7fa9af-8224-4503-8b59-e374f8b1b00c
Nov 16 03:52:05 user nova-compute[103546]: INFO nova.virt.block_device [None req-872f33cf-c405-45b0-8afe-6953ce4bfd66 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Attempting to driver detach volume bc7fa9af-8224-4503-8b59-e374f8b1b00c from mountpoint /dev/vdb
Nov 16 03:52:05 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-872f33cf-c405-45b0-8afe-6953ce4bfd66 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Attempting to detach device vdb from instance 63b95121-b211-42c3-831e-0392d4abd09a from the persistent domain config. {{(pid=103546) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 03:52:05 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-872f33cf-c405-45b0-8afe-6953ce4bfd66 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 03:52:05 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 03:52:05 user nova-compute[103546]:   <source dev="/dev/sde"/>
Nov 16 03:52:05 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 03:52:05 user nova-compute[103546]:   <serial>bc7fa9af-8224-4503-8b59-e374f8b1b00c</serial>
Nov 16 03:52:05 user nova-compute[103546]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 03:52:05 user nova-compute[103546]: </disk>
Nov 16 03:52:05 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 03:52:05 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-872f33cf-c405-45b0-8afe-6953ce4bfd66 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Successfully detached device vdb from instance 63b95121-b211-42c3-831e-0392d4abd09a from the persistent domain config.
Nov 16 03:52:05 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-872f33cf-c405-45b0-8afe-6953ce4bfd66 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 63b95121-b211-42c3-831e-0392d4abd09a from the live domain config. {{(pid=103546) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 03:52:05 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-872f33cf-c405-45b0-8afe-6953ce4bfd66 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 03:52:05 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 03:52:05 user nova-compute[103546]:   <source dev="/dev/sde"/>
Nov 16 03:52:05 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 03:52:05 user nova-compute[103546]:   <serial>bc7fa9af-8224-4503-8b59-e374f8b1b00c</serial>
Nov 16 03:52:05 user nova-compute[103546]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 03:52:05 user nova-compute[103546]: </disk>
Nov 16 03:52:05 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 03:52:06 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-872f33cf-c405-45b0-8afe-6953ce4bfd66 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 63b95121-b211-42c3-831e-0392d4abd09a {{(pid=103546) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 03:52:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:52:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:52:10 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:52:10 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:52:10 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:52:10 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Cleaning up deleted instances {{(pid=103546) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 03:52:10 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] There are 0 instances to clean {{(pid=103546) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 03:52:11 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:52:11 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:52:11 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager.update_available_resource {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:52:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:52:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:52:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:52:11 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Auditing locally available compute resources for user (node: user) {{(pid=103546) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 03:52:11 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63b95121-b211-42c3-831e-0392d4abd09a/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:12 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63b95121-b211-42c3-831e-0392d4abd09a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:52:12 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63b95121-b211-42c3-831e-0392d4abd09a/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:12 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63b95121-b211-42c3-831e-0392d4abd09a/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:52:12 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c929d5-2f1c-4be4-8864-6ec81625daac/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:12 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c929d5-2f1c-4be4-8864-6ec81625daac/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:52:12 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c929d5-2f1c-4be4-8864-6ec81625daac/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:52:12 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05c929d5-2f1c-4be4-8864-6ec81625daac/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:52:12 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24b48ca5-a0df-4713-bd32-6b62a9ee8367/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:12 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24b48ca5-a0df-4713-bd32-6b62a9ee8367/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:52:12 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24b48ca5-a0df-4713-bd32-6b62a9ee8367/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24b48ca5-a0df-4713-bd32-6b62a9ee8367/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:52:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e2954-d786-4544-903d-8edc63646e2d/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e2954-d786-4544-903d-8edc63646e2d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:52:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e2954-d786-4544-903d-8edc63646e2d/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:52:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e2954-d786-4544-903d-8edc63646e2d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:52:13 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 03:52:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51554aab-44ec-4161-b926-9c07a3f838a5/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51554aab-44ec-4161-b926-9c07a3f838a5/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:52:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51554aab-44ec-4161-b926-9c07a3f838a5/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51554aab-44ec-4161-b926-9c07a3f838a5/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:52:13 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 03:52:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:52:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:52:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7862d05d-4293-46a5-98aa-41967a572fe3/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7862d05d-4293-46a5-98aa-41967a572fe3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:52:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7862d05d-4293-46a5-98aa-41967a572fe3/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7862d05d-4293-46a5-98aa-41967a572fe3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:52:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:52:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:52:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9afa69-2674-46fc-8e30-e196928ff07c/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9afa69-2674-46fc-8e30-e196928ff07c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:52:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9afa69-2674-46fc-8e30-e196928ff07c/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a9afa69-2674-46fc-8e30-e196928ff07c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:52:15 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:52:15 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:52:15 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Hypervisor/Node resource view: name=user free_ram=7405MB free_disk=25.403499603271484GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=103546) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 03:52:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:52:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:52:16 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 279e2954-d786-4544-903d-8edc63646e2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:52:16 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 05c929d5-2f1c-4be4-8864-6ec81625daac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:52:16 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 63b95121-b211-42c3-831e-0392d4abd09a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:52:16 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 51554aab-44ec-4161-b926-9c07a3f838a5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:52:16 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 7862d05d-4293-46a5-98aa-41967a572fe3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:52:16 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 9a89970b-fc61-4419-8ff9-b48013dccf9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:52:16 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 24b48ca5-a0df-4713-bd32-6b62a9ee8367 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:52:16 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 04101512-7333-4581-add3-7af3821e335b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:52:16 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 6a9afa69-2674-46fc-8e30-e196928ff07c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:52:16 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 58e02332-2918-4744-a8f7-90e28391d391 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:52:16 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 03:52:16 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 03:52:16 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Refreshing inventories for resource provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 03:52:16 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Updating ProviderTree inventory for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 03:52:16 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Updating inventory in ProviderTree for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 03:52:16 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Refreshing aggregate associations for resource provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a, aggregates: None {{(pid=103546) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 03:52:16 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Refreshing trait associations for resource provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=103546) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 03:52:16 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:52:16 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:52:16 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Compute_service record updated for user:user {{(pid=103546) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 03:52:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.780s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:52:16 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:52:16 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:52:16 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:52:16 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Starting heal instance info cache {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 03:52:16 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Rebuilding the list of instances to heal {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 03:52:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "refresh_cache-279e2954-d786-4544-903d-8edc63646e2d" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:52:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquired lock "refresh_cache-279e2954-d786-4544-903d-8edc63646e2d" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:52:16 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 279e2954-d786-4544-903d-8edc63646e2d] Forcefully refreshing network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 03:52:16 user nova-compute[103546]: DEBUG nova.objects.instance [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lazy-loading 'info_cache' on Instance uuid 279e2954-d786-4544-903d-8edc63646e2d {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:52:17 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 279e2954-d786-4544-903d-8edc63646e2d] Updating instance_info_cache with network_info: [{"id": "e60cc693-67d4-45a3-a97e-40bb5f753c9d", "address": "fa:16:3e:44:ef:27", "network": {"id": "56e4e469-bfda-4ab1-9fdd-e3aa1a0655fc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-669383710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f227c815224d55afdb3eba43e68757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape60cc693-67", "ovs_interfaceid": "e60cc693-67d4-45a3-a97e-40bb5f753c9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:52:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Releasing lock "refresh_cache-279e2954-d786-4544-903d-8edc63646e2d" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:52:17 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 279e2954-d786-4544-903d-8edc63646e2d] Updated the network info_cache for instance {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 03:52:17 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:52:17 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:52:17 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:52:17 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=103546) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 03:52:17 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:52:17 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Cleaning up deleted instances with incomplete migration  {{(pid=103546) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 03:52:17 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:52:17 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:52:18 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:52:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4a573744-05b2-42fe-b20d-1ee2285b96c1 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Acquiring lock "05c929d5-2f1c-4be4-8864-6ec81625daac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:52:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4a573744-05b2-42fe-b20d-1ee2285b96c1 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Lock "05c929d5-2f1c-4be4-8864-6ec81625daac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:52:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4a573744-05b2-42fe-b20d-1ee2285b96c1 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Acquiring lock "05c929d5-2f1c-4be4-8864-6ec81625daac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:52:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4a573744-05b2-42fe-b20d-1ee2285b96c1 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Lock "05c929d5-2f1c-4be4-8864-6ec81625daac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:52:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4a573744-05b2-42fe-b20d-1ee2285b96c1 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Lock "05c929d5-2f1c-4be4-8864-6ec81625daac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:52:19 user nova-compute[103546]: INFO nova.compute.manager [None req-4a573744-05b2-42fe-b20d-1ee2285b96c1 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Terminating instance
Nov 16 03:52:19 user nova-compute[103546]: DEBUG nova.compute.manager [None req-4a573744-05b2-42fe-b20d-1ee2285b96c1 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Start destroying the instance on the hypervisor. {{(pid=103546) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 03:52:19 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:52:19 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:52:19 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:52:19 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:52:19 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG nova.compute.manager [req-9242660b-20f6-4d0e-95cd-81304cdd64d6 req-a8b1eeb9-ffec-43e6-b79e-e866d14d320a service nova] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Received event network-vif-unplugged-6283c5fe-57f3-4552-b0cd-5d05b38e983c {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-9242660b-20f6-4d0e-95cd-81304cdd64d6 req-a8b1eeb9-ffec-43e6-b79e-e866d14d320a service nova] Acquiring lock "05c929d5-2f1c-4be4-8864-6ec81625daac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-9242660b-20f6-4d0e-95cd-81304cdd64d6 req-a8b1eeb9-ffec-43e6-b79e-e866d14d320a service nova] Lock "05c929d5-2f1c-4be4-8864-6ec81625daac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-9242660b-20f6-4d0e-95cd-81304cdd64d6 req-a8b1eeb9-ffec-43e6-b79e-e866d14d320a service nova] Lock "05c929d5-2f1c-4be4-8864-6ec81625daac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG nova.compute.manager [req-9242660b-20f6-4d0e-95cd-81304cdd64d6 req-a8b1eeb9-ffec-43e6-b79e-e866d14d320a service nova] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] No waiting events found dispatching network-vif-unplugged-6283c5fe-57f3-4552-b0cd-5d05b38e983c {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG nova.compute.manager [req-9242660b-20f6-4d0e-95cd-81304cdd64d6 req-a8b1eeb9-ffec-43e6-b79e-e866d14d320a service nova] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Received event network-vif-unplugged-6283c5fe-57f3-4552-b0cd-5d05b38e983c for instance with task_state deleting. {{(pid=103546) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 03:52:20 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-cfb3011c-1670-4b71-9e17-bffa476d1a00 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 7862d05d-4293-46a5-98aa-41967a572fe3 is timed out.
Nov 16 03:52:20 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-cfb3011c-1670-4b71-9e17-bffa476d1a00 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Successfully detached device vdc from instance 7862d05d-4293-46a5-98aa-41967a572fe3 from the live domain config.
Nov 16 03:52:20 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfb3011c-1670-4b71-9e17-bffa476d1a00 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb3011c-1670-4b71-9e17-bffa476d1a00 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FlujTcmh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:52:20 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-cfb3011c-1670-4b71-9e17-bffa476d1a00 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:52:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-cfb3011c-1670-4b71-9e17-bffa476d1a00 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-cfb3011c-1670-4b71-9e17-bffa476d1a00 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:20 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Instance destroyed successfully.
Nov 16 03:52:20 user nova-compute[103546]: DEBUG nova.objects.instance [None req-4a573744-05b2-42fe-b20d-1ee2285b96c1 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Lazy-loading 'resources' on Instance uuid 05c929d5-2f1c-4be4-8864-6ec81625daac {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-4a573744-05b2-42fe-b20d-1ee2285b96c1 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:46:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2129922595',display_name='tempest-VolumesAdminNegativeTest-server-2129922595',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2129922595',id=5,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKa1C6Rh+qC1XTCUr7+ou2R1qUyOGn3m4XXoKYtqTkZNx9GmXFYEKcYTXC/eCB8+w3YwE/BUPbVFe5cpEj8Pdo1Lu/GLQwm6IAtg1poS77gPYWGy46p56gENzl98OJYlNA==',key_name='tempest-keypair-1917364052',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:46:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='998b2147e8194af3a15fce90bc7063b0',ramdisk_id='',reservation_id='r-qgsev7rm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1034179231',owner_user_name='tempest-VolumesAdminNegativeTest-1034179231-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T03:46:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bf9f55ab03b4df38e0b35ed4c8967e8',uuid=05c929d5-2f1c-4be4-8864-6ec81625daac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6283c5fe-57f3-4552-b0cd-5d05b38e983c", "address": "fa:16:3e:4d:ec:83", "network": {"id": "1a48a5d8-8046-4baf-9b30-4505213d862a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1526890096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998b2147e8194af3a15fce90bc7063b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6283c5fe-57", "ovs_interfaceid": "6283c5fe-57f3-4552-b0cd-5d05b38e983c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-4a573744-05b2-42fe-b20d-1ee2285b96c1 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Converting VIF {"id": "6283c5fe-57f3-4552-b0cd-5d05b38e983c", "address": "fa:16:3e:4d:ec:83", "network": {"id": "1a48a5d8-8046-4baf-9b30-4505213d862a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1526890096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998b2147e8194af3a15fce90bc7063b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6283c5fe-57", "ovs_interfaceid": "6283c5fe-57f3-4552-b0cd-5d05b38e983c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-4a573744-05b2-42fe-b20d-1ee2285b96c1 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:ec:83,bridge_name='br-int',has_traffic_filtering=True,id=6283c5fe-57f3-4552-b0cd-5d05b38e983c,network=Network(1a48a5d8-8046-4baf-9b30-4505213d862a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6283c5fe-57') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG os_vif [None req-4a573744-05b2-42fe-b20d-1ee2285b96c1 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:ec:83,bridge_name='br-int',has_traffic_filtering=True,id=6283c5fe-57f3-4552-b0cd-5d05b38e983c,network=Network(1a48a5d8-8046-4baf-9b30-4505213d862a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6283c5fe-57') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[9362362e-e6e0-486c-a6db-60fbc0c41442]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc7fa9af-8224-4503-8b59-e374f8b1b00c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb3011c-1670-4b71-9e17-bffa476d1a00 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 03:52:20 user nova-compute[103546]: No targets found.
Nov 16 03:52:20 user nova-compute[103546]: iSNS:
Nov 16 03:52:20 user nova-compute[103546]: No targets found.
Nov 16 03:52:20 user nova-compute[103546]: STATIC:
Nov 16 03:52:20 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f
Nov 16 03:52:20 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:52:20 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:52:20 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c
Nov 16 03:52:20 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:52:20 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:52:20 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:bc7fa9af-8224-4503-8b59-e374f8b1b00c
Nov 16 03:52:20 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:52:20 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:52:20 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9
Nov 16 03:52:20 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:52:20 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:52:20 user nova-compute[103546]: FIRMWARE:
Nov 16 03:52:20 user nova-compute[103546]: No targets found.
Nov 16 03:52:20 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb3011c-1670-4b71-9e17-bffa476d1a00 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 03:52:20 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 03:52:20 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb3011c-1670-4b71-9e17-bffa476d1a00 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6283c5fe-57, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d8b6c287-d1f4-40c0-b34e-99132efca319) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97ab746-4189-4b63-8425-29d762adc982]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc7fa9af-8224-4503-8b59-e374f8b1b00c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:52:20 user nova-compute[103546]: INFO os_vif [None req-4a573744-05b2-42fe-b20d-1ee2285b96c1 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:ec:83,bridge_name='br-int',has_traffic_filtering=True,id=6283c5fe-57f3-4552-b0cd-5d05b38e983c,network=Network(1a48a5d8-8046-4baf-9b30-4505213d862a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6283c5fe-57')
Nov 16 03:52:20 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-4a573744-05b2-42fe-b20d-1ee2285b96c1 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Deleting instance files /opt/stack/data/nova/instances/05c929d5-2f1c-4be4-8864-6ec81625daac_del
Nov 16 03:52:20 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-4a573744-05b2-42fe-b20d-1ee2285b96c1 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Deletion of /opt/stack/data/nova/instances/05c929d5-2f1c-4be4-8864-6ec81625daac_del complete
Nov 16 03:52:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a587f6a5-503a-4f48-a4e6-a252eb11e312]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc7fa9af-8224-4503-8b59-e374f8b1b00c (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb3011c-1670-4b71-9e17-bffa476d1a00 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9 (non-flash)
Nov 16 03:52:20 user nova-compute[103546]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)
Nov 16 03:52:20 user nova-compute[103546]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f (non-flash)
Nov 16 03:52:20 user nova-compute[103546]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc7fa9af-8224-4503-8b59-e374f8b1b00c (non-flash)
Nov 16 03:52:20 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb3011c-1670-4b71-9e17-bffa476d1a00 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9 (non-flash)
Nov 16 03:52:20 user nova-compute[103546]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)
Nov 16 03:52:20 user nova-compute[103546]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f (non-flash)
Nov 16 03:52:20 user nova-compute[103546]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc7fa9af-8224-4503-8b59-e374f8b1b00c (non-flash)
Nov 16 03:52:20 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb3011c-1670-4b71-9e17-bffa476d1a00 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60cc59d3f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9'): ({'sdc'}, set())}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-cfb3011c-1670-4b71-9e17-bffa476d1a00 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Removing single pathed devices sdc {{(pid=103546) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f4650d-f8da-4483-953c-e4c5db35ff4b]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:20 user nova-compute[103546]: INFO nova.compute.manager [None req-4a573744-05b2-42fe-b20d-1ee2285b96c1 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 16 03:52:20 user nova-compute[103546]: DEBUG oslo.service.loopingcall [None req-4a573744-05b2-42fe-b20d-1ee2285b96c1 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=103546) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG nova.compute.manager [-] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Deallocating network for instance {{(pid=103546) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] deallocate_for_instance() {{(pid=103546) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c04d72-d4e6-48fb-9900-3801ee53e06a]: (4, ('ok\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-cfb3011c-1670-4b71-9e17-bffa476d1a00 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Flushing IO for device /dev/sdc {{(pid=103546) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[962ab1a5-e43e-46b7-8e17-f07f62cedf2d]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-cfb3011c-1670-4b71-9e17-bffa476d1a00 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=103546) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[01585b4b-3c3f-4fb2-92a7-6ce2f4bc1a64]: (4, ('1', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-cfb3011c-1670-4b71-9e17-bffa476d1a00 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-cfb3011c-1670-4b71-9e17-bffa476d1a00 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] SCSI volumes sdc have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb3011c-1670-4b71-9e17-bffa476d1a00 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9')] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[04651c18-fcda-4356-9a55-baa6f82cd519]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb3011c-1670-4b71-9e17-bffa476d1a00 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9 -p 172.16.0.220:3260 --logout {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73c5e7a-f466-40ca-995d-f0420058a148]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb3011c-1670-4b71-9e17-bffa476d1a00 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9, portal: 172.16.0.220,3260]
Nov 16 03:52:20 user nova-compute[103546]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9, portal: 172.16.0.220,3260] successful.
Nov 16 03:52:20 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9 -p 172.16.0.220:3260 --op delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17c96a71-8e3c-44ff-aaf7-ccadc227b7e9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72c44c6-fd1b-4ec5-9c49-f83ff46fe787]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb3011c-1670-4b71-9e17-bffa476d1a00 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-cfb3011c-1670-4b71-9e17-bffa476d1a00 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb3011c-1670-4b71-9e17-bffa476d1a00 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] <== disconnect_volume: return (323ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:52:20 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfb3011c-1670-4b71-9e17-bffa476d1a00 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 03:52:21 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:52:21 user nova-compute[103546]: INFO nova.compute.manager [-] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Took 0.69 seconds to deallocate network for instance.
Nov 16 03:52:21 user nova-compute[103546]: DEBUG nova.compute.manager [req-8c6fafe0-b549-46ea-8b15-2c99e43f1e2d req-42f5a8d5-4920-4e07-86c8-382242da095b service nova] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Received event network-vif-deleted-6283c5fe-57f3-4552-b0cd-5d05b38e983c {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:52:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4a573744-05b2-42fe-b20d-1ee2285b96c1 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:52:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4a573744-05b2-42fe-b20d-1ee2285b96c1 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:52:21 user nova-compute[103546]: DEBUG nova.objects.instance [None req-cfb3011c-1670-4b71-9e17-bffa476d1a00 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lazy-loading 'flavor' on Instance uuid 7862d05d-4293-46a5-98aa-41967a572fe3 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:52:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cfb3011c-1670-4b71-9e17-bffa476d1a00 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "7862d05d-4293-46a5-98aa-41967a572fe3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.744s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:52:21 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-4a573744-05b2-42fe-b20d-1ee2285b96c1 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:52:21 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-4a573744-05b2-42fe-b20d-1ee2285b96c1 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:52:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4a573744-05b2-42fe-b20d-1ee2285b96c1 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.315s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:52:21 user nova-compute[103546]: INFO nova.scheduler.client.report [None req-4a573744-05b2-42fe-b20d-1ee2285b96c1 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Deleted allocations for instance 05c929d5-2f1c-4be4-8864-6ec81625daac
Nov 16 03:52:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4a573744-05b2-42fe-b20d-1ee2285b96c1 tempest-VolumesAdminNegativeTest-1034179231 tempest-VolumesAdminNegativeTest-1034179231-project-member] Lock "05c929d5-2f1c-4be4-8864-6ec81625daac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.091s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:52:22 user nova-compute[103546]: DEBUG nova.compute.manager [req-0c0c077d-662a-40d4-a6cd-70937f28805c req-5d0671a6-9118-47f1-ba54-9a937a691a09 service nova] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Received event network-vif-plugged-6283c5fe-57f3-4552-b0cd-5d05b38e983c {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:52:22 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-0c0c077d-662a-40d4-a6cd-70937f28805c req-5d0671a6-9118-47f1-ba54-9a937a691a09 service nova] Acquiring lock "05c929d5-2f1c-4be4-8864-6ec81625daac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:52:22 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-0c0c077d-662a-40d4-a6cd-70937f28805c req-5d0671a6-9118-47f1-ba54-9a937a691a09 service nova] Lock "05c929d5-2f1c-4be4-8864-6ec81625daac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:52:22 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-0c0c077d-662a-40d4-a6cd-70937f28805c req-5d0671a6-9118-47f1-ba54-9a937a691a09 service nova] Lock "05c929d5-2f1c-4be4-8864-6ec81625daac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:52:22 user nova-compute[103546]: DEBUG nova.compute.manager [req-0c0c077d-662a-40d4-a6cd-70937f28805c req-5d0671a6-9118-47f1-ba54-9a937a691a09 service nova] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] No waiting events found dispatching network-vif-plugged-6283c5fe-57f3-4552-b0cd-5d05b38e983c {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:52:22 user nova-compute[103546]: WARNING nova.compute.manager [req-0c0c077d-662a-40d4-a6cd-70937f28805c req-5d0671a6-9118-47f1-ba54-9a937a691a09 service nova] [instance: 05c929d5-2f1c-4be4-8864-6ec81625daac] Received unexpected event network-vif-plugged-6283c5fe-57f3-4552-b0cd-5d05b38e983c for instance with vm_state deleted and task_state None.
Nov 16 03:52:23 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:52:23 user nova-compute[103546]: DEBUG nova.compute.manager [req-d1a4b950-4e10-437e-9bb7-8af55c67d1ec req-905d0459-36a0-4b77-a0bc-cfc0f7cc38c2 service nova] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Received event network-changed-5f4e3564-4185-44d2-93f6-2e3803aaf0f8 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:52:23 user nova-compute[103546]: DEBUG nova.compute.manager [req-d1a4b950-4e10-437e-9bb7-8af55c67d1ec req-905d0459-36a0-4b77-a0bc-cfc0f7cc38c2 service nova] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Refreshing instance network info cache due to event network-changed-5f4e3564-4185-44d2-93f6-2e3803aaf0f8. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:52:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d1a4b950-4e10-437e-9bb7-8af55c67d1ec req-905d0459-36a0-4b77-a0bc-cfc0f7cc38c2 service nova] Acquiring lock "refresh_cache-9a89970b-fc61-4419-8ff9-b48013dccf9f" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:52:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d1a4b950-4e10-437e-9bb7-8af55c67d1ec req-905d0459-36a0-4b77-a0bc-cfc0f7cc38c2 service nova] Acquired lock "refresh_cache-9a89970b-fc61-4419-8ff9-b48013dccf9f" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:52:23 user nova-compute[103546]: DEBUG nova.network.neutron [req-d1a4b950-4e10-437e-9bb7-8af55c67d1ec req-905d0459-36a0-4b77-a0bc-cfc0f7cc38c2 service nova] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Refreshing network info cache for port 5f4e3564-4185-44d2-93f6-2e3803aaf0f8 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:52:24 user nova-compute[103546]: DEBUG nova.network.neutron [req-d1a4b950-4e10-437e-9bb7-8af55c67d1ec req-905d0459-36a0-4b77-a0bc-cfc0f7cc38c2 service nova] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Updated VIF entry in instance network info cache for port 5f4e3564-4185-44d2-93f6-2e3803aaf0f8. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 03:52:24 user nova-compute[103546]: DEBUG nova.network.neutron [req-d1a4b950-4e10-437e-9bb7-8af55c67d1ec req-905d0459-36a0-4b77-a0bc-cfc0f7cc38c2 service nova] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Updating instance_info_cache with network_info: [{"id": "5f4e3564-4185-44d2-93f6-2e3803aaf0f8", "address": "fa:16:3e:56:e2:fb", "network": {"id": "29e9620f-313d-4679-89d7-459e7cf75b38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1690634205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72b30a015db444798ee72ff6fd14c69e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f4e3564-41", "ovs_interfaceid": "5f4e3564-4185-44d2-93f6-2e3803aaf0f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:52:24 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d1a4b950-4e10-437e-9bb7-8af55c67d1ec req-905d0459-36a0-4b77-a0bc-cfc0f7cc38c2 service nova] Releasing lock "refresh_cache-9a89970b-fc61-4419-8ff9-b48013dccf9f" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:52:25 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:52:26 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-872f33cf-c405-45b0-8afe-6953ce4bfd66 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 63b95121-b211-42c3-831e-0392d4abd09a is timed out.
Nov 16 03:52:26 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-872f33cf-c405-45b0-8afe-6953ce4bfd66 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Successfully detached device vdb from instance 63b95121-b211-42c3-831e-0392d4abd09a from the live domain config.
Nov 16 03:52:26 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-872f33cf-c405-45b0-8afe-6953ce4bfd66 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 03:52:26 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-872f33cf-c405-45b0-8afe-6953ce4bfd66 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:bc7fa9af-8224-4503-8b59-e374f8b1b00c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xYXiVcPw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:52:26 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-872f33cf-c405-45b0-8afe-6953ce4bfd66 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:52:26 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-872f33cf-c405-45b0-8afe-6953ce4bfd66 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:52:26 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-872f33cf-c405-45b0-8afe-6953ce4bfd66 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:52:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:52:26 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb3eb80-d848-4afa-99d4-2e8aabd00a79]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc7fa9af-8224-4503-8b59-e374f8b1b00c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:52:26 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-872f33cf-c405-45b0-8afe-6953ce4bfd66 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 03:52:26 user nova-compute[103546]: No targets found.
Nov 16 03:52:26 user nova-compute[103546]: iSNS:
Nov 16 03:52:26 user nova-compute[103546]: No targets found.
Nov 16 03:52:26 user nova-compute[103546]: STATIC:
Nov 16 03:52:26 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f
Nov 16 03:52:26 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:52:26 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:52:26 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c
Nov 16 03:52:26 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:52:26 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:52:26 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:bc7fa9af-8224-4503-8b59-e374f8b1b00c
Nov 16 03:52:26 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:52:26 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:52:26 user nova-compute[103546]: FIRMWARE:
Nov 16 03:52:26 user nova-compute[103546]: No targets found.
Nov 16 03:52:26 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:52:26 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-872f33cf-c405-45b0-8afe-6953ce4bfd66 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 03:52:26 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 03:52:26 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 03:52:26 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-872f33cf-c405-45b0-8afe-6953ce4bfd66 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc7fa9af-8224-4503-8b59-e374f8b1b00c', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 03:52:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:52:26 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[202ea255-023b-4e6d-8fb1-1a0ff00c3a80]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc7fa9af-8224-4503-8b59-e374f8b1b00c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:52:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:52:26 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[175dc9e9-ddbb-41f2-91c6-4c9a5d32dcb5]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc7fa9af-8224-4503-8b59-e374f8b1b00c (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:52:26 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-872f33cf-c405-45b0-8afe-6953ce4bfd66 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)
Nov 16 03:52:26 user nova-compute[103546]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f (non-flash)
Nov 16 03:52:26 user nova-compute[103546]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc7fa9af-8224-4503-8b59-e374f8b1b00c (non-flash)
Nov 16 03:52:26 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:52:26 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-872f33cf-c405-45b0-8afe-6953ce4bfd66 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)
Nov 16 03:52:26 user nova-compute[103546]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f (non-flash)
Nov 16 03:52:26 user nova-compute[103546]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc7fa9af-8224-4503-8b59-e374f8b1b00c (non-flash)
Nov 16 03:52:26 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:52:26 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-872f33cf-c405-45b0-8afe-6953ce4bfd66 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60ac5bd750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc7fa9af-8224-4503-8b59-e374f8b1b00c'): ({'sde'}, set())}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 03:52:26 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-872f33cf-c405-45b0-8afe-6953ce4bfd66 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Removing single pathed devices sde {{(pid=103546) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 03:52:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:52:26 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef3c490-6f1b-4ffc-9661-2d3715a05ac5]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:52:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:52:26 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[548080f8-5652-406c-bca3-76688f1d7e95]: (4, ('ok\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:52:26 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-872f33cf-c405-45b0-8afe-6953ce4bfd66 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Flushing IO for device /dev/sde {{(pid=103546) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 03:52:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:52:26 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[2faa6f5b-fdb1-465b-b2bb-7793d5bbfe1c]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:52:26 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-872f33cf-c405-45b0-8afe-6953ce4bfd66 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=103546) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 03:52:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:52:26 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aab4a1c-c624-4c66-a6a1-5fc9a56f0f52]: (4, ('1', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:52:26 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-872f33cf-c405-45b0-8afe-6953ce4bfd66 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 03:52:26 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-872f33cf-c405-45b0-8afe-6953ce4bfd66 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] SCSI volumes sde have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 03:52:26 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-872f33cf-c405-45b0-8afe-6953ce4bfd66 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc7fa9af-8224-4503-8b59-e374f8b1b00c')] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 03:52:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc7fa9af-8224-4503-8b59-e374f8b1b00c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc7fa9af-8224-4503-8b59-e374f8b1b00c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:52:26 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39204ec-7041-4848-9351-776b6baffb04]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:52:26 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-872f33cf-c405-45b0-8afe-6953ce4bfd66 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:52:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc7fa9af-8224-4503-8b59-e374f8b1b00c -p 172.16.0.220:3260 --logout {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc7fa9af-8224-4503-8b59-e374f8b1b00c -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:52:26 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac84b1ed-4fb3-44c8-b40c-3ba2fbb9fea7]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:bc7fa9af-8224-4503-8b59-e374f8b1b00c, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:bc7fa9af-8224-4503-8b59-e374f8b1b00c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:52:26 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-872f33cf-c405-45b0-8afe-6953ce4bfd66 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:bc7fa9af-8224-4503-8b59-e374f8b1b00c, portal: 172.16.0.220,3260]
Nov 16 03:52:26 user nova-compute[103546]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:bc7fa9af-8224-4503-8b59-e374f8b1b00c, portal: 172.16.0.220,3260] successful.
Nov 16 03:52:26 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:52:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc7fa9af-8224-4503-8b59-e374f8b1b00c -p 172.16.0.220:3260 --op delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc7fa9af-8224-4503-8b59-e374f8b1b00c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:52:26 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2b39ba-2e4f-49da-9bae-3eb1fee166a6]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:52:26 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-872f33cf-c405-45b0-8afe-6953ce4bfd66 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:52:26 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-872f33cf-c405-45b0-8afe-6953ce4bfd66 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:52:26 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-872f33cf-c405-45b0-8afe-6953ce4bfd66 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] <== disconnect_volume: return (314ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:52:26 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-872f33cf-c405-45b0-8afe-6953ce4bfd66 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 03:52:27 user nova-compute[103546]: DEBUG nova.objects.instance [None req-872f33cf-c405-45b0-8afe-6953ce4bfd66 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lazy-loading 'flavor' on Instance uuid 63b95121-b211-42c3-831e-0392d4abd09a {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:52:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-872f33cf-c405-45b0-8afe-6953ce4bfd66 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "63b95121-b211-42c3-831e-0392d4abd09a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.700s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:52:28 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:52:30 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:52:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:52:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:52:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:52:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:52:40 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:52:43 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f77503df-8cf1-466b-8056-72d06ea99267 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Acquiring lock "24b48ca5-a0df-4713-bd32-6b62a9ee8367" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:52:43 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f77503df-8cf1-466b-8056-72d06ea99267 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Lock "24b48ca5-a0df-4713-bd32-6b62a9ee8367" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:52:43 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f77503df-8cf1-466b-8056-72d06ea99267 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Acquiring lock "24b48ca5-a0df-4713-bd32-6b62a9ee8367-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:52:43 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f77503df-8cf1-466b-8056-72d06ea99267 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Lock "24b48ca5-a0df-4713-bd32-6b62a9ee8367-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:52:43 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f77503df-8cf1-466b-8056-72d06ea99267 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Lock "24b48ca5-a0df-4713-bd32-6b62a9ee8367-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:52:43 user nova-compute[103546]: INFO nova.compute.manager [None req-f77503df-8cf1-466b-8056-72d06ea99267 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] Terminating instance
Nov 16 03:52:43 user nova-compute[103546]: DEBUG nova.compute.manager [None req-f77503df-8cf1-466b-8056-72d06ea99267 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] Start destroying the instance on the hypervisor. {{(pid=103546) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 03:52:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:52:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:52:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:52:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:52:43 user nova-compute[103546]: DEBUG nova.compute.manager [req-a3181d36-562f-4431-9581-6451ee4af016 req-f35d1498-7235-4ae5-bdb2-8acdc9bb9d12 service nova] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] Received event network-vif-unplugged-606892d8-a634-4999-8682-4966006bfb09 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:52:43 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a3181d36-562f-4431-9581-6451ee4af016 req-f35d1498-7235-4ae5-bdb2-8acdc9bb9d12 service nova] Acquiring lock "24b48ca5-a0df-4713-bd32-6b62a9ee8367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:52:43 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a3181d36-562f-4431-9581-6451ee4af016 req-f35d1498-7235-4ae5-bdb2-8acdc9bb9d12 service nova] Lock "24b48ca5-a0df-4713-bd32-6b62a9ee8367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:52:43 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a3181d36-562f-4431-9581-6451ee4af016 req-f35d1498-7235-4ae5-bdb2-8acdc9bb9d12 service nova] Lock "24b48ca5-a0df-4713-bd32-6b62a9ee8367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:52:43 user nova-compute[103546]: DEBUG nova.compute.manager [req-a3181d36-562f-4431-9581-6451ee4af016 req-f35d1498-7235-4ae5-bdb2-8acdc9bb9d12 service nova] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] No waiting events found dispatching network-vif-unplugged-606892d8-a634-4999-8682-4966006bfb09 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:52:43 user nova-compute[103546]: DEBUG nova.compute.manager [req-a3181d36-562f-4431-9581-6451ee4af016 req-f35d1498-7235-4ae5-bdb2-8acdc9bb9d12 service nova] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] Received event network-vif-unplugged-606892d8-a634-4999-8682-4966006bfb09 for instance with task_state deleting. {{(pid=103546) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 03:52:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:52:43 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] Instance destroyed successfully.
Nov 16 03:52:43 user nova-compute[103546]: DEBUG nova.objects.instance [None req-f77503df-8cf1-466b-8056-72d06ea99267 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Lazy-loading 'resources' on Instance uuid 24b48ca5-a0df-4713-bd32-6b62a9ee8367 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:52:43 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-f77503df-8cf1-466b-8056-72d06ea99267 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:50:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-753705400',display_name='tempest-VolumesActionsTest-instance-753705400',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-753705400',id=15,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:51:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8db9ce0a02204d269a3beac9459f5c8a',ramdisk_id='',reservation_id='r-6rm7fv5c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1514502681',owner_user_name='tempest-VolumesActionsTest-1514502681-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T03:51:00Z,user_data=None,user_id='29f86d0d50ff44e79cf3c37416a5b632',uuid=24b48ca5-a0df-4713-bd32-6b62a9ee8367,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "606892d8-a634-4999-8682-4966006bfb09", "address": "fa:16:3e:12:e0:cd", "network": {"id": "f27a9ae1-0635-4b3b-858d-fa6524d15c2d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-73312216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8db9ce0a02204d269a3beac9459f5c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap606892d8-a6", "ovs_interfaceid": "606892d8-a634-4999-8682-4966006bfb09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 03:52:43 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-f77503df-8cf1-466b-8056-72d06ea99267 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Converting VIF {"id": "606892d8-a634-4999-8682-4966006bfb09", "address": "fa:16:3e:12:e0:cd", "network": {"id": "f27a9ae1-0635-4b3b-858d-fa6524d15c2d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-73312216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8db9ce0a02204d269a3beac9459f5c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap606892d8-a6", "ovs_interfaceid": "606892d8-a634-4999-8682-4966006bfb09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:52:43 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-f77503df-8cf1-466b-8056-72d06ea99267 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:e0:cd,bridge_name='br-int',has_traffic_filtering=True,id=606892d8-a634-4999-8682-4966006bfb09,network=Network(f27a9ae1-0635-4b3b-858d-fa6524d15c2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap606892d8-a6') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:52:43 user nova-compute[103546]: DEBUG os_vif [None req-f77503df-8cf1-466b-8056-72d06ea99267 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:e0:cd,bridge_name='br-int',has_traffic_filtering=True,id=606892d8-a634-4999-8682-4966006bfb09,network=Network(f27a9ae1-0635-4b3b-858d-fa6524d15c2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap606892d8-a6') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 03:52:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:52:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap606892d8-a6, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:52:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:52:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:52:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:52:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2c1e1f8a-9100-46e3-a9e7-8ad6fe6932d8) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:52:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:52:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:52:43 user nova-compute[103546]: INFO os_vif [None req-f77503df-8cf1-466b-8056-72d06ea99267 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:e0:cd,bridge_name='br-int',has_traffic_filtering=True,id=606892d8-a634-4999-8682-4966006bfb09,network=Network(f27a9ae1-0635-4b3b-858d-fa6524d15c2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap606892d8-a6')
Nov 16 03:52:43 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-f77503df-8cf1-466b-8056-72d06ea99267 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] Deleting instance files /opt/stack/data/nova/instances/24b48ca5-a0df-4713-bd32-6b62a9ee8367_del
Nov 16 03:52:43 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-f77503df-8cf1-466b-8056-72d06ea99267 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] Deletion of /opt/stack/data/nova/instances/24b48ca5-a0df-4713-bd32-6b62a9ee8367_del complete
Nov 16 03:52:43 user nova-compute[103546]: INFO nova.compute.manager [None req-f77503df-8cf1-466b-8056-72d06ea99267 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] Took 0.78 seconds to destroy the instance on the hypervisor.
Nov 16 03:52:43 user nova-compute[103546]: DEBUG oslo.service.loopingcall [None req-f77503df-8cf1-466b-8056-72d06ea99267 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=103546) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 03:52:43 user nova-compute[103546]: DEBUG nova.compute.manager [-] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] Deallocating network for instance {{(pid=103546) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 03:52:43 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] deallocate_for_instance() {{(pid=103546) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 03:52:44 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:52:44 user nova-compute[103546]: INFO nova.compute.manager [-] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] Took 0.41 seconds to deallocate network for instance.
Nov 16 03:52:44 user nova-compute[103546]: DEBUG nova.compute.manager [req-8a7a3d12-9a9f-4b84-89de-416e41298d1e req-6d0ad4e4-df4f-4049-a042-f32487a93ba4 service nova] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] Received event network-vif-deleted-606892d8-a634-4999-8682-4966006bfb09 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:52:44 user nova-compute[103546]: INFO nova.compute.manager [req-8a7a3d12-9a9f-4b84-89de-416e41298d1e req-6d0ad4e4-df4f-4049-a042-f32487a93ba4 service nova] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] Neutron deleted interface 606892d8-a634-4999-8682-4966006bfb09; detaching it from the instance and deleting it from the info cache
Nov 16 03:52:44 user nova-compute[103546]: DEBUG nova.network.neutron [req-8a7a3d12-9a9f-4b84-89de-416e41298d1e req-6d0ad4e4-df4f-4049-a042-f32487a93ba4 service nova] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:52:44 user nova-compute[103546]: DEBUG nova.compute.manager [req-8a7a3d12-9a9f-4b84-89de-416e41298d1e req-6d0ad4e4-df4f-4049-a042-f32487a93ba4 service nova] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] Detach interface failed, port_id=606892d8-a634-4999-8682-4966006bfb09, reason: Instance 24b48ca5-a0df-4713-bd32-6b62a9ee8367 could not be found. {{(pid=103546) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 03:52:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f77503df-8cf1-466b-8056-72d06ea99267 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:52:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f77503df-8cf1-466b-8056-72d06ea99267 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:52:44 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-f77503df-8cf1-466b-8056-72d06ea99267 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:52:44 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-f77503df-8cf1-466b-8056-72d06ea99267 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:52:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f77503df-8cf1-466b-8056-72d06ea99267 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.301s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:52:44 user nova-compute[103546]: INFO nova.scheduler.client.report [None req-f77503df-8cf1-466b-8056-72d06ea99267 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Deleted allocations for instance 24b48ca5-a0df-4713-bd32-6b62a9ee8367
Nov 16 03:52:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f77503df-8cf1-466b-8056-72d06ea99267 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Lock "24b48ca5-a0df-4713-bd32-6b62a9ee8367" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.682s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:52:45 user nova-compute[103546]: DEBUG nova.compute.manager [req-4a0078f1-c43e-49cc-98fa-3ac785fb0e0d req-d17872d0-277f-4d3a-b856-ef87e1d90b51 service nova] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] Received event network-vif-plugged-606892d8-a634-4999-8682-4966006bfb09 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:52:45 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-4a0078f1-c43e-49cc-98fa-3ac785fb0e0d req-d17872d0-277f-4d3a-b856-ef87e1d90b51 service nova] Acquiring lock "24b48ca5-a0df-4713-bd32-6b62a9ee8367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:52:45 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-4a0078f1-c43e-49cc-98fa-3ac785fb0e0d req-d17872d0-277f-4d3a-b856-ef87e1d90b51 service nova] Lock "24b48ca5-a0df-4713-bd32-6b62a9ee8367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:52:45 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-4a0078f1-c43e-49cc-98fa-3ac785fb0e0d req-d17872d0-277f-4d3a-b856-ef87e1d90b51 service nova] Lock "24b48ca5-a0df-4713-bd32-6b62a9ee8367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:52:45 user nova-compute[103546]: DEBUG nova.compute.manager [req-4a0078f1-c43e-49cc-98fa-3ac785fb0e0d req-d17872d0-277f-4d3a-b856-ef87e1d90b51 service nova] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] No waiting events found dispatching network-vif-plugged-606892d8-a634-4999-8682-4966006bfb09 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:52:45 user nova-compute[103546]: WARNING nova.compute.manager [req-4a0078f1-c43e-49cc-98fa-3ac785fb0e0d req-d17872d0-277f-4d3a-b856-ef87e1d90b51 service nova] [instance: 24b48ca5-a0df-4713-bd32-6b62a9ee8367] Received unexpected event network-vif-plugged-606892d8-a634-4999-8682-4966006bfb09 for instance with vm_state deleted and task_state None.
Nov 16 03:52:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:52:48 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:52:48 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:52:49 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Acquiring lock "164533fb-64e1-4aa5-b5fb-273817dd3e74" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:52:49 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Lock "164533fb-64e1-4aa5-b5fb-273817dd3e74" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:52:49 user nova-compute[103546]: DEBUG nova.compute.manager [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Starting instance... {{(pid=103546) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 03:52:49 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:52:49 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:52:49 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=103546) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 03:52:49 user nova-compute[103546]: INFO nova.compute.claims [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Claim successful on node user
Nov 16 03:52:49 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:52:49 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:52:49 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.347s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:52:49 user nova-compute[103546]: DEBUG nova.compute.manager [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Start building networks asynchronously for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 03:52:49 user nova-compute[103546]: DEBUG nova.compute.manager [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Allocating IP information in the background. {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 03:52:49 user nova-compute[103546]: DEBUG nova.network.neutron [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] allocate_for_instance() {{(pid=103546) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 03:52:49 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 03:52:49 user nova-compute[103546]: DEBUG nova.compute.manager [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Start building block device mappings for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 03:52:49 user nova-compute[103546]: DEBUG nova.policy [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '81690bcb7edf4f74b1f712a253a9e946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697f0f13eb5e4681bfb4dbe0ad0bc9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103546) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 03:52:49 user nova-compute[103546]: DEBUG nova.compute.manager [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Start spawning the instance on the hypervisor. {{(pid=103546) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 03:52:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Creating instance directory {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 03:52:49 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Creating image(s)
Nov 16 03:52:49 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Acquiring lock "/opt/stack/data/nova/instances/164533fb-64e1-4aa5-b5fb-273817dd3e74/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:52:49 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Lock "/opt/stack/data/nova/instances/164533fb-64e1-4aa5-b5fb-273817dd3e74/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:52:49 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Lock "/opt/stack/data/nova/instances/164533fb-64e1-4aa5-b5fb-273817dd3e74/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:52:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.169s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:52:49 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Acquiring lock "8c9efafb670bfe5842ba1f4ce398924612164af7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:52:49 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:52:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.189s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:52:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/164533fb-64e1-4aa5-b5fb-273817dd3e74/disk 1073741824 {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/164533fb-64e1-4aa5-b5fb-273817dd3e74/disk 1073741824" returned: 0 in 0.062s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:52:50 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:52:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:50 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e901c0de-f638-4410-8cd9-15c2f354f0bf tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Acquiring lock "7862d05d-4293-46a5-98aa-41967a572fe3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:52:50 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e901c0de-f638-4410-8cd9-15c2f354f0bf tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "7862d05d-4293-46a5-98aa-41967a572fe3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:52:50 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e901c0de-f638-4410-8cd9-15c2f354f0bf tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Acquiring lock "7862d05d-4293-46a5-98aa-41967a572fe3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:52:50 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e901c0de-f638-4410-8cd9-15c2f354f0bf tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "7862d05d-4293-46a5-98aa-41967a572fe3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:52:50 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e901c0de-f638-4410-8cd9-15c2f354f0bf tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "7862d05d-4293-46a5-98aa-41967a572fe3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:52:50 user nova-compute[103546]: INFO nova.compute.manager [None req-e901c0de-f638-4410-8cd9-15c2f354f0bf tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Terminating instance
Nov 16 03:52:50 user nova-compute[103546]: DEBUG nova.compute.manager [None req-e901c0de-f638-4410-8cd9-15c2f354f0bf tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Start destroying the instance on the hypervisor. {{(pid=103546) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 03:52:50 user nova-compute[103546]: DEBUG nova.network.neutron [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Successfully created port: ab9b5dca-ac92-42ef-a86f-20ea3ccaf7e0 {{(pid=103546) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 03:52:50 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:52:50 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:52:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.187s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:52:50 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Checking if we can resize image /opt/stack/data/nova/instances/164533fb-64e1-4aa5-b5fb-273817dd3e74/disk. size=1073741824 {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 03:52:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/164533fb-64e1-4aa5-b5fb-273817dd3e74/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:50 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:52:50 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:52:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/164533fb-64e1-4aa5-b5fb-273817dd3e74/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:52:50 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Cannot resize image /opt/stack/data/nova/instances/164533fb-64e1-4aa5-b5fb-273817dd3e74/disk to a smaller size. {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 03:52:50 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Created local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 03:52:50 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Ensure instance console log exists: /opt/stack/data/nova/instances/164533fb-64e1-4aa5-b5fb-273817dd3e74/console.log {{(pid=103546) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 03:52:50 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:52:50 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:52:50 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG nova.network.neutron [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Successfully updated port: ab9b5dca-ac92-42ef-a86f-20ea3ccaf7e0 {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Acquiring lock "refresh_cache-164533fb-64e1-4aa5-b5fb-273817dd3e74" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Acquired lock "refresh_cache-164533fb-64e1-4aa5-b5fb-273817dd3e74" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG nova.network.neutron [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG nova.compute.manager [req-1dc335f7-e590-4f68-8b30-1d3f4fe88b58 req-88d5ae0b-2d04-43d4-a408-94e87c18c092 service nova] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Received event network-changed-ab9b5dca-ac92-42ef-a86f-20ea3ccaf7e0 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG nova.compute.manager [req-1dc335f7-e590-4f68-8b30-1d3f4fe88b58 req-88d5ae0b-2d04-43d4-a408-94e87c18c092 service nova] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Refreshing instance network info cache due to event network-changed-ab9b5dca-ac92-42ef-a86f-20ea3ccaf7e0. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-1dc335f7-e590-4f68-8b30-1d3f4fe88b58 req-88d5ae0b-2d04-43d4-a408-94e87c18c092 service nova] Acquiring lock "refresh_cache-164533fb-64e1-4aa5-b5fb-273817dd3e74" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:52:51 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Instance destroyed successfully.
Nov 16 03:52:51 user nova-compute[103546]: DEBUG nova.objects.instance [None req-e901c0de-f638-4410-8cd9-15c2f354f0bf tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lazy-loading 'resources' on Instance uuid 7862d05d-4293-46a5-98aa-41967a572fe3 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-e901c0de-f638-4410-8cd9-15c2f354f0bf tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T03:46:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1027244547',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1027244547',id=3,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIFxV00qDStRyM0aDchwn6O7nlyPBZ3FOeBCFyiv8nQiisuU4RVmz5Isxf+3jZU4Uk5uvGKisEupEEQry1rV9qqNWz0A/tXtKp7pERmtHb5Hdrh+a6bO5Ag2wMW0itUDaA==',key_name='tempest-keypair-494888',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:50:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='63722fdf17e4408299de8c215c133812',ramdisk_id='',reservation_id='r-l9s12mms',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1382373405',owner_user_name='tempest-AttachVolumeShelveTestJSON-1382373405-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T03:50:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21d4e9052a614968bda331f028920ca7',uuid=7862d05d-4293-46a5-98aa-41967a572fe3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26fd759d-5cb8-4798-ab59-c7f5cb7773e8", "address": "fa:16:3e:a0:1a:6c", "network": {"id": "b2fca984-f1e9-4c86-a3a5-b8d5b9950555", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-172535633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63722fdf17e4408299de8c215c133812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26fd759d-5c", "ovs_interfaceid": "26fd759d-5cb8-4798-ab59-c7f5cb7773e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-e901c0de-f638-4410-8cd9-15c2f354f0bf tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Converting VIF {"id": "26fd759d-5cb8-4798-ab59-c7f5cb7773e8", "address": "fa:16:3e:a0:1a:6c", "network": {"id": "b2fca984-f1e9-4c86-a3a5-b8d5b9950555", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-172535633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63722fdf17e4408299de8c215c133812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26fd759d-5c", "ovs_interfaceid": "26fd759d-5cb8-4798-ab59-c7f5cb7773e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-e901c0de-f638-4410-8cd9-15c2f354f0bf tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:1a:6c,bridge_name='br-int',has_traffic_filtering=True,id=26fd759d-5cb8-4798-ab59-c7f5cb7773e8,network=Network(b2fca984-f1e9-4c86-a3a5-b8d5b9950555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26fd759d-5c') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG os_vif [None req-e901c0de-f638-4410-8cd9-15c2f354f0bf tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:1a:6c,bridge_name='br-int',has_traffic_filtering=True,id=26fd759d-5cb8-4798-ab59-c7f5cb7773e8,network=Network(b2fca984-f1e9-4c86-a3a5-b8d5b9950555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26fd759d-5c') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26fd759d-5c, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8903370e-a844-456d-b6ae-5f6d19f36310) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:52:51 user nova-compute[103546]: INFO os_vif [None req-e901c0de-f638-4410-8cd9-15c2f354f0bf tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:1a:6c,bridge_name='br-int',has_traffic_filtering=True,id=26fd759d-5cb8-4798-ab59-c7f5cb7773e8,network=Network(b2fca984-f1e9-4c86-a3a5-b8d5b9950555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26fd759d-5c')
Nov 16 03:52:51 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-e901c0de-f638-4410-8cd9-15c2f354f0bf tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Deleting instance files /opt/stack/data/nova/instances/7862d05d-4293-46a5-98aa-41967a572fe3_del
Nov 16 03:52:51 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-e901c0de-f638-4410-8cd9-15c2f354f0bf tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Deletion of /opt/stack/data/nova/instances/7862d05d-4293-46a5-98aa-41967a572fe3_del complete
Nov 16 03:52:51 user nova-compute[103546]: INFO nova.compute.manager [None req-e901c0de-f638-4410-8cd9-15c2f354f0bf tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 16 03:52:51 user nova-compute[103546]: DEBUG oslo.service.loopingcall [None req-e901c0de-f638-4410-8cd9-15c2f354f0bf tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=103546) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG nova.compute.manager [-] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Deallocating network for instance {{(pid=103546) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] deallocate_for_instance() {{(pid=103546) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG nova.network.neutron [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG nova.network.neutron [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Updating instance_info_cache with network_info: [{"id": "ab9b5dca-ac92-42ef-a86f-20ea3ccaf7e0", "address": "fa:16:3e:7b:45:4e", "network": {"id": "e6c6220f-786a-4445-981c-58cb30c01961", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1592167081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "697f0f13eb5e4681bfb4dbe0ad0bc9d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab9b5dca-ac", "ovs_interfaceid": "ab9b5dca-ac92-42ef-a86f-20ea3ccaf7e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Releasing lock "refresh_cache-164533fb-64e1-4aa5-b5fb-273817dd3e74" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG nova.compute.manager [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Instance network_info: |[{"id": "ab9b5dca-ac92-42ef-a86f-20ea3ccaf7e0", "address": "fa:16:3e:7b:45:4e", "network": {"id": "e6c6220f-786a-4445-981c-58cb30c01961", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1592167081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "697f0f13eb5e4681bfb4dbe0ad0bc9d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab9b5dca-ac", "ovs_interfaceid": "ab9b5dca-ac92-42ef-a86f-20ea3ccaf7e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-1dc335f7-e590-4f68-8b30-1d3f4fe88b58 req-88d5ae0b-2d04-43d4-a408-94e87c18c092 service nova] Acquired lock "refresh_cache-164533fb-64e1-4aa5-b5fb-273817dd3e74" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG nova.network.neutron [req-1dc335f7-e590-4f68-8b30-1d3f4fe88b58 req-88d5ae0b-2d04-43d4-a408-94e87c18c092 service nova] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Refreshing network info cache for port ab9b5dca-ac92-42ef-a86f-20ea3ccaf7e0 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Start _get_guest_xml network_info=[{"id": "ab9b5dca-ac92-42ef-a86f-20ea3ccaf7e0", "address": "fa:16:3e:7b:45:4e", "network": {"id": "e6c6220f-786a-4445-981c-58cb30c01961", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1592167081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "697f0f13eb5e4681bfb4dbe0ad0bc9d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab9b5dca-ac", "ovs_interfaceid": "ab9b5dca-ac92-42ef-a86f-20ea3ccaf7e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '5c6f539a-01e5-4478-bf8f-a14310b5d7dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 03:52:51 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:52:51 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:52:51 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:52:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-524672440',display_name='tempest-TestServerVolumeAttachmentScenario-server-524672440',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-524672440',id=19,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFPXN0cjcjdu+HbblGQnvXuYiDAPeKI1oS5pvWB3H0HK1ye8W1jRurC78OiXPXnsGZKKqbYr8DK2B+Jc9EsWwL6GIxf7ANF7GpxGIpV6ECbKFo8L1Fk9kJ9tnWBO7h8EzA==',key_name='tempest-keypair-1213057093',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='697f0f13eb5e4681bfb4dbe0ad0bc9d2',ramdisk_id='',reservation_id='r-hcnxxi7y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1463401272',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1463401272-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:52:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81690bcb7edf4f74b1f712a253a9e946',uuid=164533fb-64e1-4aa5-b5fb-273817dd3e74,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab9b5dca-ac92-42ef-a86f-20ea3ccaf7e0", "address": "fa:16:3e:7b:45:4e", "network": {"id": "e6c6220f-786a-4445-981c-58cb30c01961", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1592167081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "697f0f13eb5e4681bfb4dbe0ad0bc9d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab9b5dca-ac", "ovs_interfaceid": "ab9b5dca-ac92-42ef-a86f-20ea3ccaf7e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Converting VIF {"id": "ab9b5dca-ac92-42ef-a86f-20ea3ccaf7e0", "address": "fa:16:3e:7b:45:4e", "network": {"id": "e6c6220f-786a-4445-981c-58cb30c01961", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1592167081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "697f0f13eb5e4681bfb4dbe0ad0bc9d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab9b5dca-ac", "ovs_interfaceid": "ab9b5dca-ac92-42ef-a86f-20ea3ccaf7e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:45:4e,bridge_name='br-int',has_traffic_filtering=True,id=ab9b5dca-ac92-42ef-a86f-20ea3ccaf7e0,network=Network(e6c6220f-786a-4445-981c-58cb30c01961),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab9b5dca-ac') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG nova.objects.instance [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Lazy-loading 'pci_devices' on Instance uuid 164533fb-64e1-4aa5-b5fb-273817dd3e74 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] End _get_guest_xml xml=<domain type="kvm">
Nov 16 03:52:51 user nova-compute[103546]:   <uuid>164533fb-64e1-4aa5-b5fb-273817dd3e74</uuid>
Nov 16 03:52:51 user nova-compute[103546]:   <name>instance-00000013</name>
Nov 16 03:52:51 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 03:52:51 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 03:52:51 user nova-compute[103546]:   <metadata>
Nov 16 03:52:51 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 03:52:51 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 03:52:51 user nova-compute[103546]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-524672440</nova:name>
Nov 16 03:52:51 user nova-compute[103546]:       <nova:creationTime>2023-11-16 03:52:51</nova:creationTime>
Nov 16 03:52:51 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 03:52:51 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 03:52:51 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 03:52:51 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 03:52:51 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 03:52:51 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 03:52:51 user nova-compute[103546]:       </nova:flavor>
Nov 16 03:52:51 user nova-compute[103546]:       <nova:owner>
Nov 16 03:52:51 user nova-compute[103546]:         <nova:user uuid="81690bcb7edf4f74b1f712a253a9e946">tempest-TestServerVolumeAttachmentScenario-1463401272-project-member</nova:user>
Nov 16 03:52:51 user nova-compute[103546]:         <nova:project uuid="697f0f13eb5e4681bfb4dbe0ad0bc9d2">tempest-TestServerVolumeAttachmentScenario-1463401272</nova:project>
Nov 16 03:52:51 user nova-compute[103546]:       </nova:owner>
Nov 16 03:52:51 user nova-compute[103546]:       <nova:root type="image" uuid="5c6f539a-01e5-4478-bf8f-a14310b5d7dd"/>
Nov 16 03:52:51 user nova-compute[103546]:       <nova:ports>
Nov 16 03:52:51 user nova-compute[103546]:         <nova:port uuid="ab9b5dca-ac92-42ef-a86f-20ea3ccaf7e0">
Nov 16 03:52:51 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 16 03:52:51 user nova-compute[103546]:         </nova:port>
Nov 16 03:52:51 user nova-compute[103546]:       </nova:ports>
Nov 16 03:52:51 user nova-compute[103546]:     </nova:instance>
Nov 16 03:52:51 user nova-compute[103546]:   </metadata>
Nov 16 03:52:51 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 03:52:51 user nova-compute[103546]:     <system>
Nov 16 03:52:51 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 03:52:51 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 03:52:51 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 03:52:51 user nova-compute[103546]:       <entry name="serial">164533fb-64e1-4aa5-b5fb-273817dd3e74</entry>
Nov 16 03:52:51 user nova-compute[103546]:       <entry name="uuid">164533fb-64e1-4aa5-b5fb-273817dd3e74</entry>
Nov 16 03:52:51 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 03:52:51 user nova-compute[103546]:     </system>
Nov 16 03:52:51 user nova-compute[103546]:   </sysinfo>
Nov 16 03:52:51 user nova-compute[103546]:   <os>
Nov 16 03:52:51 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 03:52:51 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 03:52:51 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 03:52:51 user nova-compute[103546]:   </os>
Nov 16 03:52:51 user nova-compute[103546]:   <features>
Nov 16 03:52:51 user nova-compute[103546]:     <acpi/>
Nov 16 03:52:51 user nova-compute[103546]:     <apic/>
Nov 16 03:52:51 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 03:52:51 user nova-compute[103546]:   </features>
Nov 16 03:52:51 user nova-compute[103546]:   <clock offset="utc">
Nov 16 03:52:51 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 03:52:51 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 03:52:51 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 03:52:51 user nova-compute[103546]:   </clock>
Nov 16 03:52:51 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 03:52:51 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 03:52:51 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 03:52:51 user nova-compute[103546]:   </cpu>
Nov 16 03:52:51 user nova-compute[103546]:   <devices>
Nov 16 03:52:51 user nova-compute[103546]:     <disk type="file" device="disk">
Nov 16 03:52:51 user nova-compute[103546]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 03:52:51 user nova-compute[103546]:       <source file="/opt/stack/data/nova/instances/164533fb-64e1-4aa5-b5fb-273817dd3e74/disk"/>
Nov 16 03:52:51 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 03:52:51 user nova-compute[103546]:     </disk>
Nov 16 03:52:51 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 03:52:51 user nova-compute[103546]:       <mac address="fa:16:3e:7b:45:4e"/>
Nov 16 03:52:51 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:52:51 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 03:52:51 user nova-compute[103546]:       <target dev="tapab9b5dca-ac"/>
Nov 16 03:52:51 user nova-compute[103546]:     </interface>
Nov 16 03:52:51 user nova-compute[103546]:     <serial type="pty">
Nov 16 03:52:51 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/164533fb-64e1-4aa5-b5fb-273817dd3e74/console.log" append="off"/>
Nov 16 03:52:51 user nova-compute[103546]:     </serial>
Nov 16 03:52:51 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 03:52:51 user nova-compute[103546]:     <video>
Nov 16 03:52:51 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:52:51 user nova-compute[103546]:     </video>
Nov 16 03:52:51 user nova-compute[103546]:     <rng model="virtio">
Nov 16 03:52:51 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 03:52:51 user nova-compute[103546]:     </rng>
Nov 16 03:52:51 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 03:52:51 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 03:52:51 user nova-compute[103546]:       <stats period="10"/>
Nov 16 03:52:51 user nova-compute[103546]:     </memballoon>
Nov 16 03:52:51 user nova-compute[103546]:   </devices>
Nov 16 03:52:51 user nova-compute[103546]: </domain>
Nov 16 03:52:51 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:52:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-524672440',display_name='tempest-TestServerVolumeAttachmentScenario-server-524672440',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-524672440',id=19,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFPXN0cjcjdu+HbblGQnvXuYiDAPeKI1oS5pvWB3H0HK1ye8W1jRurC78OiXPXnsGZKKqbYr8DK2B+Jc9EsWwL6GIxf7ANF7GpxGIpV6ECbKFo8L1Fk9kJ9tnWBO7h8EzA==',key_name='tempest-keypair-1213057093',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='697f0f13eb5e4681bfb4dbe0ad0bc9d2',ramdisk_id='',reservation_id='r-hcnxxi7y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1463401272',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1463401272-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:52:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81690bcb7edf4f74b1f712a253a9e946',uuid=164533fb-64e1-4aa5-b5fb-273817dd3e74,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab9b5dca-ac92-42ef-a86f-20ea3ccaf7e0", "address": "fa:16:3e:7b:45:4e", "network": {"id": "e6c6220f-786a-4445-981c-58cb30c01961", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1592167081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "697f0f13eb5e4681bfb4dbe0ad0bc9d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab9b5dca-ac", "ovs_interfaceid": "ab9b5dca-ac92-42ef-a86f-20ea3ccaf7e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Converting VIF {"id": "ab9b5dca-ac92-42ef-a86f-20ea3ccaf7e0", "address": "fa:16:3e:7b:45:4e", "network": {"id": "e6c6220f-786a-4445-981c-58cb30c01961", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1592167081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "697f0f13eb5e4681bfb4dbe0ad0bc9d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab9b5dca-ac", "ovs_interfaceid": "ab9b5dca-ac92-42ef-a86f-20ea3ccaf7e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:45:4e,bridge_name='br-int',has_traffic_filtering=True,id=ab9b5dca-ac92-42ef-a86f-20ea3ccaf7e0,network=Network(e6c6220f-786a-4445-981c-58cb30c01961),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab9b5dca-ac') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG os_vif [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:45:4e,bridge_name='br-int',has_traffic_filtering=True,id=ab9b5dca-ac92-42ef-a86f-20ea3ccaf7e0,network=Network(e6c6220f-786a-4445-981c-58cb30c01961),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab9b5dca-ac') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4a479d61-65b9-58d2-bb36-c5da119db085', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapab9b5dca-ac, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapab9b5dca-ac, col_values=(('qos', UUID('2e2d579d-d116-4069-b328-e79bd139a8a0')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapab9b5dca-ac, col_values=(('external_ids', {'iface-id': 'ab9b5dca-ac92-42ef-a86f-20ea3ccaf7e0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:45:4e', 'vm-uuid': '164533fb-64e1-4aa5-b5fb-273817dd3e74'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:52:51 user nova-compute[103546]: INFO os_vif [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:45:4e,bridge_name='br-int',has_traffic_filtering=True,id=ab9b5dca-ac92-42ef-a86f-20ea3ccaf7e0,network=Network(e6c6220f-786a-4445-981c-58cb30c01961),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab9b5dca-ac')
Nov 16 03:52:51 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] No VIF found with MAC fa:16:3e:7b:45:4e, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:52:51 user nova-compute[103546]: INFO nova.compute.manager [-] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Took 0.64 seconds to deallocate network for instance.
Nov 16 03:52:51 user nova-compute[103546]: DEBUG nova.compute.manager [req-e41ebac0-27bf-41ba-95c9-5c734c473a5b req-04962f54-f108-4839-b536-dbecbf01206f service nova] [instance: 7862d05d-4293-46a5-98aa-41967a572fe3] Received event network-vif-deleted-26fd759d-5cb8-4798-ab59-c7f5cb7773e8 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e901c0de-f638-4410-8cd9-15c2f354f0bf tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e901c0de-f638-4410-8cd9-15c2f354f0bf tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG nova.network.neutron [req-1dc335f7-e590-4f68-8b30-1d3f4fe88b58 req-88d5ae0b-2d04-43d4-a408-94e87c18c092 service nova] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Updated VIF entry in instance network info cache for port ab9b5dca-ac92-42ef-a86f-20ea3ccaf7e0. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG nova.network.neutron [req-1dc335f7-e590-4f68-8b30-1d3f4fe88b58 req-88d5ae0b-2d04-43d4-a408-94e87c18c092 service nova] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Updating instance_info_cache with network_info: [{"id": "ab9b5dca-ac92-42ef-a86f-20ea3ccaf7e0", "address": "fa:16:3e:7b:45:4e", "network": {"id": "e6c6220f-786a-4445-981c-58cb30c01961", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1592167081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "697f0f13eb5e4681bfb4dbe0ad0bc9d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab9b5dca-ac", "ovs_interfaceid": "ab9b5dca-ac92-42ef-a86f-20ea3ccaf7e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:52:51 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-1dc335f7-e590-4f68-8b30-1d3f4fe88b58 req-88d5ae0b-2d04-43d4-a408-94e87c18c092 service nova] Releasing lock "refresh_cache-164533fb-64e1-4aa5-b5fb-273817dd3e74" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:52:52 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-e901c0de-f638-4410-8cd9-15c2f354f0bf tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:52:52 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-e901c0de-f638-4410-8cd9-15c2f354f0bf tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:52:52 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e901c0de-f638-4410-8cd9-15c2f354f0bf tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.276s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:52:52 user nova-compute[103546]: INFO nova.scheduler.client.report [None req-e901c0de-f638-4410-8cd9-15c2f354f0bf tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Deleted allocations for instance 7862d05d-4293-46a5-98aa-41967a572fe3
Nov 16 03:52:52 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e901c0de-f638-4410-8cd9-15c2f354f0bf tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "7862d05d-4293-46a5-98aa-41967a572fe3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.964s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:52:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:52:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:52:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:52:53 user nova-compute[103546]: DEBUG nova.compute.manager [req-679281ea-5204-4fe4-8847-5a818abc7fbb req-ff59ba93-4743-4af8-8925-745364651b35 service nova] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Received event network-vif-plugged-ab9b5dca-ac92-42ef-a86f-20ea3ccaf7e0 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:52:53 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-679281ea-5204-4fe4-8847-5a818abc7fbb req-ff59ba93-4743-4af8-8925-745364651b35 service nova] Acquiring lock "164533fb-64e1-4aa5-b5fb-273817dd3e74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:52:53 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-679281ea-5204-4fe4-8847-5a818abc7fbb req-ff59ba93-4743-4af8-8925-745364651b35 service nova] Lock "164533fb-64e1-4aa5-b5fb-273817dd3e74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:52:53 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-679281ea-5204-4fe4-8847-5a818abc7fbb req-ff59ba93-4743-4af8-8925-745364651b35 service nova] Lock "164533fb-64e1-4aa5-b5fb-273817dd3e74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:52:53 user nova-compute[103546]: DEBUG nova.compute.manager [req-679281ea-5204-4fe4-8847-5a818abc7fbb req-ff59ba93-4743-4af8-8925-745364651b35 service nova] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] No waiting events found dispatching network-vif-plugged-ab9b5dca-ac92-42ef-a86f-20ea3ccaf7e0 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:52:53 user nova-compute[103546]: WARNING nova.compute.manager [req-679281ea-5204-4fe4-8847-5a818abc7fbb req-ff59ba93-4743-4af8-8925-745364651b35 service nova] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Received unexpected event network-vif-plugged-ab9b5dca-ac92-42ef-a86f-20ea3ccaf7e0 for instance with vm_state building and task_state spawning.
Nov 16 03:52:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:52:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:52:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:52:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:52:54 user nova-compute[103546]: DEBUG nova.compute.manager [None req-8f153599-b4bf-4e47-924d-ddab58d03f21 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 04101512-7333-4581-add3-7af3821e335b] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 03:52:54 user nova-compute[103546]: INFO nova.compute.manager [None req-8f153599-b4bf-4e47-924d-ddab58d03f21 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 04101512-7333-4581-add3-7af3821e335b] instance snapshotting
Nov 16 03:52:54 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-8f153599-b4bf-4e47-924d-ddab58d03f21 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 04101512-7333-4581-add3-7af3821e335b] Beginning live snapshot process
Nov 16 03:52:54 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-8f153599-b4bf-4e47-924d-ddab58d03f21 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json -f qcow2 {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-8f153599-b4bf-4e47-924d-ddab58d03f21 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json -f qcow2" returned: 0 in 0.168s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:52:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-8f153599-b4bf-4e47-924d-ddab58d03f21 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json -f qcow2 {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:55 user nova-compute[103546]: DEBUG nova.compute.manager [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 03:52:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Guest created on hypervisor {{(pid=103546) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 03:52:55 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Instance spawned successfully.
Nov 16 03:52:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 03:52:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Found default for hw_cdrom_bus of ide {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:52:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Found default for hw_disk_bus of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:52:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Found default for hw_input_bus of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:52:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Found default for hw_pointer_model of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:52:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Found default for hw_video_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:52:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Found default for hw_vif_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:52:55 user nova-compute[103546]: INFO nova.compute.manager [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Took 5.43 seconds to spawn the instance on the hypervisor.
Nov 16 03:52:55 user nova-compute[103546]: DEBUG nova.compute.manager [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 03:52:55 user nova-compute[103546]: DEBUG nova.compute.manager [req-92c7ffd2-d12a-4a2f-be10-f3a11882e102 req-26216fb4-e9e1-4928-82a6-97d831fa4615 service nova] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Received event network-vif-plugged-ab9b5dca-ac92-42ef-a86f-20ea3ccaf7e0 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:52:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-92c7ffd2-d12a-4a2f-be10-f3a11882e102 req-26216fb4-e9e1-4928-82a6-97d831fa4615 service nova] Acquiring lock "164533fb-64e1-4aa5-b5fb-273817dd3e74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:52:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-92c7ffd2-d12a-4a2f-be10-f3a11882e102 req-26216fb4-e9e1-4928-82a6-97d831fa4615 service nova] Lock "164533fb-64e1-4aa5-b5fb-273817dd3e74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:52:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-92c7ffd2-d12a-4a2f-be10-f3a11882e102 req-26216fb4-e9e1-4928-82a6-97d831fa4615 service nova] Lock "164533fb-64e1-4aa5-b5fb-273817dd3e74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:52:55 user nova-compute[103546]: DEBUG nova.compute.manager [req-92c7ffd2-d12a-4a2f-be10-f3a11882e102 req-26216fb4-e9e1-4928-82a6-97d831fa4615 service nova] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] No waiting events found dispatching network-vif-plugged-ab9b5dca-ac92-42ef-a86f-20ea3ccaf7e0 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:52:55 user nova-compute[103546]: WARNING nova.compute.manager [req-92c7ffd2-d12a-4a2f-be10-f3a11882e102 req-26216fb4-e9e1-4928-82a6-97d831fa4615 service nova] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Received unexpected event network-vif-plugged-ab9b5dca-ac92-42ef-a86f-20ea3ccaf7e0 for instance with vm_state building and task_state spawning.
Nov 16 03:52:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-8f153599-b4bf-4e47-924d-ddab58d03f21 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json -f qcow2" returned: 0 in 0.177s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:52:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-8f153599-b4bf-4e47-924d-ddab58d03f21 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:55 user nova-compute[103546]: INFO nova.compute.manager [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Took 6.12 seconds to build instance.
Nov 16 03:52:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-94566b0a-2eff-4d02-9685-e69b37e49e10 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Lock "164533fb-64e1-4aa5-b5fb-273817dd3e74" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.218s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:52:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-8f153599-b4bf-4e47-924d-ddab58d03f21 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.177s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:52:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-8f153599-b4bf-4e47-924d-ddab58d03f21 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp6p53fy7m/21a70cfc87994f8d913e029bb9a632cf.delta 1073741824 {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-8f153599-b4bf-4e47-924d-ddab58d03f21 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp6p53fy7m/21a70cfc87994f8d913e029bb9a632cf.delta 1073741824" returned: 0 in 0.045s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:52:55 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-8f153599-b4bf-4e47-924d-ddab58d03f21 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 04101512-7333-4581-add3-7af3821e335b] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 16 03:52:56 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-8f153599-b4bf-4e47-924d-ddab58d03f21 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=103546) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 03:52:56 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:52:56 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-8f153599-b4bf-4e47-924d-ddab58d03f21 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=103546) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 03:52:56 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-8f153599-b4bf-4e47-924d-ddab58d03f21 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 04101512-7333-4581-add3-7af3821e335b] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 16 03:52:56 user nova-compute[103546]: DEBUG nova.privsep.utils [None req-8f153599-b4bf-4e47-924d-ddab58d03f21 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=103546) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 03:52:56 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-8f153599-b4bf-4e47-924d-ddab58d03f21 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp6p53fy7m/21a70cfc87994f8d913e029bb9a632cf.delta /opt/stack/data/nova/instances/snapshots/tmp6p53fy7m/21a70cfc87994f8d913e029bb9a632cf {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:57 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-8f153599-b4bf-4e47-924d-ddab58d03f21 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp6p53fy7m/21a70cfc87994f8d913e029bb9a632cf.delta /opt/stack/data/nova/instances/snapshots/tmp6p53fy7m/21a70cfc87994f8d913e029bb9a632cf" returned: 0 in 0.530s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:52:57 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-8f153599-b4bf-4e47-924d-ddab58d03f21 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 04101512-7333-4581-add3-7af3821e335b] Snapshot extracted, beginning image upload
Nov 16 03:52:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e114e90a-cf56-4933-8d36-62f365668d00 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Acquiring lock "63b95121-b211-42c3-831e-0392d4abd09a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:52:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e114e90a-cf56-4933-8d36-62f365668d00 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "63b95121-b211-42c3-831e-0392d4abd09a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:52:57 user nova-compute[103546]: DEBUG nova.objects.instance [None req-e114e90a-cf56-4933-8d36-62f365668d00 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lazy-loading 'flavor' on Instance uuid 63b95121-b211-42c3-831e-0392d4abd09a {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:52:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e114e90a-cf56-4933-8d36-62f365668d00 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "63b95121-b211-42c3-831e-0392d4abd09a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:52:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e114e90a-cf56-4933-8d36-62f365668d00 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Acquiring lock "63b95121-b211-42c3-831e-0392d4abd09a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:52:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e114e90a-cf56-4933-8d36-62f365668d00 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "63b95121-b211-42c3-831e-0392d4abd09a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:52:57 user nova-compute[103546]: INFO nova.compute.manager [None req-e114e90a-cf56-4933-8d36-62f365668d00 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Attaching volume e2482635-6049-4358-94b5-f1cf8f5eeab4 to /dev/vdb
Nov 16 03:52:58 user nova-compute[103546]: DEBUG os_brick.utils [None req-e114e90a-cf56-4933-8d36-62f365668d00 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:52:58 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:58 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:52:58 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd86b96-8ff4-45ac-8133-a1fadca73ee7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af5c39b14ece\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:52:58 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:58 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:52:58 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[08cac685-4606-4275-a7fb-8a0e75490e3e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:52:58 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:58 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:52:58 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd91f31-262a-4469-b0f5-ff4434866ea5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:52:58 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d456f668-a5fb-404c-805e-d754b659a1fc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:52:58 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-e114e90a-cf56-4933-8d36-62f365668d00 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Running cmd (subprocess): nvme version {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:58 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-e114e90a-cf56-4933-8d36-62f365668d00 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] 'nvme version' failed. Not Retrying. {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:52:58 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e114e90a-cf56-4933-8d36-62f365668d00 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] nvme not present on system {{(pid=103546) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 03:52:58 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:52:58 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:52:58 user nova-compute[103546]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 03:52:58 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e07106-3a0b-43c0-8d05-e118fc81e566]: (4, '') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:52:58 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-e114e90a-cf56-4933-8d36-62f365668d00 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=103546) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 03:52:58 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-e114e90a-cf56-4933-8d36-62f365668d00 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 03:52:58 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-e114e90a-cf56-4933-8d36-62f365668d00 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] LIGHTOS: no hostnqn found. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 03:52:58 user nova-compute[103546]: DEBUG os_brick.utils [None req-e114e90a-cf56-4933-8d36-62f365668d00 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af5c39b14ece', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:52:58 user nova-compute[103546]: DEBUG nova.virt.block_device [None req-e114e90a-cf56-4933-8d36-62f365668d00 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Updating existing volume attachment record: bcd9ec24-461e-4af0-a16e-bf9824092aea {{(pid=103546) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 03:52:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:52:59 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-8f153599-b4bf-4e47-924d-ddab58d03f21 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 04101512-7333-4581-add3-7af3821e335b] Snapshot image upload complete
Nov 16 03:52:59 user nova-compute[103546]: INFO nova.compute.manager [None req-8f153599-b4bf-4e47-924d-ddab58d03f21 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 04101512-7333-4581-add3-7af3821e335b] Took 5.68 seconds to snapshot the instance on the hypervisor.
Nov 16 03:53:01 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:03 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e114e90a-cf56-4933-8d36-62f365668d00 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 03:53:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-e114e90a-cf56-4933-8d36-62f365668d00 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e2482635-6049-4358-94b5-f1cf8f5eeab4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yaCQVzXv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:53:03 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-e114e90a-cf56-4933-8d36-62f365668d00 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:53:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-e114e90a-cf56-4933-8d36-62f365668d00 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:53:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-e114e90a-cf56-4933-8d36-62f365668d00 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:53:03 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-e114e90a-cf56-4933-8d36-62f365668d00 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:53:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-e114e90a-cf56-4933-8d36-62f365668d00 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2482635-6049-4358-94b5-f1cf8f5eeab4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:53:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-e114e90a-cf56-4933-8d36-62f365668d00 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2482635-6049-4358-94b5-f1cf8f5eeab4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:53:03 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-e114e90a-cf56-4933-8d36-62f365668d00 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 03:53:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2482635-6049-4358-94b5-f1cf8f5eeab4 -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2482635-6049-4358-94b5-f1cf8f5eeab4 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:03 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[894d45f1-23dc-4c27-bfd8-17419fa7b144]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:53:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-e114e90a-cf56-4933-8d36-62f365668d00 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 03:53:03 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:53:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2482635-6049-4358-94b5-f1cf8f5eeab4 -p 172.16.0.220:3260 --interface default --op new {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2482635-6049-4358-94b5-f1cf8f5eeab4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:03 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[1862676b-6169-4dfd-a5b6-aa4e7b8f2794]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e2482635-6049-4358-94b5-f1cf8f5eeab4] added\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:53:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-e114e90a-cf56-4933-8d36-62f365668d00 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e2482635-6049-4358-94b5-f1cf8f5eeab4] added
Nov 16 03:53:03 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:53:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2482635-6049-4358-94b5-f1cf8f5eeab4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2482635-6049-4358-94b5-f1cf8f5eeab4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:03 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ffbb46-b263-48cd-a4b3-c40508b9095b]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:53:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-e114e90a-cf56-4933-8d36-62f365668d00 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:53:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2482635-6049-4358-94b5-f1cf8f5eeab4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2482635-6049-4358-94b5-f1cf8f5eeab4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:03 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc32736-e3ed-4d5c-aee0-e0bbab993c97]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:53:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-e114e90a-cf56-4933-8d36-62f365668d00 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:53:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2482635-6049-4358-94b5-f1cf8f5eeab4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yaCQVzXv {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2482635-6049-4358-94b5-f1cf8f5eeab4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yaCQVzXv" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:03 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b39301-b897-49e2-8107-fdb460500358]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:53:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-e114e90a-cf56-4933-8d36-62f365668d00 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yaCQVzXv'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:53:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2482635-6049-4358-94b5-f1cf8f5eeab4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2482635-6049-4358-94b5-f1cf8f5eeab4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:03 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f42e68-6a38-4e04-84be-322d8d465df9]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:53:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-e114e90a-cf56-4933-8d36-62f365668d00 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:53:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:03 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[649972eb-3648-4984-a309-ed33568d2e77]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:53:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-e114e90a-cf56-4933-8d36-62f365668d00 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)
Nov 16 03:53:03 user nova-compute[103546]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f (non-flash)
Nov 16 03:53:03 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:53:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-e114e90a-cf56-4933-8d36-62f365668d00 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)
Nov 16 03:53:03 user nova-compute[103546]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f (non-flash)
Nov 16 03:53:03 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:53:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2482635-6049-4358-94b5-f1cf8f5eeab4 -p 172.16.0.220:3260 --login {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2482635-6049-4358-94b5-f1cf8f5eeab4 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:03 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[961f19af-08e0-4fcd-90a9-3f0e36847c61]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e2482635-6049-4358-94b5-f1cf8f5eeab4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e2482635-6049-4358-94b5-f1cf8f5eeab4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:53:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-e114e90a-cf56-4933-8d36-62f365668d00 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e2482635-6049-4358-94b5-f1cf8f5eeab4, portal: 172.16.0.220,3260]
Nov 16 03:53:03 user nova-compute[103546]: Login to [iface: default, target: iqn.2010-10.org.openstack:e2482635-6049-4358-94b5-f1cf8f5eeab4, portal: 172.16.0.220,3260] successful.
Nov 16 03:53:03 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:53:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2482635-6049-4358-94b5-f1cf8f5eeab4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2482635-6049-4358-94b5-f1cf8f5eeab4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:03 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d7119c-ab4a-41bd-8ecb-bf552090fef2]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:53:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-e114e90a-cf56-4933-8d36-62f365668d00 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:53:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:03 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[da970751-d377-47d7-8760-ee76de68526a]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2482635-6049-4358-94b5-f1cf8f5eeab4 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:53:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-e114e90a-cf56-4933-8d36-62f365668d00 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)
Nov 16 03:53:03 user nova-compute[103546]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f (non-flash)
Nov 16 03:53:03 user nova-compute[103546]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2482635-6049-4358-94b5-f1cf8f5eeab4 (non-flash)
Nov 16 03:53:03 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:53:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-e114e90a-cf56-4933-8d36-62f365668d00 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)
Nov 16 03:53:03 user nova-compute[103546]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f (non-flash)
Nov 16 03:53:03 user nova-compute[103546]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2482635-6049-4358-94b5-f1cf8f5eeab4 (non-flash)
Nov 16 03:53:03 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:53:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-e114e90a-cf56-4933-8d36-62f365668d00 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2482635-6049-4358-94b5-f1cf8f5eeab4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:53:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-e114e90a-cf56-4933-8d36-62f365668d00 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 03:53:03 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-e114e90a-cf56-4933-8d36-62f365668d00 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 03:53:03 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-e114e90a-cf56-4933-8d36-62f365668d00 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 03:53:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:03 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[253c77cf-d1b3-4ac7-a67c-a110fa6acc11]: (4, ('- - 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:53:03 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-e114e90a-cf56-4933-8d36-62f365668d00 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 03:53:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-e114e90a-cf56-4933-8d36-62f365668d00 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e2482635-6049-4358-94b5-f1cf8f5eeab4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yaCQVzXv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 03:53:04 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-e114e90a-cf56-4933-8d36-62f365668d00 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:53:04 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-e114e90a-cf56-4933-8d36-62f365668d00 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '26135653761613666', 'path': '/dev/sdc'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:53:04 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e114e90a-cf56-4933-8d36-62f365668d00 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135653761613666', 'path': '/dev/sdc'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 03:53:04 user nova-compute[103546]: DEBUG nova.objects.instance [None req-e114e90a-cf56-4933-8d36-62f365668d00 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lazy-loading 'flavor' on Instance uuid 63b95121-b211-42c3-831e-0392d4abd09a {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:53:04 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-e114e90a-cf56-4933-8d36-62f365668d00 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 03:53:04 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 03:53:04 user nova-compute[103546]:   <source dev="/dev/sdc"/>
Nov 16 03:53:04 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 03:53:04 user nova-compute[103546]:   <serial>e2482635-6049-4358-94b5-f1cf8f5eeab4</serial>
Nov 16 03:53:04 user nova-compute[103546]: </disk>
Nov 16 03:53:04 user nova-compute[103546]:  {{(pid=103546) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 03:53:05 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._sync_power_states {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:53:05 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-e114e90a-cf56-4933-8d36-62f365668d00 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:53:05 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-e114e90a-cf56-4933-8d36-62f365668d00 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] No BDM found with device name vdb, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:53:05 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-e114e90a-cf56-4933-8d36-62f365668d00 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] No VIF found with MAC fa:16:3e:d0:5b:e1, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 03:53:05 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Triggering sync for uuid 279e2954-d786-4544-903d-8edc63646e2d {{(pid=103546) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 03:53:05 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Triggering sync for uuid 51554aab-44ec-4161-b926-9c07a3f838a5 {{(pid=103546) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 03:53:05 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Triggering sync for uuid 63b95121-b211-42c3-831e-0392d4abd09a {{(pid=103546) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 03:53:05 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Triggering sync for uuid 9a89970b-fc61-4419-8ff9-b48013dccf9f {{(pid=103546) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 03:53:05 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Triggering sync for uuid 04101512-7333-4581-add3-7af3821e335b {{(pid=103546) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 03:53:05 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Triggering sync for uuid 6a9afa69-2674-46fc-8e30-e196928ff07c {{(pid=103546) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 03:53:05 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Triggering sync for uuid 58e02332-2918-4744-a8f7-90e28391d391 {{(pid=103546) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 03:53:05 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Triggering sync for uuid 164533fb-64e1-4aa5-b5fb-273817dd3e74 {{(pid=103546) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 03:53:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "279e2954-d786-4544-903d-8edc63646e2d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:53:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "279e2954-d786-4544-903d-8edc63646e2d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:53:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "51554aab-44ec-4161-b926-9c07a3f838a5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:53:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "51554aab-44ec-4161-b926-9c07a3f838a5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:53:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "63b95121-b211-42c3-831e-0392d4abd09a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:53:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "9a89970b-fc61-4419-8ff9-b48013dccf9f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:53:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "9a89970b-fc61-4419-8ff9-b48013dccf9f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:53:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "04101512-7333-4581-add3-7af3821e335b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:53:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "04101512-7333-4581-add3-7af3821e335b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:53:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "6a9afa69-2674-46fc-8e30-e196928ff07c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:53:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "6a9afa69-2674-46fc-8e30-e196928ff07c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:53:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "58e02332-2918-4744-a8f7-90e28391d391" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:53:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "58e02332-2918-4744-a8f7-90e28391d391" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:53:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "164533fb-64e1-4aa5-b5fb-273817dd3e74" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:53:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "164533fb-64e1-4aa5-b5fb-273817dd3e74" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:53:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "9a89970b-fc61-4419-8ff9-b48013dccf9f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:53:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "51554aab-44ec-4161-b926-9c07a3f838a5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:53:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "6a9afa69-2674-46fc-8e30-e196928ff07c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:53:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "04101512-7333-4581-add3-7af3821e335b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.091s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:53:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "164533fb-64e1-4aa5-b5fb-273817dd3e74" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.095s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:53:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "58e02332-2918-4744-a8f7-90e28391d391" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.103s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:53:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "279e2954-d786-4544-903d-8edc63646e2d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.115s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:53:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e114e90a-cf56-4933-8d36-62f365668d00 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "63b95121-b211-42c3-831e-0392d4abd09a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.237s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:53:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "63b95121-b211-42c3-831e-0392d4abd09a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.132s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:53:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "63b95121-b211-42c3-831e-0392d4abd09a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:53:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a020342a-a4a2-47fe-8dbb-fcc3caf9736f tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Acquiring lock "6a9afa69-2674-46fc-8e30-e196928ff07c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:53:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a020342a-a4a2-47fe-8dbb-fcc3caf9736f tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Lock "6a9afa69-2674-46fc-8e30-e196928ff07c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:53:05 user nova-compute[103546]: DEBUG nova.objects.instance [None req-a020342a-a4a2-47fe-8dbb-fcc3caf9736f tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Lazy-loading 'flavor' on Instance uuid 6a9afa69-2674-46fc-8e30-e196928ff07c {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:53:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a020342a-a4a2-47fe-8dbb-fcc3caf9736f tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Lock "6a9afa69-2674-46fc-8e30-e196928ff07c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:53:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a020342a-a4a2-47fe-8dbb-fcc3caf9736f tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Acquiring lock "6a9afa69-2674-46fc-8e30-e196928ff07c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:53:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a020342a-a4a2-47fe-8dbb-fcc3caf9736f tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Lock "6a9afa69-2674-46fc-8e30-e196928ff07c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:53:05 user nova-compute[103546]: INFO nova.compute.manager [None req-a020342a-a4a2-47fe-8dbb-fcc3caf9736f tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] Attaching volume e7c3a174-a4ec-4200-9c27-73537ab3f5b5 to /dev/vdb
Nov 16 03:53:05 user nova-compute[103546]: DEBUG os_brick.utils [None req-a020342a-a4a2-47fe-8dbb-fcc3caf9736f tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:53:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:05 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecac8767-e626-4477-882e-4fedf862af9e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af5c39b14ece\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:53:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:05 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f3f598-bab4-4f09-96de-2c857fe8fbc3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:53:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:05 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01f647d-bbe1-44d9-b4a3-9093538922f3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:53:05 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e13715-4d0d-48f8-9fa5-65f4f4a49181]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:53:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-a020342a-a4a2-47fe-8dbb-fcc3caf9736f tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Running cmd (subprocess): nvme version {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:06 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-a020342a-a4a2-47fe-8dbb-fcc3caf9736f tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] 'nvme version' failed. Not Retrying. {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:53:06 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a020342a-a4a2-47fe-8dbb-fcc3caf9736f tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] nvme not present on system {{(pid=103546) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 03:53:06 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:06 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:53:06 user nova-compute[103546]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 03:53:06 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17590f5-d0dc-4003-865b-4900ccd18554]: (4, '') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:53:06 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-a020342a-a4a2-47fe-8dbb-fcc3caf9736f tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=103546) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 03:53:06 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-a020342a-a4a2-47fe-8dbb-fcc3caf9736f tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 03:53:06 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-a020342a-a4a2-47fe-8dbb-fcc3caf9736f tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] LIGHTOS: no hostnqn found. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 03:53:06 user nova-compute[103546]: DEBUG os_brick.utils [None req-a020342a-a4a2-47fe-8dbb-fcc3caf9736f tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af5c39b14ece', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:53:06 user nova-compute[103546]: DEBUG nova.virt.block_device [None req-a020342a-a4a2-47fe-8dbb-fcc3caf9736f tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] Updating existing volume attachment record: 841b725b-4a0f-4c8b-a3e4-622daa31c751 {{(pid=103546) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 03:53:06 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1c3ee634-f2c1-496d-b074-acb1011244a7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Acquiring lock "63b95121-b211-42c3-831e-0392d4abd09a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:53:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1c3ee634-f2c1-496d-b074-acb1011244a7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "63b95121-b211-42c3-831e-0392d4abd09a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:53:07 user nova-compute[103546]: INFO nova.compute.manager [None req-1c3ee634-f2c1-496d-b074-acb1011244a7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Detaching volume e2482635-6049-4358-94b5-f1cf8f5eeab4
Nov 16 03:53:07 user nova-compute[103546]: INFO nova.virt.block_device [None req-1c3ee634-f2c1-496d-b074-acb1011244a7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Attempting to driver detach volume e2482635-6049-4358-94b5-f1cf8f5eeab4 from mountpoint /dev/vdb
Nov 16 03:53:07 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1c3ee634-f2c1-496d-b074-acb1011244a7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Attempting to detach device vdb from instance 63b95121-b211-42c3-831e-0392d4abd09a from the persistent domain config. {{(pid=103546) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 03:53:07 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-1c3ee634-f2c1-496d-b074-acb1011244a7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 03:53:07 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 03:53:07 user nova-compute[103546]:   <source dev="/dev/sdc"/>
Nov 16 03:53:07 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 03:53:07 user nova-compute[103546]:   <serial>e2482635-6049-4358-94b5-f1cf8f5eeab4</serial>
Nov 16 03:53:07 user nova-compute[103546]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 03:53:07 user nova-compute[103546]: </disk>
Nov 16 03:53:07 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 03:53:07 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-1c3ee634-f2c1-496d-b074-acb1011244a7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Successfully detached device vdb from instance 63b95121-b211-42c3-831e-0392d4abd09a from the persistent domain config.
Nov 16 03:53:07 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1c3ee634-f2c1-496d-b074-acb1011244a7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 63b95121-b211-42c3-831e-0392d4abd09a from the live domain config. {{(pid=103546) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 03:53:07 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-1c3ee634-f2c1-496d-b074-acb1011244a7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 03:53:07 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 03:53:07 user nova-compute[103546]:   <source dev="/dev/sdc"/>
Nov 16 03:53:07 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 03:53:07 user nova-compute[103546]:   <serial>e2482635-6049-4358-94b5-f1cf8f5eeab4</serial>
Nov 16 03:53:07 user nova-compute[103546]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 03:53:07 user nova-compute[103546]: </disk>
Nov 16 03:53:07 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 03:53:07 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1c3ee634-f2c1-496d-b074-acb1011244a7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 63b95121-b211-42c3-831e-0392d4abd09a {{(pid=103546) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 03:53:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a020342a-a4a2-47fe-8dbb-fcc3caf9736f tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 03:53:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a020342a-a4a2-47fe-8dbb-fcc3caf9736f tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e7c3a174-a4ec-4200-9c27-73537ab3f5b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nolZQXNP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:53:10 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-a020342a-a4a2-47fe-8dbb-fcc3caf9736f tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:53:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-a020342a-a4a2-47fe-8dbb-fcc3caf9736f tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:53:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-a020342a-a4a2-47fe-8dbb-fcc3caf9736f tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:53:10 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-a020342a-a4a2-47fe-8dbb-fcc3caf9736f tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:53:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-a020342a-a4a2-47fe-8dbb-fcc3caf9736f tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7c3a174-a4ec-4200-9c27-73537ab3f5b5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:53:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-a020342a-a4a2-47fe-8dbb-fcc3caf9736f tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7c3a174-a4ec-4200-9c27-73537ab3f5b5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:53:10 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-a020342a-a4a2-47fe-8dbb-fcc3caf9736f tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 03:53:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7c3a174-a4ec-4200-9c27-73537ab3f5b5 -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7c3a174-a4ec-4200-9c27-73537ab3f5b5 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:11 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5db0dc-6b2f-479c-b512-3203404ed434]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:53:11 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a020342a-a4a2-47fe-8dbb-fcc3caf9736f tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 03:53:11 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:53:11 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7c3a174-a4ec-4200-9c27-73537ab3f5b5 -p 172.16.0.220:3260 --interface default --op new {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:11 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7c3a174-a4ec-4200-9c27-73537ab3f5b5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:11 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b72d351-9ab9-43e5-8f6a-a889fb69dc5b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7c3a174-a4ec-4200-9c27-73537ab3f5b5] added\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:53:11 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a020342a-a4a2-47fe-8dbb-fcc3caf9736f tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7c3a174-a4ec-4200-9c27-73537ab3f5b5] added
Nov 16 03:53:11 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:53:11 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7c3a174-a4ec-4200-9c27-73537ab3f5b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:11 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7c3a174-a4ec-4200-9c27-73537ab3f5b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:11 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa9954c-6775-4a68-8425-5b6dfcfaeceb]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:53:11 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a020342a-a4a2-47fe-8dbb-fcc3caf9736f tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:53:11 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7c3a174-a4ec-4200-9c27-73537ab3f5b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:11 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7c3a174-a4ec-4200-9c27-73537ab3f5b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:11 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8346ae1-7806-44d1-b287-f92010026c15]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:53:11 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a020342a-a4a2-47fe-8dbb-fcc3caf9736f tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:53:11 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7c3a174-a4ec-4200-9c27-73537ab3f5b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nolZQXNP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:11 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7c3a174-a4ec-4200-9c27-73537ab3f5b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nolZQXNP" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:11 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98425c2-1f7a-412f-a854-7009fbea55e0]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:53:11 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a020342a-a4a2-47fe-8dbb-fcc3caf9736f tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nolZQXNP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:53:11 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7c3a174-a4ec-4200-9c27-73537ab3f5b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:11 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7c3a174-a4ec-4200-9c27-73537ab3f5b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:11 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ff0d63-132a-4a97-9c39-db1c7295032b]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:53:11 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a020342a-a4a2-47fe-8dbb-fcc3caf9736f tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:53:11 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:11 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:11 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[eedf0f47-2d46-4670-9f4b-ab46dcb430da]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2482635-6049-4358-94b5-f1cf8f5eeab4 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:53:11 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a020342a-a4a2-47fe-8dbb-fcc3caf9736f tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)
Nov 16 03:53:11 user nova-compute[103546]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f (non-flash)
Nov 16 03:53:11 user nova-compute[103546]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2482635-6049-4358-94b5-f1cf8f5eeab4 (non-flash)
Nov 16 03:53:11 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:53:11 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a020342a-a4a2-47fe-8dbb-fcc3caf9736f tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)
Nov 16 03:53:11 user nova-compute[103546]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f (non-flash)
Nov 16 03:53:11 user nova-compute[103546]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2482635-6049-4358-94b5-f1cf8f5eeab4 (non-flash)
Nov 16 03:53:11 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:53:11 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7c3a174-a4ec-4200-9c27-73537ab3f5b5 -p 172.16.0.220:3260 --login {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:11 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7c3a174-a4ec-4200-9c27-73537ab3f5b5 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:11 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[7987517c-2a19-429d-841a-3375edaa952e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7c3a174-a4ec-4200-9c27-73537ab3f5b5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e7c3a174-a4ec-4200-9c27-73537ab3f5b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:53:11 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a020342a-a4a2-47fe-8dbb-fcc3caf9736f tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7c3a174-a4ec-4200-9c27-73537ab3f5b5, portal: 172.16.0.220,3260]
Nov 16 03:53:11 user nova-compute[103546]: Login to [iface: default, target: iqn.2010-10.org.openstack:e7c3a174-a4ec-4200-9c27-73537ab3f5b5, portal: 172.16.0.220,3260] successful.
Nov 16 03:53:11 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:53:11 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7c3a174-a4ec-4200-9c27-73537ab3f5b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:11 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7c3a174-a4ec-4200-9c27-73537ab3f5b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:11 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e886e9e8-4edd-42d9-8d89-e3e1de58d271]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:53:11 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a020342a-a4a2-47fe-8dbb-fcc3caf9736f tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:53:11 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:11 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:11 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0d8e60-fe84-473c-a793-c3eac7494faf]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2482635-6049-4358-94b5-f1cf8f5eeab4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7c3a174-a4ec-4200-9c27-73537ab3f5b5 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:53:11 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a020342a-a4a2-47fe-8dbb-fcc3caf9736f tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)
Nov 16 03:53:11 user nova-compute[103546]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f (non-flash)
Nov 16 03:53:11 user nova-compute[103546]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2482635-6049-4358-94b5-f1cf8f5eeab4 (non-flash)
Nov 16 03:53:11 user nova-compute[103546]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7c3a174-a4ec-4200-9c27-73537ab3f5b5 (non-flash)
Nov 16 03:53:11 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:53:11 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a020342a-a4a2-47fe-8dbb-fcc3caf9736f tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)
Nov 16 03:53:11 user nova-compute[103546]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f (non-flash)
Nov 16 03:53:11 user nova-compute[103546]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2482635-6049-4358-94b5-f1cf8f5eeab4 (non-flash)
Nov 16 03:53:11 user nova-compute[103546]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7c3a174-a4ec-4200-9c27-73537ab3f5b5 (non-flash)
Nov 16 03:53:11 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:53:11 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-a020342a-a4a2-47fe-8dbb-fcc3caf9736f tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7c3a174-a4ec-4200-9c27-73537ab3f5b5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:53:11 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a020342a-a4a2-47fe-8dbb-fcc3caf9736f tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 03:53:11 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-a020342a-a4a2-47fe-8dbb-fcc3caf9736f tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] HCTL ('36', '-', '-', 0) found on session 24 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 03:53:11 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-a020342a-a4a2-47fe-8dbb-fcc3caf9736f tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 03:53:11 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:11 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:11 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c859c3dc-c7bc-4763-a714-1a2e6dae22b5]: (4, ('- - 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:53:11 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-a020342a-a4a2-47fe-8dbb-fcc3caf9736f tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Searching for a device in session 24 and hctl ['36', '*', '*', 0] yield: sde {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 03:53:11 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a020342a-a4a2-47fe-8dbb-fcc3caf9736f tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e7c3a174-a4ec-4200-9c27-73537ab3f5b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nolZQXNP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 03:53:11 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:12 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-a020342a-a4a2-47fe-8dbb-fcc3caf9736f tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:53:12 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a020342a-a4a2-47fe-8dbb-fcc3caf9736f tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23762616163643639', 'path': '/dev/sde'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:53:12 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a020342a-a4a2-47fe-8dbb-fcc3caf9736f tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762616163643639', 'path': '/dev/sde'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 03:53:12 user nova-compute[103546]: DEBUG nova.objects.instance [None req-a020342a-a4a2-47fe-8dbb-fcc3caf9736f tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Lazy-loading 'flavor' on Instance uuid 6a9afa69-2674-46fc-8e30-e196928ff07c {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:53:12 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-a020342a-a4a2-47fe-8dbb-fcc3caf9736f tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 03:53:12 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 03:53:12 user nova-compute[103546]:   <source dev="/dev/sde"/>
Nov 16 03:53:12 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 03:53:12 user nova-compute[103546]:   <serial>e7c3a174-a4ec-4200-9c27-73537ab3f5b5</serial>
Nov 16 03:53:12 user nova-compute[103546]: </disk>
Nov 16 03:53:12 user nova-compute[103546]:  {{(pid=103546) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 03:53:12 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:53:12 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:53:12 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:53:12 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:53:12 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=103546) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 03:53:12 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a020342a-a4a2-47fe-8dbb-fcc3caf9736f tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:53:12 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a020342a-a4a2-47fe-8dbb-fcc3caf9736f tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] No BDM found with device name vdb, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:53:12 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a020342a-a4a2-47fe-8dbb-fcc3caf9736f tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] No VIF found with MAC fa:16:3e:e5:1d:2e, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 03:53:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a020342a-a4a2-47fe-8dbb-fcc3caf9736f tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Lock "6a9afa69-2674-46fc-8e30-e196928ff07c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:53:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-eb0f9cf8-7d00-4fa8-b957-b3151c593e84 tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Acquiring lock "6a9afa69-2674-46fc-8e30-e196928ff07c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:53:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-eb0f9cf8-7d00-4fa8-b957-b3151c593e84 tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Lock "6a9afa69-2674-46fc-8e30-e196928ff07c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:53:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-eb0f9cf8-7d00-4fa8-b957-b3151c593e84 tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Acquiring lock "6a9afa69-2674-46fc-8e30-e196928ff07c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:53:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-eb0f9cf8-7d00-4fa8-b957-b3151c593e84 tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Lock "6a9afa69-2674-46fc-8e30-e196928ff07c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:53:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-eb0f9cf8-7d00-4fa8-b957-b3151c593e84 tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Lock "6a9afa69-2674-46fc-8e30-e196928ff07c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:53:13 user nova-compute[103546]: INFO nova.compute.manager [None req-eb0f9cf8-7d00-4fa8-b957-b3151c593e84 tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] Terminating instance
Nov 16 03:53:13 user nova-compute[103546]: DEBUG nova.compute.manager [None req-eb0f9cf8-7d00-4fa8-b957-b3151c593e84 tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] Start destroying the instance on the hypervisor. {{(pid=103546) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 03:53:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:13 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:53:13 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager.update_available_resource {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:53:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:53:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:53:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:53:13 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Auditing locally available compute resources for user (node: user) {{(pid=103546) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 03:53:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG nova.compute.manager [req-b595af7c-3cf0-4930-8905-5a900c410200 req-87cb3fac-f035-4d7e-8120-c243bfe86d15 service nova] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] Received event network-vif-unplugged-efdedcd3-0071-412e-bd4a-e2a518ee4bf9 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-b595af7c-3cf0-4930-8905-5a900c410200 req-87cb3fac-f035-4d7e-8120-c243bfe86d15 service nova] Acquiring lock "6a9afa69-2674-46fc-8e30-e196928ff07c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-b595af7c-3cf0-4930-8905-5a900c410200 req-87cb3fac-f035-4d7e-8120-c243bfe86d15 service nova] Lock "6a9afa69-2674-46fc-8e30-e196928ff07c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-b595af7c-3cf0-4930-8905-5a900c410200 req-87cb3fac-f035-4d7e-8120-c243bfe86d15 service nova] Lock "6a9afa69-2674-46fc-8e30-e196928ff07c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG nova.compute.manager [req-b595af7c-3cf0-4930-8905-5a900c410200 req-87cb3fac-f035-4d7e-8120-c243bfe86d15 service nova] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] No waiting events found dispatching network-vif-unplugged-efdedcd3-0071-412e-bd4a-e2a518ee4bf9 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG nova.compute.manager [req-b595af7c-3cf0-4930-8905-5a900c410200 req-87cb3fac-f035-4d7e-8120-c243bfe86d15 service nova] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] Received event network-vif-unplugged-efdedcd3-0071-412e-bd4a-e2a518ee4bf9 for instance with task_state deleting. {{(pid=103546) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 03:53:14 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] Instance destroyed successfully.
Nov 16 03:53:14 user nova-compute[103546]: DEBUG nova.objects.instance [None req-eb0f9cf8-7d00-4fa8-b957-b3151c593e84 tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Lazy-loading 'resources' on Instance uuid 6a9afa69-2674-46fc-8e30-e196928ff07c {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-eb0f9cf8-7d00-4fa8-b957-b3151c593e84 tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:51:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-606707385',display_name='tempest-DeleteServersTestJSON-server-606707385',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-606707385',id=17,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:51:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5fbb710b153d435da880b41ad2a8f1bd',ramdisk_id='',reservation_id='r-rd9nw473',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-750089832',owner_user_name='tempest-DeleteServersTestJSON-750089832-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T03:51:21Z,user_data=None,user_id='0041f0189e09484481d362f3108e47f2',uuid=6a9afa69-2674-46fc-8e30-e196928ff07c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "efdedcd3-0071-412e-bd4a-e2a518ee4bf9", "address": "fa:16:3e:e5:1d:2e", "network": {"id": "7ed01459-90d0-4fe4-863b-fe90be1d41a0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1311268077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fbb710b153d435da880b41ad2a8f1bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefdedcd3-00", "ovs_interfaceid": "efdedcd3-0071-412e-bd4a-e2a518ee4bf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-eb0f9cf8-7d00-4fa8-b957-b3151c593e84 tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Converting VIF {"id": "efdedcd3-0071-412e-bd4a-e2a518ee4bf9", "address": "fa:16:3e:e5:1d:2e", "network": {"id": "7ed01459-90d0-4fe4-863b-fe90be1d41a0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1311268077-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fbb710b153d435da880b41ad2a8f1bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefdedcd3-00", "ovs_interfaceid": "efdedcd3-0071-412e-bd4a-e2a518ee4bf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-eb0f9cf8-7d00-4fa8-b957-b3151c593e84 tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:1d:2e,bridge_name='br-int',has_traffic_filtering=True,id=efdedcd3-0071-412e-bd4a-e2a518ee4bf9,network=Network(7ed01459-90d0-4fe4-863b-fe90be1d41a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefdedcd3-00') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG os_vif [None req-eb0f9cf8-7d00-4fa8-b957-b3151c593e84 tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:1d:2e,bridge_name='br-int',has_traffic_filtering=True,id=efdedcd3-0071-412e-bd4a-e2a518ee4bf9,network=Network(7ed01459-90d0-4fe4-863b-fe90be1d41a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefdedcd3-00') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapefdedcd3-00, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=759315f7-a568-4aec-be28-f4f163467dbc) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:14 user nova-compute[103546]: INFO os_vif [None req-eb0f9cf8-7d00-4fa8-b957-b3151c593e84 tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:1d:2e,bridge_name='br-int',has_traffic_filtering=True,id=efdedcd3-0071-412e-bd4a-e2a518ee4bf9,network=Network(7ed01459-90d0-4fe4-863b-fe90be1d41a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefdedcd3-00')
Nov 16 03:53:14 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb0f9cf8-7d00-4fa8-b957-b3151c593e84 tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0f9cf8-7d00-4fa8-b957-b3151c593e84 tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:e7c3a174-a4ec-4200-9c27-73537ab3f5b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nolZQXNP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:53:14 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-eb0f9cf8-7d00-4fa8-b957-b3151c593e84 tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:53:14 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-eb0f9cf8-7d00-4fa8-b957-b3151c593e84 tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-eb0f9cf8-7d00-4fa8-b957-b3151c593e84 tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d734c5ba-9ac2-4838-a55f-0606dc4a64a4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2482635-6049-4358-94b5-f1cf8f5eeab4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7c3a174-a4ec-4200-9c27-73537ab3f5b5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0f9cf8-7d00-4fa8-b957-b3151c593e84 tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 03:53:14 user nova-compute[103546]: No targets found.
Nov 16 03:53:14 user nova-compute[103546]: iSNS:
Nov 16 03:53:14 user nova-compute[103546]: No targets found.
Nov 16 03:53:14 user nova-compute[103546]: STATIC:
Nov 16 03:53:14 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f
Nov 16 03:53:14 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:53:14 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:53:14 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c
Nov 16 03:53:14 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:53:14 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:53:14 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:e2482635-6049-4358-94b5-f1cf8f5eeab4
Nov 16 03:53:14 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:53:14 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:53:14 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:e7c3a174-a4ec-4200-9c27-73537ab3f5b5
Nov 16 03:53:14 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:53:14 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:53:14 user nova-compute[103546]: FIRMWARE:
Nov 16 03:53:14 user nova-compute[103546]: No targets found.
Nov 16 03:53:14 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0f9cf8-7d00-4fa8-b957-b3151c593e84 tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 03:53:14 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 03:53:14 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0f9cf8-7d00-4fa8-b957-b3151c593e84 tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7c3a174-a4ec-4200-9c27-73537ab3f5b5', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e82f18-7d55-4060-8e88-306405191527]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2482635-6049-4358-94b5-f1cf8f5eeab4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7c3a174-a4ec-4200-9c27-73537ab3f5b5\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[95da11bf-b470-43be-8aed-ddb0f77b6083]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2482635-6049-4358-94b5-f1cf8f5eeab4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7c3a174-a4ec-4200-9c27-73537ab3f5b5 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0f9cf8-7d00-4fa8-b957-b3151c593e84 tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)
Nov 16 03:53:14 user nova-compute[103546]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f (non-flash)
Nov 16 03:53:14 user nova-compute[103546]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2482635-6049-4358-94b5-f1cf8f5eeab4 (non-flash)
Nov 16 03:53:14 user nova-compute[103546]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7c3a174-a4ec-4200-9c27-73537ab3f5b5 (non-flash)
Nov 16 03:53:14 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0f9cf8-7d00-4fa8-b957-b3151c593e84 tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)
Nov 16 03:53:14 user nova-compute[103546]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f (non-flash)
Nov 16 03:53:14 user nova-compute[103546]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2482635-6049-4358-94b5-f1cf8f5eeab4 (non-flash)
Nov 16 03:53:14 user nova-compute[103546]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7c3a174-a4ec-4200-9c27-73537ab3f5b5 (non-flash)
Nov 16 03:53:14 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0f9cf8-7d00-4fa8-b957-b3151c593e84 tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60ac61aa70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7c3a174-a4ec-4200-9c27-73537ab3f5b5'): ({'sde'}, set())}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-eb0f9cf8-7d00-4fa8-b957-b3151c593e84 tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Removing single pathed devices sde {{(pid=103546) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63b95121-b211-42c3-831e-0392d4abd09a/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5382e5bf-1036-47c4-b940-9d3ec0c746d9]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[9772f694-8fa8-459d-aac6-72ad86a9996a]: (4, ('ok\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-eb0f9cf8-7d00-4fa8-b957-b3151c593e84 tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Flushing IO for device /dev/sde {{(pid=103546) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[eddabc8e-dd88-4c97-b9c6-cf417d8cef44]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-eb0f9cf8-7d00-4fa8-b957-b3151c593e84 tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=103546) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.052s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b407770d-2c5e-47ac-98f5-c23009fa2cbc]: (4, ('1', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-eb0f9cf8-7d00-4fa8-b957-b3151c593e84 tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-eb0f9cf8-7d00-4fa8-b957-b3151c593e84 tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] SCSI volumes sde have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0f9cf8-7d00-4fa8-b957-b3151c593e84 tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7c3a174-a4ec-4200-9c27-73537ab3f5b5')] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7c3a174-a4ec-4200-9c27-73537ab3f5b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7c3a174-a4ec-4200-9c27-73537ab3f5b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[efec357a-e3e2-41d4-858b-3b63279eebc1]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0f9cf8-7d00-4fa8-b957-b3151c593e84 tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7c3a174-a4ec-4200-9c27-73537ab3f5b5 -p 172.16.0.220:3260 --logout {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63b95121-b211-42c3-831e-0392d4abd09a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63b95121-b211-42c3-831e-0392d4abd09a/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7c3a174-a4ec-4200-9c27-73537ab3f5b5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[64377999-9d4f-405e-93e0-60e984c283ea]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:e7c3a174-a4ec-4200-9c27-73537ab3f5b5, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:e7c3a174-a4ec-4200-9c27-73537ab3f5b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0f9cf8-7d00-4fa8-b957-b3151c593e84 tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:e7c3a174-a4ec-4200-9c27-73537ab3f5b5, portal: 172.16.0.220,3260]
Nov 16 03:53:14 user nova-compute[103546]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:e7c3a174-a4ec-4200-9c27-73537ab3f5b5, portal: 172.16.0.220,3260] successful.
Nov 16 03:53:14 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7c3a174-a4ec-4200-9c27-73537ab3f5b5 -p 172.16.0.220:3260 --op delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7c3a174-a4ec-4200-9c27-73537ab3f5b5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[4efc18da-bf0f-44c3-9e72-bb5c42ab1469]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0f9cf8-7d00-4fa8-b957-b3151c593e84 tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-eb0f9cf8-7d00-4fa8-b957-b3151c593e84 tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0f9cf8-7d00-4fa8-b957-b3151c593e84 tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] <== disconnect_volume: return (350ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb0f9cf8-7d00-4fa8-b957-b3151c593e84 tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 03:53:14 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-eb0f9cf8-7d00-4fa8-b957-b3151c593e84 tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] Deleting instance files /opt/stack/data/nova/instances/6a9afa69-2674-46fc-8e30-e196928ff07c_del
Nov 16 03:53:14 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-eb0f9cf8-7d00-4fa8-b957-b3151c593e84 tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] Deletion of /opt/stack/data/nova/instances/6a9afa69-2674-46fc-8e30-e196928ff07c_del complete
Nov 16 03:53:14 user nova-compute[103546]: INFO nova.compute.manager [None req-eb0f9cf8-7d00-4fa8-b957-b3151c593e84 tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] Took 1.40 seconds to destroy the instance on the hypervisor.
Nov 16 03:53:14 user nova-compute[103546]: DEBUG oslo.service.loopingcall [None req-eb0f9cf8-7d00-4fa8-b957-b3151c593e84 tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=103546) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG nova.compute.manager [-] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] Deallocating network for instance {{(pid=103546) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 03:53:14 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] deallocate_for_instance() {{(pid=103546) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 03:53:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63b95121-b211-42c3-831e-0392d4abd09a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/164533fb-64e1-4aa5-b5fb-273817dd3e74/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/164533fb-64e1-4aa5-b5fb-273817dd3e74/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/164533fb-64e1-4aa5-b5fb-273817dd3e74/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/164533fb-64e1-4aa5-b5fb-273817dd3e74/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e2954-d786-4544-903d-8edc63646e2d/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e2954-d786-4544-903d-8edc63646e2d/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e2954-d786-4544-903d-8edc63646e2d/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e2954-d786-4544-903d-8edc63646e2d/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:15 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 03:53:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51554aab-44ec-4161-b926-9c07a3f838a5/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:15 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:53:15 user nova-compute[103546]: DEBUG nova.compute.manager [req-d814fced-a12c-456a-a9bf-5e18727fc8df req-c548b275-6e21-4143-8bb0-cd68eb40d3bd service nova] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] Received event network-vif-deleted-efdedcd3-0071-412e-bd4a-e2a518ee4bf9 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:53:15 user nova-compute[103546]: INFO nova.compute.manager [req-d814fced-a12c-456a-a9bf-5e18727fc8df req-c548b275-6e21-4143-8bb0-cd68eb40d3bd service nova] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] Neutron deleted interface efdedcd3-0071-412e-bd4a-e2a518ee4bf9; detaching it from the instance and deleting it from the info cache
Nov 16 03:53:15 user nova-compute[103546]: DEBUG nova.network.neutron [req-d814fced-a12c-456a-a9bf-5e18727fc8df req-c548b275-6e21-4143-8bb0-cd68eb40d3bd service nova] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:53:15 user nova-compute[103546]: INFO nova.compute.manager [-] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] Took 0.92 seconds to deallocate network for instance.
Nov 16 03:53:15 user nova-compute[103546]: DEBUG nova.compute.manager [req-d814fced-a12c-456a-a9bf-5e18727fc8df req-c548b275-6e21-4143-8bb0-cd68eb40d3bd service nova] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] Detach interface failed, port_id=efdedcd3-0071-412e-bd4a-e2a518ee4bf9, reason: Instance 6a9afa69-2674-46fc-8e30-e196928ff07c could not be found. {{(pid=103546) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 03:53:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51554aab-44ec-4161-b926-9c07a3f838a5/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51554aab-44ec-4161-b926-9c07a3f838a5/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:16 user nova-compute[103546]: DEBUG nova.compute.manager [req-eebb58b4-e2aa-4faa-ae76-87967157c342 req-61a32b85-fcf3-4ffd-bd43-46766b272f17 service nova] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] Received event network-vif-plugged-efdedcd3-0071-412e-bd4a-e2a518ee4bf9 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:53:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-eebb58b4-e2aa-4faa-ae76-87967157c342 req-61a32b85-fcf3-4ffd-bd43-46766b272f17 service nova] Acquiring lock "6a9afa69-2674-46fc-8e30-e196928ff07c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:53:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-eebb58b4-e2aa-4faa-ae76-87967157c342 req-61a32b85-fcf3-4ffd-bd43-46766b272f17 service nova] Lock "6a9afa69-2674-46fc-8e30-e196928ff07c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:53:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-eebb58b4-e2aa-4faa-ae76-87967157c342 req-61a32b85-fcf3-4ffd-bd43-46766b272f17 service nova] Lock "6a9afa69-2674-46fc-8e30-e196928ff07c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:53:16 user nova-compute[103546]: DEBUG nova.compute.manager [req-eebb58b4-e2aa-4faa-ae76-87967157c342 req-61a32b85-fcf3-4ffd-bd43-46766b272f17 service nova] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] No waiting events found dispatching network-vif-plugged-efdedcd3-0071-412e-bd4a-e2a518ee4bf9 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:53:16 user nova-compute[103546]: WARNING nova.compute.manager [req-eebb58b4-e2aa-4faa-ae76-87967157c342 req-61a32b85-fcf3-4ffd-bd43-46766b272f17 service nova] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] Received unexpected event network-vif-plugged-efdedcd3-0071-412e-bd4a-e2a518ee4bf9 for instance with vm_state active and task_state deleting.
Nov 16 03:53:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51554aab-44ec-4161-b926-9c07a3f838a5/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:16 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 03:53:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:16 user nova-compute[103546]: INFO nova.compute.manager [None req-eb0f9cf8-7d00-4fa8-b957-b3151c593e84 tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] [instance: 6a9afa69-2674-46fc-8e30-e196928ff07c] Took 0.76 seconds to detach 1 volumes for instance.
Nov 16 03:53:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-eb0f9cf8-7d00-4fa8-b957-b3151c593e84 tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:53:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-eb0f9cf8-7d00-4fa8-b957-b3151c593e84 tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:53:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:16 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Error from libvirt while getting description of instance-00000011: [Error Code 42] Domain not found: no domain with matching uuid '6a9afa69-2674-46fc-8e30-e196928ff07c' (instance-00000011): libvirt.libvirtError: Domain not found: no domain with matching uuid '6a9afa69-2674-46fc-8e30-e196928ff07c' (instance-00000011)
Nov 16 03:53:17 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:53:17 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:53:17 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Hypervisor/Node resource view: name=user free_ram=7736MB free_disk=25.398765563964844GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=103546) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 03:53:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:53:17 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-eb0f9cf8-7d00-4fa8-b957-b3151c593e84 tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:53:17 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-eb0f9cf8-7d00-4fa8-b957-b3151c593e84 tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:53:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-eb0f9cf8-7d00-4fa8-b957-b3151c593e84 tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.766s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:53:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.193s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:53:17 user nova-compute[103546]: INFO nova.scheduler.client.report [None req-eb0f9cf8-7d00-4fa8-b957-b3151c593e84 tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Deleted allocations for instance 6a9afa69-2674-46fc-8e30-e196928ff07c
Nov 16 03:53:17 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 279e2954-d786-4544-903d-8edc63646e2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:53:17 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 63b95121-b211-42c3-831e-0392d4abd09a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:53:17 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 51554aab-44ec-4161-b926-9c07a3f838a5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:53:17 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 9a89970b-fc61-4419-8ff9-b48013dccf9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:53:17 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 04101512-7333-4581-add3-7af3821e335b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:53:17 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 58e02332-2918-4744-a8f7-90e28391d391 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:53:17 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 164533fb-64e1-4aa5-b5fb-273817dd3e74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:53:17 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 03:53:17 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 03:53:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-eb0f9cf8-7d00-4fa8-b957-b3151c593e84 tempest-DeleteServersTestJSON-750089832 tempest-DeleteServersTestJSON-750089832-project-member] Lock "6a9afa69-2674-46fc-8e30-e196928ff07c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.121s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:53:17 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:53:17 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:53:17 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Compute_service record updated for user:user {{(pid=103546) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 03:53:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.397s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:53:18 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:18 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:53:18 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:53:18 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Starting heal instance info cache {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 03:53:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "refresh_cache-51554aab-44ec-4161-b926-9c07a3f838a5" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:53:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquired lock "refresh_cache-51554aab-44ec-4161-b926-9c07a3f838a5" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:53:19 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Forcefully refreshing network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 03:53:19 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Updating instance_info_cache with network_info: [{"id": "e36fae5d-773f-47c0-b79a-5aadf6412cbc", "address": "fa:16:3e:9a:45:d0", "network": {"id": "ef471a6e-7bd1-4a61-aa01-fd7557bfae1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-865941926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76ca2da0c584a7382040eb113da4c2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape36fae5d-77", "ovs_interfaceid": "e36fae5d-773f-47c0-b79a-5aadf6412cbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:53:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Releasing lock "refresh_cache-51554aab-44ec-4161-b926-9c07a3f838a5" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:53:19 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Updated the network info_cache for instance {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 03:53:19 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:53:19 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:23 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:24 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:25 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:27 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-1c3ee634-f2c1-496d-b074-acb1011244a7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 63b95121-b211-42c3-831e-0392d4abd09a is timed out.
Nov 16 03:53:27 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-1c3ee634-f2c1-496d-b074-acb1011244a7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Successfully detached device vdb from instance 63b95121-b211-42c3-831e-0392d4abd09a from the live domain config.
Nov 16 03:53:27 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c3ee634-f2c1-496d-b074-acb1011244a7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 03:53:27 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3ee634-f2c1-496d-b074-acb1011244a7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:e2482635-6049-4358-94b5-f1cf8f5eeab4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yaCQVzXv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:53:27 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-1c3ee634-f2c1-496d-b074-acb1011244a7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:53:27 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-1c3ee634-f2c1-496d-b074-acb1011244a7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:53:27 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-1c3ee634-f2c1-496d-b074-acb1011244a7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:53:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:27 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[48bd0659-25d3-4879-99b9-c73b7b1a6aa1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2482635-6049-4358-94b5-f1cf8f5eeab4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:53:27 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3ee634-f2c1-496d-b074-acb1011244a7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 03:53:27 user nova-compute[103546]: No targets found.
Nov 16 03:53:27 user nova-compute[103546]: iSNS:
Nov 16 03:53:27 user nova-compute[103546]: No targets found.
Nov 16 03:53:27 user nova-compute[103546]: STATIC:
Nov 16 03:53:27 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f
Nov 16 03:53:27 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:53:27 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:53:27 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c
Nov 16 03:53:27 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:53:27 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:53:27 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:e2482635-6049-4358-94b5-f1cf8f5eeab4
Nov 16 03:53:27 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:53:27 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:53:27 user nova-compute[103546]: FIRMWARE:
Nov 16 03:53:27 user nova-compute[103546]: No targets found.
Nov 16 03:53:27 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:53:27 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3ee634-f2c1-496d-b074-acb1011244a7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 03:53:27 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 03:53:27 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 03:53:27 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3ee634-f2c1-496d-b074-acb1011244a7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2482635-6049-4358-94b5-f1cf8f5eeab4', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 03:53:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:27 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[27964855-f69f-42b8-b15a-ccb57fbaefb2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2482635-6049-4358-94b5-f1cf8f5eeab4\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:53:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:27 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b999be-5fc1-4223-9280-3b00fc7905da]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2482635-6049-4358-94b5-f1cf8f5eeab4 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:53:27 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3ee634-f2c1-496d-b074-acb1011244a7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)
Nov 16 03:53:27 user nova-compute[103546]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f (non-flash)
Nov 16 03:53:27 user nova-compute[103546]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2482635-6049-4358-94b5-f1cf8f5eeab4 (non-flash)
Nov 16 03:53:27 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:53:27 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3ee634-f2c1-496d-b074-acb1011244a7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)
Nov 16 03:53:27 user nova-compute[103546]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f (non-flash)
Nov 16 03:53:27 user nova-compute[103546]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2482635-6049-4358-94b5-f1cf8f5eeab4 (non-flash)
Nov 16 03:53:27 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:53:27 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3ee634-f2c1-496d-b074-acb1011244a7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60ac5bed40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2482635-6049-4358-94b5-f1cf8f5eeab4'): ({'sdc'}, set())}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 03:53:27 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-1c3ee634-f2c1-496d-b074-acb1011244a7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Removing single pathed devices sdc {{(pid=103546) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 03:53:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:27 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d806ebb0-90ea-46b1-87b1-31fe62de5129]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:53:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:27 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3210beb7-ef34-4e16-bc4c-2c3c8b87eaa7]: (4, ('ok\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:53:27 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-1c3ee634-f2c1-496d-b074-acb1011244a7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Flushing IO for device /dev/sdc {{(pid=103546) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 03:53:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:27 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[68db0a3e-0d1b-4a92-bbb3-e100ec51a77e]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:53:27 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-1c3ee634-f2c1-496d-b074-acb1011244a7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=103546) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 03:53:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:27 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[be72e4ff-3023-4f5c-be88-12806a8e963e]: (4, ('1', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:53:27 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-1c3ee634-f2c1-496d-b074-acb1011244a7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 03:53:27 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-1c3ee634-f2c1-496d-b074-acb1011244a7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] SCSI volumes sdc have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 03:53:27 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3ee634-f2c1-496d-b074-acb1011244a7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2482635-6049-4358-94b5-f1cf8f5eeab4')] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 03:53:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2482635-6049-4358-94b5-f1cf8f5eeab4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2482635-6049-4358-94b5-f1cf8f5eeab4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:28 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dbc0a48-bfa6-422b-92d1-b9af7e3a15b7]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:53:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3ee634-f2c1-496d-b074-acb1011244a7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:53:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2482635-6049-4358-94b5-f1cf8f5eeab4 -p 172.16.0.220:3260 --logout {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2482635-6049-4358-94b5-f1cf8f5eeab4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:28 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ef2bf7-5693-46bc-af51-316e02aba0fe]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:e2482635-6049-4358-94b5-f1cf8f5eeab4, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:e2482635-6049-4358-94b5-f1cf8f5eeab4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:53:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3ee634-f2c1-496d-b074-acb1011244a7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:e2482635-6049-4358-94b5-f1cf8f5eeab4, portal: 172.16.0.220,3260]
Nov 16 03:53:28 user nova-compute[103546]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:e2482635-6049-4358-94b5-f1cf8f5eeab4, portal: 172.16.0.220,3260] successful.
Nov 16 03:53:28 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:53:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2482635-6049-4358-94b5-f1cf8f5eeab4 -p 172.16.0.220:3260 --op delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2482635-6049-4358-94b5-f1cf8f5eeab4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:28 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[599009b3-fa2b-408a-b688-2c03c17d7e2a]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:53:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3ee634-f2c1-496d-b074-acb1011244a7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:53:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-1c3ee634-f2c1-496d-b074-acb1011244a7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:53:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3ee634-f2c1-496d-b074-acb1011244a7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] <== disconnect_volume: return (310ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:53:28 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c3ee634-f2c1-496d-b074-acb1011244a7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 03:53:28 user nova-compute[103546]: DEBUG nova.objects.instance [None req-1c3ee634-f2c1-496d-b074-acb1011244a7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lazy-loading 'flavor' on Instance uuid 63b95121-b211-42c3-831e-0392d4abd09a {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:53:28 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1c3ee634-f2c1-496d-b074-acb1011244a7 tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "63b95121-b211-42c3-831e-0392d4abd09a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.711s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:53:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:30 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-9c3a51d7-3efc-4aed-8318-2af4104c92d2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquiring lock "58e02332-2918-4744-a8f7-90e28391d391" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:53:30 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-9c3a51d7-3efc-4aed-8318-2af4104c92d2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "58e02332-2918-4744-a8f7-90e28391d391" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:53:30 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-9c3a51d7-3efc-4aed-8318-2af4104c92d2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquiring lock "58e02332-2918-4744-a8f7-90e28391d391-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:53:30 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-9c3a51d7-3efc-4aed-8318-2af4104c92d2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "58e02332-2918-4744-a8f7-90e28391d391-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:53:30 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-9c3a51d7-3efc-4aed-8318-2af4104c92d2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "58e02332-2918-4744-a8f7-90e28391d391-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:53:30 user nova-compute[103546]: INFO nova.compute.manager [None req-9c3a51d7-3efc-4aed-8318-2af4104c92d2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Terminating instance
Nov 16 03:53:30 user nova-compute[103546]: DEBUG nova.compute.manager [None req-9c3a51d7-3efc-4aed-8318-2af4104c92d2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Start destroying the instance on the hypervisor. {{(pid=103546) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 03:53:30 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:30 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:30 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:30 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:30 user nova-compute[103546]: DEBUG nova.compute.manager [req-bb6ef280-f3c2-4650-a9b2-786407c1d1ac req-421a30a5-5f0d-4548-92bd-e4cc9456e8eb service nova] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Received event network-vif-unplugged-e889fe81-2735-4713-907e-44c70f25a06b {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:53:30 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-bb6ef280-f3c2-4650-a9b2-786407c1d1ac req-421a30a5-5f0d-4548-92bd-e4cc9456e8eb service nova] Acquiring lock "58e02332-2918-4744-a8f7-90e28391d391-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:53:30 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-bb6ef280-f3c2-4650-a9b2-786407c1d1ac req-421a30a5-5f0d-4548-92bd-e4cc9456e8eb service nova] Lock "58e02332-2918-4744-a8f7-90e28391d391-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:53:30 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-bb6ef280-f3c2-4650-a9b2-786407c1d1ac req-421a30a5-5f0d-4548-92bd-e4cc9456e8eb service nova] Lock "58e02332-2918-4744-a8f7-90e28391d391-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:53:30 user nova-compute[103546]: DEBUG nova.compute.manager [req-bb6ef280-f3c2-4650-a9b2-786407c1d1ac req-421a30a5-5f0d-4548-92bd-e4cc9456e8eb service nova] [instance: 58e02332-2918-4744-a8f7-90e28391d391] No waiting events found dispatching network-vif-unplugged-e889fe81-2735-4713-907e-44c70f25a06b {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:53:30 user nova-compute[103546]: DEBUG nova.compute.manager [req-bb6ef280-f3c2-4650-a9b2-786407c1d1ac req-421a30a5-5f0d-4548-92bd-e4cc9456e8eb service nova] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Received event network-vif-unplugged-e889fe81-2735-4713-907e-44c70f25a06b for instance with task_state deleting. {{(pid=103546) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 03:53:30 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Instance destroyed successfully.
Nov 16 03:53:30 user nova-compute[103546]: DEBUG nova.objects.instance [None req-9c3a51d7-3efc-4aed-8318-2af4104c92d2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lazy-loading 'resources' on Instance uuid 58e02332-2918-4744-a8f7-90e28391d391 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:53:30 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-9c3a51d7-3efc-4aed-8318-2af4104c92d2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:51:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-345528758',display_name='tempest-TestVolumeBootPattern-server-345528758',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-345528758',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:51:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='40ce50192a9743b59a9430163dd6a51c',ramdisk_id='',reservation_id='r-7ksw0p8n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1283031547',owner_user_name='tempest-TestVolumeBootPattern-1283031547-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T03:51:56Z,user_data=None,user_id='ab77040a7b9846d28dc08852d678d1ed',uuid=58e02332-2918-4744-a8f7-90e28391d391,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e889fe81-2735-4713-907e-44c70f25a06b", "address": "fa:16:3e:c8:1f:ad", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape889fe81-27", "ovs_interfaceid": "e889fe81-2735-4713-907e-44c70f25a06b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 03:53:30 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-9c3a51d7-3efc-4aed-8318-2af4104c92d2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Converting VIF {"id": "e889fe81-2735-4713-907e-44c70f25a06b", "address": "fa:16:3e:c8:1f:ad", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape889fe81-27", "ovs_interfaceid": "e889fe81-2735-4713-907e-44c70f25a06b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:53:30 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-9c3a51d7-3efc-4aed-8318-2af4104c92d2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:1f:ad,bridge_name='br-int',has_traffic_filtering=True,id=e889fe81-2735-4713-907e-44c70f25a06b,network=Network(a13f532d-a30d-4c06-83fe-760bcffae183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape889fe81-27') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:53:30 user nova-compute[103546]: DEBUG os_vif [None req-9c3a51d7-3efc-4aed-8318-2af4104c92d2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:1f:ad,bridge_name='br-int',has_traffic_filtering=True,id=e889fe81-2735-4713-907e-44c70f25a06b,network=Network(a13f532d-a30d-4c06-83fe-760bcffae183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape889fe81-27') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 03:53:30 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:30 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape889fe81-27, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:53:30 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:53:30 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:30 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:30 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=97b67cb7-6458-4340-bd66-3a93a9111c46) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:53:30 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:53:30 user nova-compute[103546]: INFO os_vif [None req-9c3a51d7-3efc-4aed-8318-2af4104c92d2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:1f:ad,bridge_name='br-int',has_traffic_filtering=True,id=e889fe81-2735-4713-907e-44c70f25a06b,network=Network(a13f532d-a30d-4c06-83fe-760bcffae183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape889fe81-27')
Nov 16 03:53:30 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c3a51d7-3efc-4aed-8318-2af4104c92d2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 58e02332-2918-4744-a8f7-90e28391d391] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 03:53:30 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3a51d7-3efc-4aed-8318-2af4104c92d2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kjVUvHxt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:53:30 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-9c3a51d7-3efc-4aed-8318-2af4104c92d2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:53:30 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-9c3a51d7-3efc-4aed-8318-2af4104c92d2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:53:30 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-9c3a51d7-3efc-4aed-8318-2af4104c92d2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:53:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:30 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[334f0fd8-c5a1-4e04-9a92-4677802fefa7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:53:30 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3a51d7-3efc-4aed-8318-2af4104c92d2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 03:53:30 user nova-compute[103546]: No targets found.
Nov 16 03:53:30 user nova-compute[103546]: iSNS:
Nov 16 03:53:30 user nova-compute[103546]: No targets found.
Nov 16 03:53:30 user nova-compute[103546]: STATIC:
Nov 16 03:53:30 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f
Nov 16 03:53:30 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:53:30 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:53:30 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c
Nov 16 03:53:30 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:53:30 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:53:30 user nova-compute[103546]: FIRMWARE:
Nov 16 03:53:30 user nova-compute[103546]: No targets found.
Nov 16 03:53:30 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:53:30 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3a51d7-3efc-4aed-8318-2af4104c92d2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 03:53:30 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 03:53:30 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 03:53:30 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3a51d7-3efc-4aed-8318-2af4104c92d2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 03:53:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:30 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[76132392-3744-44bf-b7e5-5671069ed817]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:53:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:30 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb5da2b-c11b-4c64-b781-641448f47dc7]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:53:30 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3a51d7-3efc-4aed-8318-2af4104c92d2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)
Nov 16 03:53:30 user nova-compute[103546]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f (non-flash)
Nov 16 03:53:30 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:53:30 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3a51d7-3efc-4aed-8318-2af4104c92d2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)
Nov 16 03:53:30 user nova-compute[103546]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f (non-flash)
Nov 16 03:53:30 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:53:30 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3a51d7-3efc-4aed-8318-2af4104c92d2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60d0e29870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f'): ({'sdd'}, set())}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 03:53:30 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-9c3a51d7-3efc-4aed-8318-2af4104c92d2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Removing single pathed devices sdd {{(pid=103546) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 03:53:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:30 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c7837d-15f7-4c8e-bcbd-3e8f87e9b263]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:53:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:31 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3cd894-6889-488f-a14e-fa0c75abf3f2]: (4, ('ok\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:53:31 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-9c3a51d7-3efc-4aed-8318-2af4104c92d2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Flushing IO for device /dev/sdd {{(pid=103546) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 03:53:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:31 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[162a81d7-712c-486a-96f3-681e050c45b0]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:53:31 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-9c3a51d7-3efc-4aed-8318-2af4104c92d2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=103546) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 03:53:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:31 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0876b4-fd56-42b7-8e76-ff6a62664812]: (4, ('1', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:53:31 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-9c3a51d7-3efc-4aed-8318-2af4104c92d2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 03:53:31 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-9c3a51d7-3efc-4aed-8318-2af4104c92d2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] SCSI volumes sdd have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 03:53:31 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3a51d7-3efc-4aed-8318-2af4104c92d2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f')] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 03:53:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:31 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0c5073-68ba-4a0f-9bd0-c6afb1ba2bb7]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:53:31 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3a51d7-3efc-4aed-8318-2af4104c92d2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:53:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f -p 172.16.0.220:3260 --logout {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:31 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54e5542-77df-4357-8115-d29a31bb9f3a]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:53:31 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3a51d7-3efc-4aed-8318-2af4104c92d2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f, portal: 172.16.0.220,3260]
Nov 16 03:53:31 user nova-compute[103546]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f, portal: 172.16.0.220,3260] successful.
Nov 16 03:53:31 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:53:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f -p 172.16.0.220:3260 --op delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de115f8d-692c-40cc-96ba-2adc6acaa54f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:31 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f7704a-2cd7-4d62-97c4-2005071119f3]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:53:31 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3a51d7-3efc-4aed-8318-2af4104c92d2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:53:31 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-9c3a51d7-3efc-4aed-8318-2af4104c92d2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:53:31 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3a51d7-3efc-4aed-8318-2af4104c92d2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] <== disconnect_volume: return (324ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:53:31 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c3a51d7-3efc-4aed-8318-2af4104c92d2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 03:53:31 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-9c3a51d7-3efc-4aed-8318-2af4104c92d2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Deleting instance files /opt/stack/data/nova/instances/58e02332-2918-4744-a8f7-90e28391d391_del
Nov 16 03:53:31 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-9c3a51d7-3efc-4aed-8318-2af4104c92d2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Deletion of /opt/stack/data/nova/instances/58e02332-2918-4744-a8f7-90e28391d391_del complete
Nov 16 03:53:31 user nova-compute[103546]: INFO nova.compute.manager [None req-9c3a51d7-3efc-4aed-8318-2af4104c92d2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Took 1.27 seconds to destroy the instance on the hypervisor.
Nov 16 03:53:31 user nova-compute[103546]: DEBUG oslo.service.loopingcall [None req-9c3a51d7-3efc-4aed-8318-2af4104c92d2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=103546) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 03:53:31 user nova-compute[103546]: DEBUG nova.compute.manager [-] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Deallocating network for instance {{(pid=103546) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 03:53:31 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 58e02332-2918-4744-a8f7-90e28391d391] deallocate_for_instance() {{(pid=103546) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 03:53:32 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:53:32 user nova-compute[103546]: INFO nova.compute.manager [-] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Took 0.75 seconds to deallocate network for instance.
Nov 16 03:53:32 user nova-compute[103546]: DEBUG nova.compute.manager [req-2b96b8b3-64ef-468b-b193-8e21ee2ddce2 req-975b5fb5-5144-4180-9d05-ec899a600fc4 service nova] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Received event network-vif-deleted-e889fe81-2735-4713-907e-44c70f25a06b {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:53:32 user nova-compute[103546]: INFO nova.compute.manager [req-2b96b8b3-64ef-468b-b193-8e21ee2ddce2 req-975b5fb5-5144-4180-9d05-ec899a600fc4 service nova] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Neutron deleted interface e889fe81-2735-4713-907e-44c70f25a06b; detaching it from the instance and deleting it from the info cache
Nov 16 03:53:32 user nova-compute[103546]: DEBUG nova.network.neutron [req-2b96b8b3-64ef-468b-b193-8e21ee2ddce2 req-975b5fb5-5144-4180-9d05-ec899a600fc4 service nova] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:53:32 user nova-compute[103546]: DEBUG nova.compute.manager [req-2b96b8b3-64ef-468b-b193-8e21ee2ddce2 req-975b5fb5-5144-4180-9d05-ec899a600fc4 service nova] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Detach interface failed, port_id=e889fe81-2735-4713-907e-44c70f25a06b, reason: Instance 58e02332-2918-4744-a8f7-90e28391d391 could not be found. {{(pid=103546) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 03:53:32 user nova-compute[103546]: DEBUG nova.compute.manager [req-ca84249c-27be-44ec-92b6-30bb4581d029 req-f9fb58c6-6373-455c-ba4e-40591ac9bc8b service nova] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Received event network-vif-plugged-e889fe81-2735-4713-907e-44c70f25a06b {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:53:32 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ca84249c-27be-44ec-92b6-30bb4581d029 req-f9fb58c6-6373-455c-ba4e-40591ac9bc8b service nova] Acquiring lock "58e02332-2918-4744-a8f7-90e28391d391-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:53:32 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ca84249c-27be-44ec-92b6-30bb4581d029 req-f9fb58c6-6373-455c-ba4e-40591ac9bc8b service nova] Lock "58e02332-2918-4744-a8f7-90e28391d391-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:53:32 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ca84249c-27be-44ec-92b6-30bb4581d029 req-f9fb58c6-6373-455c-ba4e-40591ac9bc8b service nova] Lock "58e02332-2918-4744-a8f7-90e28391d391-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:53:32 user nova-compute[103546]: DEBUG nova.compute.manager [req-ca84249c-27be-44ec-92b6-30bb4581d029 req-f9fb58c6-6373-455c-ba4e-40591ac9bc8b service nova] [instance: 58e02332-2918-4744-a8f7-90e28391d391] No waiting events found dispatching network-vif-plugged-e889fe81-2735-4713-907e-44c70f25a06b {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:53:32 user nova-compute[103546]: WARNING nova.compute.manager [req-ca84249c-27be-44ec-92b6-30bb4581d029 req-f9fb58c6-6373-455c-ba4e-40591ac9bc8b service nova] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Received unexpected event network-vif-plugged-e889fe81-2735-4713-907e-44c70f25a06b for instance with vm_state active and task_state deleting.
Nov 16 03:53:32 user nova-compute[103546]: INFO nova.compute.manager [None req-9c3a51d7-3efc-4aed-8318-2af4104c92d2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Took 0.81 seconds to detach 1 volumes for instance.
Nov 16 03:53:32 user nova-compute[103546]: DEBUG nova.compute.manager [None req-9c3a51d7-3efc-4aed-8318-2af4104c92d2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 58e02332-2918-4744-a8f7-90e28391d391] Deleting volume: de115f8d-692c-40cc-96ba-2adc6acaa54f {{(pid=103546) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 16 03:53:33 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-9c3a51d7-3efc-4aed-8318-2af4104c92d2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:53:33 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-9c3a51d7-3efc-4aed-8318-2af4104c92d2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:53:33 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-9c3a51d7-3efc-4aed-8318-2af4104c92d2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:53:33 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-9c3a51d7-3efc-4aed-8318-2af4104c92d2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:53:33 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-9c3a51d7-3efc-4aed-8318-2af4104c92d2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.296s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:53:33 user nova-compute[103546]: INFO nova.scheduler.client.report [None req-9c3a51d7-3efc-4aed-8318-2af4104c92d2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Deleted allocations for instance 58e02332-2918-4744-a8f7-90e28391d391
Nov 16 03:53:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:33 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-9c3a51d7-3efc-4aed-8318-2af4104c92d2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "58e02332-2918-4744-a8f7-90e28391d391" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.392s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:53:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:34 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Acquiring lock "4edd4240-a8e3-4f7d-ad89-795d294b72df" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:53:34 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Lock "4edd4240-a8e3-4f7d-ad89-795d294b72df" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:53:34 user nova-compute[103546]: DEBUG nova.compute.manager [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] Starting instance... {{(pid=103546) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 03:53:34 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:53:34 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:53:34 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=103546) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 03:53:34 user nova-compute[103546]: INFO nova.compute.claims [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] Claim successful on node user
Nov 16 03:53:35 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:53:35 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:53:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.502s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:53:35 user nova-compute[103546]: DEBUG nova.compute.manager [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] Start building networks asynchronously for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 03:53:35 user nova-compute[103546]: DEBUG nova.compute.manager [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] Allocating IP information in the background. {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 03:53:35 user nova-compute[103546]: DEBUG nova.network.neutron [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] allocate_for_instance() {{(pid=103546) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 03:53:35 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 03:53:35 user nova-compute[103546]: DEBUG nova.compute.manager [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] Start building block device mappings for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 03:53:35 user nova-compute[103546]: DEBUG nova.policy [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '29f86d0d50ff44e79cf3c37416a5b632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db9ce0a02204d269a3beac9459f5c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103546) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 03:53:35 user nova-compute[103546]: DEBUG nova.compute.manager [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] Start spawning the instance on the hypervisor. {{(pid=103546) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 03:53:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] Creating instance directory {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 03:53:35 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] Creating image(s)
Nov 16 03:53:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Acquiring lock "/opt/stack/data/nova/instances/4edd4240-a8e3-4f7d-ad89-795d294b72df/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:53:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Lock "/opt/stack/data/nova/instances/4edd4240-a8e3-4f7d-ad89-795d294b72df/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:53:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Lock "/opt/stack/data/nova/instances/4edd4240-a8e3-4f7d-ad89-795d294b72df/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:53:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.181s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Acquiring lock "8c9efafb670bfe5842ba1f4ce398924612164af7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:53:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:53:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.186s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/4edd4240-a8e3-4f7d-ad89-795d294b72df/disk 1073741824 {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/4edd4240-a8e3-4f7d-ad89-795d294b72df/disk 1073741824" returned: 0 in 0.058s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:36 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:53:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:36 user nova-compute[103546]: DEBUG nova.network.neutron [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] Successfully created port: c7a5f1de-8036-4fb3-aaf0-78dce691474a {{(pid=103546) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 03:53:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.196s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:36 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4edd4240-a8e3-4f7d-ad89-795d294b72df/disk. size=1073741824 {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 03:53:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4edd4240-a8e3-4f7d-ad89-795d294b72df/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4edd4240-a8e3-4f7d-ad89-795d294b72df/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:36 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Cannot resize image /opt/stack/data/nova/instances/4edd4240-a8e3-4f7d-ad89-795d294b72df/disk to a smaller size. {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 03:53:36 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] Created local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 03:53:36 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] Ensure instance console log exists: /opt/stack/data/nova/instances/4edd4240-a8e3-4f7d-ad89-795d294b72df/console.log {{(pid=103546) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 03:53:36 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:53:36 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:53:36 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:53:36 user nova-compute[103546]: DEBUG nova.network.neutron [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] Successfully updated port: c7a5f1de-8036-4fb3-aaf0-78dce691474a {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 03:53:36 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Acquiring lock "refresh_cache-4edd4240-a8e3-4f7d-ad89-795d294b72df" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:53:36 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Acquired lock "refresh_cache-4edd4240-a8e3-4f7d-ad89-795d294b72df" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:53:36 user nova-compute[103546]: DEBUG nova.network.neutron [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 03:53:36 user nova-compute[103546]: DEBUG nova.compute.manager [req-d58882ed-eea8-442e-b3dc-50820a81418f req-5f05e18f-1349-4f5a-9822-a960e2c9ef35 service nova] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] Received event network-changed-c7a5f1de-8036-4fb3-aaf0-78dce691474a {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:53:36 user nova-compute[103546]: DEBUG nova.compute.manager [req-d58882ed-eea8-442e-b3dc-50820a81418f req-5f05e18f-1349-4f5a-9822-a960e2c9ef35 service nova] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] Refreshing instance network info cache due to event network-changed-c7a5f1de-8036-4fb3-aaf0-78dce691474a. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:53:36 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d58882ed-eea8-442e-b3dc-50820a81418f req-5f05e18f-1349-4f5a-9822-a960e2c9ef35 service nova] Acquiring lock "refresh_cache-4edd4240-a8e3-4f7d-ad89-795d294b72df" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:53:36 user nova-compute[103546]: DEBUG nova.network.neutron [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 03:53:37 user nova-compute[103546]: DEBUG nova.network.neutron [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] Updating instance_info_cache with network_info: [{"id": "c7a5f1de-8036-4fb3-aaf0-78dce691474a", "address": "fa:16:3e:28:80:5b", "network": {"id": "f27a9ae1-0635-4b3b-858d-fa6524d15c2d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-73312216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8db9ce0a02204d269a3beac9459f5c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7a5f1de-80", "ovs_interfaceid": "c7a5f1de-8036-4fb3-aaf0-78dce691474a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:53:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Releasing lock "refresh_cache-4edd4240-a8e3-4f7d-ad89-795d294b72df" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:53:37 user nova-compute[103546]: DEBUG nova.compute.manager [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] Instance network_info: |[{"id": "c7a5f1de-8036-4fb3-aaf0-78dce691474a", "address": "fa:16:3e:28:80:5b", "network": {"id": "f27a9ae1-0635-4b3b-858d-fa6524d15c2d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-73312216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8db9ce0a02204d269a3beac9459f5c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7a5f1de-80", "ovs_interfaceid": "c7a5f1de-8036-4fb3-aaf0-78dce691474a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 03:53:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d58882ed-eea8-442e-b3dc-50820a81418f req-5f05e18f-1349-4f5a-9822-a960e2c9ef35 service nova] Acquired lock "refresh_cache-4edd4240-a8e3-4f7d-ad89-795d294b72df" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:53:37 user nova-compute[103546]: DEBUG nova.network.neutron [req-d58882ed-eea8-442e-b3dc-50820a81418f req-5f05e18f-1349-4f5a-9822-a960e2c9ef35 service nova] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] Refreshing network info cache for port c7a5f1de-8036-4fb3-aaf0-78dce691474a {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:53:37 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] Start _get_guest_xml network_info=[{"id": "c7a5f1de-8036-4fb3-aaf0-78dce691474a", "address": "fa:16:3e:28:80:5b", "network": {"id": "f27a9ae1-0635-4b3b-858d-fa6524d15c2d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-73312216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8db9ce0a02204d269a3beac9459f5c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7a5f1de-80", "ovs_interfaceid": "c7a5f1de-8036-4fb3-aaf0-78dce691474a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '5c6f539a-01e5-4478-bf8f-a14310b5d7dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 03:53:37 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:53:37 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:53:37 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 03:53:37 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 03:53:37 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 03:53:37 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 03:53:37 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 03:53:37 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 03:53:37 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 03:53:37 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 03:53:37 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 03:53:37 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 03:53:37 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 03:53:37 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 03:53:37 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 03:53:37 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 03:53:37 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 03:53:37 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 03:53:37 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-915501901',display_name='tempest-VolumesActionsTest-instance-915501901',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-915501901',id=20,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8db9ce0a02204d269a3beac9459f5c8a',ramdisk_id='',reservation_id='r-q1kaocuy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1514502681',owner_user_name='tempest-VolumesActionsTest-1514502681-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:53:36Z,user_data=None,user_id='29f86d0d50ff44e79cf3c37416a5b632',uuid=4edd4240-a8e3-4f7d-ad89-795d294b72df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7a5f1de-8036-4fb3-aaf0-78dce691474a", "address": "fa:16:3e:28:80:5b", "network": {"id": "f27a9ae1-0635-4b3b-858d-fa6524d15c2d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-73312216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8db9ce0a02204d269a3beac9459f5c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7a5f1de-80", "ovs_interfaceid": "c7a5f1de-8036-4fb3-aaf0-78dce691474a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 03:53:37 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Converting VIF {"id": "c7a5f1de-8036-4fb3-aaf0-78dce691474a", "address": "fa:16:3e:28:80:5b", "network": {"id": "f27a9ae1-0635-4b3b-858d-fa6524d15c2d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-73312216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8db9ce0a02204d269a3beac9459f5c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7a5f1de-80", "ovs_interfaceid": "c7a5f1de-8036-4fb3-aaf0-78dce691474a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:53:37 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:80:5b,bridge_name='br-int',has_traffic_filtering=True,id=c7a5f1de-8036-4fb3-aaf0-78dce691474a,network=Network(f27a9ae1-0635-4b3b-858d-fa6524d15c2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7a5f1de-80') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:53:37 user nova-compute[103546]: DEBUG nova.objects.instance [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Lazy-loading 'pci_devices' on Instance uuid 4edd4240-a8e3-4f7d-ad89-795d294b72df {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:53:37 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] End _get_guest_xml xml=<domain type="kvm">
Nov 16 03:53:37 user nova-compute[103546]:   <uuid>4edd4240-a8e3-4f7d-ad89-795d294b72df</uuid>
Nov 16 03:53:37 user nova-compute[103546]:   <name>instance-00000014</name>
Nov 16 03:53:37 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 03:53:37 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 03:53:37 user nova-compute[103546]:   <metadata>
Nov 16 03:53:37 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 03:53:37 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 03:53:37 user nova-compute[103546]:       <nova:name>tempest-VolumesActionsTest-instance-915501901</nova:name>
Nov 16 03:53:37 user nova-compute[103546]:       <nova:creationTime>2023-11-16 03:53:37</nova:creationTime>
Nov 16 03:53:37 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 03:53:37 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 03:53:37 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 03:53:37 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 03:53:37 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 03:53:37 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 03:53:37 user nova-compute[103546]:       </nova:flavor>
Nov 16 03:53:37 user nova-compute[103546]:       <nova:owner>
Nov 16 03:53:37 user nova-compute[103546]:         <nova:user uuid="29f86d0d50ff44e79cf3c37416a5b632">tempest-VolumesActionsTest-1514502681-project-member</nova:user>
Nov 16 03:53:37 user nova-compute[103546]:         <nova:project uuid="8db9ce0a02204d269a3beac9459f5c8a">tempest-VolumesActionsTest-1514502681</nova:project>
Nov 16 03:53:37 user nova-compute[103546]:       </nova:owner>
Nov 16 03:53:37 user nova-compute[103546]:       <nova:root type="image" uuid="5c6f539a-01e5-4478-bf8f-a14310b5d7dd"/>
Nov 16 03:53:37 user nova-compute[103546]:       <nova:ports>
Nov 16 03:53:37 user nova-compute[103546]:         <nova:port uuid="c7a5f1de-8036-4fb3-aaf0-78dce691474a">
Nov 16 03:53:37 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 16 03:53:37 user nova-compute[103546]:         </nova:port>
Nov 16 03:53:37 user nova-compute[103546]:       </nova:ports>
Nov 16 03:53:37 user nova-compute[103546]:     </nova:instance>
Nov 16 03:53:37 user nova-compute[103546]:   </metadata>
Nov 16 03:53:37 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 03:53:37 user nova-compute[103546]:     <system>
Nov 16 03:53:37 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 03:53:37 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 03:53:37 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 03:53:37 user nova-compute[103546]:       <entry name="serial">4edd4240-a8e3-4f7d-ad89-795d294b72df</entry>
Nov 16 03:53:37 user nova-compute[103546]:       <entry name="uuid">4edd4240-a8e3-4f7d-ad89-795d294b72df</entry>
Nov 16 03:53:37 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 03:53:37 user nova-compute[103546]:     </system>
Nov 16 03:53:37 user nova-compute[103546]:   </sysinfo>
Nov 16 03:53:37 user nova-compute[103546]:   <os>
Nov 16 03:53:37 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 03:53:37 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 03:53:37 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 03:53:37 user nova-compute[103546]:   </os>
Nov 16 03:53:37 user nova-compute[103546]:   <features>
Nov 16 03:53:37 user nova-compute[103546]:     <acpi/>
Nov 16 03:53:37 user nova-compute[103546]:     <apic/>
Nov 16 03:53:37 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 03:53:37 user nova-compute[103546]:   </features>
Nov 16 03:53:37 user nova-compute[103546]:   <clock offset="utc">
Nov 16 03:53:37 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 03:53:37 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 03:53:37 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 03:53:37 user nova-compute[103546]:   </clock>
Nov 16 03:53:37 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 03:53:37 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 03:53:37 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 03:53:37 user nova-compute[103546]:   </cpu>
Nov 16 03:53:37 user nova-compute[103546]:   <devices>
Nov 16 03:53:37 user nova-compute[103546]:     <disk type="file" device="disk">
Nov 16 03:53:37 user nova-compute[103546]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 03:53:37 user nova-compute[103546]:       <source file="/opt/stack/data/nova/instances/4edd4240-a8e3-4f7d-ad89-795d294b72df/disk"/>
Nov 16 03:53:37 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 03:53:37 user nova-compute[103546]:     </disk>
Nov 16 03:53:37 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 03:53:37 user nova-compute[103546]:       <mac address="fa:16:3e:28:80:5b"/>
Nov 16 03:53:37 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:53:37 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 03:53:37 user nova-compute[103546]:       <target dev="tapc7a5f1de-80"/>
Nov 16 03:53:37 user nova-compute[103546]:     </interface>
Nov 16 03:53:37 user nova-compute[103546]:     <serial type="pty">
Nov 16 03:53:37 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/4edd4240-a8e3-4f7d-ad89-795d294b72df/console.log" append="off"/>
Nov 16 03:53:37 user nova-compute[103546]:     </serial>
Nov 16 03:53:37 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 03:53:37 user nova-compute[103546]:     <video>
Nov 16 03:53:37 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:53:37 user nova-compute[103546]:     </video>
Nov 16 03:53:37 user nova-compute[103546]:     <rng model="virtio">
Nov 16 03:53:37 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 03:53:37 user nova-compute[103546]:     </rng>
Nov 16 03:53:37 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 03:53:37 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 03:53:37 user nova-compute[103546]:       <stats period="10"/>
Nov 16 03:53:37 user nova-compute[103546]:     </memballoon>
Nov 16 03:53:37 user nova-compute[103546]:   </devices>
Nov 16 03:53:37 user nova-compute[103546]: </domain>
Nov 16 03:53:37 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 03:53:37 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-915501901',display_name='tempest-VolumesActionsTest-instance-915501901',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-915501901',id=20,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8db9ce0a02204d269a3beac9459f5c8a',ramdisk_id='',reservation_id='r-q1kaocuy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1514502681',owner_user_name='tempest-VolumesActionsTest-1514502681-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:53:36Z,user_data=None,user_id='29f86d0d50ff44e79cf3c37416a5b632',uuid=4edd4240-a8e3-4f7d-ad89-795d294b72df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7a5f1de-8036-4fb3-aaf0-78dce691474a", "address": "fa:16:3e:28:80:5b", "network": {"id": "f27a9ae1-0635-4b3b-858d-fa6524d15c2d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-73312216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8db9ce0a02204d269a3beac9459f5c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7a5f1de-80", "ovs_interfaceid": "c7a5f1de-8036-4fb3-aaf0-78dce691474a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 03:53:37 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Converting VIF {"id": "c7a5f1de-8036-4fb3-aaf0-78dce691474a", "address": "fa:16:3e:28:80:5b", "network": {"id": "f27a9ae1-0635-4b3b-858d-fa6524d15c2d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-73312216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8db9ce0a02204d269a3beac9459f5c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7a5f1de-80", "ovs_interfaceid": "c7a5f1de-8036-4fb3-aaf0-78dce691474a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:53:37 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:80:5b,bridge_name='br-int',has_traffic_filtering=True,id=c7a5f1de-8036-4fb3-aaf0-78dce691474a,network=Network(f27a9ae1-0635-4b3b-858d-fa6524d15c2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7a5f1de-80') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:53:37 user nova-compute[103546]: DEBUG os_vif [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:80:5b,bridge_name='br-int',has_traffic_filtering=True,id=c7a5f1de-8036-4fb3-aaf0-78dce691474a,network=Network(f27a9ae1-0635-4b3b-858d-fa6524d15c2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7a5f1de-80') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 03:53:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:53:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 03:53:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3bd140a5-e7a1-59b2-8485-3f938dcc3563', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:53:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:53:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc7a5f1de-80, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:53:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc7a5f1de-80, col_values=(('qos', UUID('07af4d4a-a77f-4c31-af2c-5a14465b0cbc')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:53:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc7a5f1de-80, col_values=(('external_ids', {'iface-id': 'c7a5f1de-8036-4fb3-aaf0-78dce691474a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:80:5b', 'vm-uuid': '4edd4240-a8e3-4f7d-ad89-795d294b72df'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:53:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:53:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:37 user nova-compute[103546]: INFO os_vif [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:80:5b,bridge_name='br-int',has_traffic_filtering=True,id=c7a5f1de-8036-4fb3-aaf0-78dce691474a,network=Network(f27a9ae1-0635-4b3b-858d-fa6524d15c2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7a5f1de-80')
Nov 16 03:53:37 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:53:37 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] No VIF found with MAC fa:16:3e:28:80:5b, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 03:53:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:37 user nova-compute[103546]: DEBUG nova.network.neutron [req-d58882ed-eea8-442e-b3dc-50820a81418f req-5f05e18f-1349-4f5a-9822-a960e2c9ef35 service nova] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] Updated VIF entry in instance network info cache for port c7a5f1de-8036-4fb3-aaf0-78dce691474a. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 03:53:37 user nova-compute[103546]: DEBUG nova.network.neutron [req-d58882ed-eea8-442e-b3dc-50820a81418f req-5f05e18f-1349-4f5a-9822-a960e2c9ef35 service nova] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] Updating instance_info_cache with network_info: [{"id": "c7a5f1de-8036-4fb3-aaf0-78dce691474a", "address": "fa:16:3e:28:80:5b", "network": {"id": "f27a9ae1-0635-4b3b-858d-fa6524d15c2d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-73312216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8db9ce0a02204d269a3beac9459f5c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7a5f1de-80", "ovs_interfaceid": "c7a5f1de-8036-4fb3-aaf0-78dce691474a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:53:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d58882ed-eea8-442e-b3dc-50820a81418f req-5f05e18f-1349-4f5a-9822-a960e2c9ef35 service nova] Releasing lock "refresh_cache-4edd4240-a8e3-4f7d-ad89-795d294b72df" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:53:38 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:38 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:38 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:38 user nova-compute[103546]: DEBUG nova.compute.manager [req-5977dcf3-3979-4545-8185-15d457d90567 req-7c5519ec-0189-4168-b594-45bbab8614a4 service nova] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] Received event network-vif-plugged-c7a5f1de-8036-4fb3-aaf0-78dce691474a {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:53:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-5977dcf3-3979-4545-8185-15d457d90567 req-7c5519ec-0189-4168-b594-45bbab8614a4 service nova] Acquiring lock "4edd4240-a8e3-4f7d-ad89-795d294b72df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:53:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-5977dcf3-3979-4545-8185-15d457d90567 req-7c5519ec-0189-4168-b594-45bbab8614a4 service nova] Lock "4edd4240-a8e3-4f7d-ad89-795d294b72df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:53:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-5977dcf3-3979-4545-8185-15d457d90567 req-7c5519ec-0189-4168-b594-45bbab8614a4 service nova] Lock "4edd4240-a8e3-4f7d-ad89-795d294b72df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:53:38 user nova-compute[103546]: DEBUG nova.compute.manager [req-5977dcf3-3979-4545-8185-15d457d90567 req-7c5519ec-0189-4168-b594-45bbab8614a4 service nova] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] No waiting events found dispatching network-vif-plugged-c7a5f1de-8036-4fb3-aaf0-78dce691474a {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:53:38 user nova-compute[103546]: WARNING nova.compute.manager [req-5977dcf3-3979-4545-8185-15d457d90567 req-7c5519ec-0189-4168-b594-45bbab8614a4 service nova] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] Received unexpected event network-vif-plugged-c7a5f1de-8036-4fb3-aaf0-78dce691474a for instance with vm_state building and task_state spawning.
Nov 16 03:53:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Acquiring lock "2ab2f87d-f9da-4490-8e23-2bd4a480ee5d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:53:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Lock "2ab2f87d-f9da-4490-8e23-2bd4a480ee5d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:53:40 user nova-compute[103546]: DEBUG nova.compute.manager [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] [instance: 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d] Starting instance... {{(pid=103546) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 03:53:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:53:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:53:40 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=103546) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 03:53:40 user nova-compute[103546]: INFO nova.compute.claims [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] [instance: 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d] Claim successful on node user
Nov 16 03:53:40 user nova-compute[103546]: DEBUG nova.compute.manager [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 03:53:40 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] Guest created on hypervisor {{(pid=103546) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 03:53:40 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] Instance spawned successfully.
Nov 16 03:53:40 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 03:53:40 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] Found default for hw_cdrom_bus of ide {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:53:40 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] Found default for hw_disk_bus of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:53:40 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] Found default for hw_input_bus of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:53:40 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] Found default for hw_pointer_model of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:53:40 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] Found default for hw_video_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:53:40 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] Found default for hw_vif_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:53:40 user nova-compute[103546]: INFO nova.compute.manager [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] Took 5.13 seconds to spawn the instance on the hypervisor.
Nov 16 03:53:40 user nova-compute[103546]: DEBUG nova.compute.manager [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 03:53:40 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:53:40 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:53:40 user nova-compute[103546]: DEBUG nova.compute.manager [req-0eba071b-a0d2-43a6-b946-da4579eccd58 req-a82c2a4b-e490-4abe-bc7a-7156336c2295 service nova] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] Received event network-vif-plugged-c7a5f1de-8036-4fb3-aaf0-78dce691474a {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:53:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-0eba071b-a0d2-43a6-b946-da4579eccd58 req-a82c2a4b-e490-4abe-bc7a-7156336c2295 service nova] Acquiring lock "4edd4240-a8e3-4f7d-ad89-795d294b72df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:53:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-0eba071b-a0d2-43a6-b946-da4579eccd58 req-a82c2a4b-e490-4abe-bc7a-7156336c2295 service nova] Lock "4edd4240-a8e3-4f7d-ad89-795d294b72df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:53:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-0eba071b-a0d2-43a6-b946-da4579eccd58 req-a82c2a4b-e490-4abe-bc7a-7156336c2295 service nova] Lock "4edd4240-a8e3-4f7d-ad89-795d294b72df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:53:40 user nova-compute[103546]: DEBUG nova.compute.manager [req-0eba071b-a0d2-43a6-b946-da4579eccd58 req-a82c2a4b-e490-4abe-bc7a-7156336c2295 service nova] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] No waiting events found dispatching network-vif-plugged-c7a5f1de-8036-4fb3-aaf0-78dce691474a {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:53:40 user nova-compute[103546]: WARNING nova.compute.manager [req-0eba071b-a0d2-43a6-b946-da4579eccd58 req-a82c2a4b-e490-4abe-bc7a-7156336c2295 service nova] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] Received unexpected event network-vif-plugged-c7a5f1de-8036-4fb3-aaf0-78dce691474a for instance with vm_state building and task_state spawning.
Nov 16 03:53:40 user nova-compute[103546]: INFO nova.compute.manager [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] Took 5.98 seconds to build instance.
Nov 16 03:53:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.375s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:53:40 user nova-compute[103546]: DEBUG nova.compute.manager [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] [instance: 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d] Start building networks asynchronously for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 03:53:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-ab280bd1-fef4-4350-be8b-cbed9e601c07 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Lock "4edd4240-a8e3-4f7d-ad89-795d294b72df" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.094s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:53:40 user nova-compute[103546]: DEBUG nova.compute.manager [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] [instance: 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d] Allocating IP information in the background. {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 03:53:40 user nova-compute[103546]: DEBUG nova.network.neutron [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] [instance: 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d] allocate_for_instance() {{(pid=103546) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 03:53:40 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] [instance: 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 03:53:40 user nova-compute[103546]: DEBUG nova.compute.manager [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] [instance: 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d] Start building block device mappings for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 03:53:41 user nova-compute[103546]: DEBUG nova.policy [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3ebecaf10cd8491e929be94a76246660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8ecdd929f64310a04b173f17f69667', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103546) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 03:53:41 user nova-compute[103546]: DEBUG nova.compute.manager [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] [instance: 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d] Start spawning the instance on the hypervisor. {{(pid=103546) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 03:53:41 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] [instance: 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d] Creating instance directory {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 03:53:41 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] [instance: 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d] Creating image(s)
Nov 16 03:53:41 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Acquiring lock "/opt/stack/data/nova/instances/2ab2f87d-f9da-4490-8e23-2bd4a480ee5d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:53:41 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Lock "/opt/stack/data/nova/instances/2ab2f87d-f9da-4490-8e23-2bd4a480ee5d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:53:41 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Lock "/opt/stack/data/nova/instances/2ab2f87d-f9da-4490-8e23-2bd4a480ee5d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:53:41 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:41 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.198s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:41 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Acquiring lock "8c9efafb670bfe5842ba1f4ce398924612164af7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:53:41 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:53:41 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:41 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.179s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:41 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/2ab2f87d-f9da-4490-8e23-2bd4a480ee5d/disk 1073741824 {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:41 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/2ab2f87d-f9da-4490-8e23-2bd4a480ee5d/disk 1073741824" returned: 0 in 0.050s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:41 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:53:41 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:41 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.196s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:41 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2ab2f87d-f9da-4490-8e23-2bd4a480ee5d/disk. size=1073741824 {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 03:53:41 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ab2f87d-f9da-4490-8e23-2bd4a480ee5d/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:41 user nova-compute[103546]: DEBUG nova.network.neutron [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] [instance: 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d] Successfully created port: a353a80b-d493-414f-b459-38227f8fc64b {{(pid=103546) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 03:53:41 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ab2f87d-f9da-4490-8e23-2bd4a480ee5d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:41 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Cannot resize image /opt/stack/data/nova/instances/2ab2f87d-f9da-4490-8e23-2bd4a480ee5d/disk to a smaller size. {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 03:53:41 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] [instance: 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d] Created local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 03:53:41 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] [instance: 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d] Ensure instance console log exists: /opt/stack/data/nova/instances/2ab2f87d-f9da-4490-8e23-2bd4a480ee5d/console.log {{(pid=103546) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 03:53:41 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:53:41 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:53:41 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:53:42 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:42 user nova-compute[103546]: DEBUG nova.network.neutron [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] [instance: 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d] Successfully updated port: a353a80b-d493-414f-b459-38227f8fc64b {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 03:53:42 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Acquiring lock "refresh_cache-2ab2f87d-f9da-4490-8e23-2bd4a480ee5d" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:53:42 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Acquired lock "refresh_cache-2ab2f87d-f9da-4490-8e23-2bd4a480ee5d" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:53:42 user nova-compute[103546]: DEBUG nova.network.neutron [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] [instance: 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 03:53:42 user nova-compute[103546]: DEBUG nova.network.neutron [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] [instance: 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 03:53:42 user nova-compute[103546]: DEBUG nova.network.neutron [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] [instance: 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d] Updating instance_info_cache with network_info: [{"id": "a353a80b-d493-414f-b459-38227f8fc64b", "address": "fa:16:3e:e8:14:4a", "network": {"id": "6d63abf1-29d1-47a9-b2ff-8f894dde1dcf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1773810435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8ecdd929f64310a04b173f17f69667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa353a80b-d4", "ovs_interfaceid": "a353a80b-d493-414f-b459-38227f8fc64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:53:42 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Releasing lock "refresh_cache-2ab2f87d-f9da-4490-8e23-2bd4a480ee5d" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:53:42 user nova-compute[103546]: DEBUG nova.compute.manager [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] [instance: 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d] Instance network_info: |[{"id": "a353a80b-d493-414f-b459-38227f8fc64b", "address": "fa:16:3e:e8:14:4a", "network": {"id": "6d63abf1-29d1-47a9-b2ff-8f894dde1dcf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1773810435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8ecdd929f64310a04b173f17f69667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa353a80b-d4", "ovs_interfaceid": "a353a80b-d493-414f-b459-38227f8fc64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 03:53:42 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] [instance: 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d] Start _get_guest_xml network_info=[{"id": "a353a80b-d493-414f-b459-38227f8fc64b", "address": "fa:16:3e:e8:14:4a", "network": {"id": "6d63abf1-29d1-47a9-b2ff-8f894dde1dcf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1773810435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8ecdd929f64310a04b173f17f69667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa353a80b-d4", "ovs_interfaceid": "a353a80b-d493-414f-b459-38227f8fc64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '5c6f539a-01e5-4478-bf8f-a14310b5d7dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 03:53:42 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:53:42 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:53:42 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 03:53:42 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 03:53:42 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 03:53:42 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 03:53:42 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 03:53:42 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 03:53:42 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 03:53:42 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 03:53:42 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 03:53:42 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 03:53:42 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 03:53:42 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 03:53:42 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 03:53:42 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 03:53:42 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 03:53:42 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 03:53:42 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:53:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2095380072',display_name='tempest-VolumesActionsTest-instance-2095380072',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2095380072',id=21,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c8ecdd929f64310a04b173f17f69667',ramdisk_id='',reservation_id='r-etn1ysit',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1397867412',owner_user_name='tempest-VolumesActionsTest-1397867412-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:53:41Z,user_data=None,user_id='3ebecaf10cd8491e929be94a76246660',uuid=2ab2f87d-f9da-4490-8e23-2bd4a480ee5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a353a80b-d493-414f-b459-38227f8fc64b", "address": "fa:16:3e:e8:14:4a", "network": {"id": "6d63abf1-29d1-47a9-b2ff-8f894dde1dcf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1773810435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8ecdd929f64310a04b173f17f69667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa353a80b-d4", "ovs_interfaceid": "a353a80b-d493-414f-b459-38227f8fc64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 03:53:42 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Converting VIF {"id": "a353a80b-d493-414f-b459-38227f8fc64b", "address": "fa:16:3e:e8:14:4a", "network": {"id": "6d63abf1-29d1-47a9-b2ff-8f894dde1dcf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1773810435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8ecdd929f64310a04b173f17f69667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa353a80b-d4", "ovs_interfaceid": "a353a80b-d493-414f-b459-38227f8fc64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:53:42 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:14:4a,bridge_name='br-int',has_traffic_filtering=True,id=a353a80b-d493-414f-b459-38227f8fc64b,network=Network(6d63abf1-29d1-47a9-b2ff-8f894dde1dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa353a80b-d4') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:53:42 user nova-compute[103546]: DEBUG nova.objects.instance [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Lazy-loading 'pci_devices' on Instance uuid 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:53:42 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] [instance: 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d] End _get_guest_xml xml=<domain type="kvm">
Nov 16 03:53:42 user nova-compute[103546]:   <uuid>2ab2f87d-f9da-4490-8e23-2bd4a480ee5d</uuid>
Nov 16 03:53:42 user nova-compute[103546]:   <name>instance-00000015</name>
Nov 16 03:53:42 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 03:53:42 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 03:53:42 user nova-compute[103546]:   <metadata>
Nov 16 03:53:42 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 03:53:42 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 03:53:42 user nova-compute[103546]:       <nova:name>tempest-VolumesActionsTest-instance-2095380072</nova:name>
Nov 16 03:53:42 user nova-compute[103546]:       <nova:creationTime>2023-11-16 03:53:42</nova:creationTime>
Nov 16 03:53:42 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 03:53:42 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 03:53:42 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 03:53:42 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 03:53:42 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 03:53:42 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 03:53:42 user nova-compute[103546]:       </nova:flavor>
Nov 16 03:53:42 user nova-compute[103546]:       <nova:owner>
Nov 16 03:53:42 user nova-compute[103546]:         <nova:user uuid="3ebecaf10cd8491e929be94a76246660">tempest-VolumesActionsTest-1397867412-project-member</nova:user>
Nov 16 03:53:42 user nova-compute[103546]:         <nova:project uuid="6c8ecdd929f64310a04b173f17f69667">tempest-VolumesActionsTest-1397867412</nova:project>
Nov 16 03:53:42 user nova-compute[103546]:       </nova:owner>
Nov 16 03:53:42 user nova-compute[103546]:       <nova:root type="image" uuid="5c6f539a-01e5-4478-bf8f-a14310b5d7dd"/>
Nov 16 03:53:42 user nova-compute[103546]:       <nova:ports>
Nov 16 03:53:42 user nova-compute[103546]:         <nova:port uuid="a353a80b-d493-414f-b459-38227f8fc64b">
Nov 16 03:53:42 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 16 03:53:42 user nova-compute[103546]:         </nova:port>
Nov 16 03:53:42 user nova-compute[103546]:       </nova:ports>
Nov 16 03:53:42 user nova-compute[103546]:     </nova:instance>
Nov 16 03:53:42 user nova-compute[103546]:   </metadata>
Nov 16 03:53:42 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 03:53:42 user nova-compute[103546]:     <system>
Nov 16 03:53:42 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 03:53:42 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 03:53:42 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 03:53:42 user nova-compute[103546]:       <entry name="serial">2ab2f87d-f9da-4490-8e23-2bd4a480ee5d</entry>
Nov 16 03:53:42 user nova-compute[103546]:       <entry name="uuid">2ab2f87d-f9da-4490-8e23-2bd4a480ee5d</entry>
Nov 16 03:53:42 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 03:53:42 user nova-compute[103546]:     </system>
Nov 16 03:53:42 user nova-compute[103546]:   </sysinfo>
Nov 16 03:53:42 user nova-compute[103546]:   <os>
Nov 16 03:53:42 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 03:53:42 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 03:53:42 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 03:53:42 user nova-compute[103546]:   </os>
Nov 16 03:53:42 user nova-compute[103546]:   <features>
Nov 16 03:53:42 user nova-compute[103546]:     <acpi/>
Nov 16 03:53:42 user nova-compute[103546]:     <apic/>
Nov 16 03:53:42 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 03:53:42 user nova-compute[103546]:   </features>
Nov 16 03:53:42 user nova-compute[103546]:   <clock offset="utc">
Nov 16 03:53:42 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 03:53:42 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 03:53:42 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 03:53:42 user nova-compute[103546]:   </clock>
Nov 16 03:53:42 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 03:53:42 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 03:53:42 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 03:53:42 user nova-compute[103546]:   </cpu>
Nov 16 03:53:42 user nova-compute[103546]:   <devices>
Nov 16 03:53:42 user nova-compute[103546]:     <disk type="file" device="disk">
Nov 16 03:53:42 user nova-compute[103546]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 03:53:42 user nova-compute[103546]:       <source file="/opt/stack/data/nova/instances/2ab2f87d-f9da-4490-8e23-2bd4a480ee5d/disk"/>
Nov 16 03:53:42 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 03:53:42 user nova-compute[103546]:     </disk>
Nov 16 03:53:42 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 03:53:42 user nova-compute[103546]:       <mac address="fa:16:3e:e8:14:4a"/>
Nov 16 03:53:42 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:53:42 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 03:53:42 user nova-compute[103546]:       <target dev="tapa353a80b-d4"/>
Nov 16 03:53:42 user nova-compute[103546]:     </interface>
Nov 16 03:53:42 user nova-compute[103546]:     <serial type="pty">
Nov 16 03:53:42 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/2ab2f87d-f9da-4490-8e23-2bd4a480ee5d/console.log" append="off"/>
Nov 16 03:53:42 user nova-compute[103546]:     </serial>
Nov 16 03:53:42 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 03:53:42 user nova-compute[103546]:     <video>
Nov 16 03:53:42 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:53:42 user nova-compute[103546]:     </video>
Nov 16 03:53:42 user nova-compute[103546]:     <rng model="virtio">
Nov 16 03:53:42 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 03:53:42 user nova-compute[103546]:     </rng>
Nov 16 03:53:42 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 03:53:42 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 03:53:42 user nova-compute[103546]:       <stats period="10"/>
Nov 16 03:53:42 user nova-compute[103546]:     </memballoon>
Nov 16 03:53:42 user nova-compute[103546]:   </devices>
Nov 16 03:53:42 user nova-compute[103546]: </domain>
Nov 16 03:53:42 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 03:53:42 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:53:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2095380072',display_name='tempest-VolumesActionsTest-instance-2095380072',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2095380072',id=21,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c8ecdd929f64310a04b173f17f69667',ramdisk_id='',reservation_id='r-etn1ysit',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1397867412',owner_user_name='tempest-VolumesActionsTest-1397867412-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:53:41Z,user_data=None,user_id='3ebecaf10cd8491e929be94a76246660',uuid=2ab2f87d-f9da-4490-8e23-2bd4a480ee5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a353a80b-d493-414f-b459-38227f8fc64b", "address": "fa:16:3e:e8:14:4a", "network": {"id": "6d63abf1-29d1-47a9-b2ff-8f894dde1dcf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1773810435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8ecdd929f64310a04b173f17f69667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa353a80b-d4", "ovs_interfaceid": "a353a80b-d493-414f-b459-38227f8fc64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 03:53:42 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Converting VIF {"id": "a353a80b-d493-414f-b459-38227f8fc64b", "address": "fa:16:3e:e8:14:4a", "network": {"id": "6d63abf1-29d1-47a9-b2ff-8f894dde1dcf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1773810435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8ecdd929f64310a04b173f17f69667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa353a80b-d4", "ovs_interfaceid": "a353a80b-d493-414f-b459-38227f8fc64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:53:42 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:14:4a,bridge_name='br-int',has_traffic_filtering=True,id=a353a80b-d493-414f-b459-38227f8fc64b,network=Network(6d63abf1-29d1-47a9-b2ff-8f894dde1dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa353a80b-d4') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:53:42 user nova-compute[103546]: DEBUG os_vif [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:14:4a,bridge_name='br-int',has_traffic_filtering=True,id=a353a80b-d493-414f-b459-38227f8fc64b,network=Network(6d63abf1-29d1-47a9-b2ff-8f894dde1dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa353a80b-d4') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 03:53:42 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:42 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:53:42 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 03:53:42 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:42 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5076cb60-4214-5cd8-bf11-006074e3ee31', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:53:42 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:42 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:53:42 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:42 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa353a80b-d4, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:53:42 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa353a80b-d4, col_values=(('qos', UUID('43254a63-ff41-4a8e-aa87-a27a28ac4d85')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:53:42 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa353a80b-d4, col_values=(('external_ids', {'iface-id': 'a353a80b-d493-414f-b459-38227f8fc64b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:14:4a', 'vm-uuid': '2ab2f87d-f9da-4490-8e23-2bd4a480ee5d'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:53:42 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:42 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:53:42 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:42 user nova-compute[103546]: INFO os_vif [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:14:4a,bridge_name='br-int',has_traffic_filtering=True,id=a353a80b-d493-414f-b459-38227f8fc64b,network=Network(6d63abf1-29d1-47a9-b2ff-8f894dde1dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa353a80b-d4')
Nov 16 03:53:42 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:53:42 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] No VIF found with MAC fa:16:3e:e8:14:4a, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 03:53:42 user nova-compute[103546]: DEBUG nova.compute.manager [req-709689ff-33f1-452d-9944-6912a23c5a16 req-9bbe3e9c-c5ea-4fd4-ae30-71a870b6bc77 service nova] [instance: 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d] Received event network-changed-a353a80b-d493-414f-b459-38227f8fc64b {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:53:42 user nova-compute[103546]: DEBUG nova.compute.manager [req-709689ff-33f1-452d-9944-6912a23c5a16 req-9bbe3e9c-c5ea-4fd4-ae30-71a870b6bc77 service nova] [instance: 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d] Refreshing instance network info cache due to event network-changed-a353a80b-d493-414f-b459-38227f8fc64b. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:53:42 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-709689ff-33f1-452d-9944-6912a23c5a16 req-9bbe3e9c-c5ea-4fd4-ae30-71a870b6bc77 service nova] Acquiring lock "refresh_cache-2ab2f87d-f9da-4490-8e23-2bd4a480ee5d" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:53:42 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-709689ff-33f1-452d-9944-6912a23c5a16 req-9bbe3e9c-c5ea-4fd4-ae30-71a870b6bc77 service nova] Acquired lock "refresh_cache-2ab2f87d-f9da-4490-8e23-2bd4a480ee5d" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:53:42 user nova-compute[103546]: DEBUG nova.network.neutron [req-709689ff-33f1-452d-9944-6912a23c5a16 req-9bbe3e9c-c5ea-4fd4-ae30-71a870b6bc77 service nova] [instance: 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d] Refreshing network info cache for port a353a80b-d493-414f-b459-38227f8fc64b {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:53:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:43 user nova-compute[103546]: DEBUG nova.network.neutron [req-709689ff-33f1-452d-9944-6912a23c5a16 req-9bbe3e9c-c5ea-4fd4-ae30-71a870b6bc77 service nova] [instance: 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d] Updated VIF entry in instance network info cache for port a353a80b-d493-414f-b459-38227f8fc64b. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 03:53:43 user nova-compute[103546]: DEBUG nova.network.neutron [req-709689ff-33f1-452d-9944-6912a23c5a16 req-9bbe3e9c-c5ea-4fd4-ae30-71a870b6bc77 service nova] [instance: 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d] Updating instance_info_cache with network_info: [{"id": "a353a80b-d493-414f-b459-38227f8fc64b", "address": "fa:16:3e:e8:14:4a", "network": {"id": "6d63abf1-29d1-47a9-b2ff-8f894dde1dcf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1773810435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8ecdd929f64310a04b173f17f69667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa353a80b-d4", "ovs_interfaceid": "a353a80b-d493-414f-b459-38227f8fc64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:53:43 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-709689ff-33f1-452d-9944-6912a23c5a16 req-9bbe3e9c-c5ea-4fd4-ae30-71a870b6bc77 service nova] Releasing lock "refresh_cache-2ab2f87d-f9da-4490-8e23-2bd4a480ee5d" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:53:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Acquiring lock "ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:53:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:53:44 user nova-compute[103546]: DEBUG nova.compute.manager [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Starting instance... {{(pid=103546) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 03:53:44 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:44 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:44 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:53:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:53:44 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=103546) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 03:53:44 user nova-compute[103546]: INFO nova.compute.claims [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Claim successful on node user
Nov 16 03:53:44 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:53:44 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:53:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.476s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:53:44 user nova-compute[103546]: DEBUG nova.compute.manager [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Start building networks asynchronously for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 03:53:44 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:44 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:44 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:44 user nova-compute[103546]: DEBUG nova.compute.manager [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Allocating IP information in the background. {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 03:53:44 user nova-compute[103546]: DEBUG nova.network.neutron [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] allocate_for_instance() {{(pid=103546) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 03:53:44 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 03:53:44 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:44 user nova-compute[103546]: DEBUG nova.compute.manager [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Start building block device mappings for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 03:53:44 user nova-compute[103546]: DEBUG nova.policy [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '21d4e9052a614968bda331f028920ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63722fdf17e4408299de8c215c133812', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103546) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 03:53:44 user nova-compute[103546]: DEBUG nova.compute.manager [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Start spawning the instance on the hypervisor. {{(pid=103546) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 03:53:44 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Creating instance directory {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 03:53:44 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Creating image(s)
Nov 16 03:53:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Acquiring lock "/opt/stack/data/nova/instances/ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:53:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "/opt/stack/data/nova/instances/ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:53:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "/opt/stack/data/nova/instances/ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:53:44 user nova-compute[103546]: DEBUG nova.compute.manager [req-d1cd6d65-bdba-4689-a7be-7f2b746bef37 req-640a87bf-48c1-43bf-8294-a58886b0acf8 service nova] [instance: 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d] Received event network-vif-plugged-a353a80b-d493-414f-b459-38227f8fc64b {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:53:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d1cd6d65-bdba-4689-a7be-7f2b746bef37 req-640a87bf-48c1-43bf-8294-a58886b0acf8 service nova] Acquiring lock "2ab2f87d-f9da-4490-8e23-2bd4a480ee5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:53:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d1cd6d65-bdba-4689-a7be-7f2b746bef37 req-640a87bf-48c1-43bf-8294-a58886b0acf8 service nova] Lock "2ab2f87d-f9da-4490-8e23-2bd4a480ee5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:53:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d1cd6d65-bdba-4689-a7be-7f2b746bef37 req-640a87bf-48c1-43bf-8294-a58886b0acf8 service nova] Lock "2ab2f87d-f9da-4490-8e23-2bd4a480ee5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:53:44 user nova-compute[103546]: DEBUG nova.compute.manager [req-d1cd6d65-bdba-4689-a7be-7f2b746bef37 req-640a87bf-48c1-43bf-8294-a58886b0acf8 service nova] [instance: 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d] No waiting events found dispatching network-vif-plugged-a353a80b-d493-414f-b459-38227f8fc64b {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:53:44 user nova-compute[103546]: WARNING nova.compute.manager [req-d1cd6d65-bdba-4689-a7be-7f2b746bef37 req-640a87bf-48c1-43bf-8294-a58886b0acf8 service nova] [instance: 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d] Received unexpected event network-vif-plugged-a353a80b-d493-414f-b459-38227f8fc64b for instance with vm_state building and task_state spawning.
Nov 16 03:53:44 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.194s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:45 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Acquiring lock "8c9efafb670bfe5842ba1f4ce398924612164af7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:53:45 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:53:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.179s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c/disk 1073741824 {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c/disk 1073741824" returned: 0 in 0.057s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:45 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:53:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:45 user nova-compute[103546]: DEBUG nova.network.neutron [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Successfully created port: 757f4202-bbf9-42cf-8ccc-7e970b892f1f {{(pid=103546) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 03:53:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.184s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:45 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c/disk. size=1073741824 {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 03:53:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:53:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:53:45 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Cannot resize image /opt/stack/data/nova/instances/ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c/disk to a smaller size. {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 03:53:45 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Created local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 03:53:45 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Ensure instance console log exists: /opt/stack/data/nova/instances/ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c/console.log {{(pid=103546) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 03:53:45 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:53:45 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:53:45 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:53:46 user nova-compute[103546]: DEBUG nova.network.neutron [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Successfully updated port: 757f4202-bbf9-42cf-8ccc-7e970b892f1f {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 03:53:46 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Acquiring lock "refresh_cache-ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:53:46 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Acquired lock "refresh_cache-ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:53:46 user nova-compute[103546]: DEBUG nova.network.neutron [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 03:53:46 user nova-compute[103546]: DEBUG nova.compute.manager [req-73eac015-b028-4cfe-a241-2a8837644c37 req-c27d892e-9747-475a-a369-f999b523b266 service nova] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Received event network-changed-757f4202-bbf9-42cf-8ccc-7e970b892f1f {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:53:46 user nova-compute[103546]: DEBUG nova.compute.manager [req-73eac015-b028-4cfe-a241-2a8837644c37 req-c27d892e-9747-475a-a369-f999b523b266 service nova] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Refreshing instance network info cache due to event network-changed-757f4202-bbf9-42cf-8ccc-7e970b892f1f. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:53:46 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-73eac015-b028-4cfe-a241-2a8837644c37 req-c27d892e-9747-475a-a369-f999b523b266 service nova] Acquiring lock "refresh_cache-ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:53:46 user nova-compute[103546]: DEBUG nova.compute.manager [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] [instance: 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 03:53:46 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] [instance: 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d] Guest created on hypervisor {{(pid=103546) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 03:53:46 user nova-compute[103546]: DEBUG nova.network.neutron [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 03:53:46 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d] Instance spawned successfully.
Nov 16 03:53:46 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] [instance: 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 03:53:46 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] [instance: 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d] Found default for hw_cdrom_bus of ide {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:53:46 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] [instance: 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d] Found default for hw_disk_bus of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:53:46 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] [instance: 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d] Found default for hw_input_bus of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:53:46 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] [instance: 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d] Found default for hw_pointer_model of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:53:46 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] [instance: 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d] Found default for hw_video_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:53:46 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] [instance: 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d] Found default for hw_vif_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:53:46 user nova-compute[103546]: INFO nova.compute.manager [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] [instance: 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d] Took 5.42 seconds to spawn the instance on the hypervisor.
Nov 16 03:53:46 user nova-compute[103546]: DEBUG nova.compute.manager [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] [instance: 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 03:53:46 user nova-compute[103546]: INFO nova.compute.manager [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] [instance: 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d] Took 6.12 seconds to build instance.
Nov 16 03:53:46 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-855daac3-e1a1-40b5-811e-99ceba835659 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Lock "2ab2f87d-f9da-4490-8e23-2bd4a480ee5d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.237s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:53:46 user nova-compute[103546]: DEBUG nova.network.neutron [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Updating instance_info_cache with network_info: [{"id": "757f4202-bbf9-42cf-8ccc-7e970b892f1f", "address": "fa:16:3e:db:d6:71", "network": {"id": "b2fca984-f1e9-4c86-a3a5-b8d5b9950555", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-172535633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63722fdf17e4408299de8c215c133812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap757f4202-bb", "ovs_interfaceid": "757f4202-bbf9-42cf-8ccc-7e970b892f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:53:46 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Releasing lock "refresh_cache-ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:53:46 user nova-compute[103546]: DEBUG nova.compute.manager [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Instance network_info: |[{"id": "757f4202-bbf9-42cf-8ccc-7e970b892f1f", "address": "fa:16:3e:db:d6:71", "network": {"id": "b2fca984-f1e9-4c86-a3a5-b8d5b9950555", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-172535633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63722fdf17e4408299de8c215c133812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap757f4202-bb", "ovs_interfaceid": "757f4202-bbf9-42cf-8ccc-7e970b892f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 03:53:46 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-73eac015-b028-4cfe-a241-2a8837644c37 req-c27d892e-9747-475a-a369-f999b523b266 service nova] Acquired lock "refresh_cache-ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:53:46 user nova-compute[103546]: DEBUG nova.network.neutron [req-73eac015-b028-4cfe-a241-2a8837644c37 req-c27d892e-9747-475a-a369-f999b523b266 service nova] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Refreshing network info cache for port 757f4202-bbf9-42cf-8ccc-7e970b892f1f {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:53:46 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Start _get_guest_xml network_info=[{"id": "757f4202-bbf9-42cf-8ccc-7e970b892f1f", "address": "fa:16:3e:db:d6:71", "network": {"id": "b2fca984-f1e9-4c86-a3a5-b8d5b9950555", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-172535633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63722fdf17e4408299de8c215c133812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap757f4202-bb", "ovs_interfaceid": "757f4202-bbf9-42cf-8ccc-7e970b892f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '5c6f539a-01e5-4478-bf8f-a14310b5d7dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 03:53:46 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:53:46 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:53:46 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 03:53:46 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 03:53:46 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 03:53:46 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 03:53:46 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 03:53:46 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 03:53:46 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 03:53:46 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 03:53:46 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 03:53:46 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 03:53:46 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 03:53:46 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 03:53:46 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 03:53:46 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 03:53:46 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 03:53:46 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 03:53:46 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:53:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-131803665',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-131803665',id=22,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCpMkDeLog7bvOvwKkIjqfS8179Rp5Wy/oiCfL7hNx4ACLwn8Ka5bKgRH8IHZl2m0/RN2qLs1wVx1qnT5sRNlnObDaB0h+OIqSDqvVheIpq1rj9KpUcFGrgypySriGKxIw==',key_name='tempest-keypair-1198627758',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63722fdf17e4408299de8c215c133812',ramdisk_id='',reservation_id='r-gew0pxlb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1382373405',owner_user_name='tempest-AttachVolumeShelveTestJSON-1382373405-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:53:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21d4e9052a614968bda331f028920ca7',uuid=ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "757f4202-bbf9-42cf-8ccc-7e970b892f1f", "address": "fa:16:3e:db:d6:71", "network": {"id": "b2fca984-f1e9-4c86-a3a5-b8d5b9950555", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-172535633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63722fdf17e4408299de8c215c133812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap757f4202-bb", "ovs_interfaceid": "757f4202-bbf9-42cf-8ccc-7e970b892f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 03:53:46 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Converting VIF {"id": "757f4202-bbf9-42cf-8ccc-7e970b892f1f", "address": "fa:16:3e:db:d6:71", "network": {"id": "b2fca984-f1e9-4c86-a3a5-b8d5b9950555", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-172535633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63722fdf17e4408299de8c215c133812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap757f4202-bb", "ovs_interfaceid": "757f4202-bbf9-42cf-8ccc-7e970b892f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:53:46 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:d6:71,bridge_name='br-int',has_traffic_filtering=True,id=757f4202-bbf9-42cf-8ccc-7e970b892f1f,network=Network(b2fca984-f1e9-4c86-a3a5-b8d5b9950555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap757f4202-bb') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:53:46 user nova-compute[103546]: DEBUG nova.objects.instance [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lazy-loading 'pci_devices' on Instance uuid ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:53:46 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] End _get_guest_xml xml=<domain type="kvm">
Nov 16 03:53:46 user nova-compute[103546]:   <uuid>ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c</uuid>
Nov 16 03:53:46 user nova-compute[103546]:   <name>instance-00000016</name>
Nov 16 03:53:46 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 03:53:46 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 03:53:46 user nova-compute[103546]:   <metadata>
Nov 16 03:53:46 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 03:53:46 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 03:53:46 user nova-compute[103546]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-131803665</nova:name>
Nov 16 03:53:46 user nova-compute[103546]:       <nova:creationTime>2023-11-16 03:53:46</nova:creationTime>
Nov 16 03:53:46 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 03:53:46 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 03:53:46 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 03:53:46 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 03:53:46 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 03:53:46 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 03:53:46 user nova-compute[103546]:       </nova:flavor>
Nov 16 03:53:46 user nova-compute[103546]:       <nova:owner>
Nov 16 03:53:46 user nova-compute[103546]:         <nova:user uuid="21d4e9052a614968bda331f028920ca7">tempest-AttachVolumeShelveTestJSON-1382373405-project-member</nova:user>
Nov 16 03:53:46 user nova-compute[103546]:         <nova:project uuid="63722fdf17e4408299de8c215c133812">tempest-AttachVolumeShelveTestJSON-1382373405</nova:project>
Nov 16 03:53:46 user nova-compute[103546]:       </nova:owner>
Nov 16 03:53:46 user nova-compute[103546]:       <nova:root type="image" uuid="5c6f539a-01e5-4478-bf8f-a14310b5d7dd"/>
Nov 16 03:53:46 user nova-compute[103546]:       <nova:ports>
Nov 16 03:53:46 user nova-compute[103546]:         <nova:port uuid="757f4202-bbf9-42cf-8ccc-7e970b892f1f">
Nov 16 03:53:46 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 16 03:53:46 user nova-compute[103546]:         </nova:port>
Nov 16 03:53:46 user nova-compute[103546]:       </nova:ports>
Nov 16 03:53:46 user nova-compute[103546]:     </nova:instance>
Nov 16 03:53:46 user nova-compute[103546]:   </metadata>
Nov 16 03:53:46 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 03:53:46 user nova-compute[103546]:     <system>
Nov 16 03:53:46 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 03:53:46 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 03:53:46 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 03:53:46 user nova-compute[103546]:       <entry name="serial">ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c</entry>
Nov 16 03:53:46 user nova-compute[103546]:       <entry name="uuid">ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c</entry>
Nov 16 03:53:46 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 03:53:46 user nova-compute[103546]:     </system>
Nov 16 03:53:46 user nova-compute[103546]:   </sysinfo>
Nov 16 03:53:46 user nova-compute[103546]:   <os>
Nov 16 03:53:46 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 03:53:46 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 03:53:46 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 03:53:46 user nova-compute[103546]:   </os>
Nov 16 03:53:46 user nova-compute[103546]:   <features>
Nov 16 03:53:46 user nova-compute[103546]:     <acpi/>
Nov 16 03:53:46 user nova-compute[103546]:     <apic/>
Nov 16 03:53:46 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 03:53:46 user nova-compute[103546]:   </features>
Nov 16 03:53:46 user nova-compute[103546]:   <clock offset="utc">
Nov 16 03:53:46 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 03:53:46 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 03:53:46 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 03:53:46 user nova-compute[103546]:   </clock>
Nov 16 03:53:46 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 03:53:46 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 03:53:46 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 03:53:46 user nova-compute[103546]:   </cpu>
Nov 16 03:53:46 user nova-compute[103546]:   <devices>
Nov 16 03:53:46 user nova-compute[103546]:     <disk type="file" device="disk">
Nov 16 03:53:46 user nova-compute[103546]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 03:53:46 user nova-compute[103546]:       <source file="/opt/stack/data/nova/instances/ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c/disk"/>
Nov 16 03:53:46 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 03:53:46 user nova-compute[103546]:     </disk>
Nov 16 03:53:46 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 03:53:46 user nova-compute[103546]:       <mac address="fa:16:3e:db:d6:71"/>
Nov 16 03:53:46 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:53:46 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 03:53:46 user nova-compute[103546]:       <target dev="tap757f4202-bb"/>
Nov 16 03:53:46 user nova-compute[103546]:     </interface>
Nov 16 03:53:46 user nova-compute[103546]:     <serial type="pty">
Nov 16 03:53:46 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c/console.log" append="off"/>
Nov 16 03:53:46 user nova-compute[103546]:     </serial>
Nov 16 03:53:46 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 03:53:46 user nova-compute[103546]:     <video>
Nov 16 03:53:46 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:53:46 user nova-compute[103546]:     </video>
Nov 16 03:53:46 user nova-compute[103546]:     <rng model="virtio">
Nov 16 03:53:46 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 03:53:46 user nova-compute[103546]:     </rng>
Nov 16 03:53:46 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 03:53:46 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 03:53:46 user nova-compute[103546]:       <stats period="10"/>
Nov 16 03:53:46 user nova-compute[103546]:     </memballoon>
Nov 16 03:53:46 user nova-compute[103546]:   </devices>
Nov 16 03:53:46 user nova-compute[103546]: </domain>
Nov 16 03:53:46 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 03:53:46 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:53:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-131803665',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-131803665',id=22,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCpMkDeLog7bvOvwKkIjqfS8179Rp5Wy/oiCfL7hNx4ACLwn8Ka5bKgRH8IHZl2m0/RN2qLs1wVx1qnT5sRNlnObDaB0h+OIqSDqvVheIpq1rj9KpUcFGrgypySriGKxIw==',key_name='tempest-keypair-1198627758',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63722fdf17e4408299de8c215c133812',ramdisk_id='',reservation_id='r-gew0pxlb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1382373405',owner_user_name='tempest-AttachVolumeShelveTestJSON-1382373405-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:53:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21d4e9052a614968bda331f028920ca7',uuid=ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "757f4202-bbf9-42cf-8ccc-7e970b892f1f", "address": "fa:16:3e:db:d6:71", "network": {"id": "b2fca984-f1e9-4c86-a3a5-b8d5b9950555", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-172535633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63722fdf17e4408299de8c215c133812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap757f4202-bb", "ovs_interfaceid": "757f4202-bbf9-42cf-8ccc-7e970b892f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 03:53:46 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Converting VIF {"id": "757f4202-bbf9-42cf-8ccc-7e970b892f1f", "address": "fa:16:3e:db:d6:71", "network": {"id": "b2fca984-f1e9-4c86-a3a5-b8d5b9950555", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-172535633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63722fdf17e4408299de8c215c133812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap757f4202-bb", "ovs_interfaceid": "757f4202-bbf9-42cf-8ccc-7e970b892f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:53:46 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:d6:71,bridge_name='br-int',has_traffic_filtering=True,id=757f4202-bbf9-42cf-8ccc-7e970b892f1f,network=Network(b2fca984-f1e9-4c86-a3a5-b8d5b9950555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap757f4202-bb') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:53:46 user nova-compute[103546]: DEBUG os_vif [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:d6:71,bridge_name='br-int',has_traffic_filtering=True,id=757f4202-bbf9-42cf-8ccc-7e970b892f1f,network=Network(b2fca984-f1e9-4c86-a3a5-b8d5b9950555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap757f4202-bb') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 03:53:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:53:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 03:53:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6e307f88-ebfc-5131-b177-53f94cc6cd37', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:53:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:53:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap757f4202-bb, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:53:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap757f4202-bb, col_values=(('qos', UUID('232933c2-a217-4bf7-82c5-9213c38cc21f')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:53:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap757f4202-bb, col_values=(('external_ids', {'iface-id': '757f4202-bbf9-42cf-8ccc-7e970b892f1f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:d6:71', 'vm-uuid': 'ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:53:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:53:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:46 user nova-compute[103546]: INFO os_vif [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:d6:71,bridge_name='br-int',has_traffic_filtering=True,id=757f4202-bbf9-42cf-8ccc-7e970b892f1f,network=Network(b2fca984-f1e9-4c86-a3a5-b8d5b9950555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap757f4202-bb')
Nov 16 03:53:46 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:53:46 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] No VIF found with MAC fa:16:3e:db:d6:71, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 03:53:47 user nova-compute[103546]: DEBUG nova.compute.manager [req-a501cf18-81c8-424e-bafd-de26df3fc8c9 req-a4cd8105-be65-450c-80dd-e3f6a6cdbe20 service nova] [instance: 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d] Received event network-vif-plugged-a353a80b-d493-414f-b459-38227f8fc64b {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:53:47 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a501cf18-81c8-424e-bafd-de26df3fc8c9 req-a4cd8105-be65-450c-80dd-e3f6a6cdbe20 service nova] Acquiring lock "2ab2f87d-f9da-4490-8e23-2bd4a480ee5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:53:47 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a501cf18-81c8-424e-bafd-de26df3fc8c9 req-a4cd8105-be65-450c-80dd-e3f6a6cdbe20 service nova] Lock "2ab2f87d-f9da-4490-8e23-2bd4a480ee5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:53:47 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a501cf18-81c8-424e-bafd-de26df3fc8c9 req-a4cd8105-be65-450c-80dd-e3f6a6cdbe20 service nova] Lock "2ab2f87d-f9da-4490-8e23-2bd4a480ee5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:53:47 user nova-compute[103546]: DEBUG nova.compute.manager [req-a501cf18-81c8-424e-bafd-de26df3fc8c9 req-a4cd8105-be65-450c-80dd-e3f6a6cdbe20 service nova] [instance: 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d] No waiting events found dispatching network-vif-plugged-a353a80b-d493-414f-b459-38227f8fc64b {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:53:47 user nova-compute[103546]: WARNING nova.compute.manager [req-a501cf18-81c8-424e-bafd-de26df3fc8c9 req-a4cd8105-be65-450c-80dd-e3f6a6cdbe20 service nova] [instance: 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d] Received unexpected event network-vif-plugged-a353a80b-d493-414f-b459-38227f8fc64b for instance with vm_state active and task_state None.
Nov 16 03:53:47 user nova-compute[103546]: DEBUG nova.network.neutron [req-73eac015-b028-4cfe-a241-2a8837644c37 req-c27d892e-9747-475a-a369-f999b523b266 service nova] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Updated VIF entry in instance network info cache for port 757f4202-bbf9-42cf-8ccc-7e970b892f1f. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 03:53:47 user nova-compute[103546]: DEBUG nova.network.neutron [req-73eac015-b028-4cfe-a241-2a8837644c37 req-c27d892e-9747-475a-a369-f999b523b266 service nova] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Updating instance_info_cache with network_info: [{"id": "757f4202-bbf9-42cf-8ccc-7e970b892f1f", "address": "fa:16:3e:db:d6:71", "network": {"id": "b2fca984-f1e9-4c86-a3a5-b8d5b9950555", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-172535633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63722fdf17e4408299de8c215c133812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap757f4202-bb", "ovs_interfaceid": "757f4202-bbf9-42cf-8ccc-7e970b892f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:53:47 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-73eac015-b028-4cfe-a241-2a8837644c37 req-c27d892e-9747-475a-a369-f999b523b266 service nova] Releasing lock "refresh_cache-ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:53:48 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:48 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:48 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:48 user nova-compute[103546]: DEBUG nova.compute.manager [req-833bce19-d8cf-4e1c-af90-168b02488836 req-611ce2e6-c1fa-4ef2-ad6f-ab2f7262f571 service nova] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Received event network-vif-plugged-757f4202-bbf9-42cf-8ccc-7e970b892f1f {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:53:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-833bce19-d8cf-4e1c-af90-168b02488836 req-611ce2e6-c1fa-4ef2-ad6f-ab2f7262f571 service nova] Acquiring lock "ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:53:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-833bce19-d8cf-4e1c-af90-168b02488836 req-611ce2e6-c1fa-4ef2-ad6f-ab2f7262f571 service nova] Lock "ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:53:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-833bce19-d8cf-4e1c-af90-168b02488836 req-611ce2e6-c1fa-4ef2-ad6f-ab2f7262f571 service nova] Lock "ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:53:48 user nova-compute[103546]: DEBUG nova.compute.manager [req-833bce19-d8cf-4e1c-af90-168b02488836 req-611ce2e6-c1fa-4ef2-ad6f-ab2f7262f571 service nova] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] No waiting events found dispatching network-vif-plugged-757f4202-bbf9-42cf-8ccc-7e970b892f1f {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:53:48 user nova-compute[103546]: WARNING nova.compute.manager [req-833bce19-d8cf-4e1c-af90-168b02488836 req-611ce2e6-c1fa-4ef2-ad6f-ab2f7262f571 service nova] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Received unexpected event network-vif-plugged-757f4202-bbf9-42cf-8ccc-7e970b892f1f for instance with vm_state building and task_state spawning.
Nov 16 03:53:48 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:48 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:50 user nova-compute[103546]: DEBUG nova.compute.manager [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 03:53:50 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Guest created on hypervisor {{(pid=103546) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 03:53:50 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Instance spawned successfully.
Nov 16 03:53:50 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 03:53:50 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Found default for hw_cdrom_bus of ide {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:53:50 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Found default for hw_disk_bus of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:53:50 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Found default for hw_input_bus of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:53:50 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Found default for hw_pointer_model of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:53:50 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Found default for hw_video_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:53:50 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Found default for hw_vif_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:53:50 user nova-compute[103546]: INFO nova.compute.manager [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Took 5.41 seconds to spawn the instance on the hypervisor.
Nov 16 03:53:50 user nova-compute[103546]: DEBUG nova.compute.manager [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 03:53:50 user nova-compute[103546]: DEBUG nova.compute.manager [req-366a7e3f-f3dc-4e44-a852-9cbcbdd9ada1 req-50372de7-1ada-46cb-8d0c-9e4ed8b3dec3 service nova] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Received event network-vif-plugged-757f4202-bbf9-42cf-8ccc-7e970b892f1f {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:53:50 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-366a7e3f-f3dc-4e44-a852-9cbcbdd9ada1 req-50372de7-1ada-46cb-8d0c-9e4ed8b3dec3 service nova] Acquiring lock "ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:53:50 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-366a7e3f-f3dc-4e44-a852-9cbcbdd9ada1 req-50372de7-1ada-46cb-8d0c-9e4ed8b3dec3 service nova] Lock "ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:53:50 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-366a7e3f-f3dc-4e44-a852-9cbcbdd9ada1 req-50372de7-1ada-46cb-8d0c-9e4ed8b3dec3 service nova] Lock "ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:53:50 user nova-compute[103546]: DEBUG nova.compute.manager [req-366a7e3f-f3dc-4e44-a852-9cbcbdd9ada1 req-50372de7-1ada-46cb-8d0c-9e4ed8b3dec3 service nova] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] No waiting events found dispatching network-vif-plugged-757f4202-bbf9-42cf-8ccc-7e970b892f1f {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:53:50 user nova-compute[103546]: WARNING nova.compute.manager [req-366a7e3f-f3dc-4e44-a852-9cbcbdd9ada1 req-50372de7-1ada-46cb-8d0c-9e4ed8b3dec3 service nova] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Received unexpected event network-vif-plugged-757f4202-bbf9-42cf-8ccc-7e970b892f1f for instance with vm_state building and task_state spawning.
Nov 16 03:53:50 user nova-compute[103546]: INFO nova.compute.manager [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Took 6.26 seconds to build instance.
Nov 16 03:53:50 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a5d9c99d-cd9b-4e24-9cb1-fd03efab5754 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.368s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:53:51 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:56 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:53:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:01 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:02 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Acquiring lock "fa7e5468-9dd4-407d-85ec-d45ec76f9e29" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:54:02 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "fa7e5468-9dd4-407d-85ec-d45ec76f9e29" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:54:02 user nova-compute[103546]: DEBUG nova.compute.manager [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Starting instance... {{(pid=103546) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 03:54:02 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:54:02 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:54:02 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=103546) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 03:54:02 user nova-compute[103546]: INFO nova.compute.claims [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Claim successful on node user
Nov 16 03:54:02 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:54:02 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:54:02 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.433s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:54:02 user nova-compute[103546]: DEBUG nova.compute.manager [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Start building networks asynchronously for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 03:54:02 user nova-compute[103546]: DEBUG nova.compute.manager [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Allocating IP information in the background. {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 03:54:02 user nova-compute[103546]: DEBUG nova.network.neutron [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] allocate_for_instance() {{(pid=103546) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 03:54:02 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 03:54:02 user nova-compute[103546]: DEBUG nova.compute.manager [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Start building block device mappings for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 03:54:02 user nova-compute[103546]: DEBUG nova.policy [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e1176a2817ef428ea81e2fb18299a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2a38a5eb514ce8a7569c8322657eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103546) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 03:54:02 user nova-compute[103546]: INFO nova.virt.block_device [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Booting with blank volume at /dev/vda
Nov 16 03:54:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:03 user nova-compute[103546]: DEBUG nova.network.neutron [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Successfully created port: 764b22e9-e899-4d39-8bc7-903ff8a7c3f6 {{(pid=103546) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 03:54:04 user nova-compute[103546]: DEBUG nova.network.neutron [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Successfully updated port: 764b22e9-e899-4d39-8bc7-903ff8a7c3f6 {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 03:54:04 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Acquiring lock "refresh_cache-fa7e5468-9dd4-407d-85ec-d45ec76f9e29" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:54:04 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Acquired lock "refresh_cache-fa7e5468-9dd4-407d-85ec-d45ec76f9e29" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:54:04 user nova-compute[103546]: DEBUG nova.network.neutron [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 03:54:04 user nova-compute[103546]: DEBUG nova.compute.manager [req-4081c46b-c30d-4a01-8651-cdc6779c6d3e req-0cc8e047-d75c-4eee-88a9-bb9f8ac478f0 service nova] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Received event network-changed-764b22e9-e899-4d39-8bc7-903ff8a7c3f6 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:54:04 user nova-compute[103546]: DEBUG nova.compute.manager [req-4081c46b-c30d-4a01-8651-cdc6779c6d3e req-0cc8e047-d75c-4eee-88a9-bb9f8ac478f0 service nova] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Refreshing instance network info cache due to event network-changed-764b22e9-e899-4d39-8bc7-903ff8a7c3f6. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:54:04 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-4081c46b-c30d-4a01-8651-cdc6779c6d3e req-0cc8e047-d75c-4eee-88a9-bb9f8ac478f0 service nova] Acquiring lock "refresh_cache-fa7e5468-9dd4-407d-85ec-d45ec76f9e29" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:54:04 user nova-compute[103546]: DEBUG nova.network.neutron [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 03:54:04 user nova-compute[103546]: DEBUG nova.network.neutron [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Updating instance_info_cache with network_info: [{"id": "764b22e9-e899-4d39-8bc7-903ff8a7c3f6", "address": "fa:16:3e:77:63:89", "network": {"id": "fdbb2d2c-9a54-4517-b33a-cf27ce7570b1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79661471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2a38a5eb514ce8a7569c8322657eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap764b22e9-e8", "ovs_interfaceid": "764b22e9-e899-4d39-8bc7-903ff8a7c3f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:54:04 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Releasing lock "refresh_cache-fa7e5468-9dd4-407d-85ec-d45ec76f9e29" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:54:04 user nova-compute[103546]: DEBUG nova.compute.manager [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Instance network_info: |[{"id": "764b22e9-e899-4d39-8bc7-903ff8a7c3f6", "address": "fa:16:3e:77:63:89", "network": {"id": "fdbb2d2c-9a54-4517-b33a-cf27ce7570b1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79661471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2a38a5eb514ce8a7569c8322657eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap764b22e9-e8", "ovs_interfaceid": "764b22e9-e899-4d39-8bc7-903ff8a7c3f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 03:54:04 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-4081c46b-c30d-4a01-8651-cdc6779c6d3e req-0cc8e047-d75c-4eee-88a9-bb9f8ac478f0 service nova] Acquired lock "refresh_cache-fa7e5468-9dd4-407d-85ec-d45ec76f9e29" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:54:04 user nova-compute[103546]: DEBUG nova.network.neutron [req-4081c46b-c30d-4a01-8651-cdc6779c6d3e req-0cc8e047-d75c-4eee-88a9-bb9f8ac478f0 service nova] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Refreshing network info cache for port 764b22e9-e899-4d39-8bc7-903ff8a7c3f6 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:54:05 user nova-compute[103546]: DEBUG nova.network.neutron [req-4081c46b-c30d-4a01-8651-cdc6779c6d3e req-0cc8e047-d75c-4eee-88a9-bb9f8ac478f0 service nova] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Updated VIF entry in instance network info cache for port 764b22e9-e899-4d39-8bc7-903ff8a7c3f6. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 03:54:05 user nova-compute[103546]: DEBUG nova.network.neutron [req-4081c46b-c30d-4a01-8651-cdc6779c6d3e req-0cc8e047-d75c-4eee-88a9-bb9f8ac478f0 service nova] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Updating instance_info_cache with network_info: [{"id": "764b22e9-e899-4d39-8bc7-903ff8a7c3f6", "address": "fa:16:3e:77:63:89", "network": {"id": "fdbb2d2c-9a54-4517-b33a-cf27ce7570b1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79661471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2a38a5eb514ce8a7569c8322657eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap764b22e9-e8", "ovs_interfaceid": "764b22e9-e899-4d39-8bc7-903ff8a7c3f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:54:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-4081c46b-c30d-4a01-8651-cdc6779c6d3e req-0cc8e047-d75c-4eee-88a9-bb9f8ac478f0 service nova] Releasing lock "refresh_cache-fa7e5468-9dd4-407d-85ec-d45ec76f9e29" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:54:06 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:08 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b72e80b4-ebd4-4e3f-b954-fad01aec92f2 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Acquiring lock "51554aab-44ec-4161-b926-9c07a3f838a5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:54:08 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b72e80b4-ebd4-4e3f-b954-fad01aec92f2 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Lock "51554aab-44ec-4161-b926-9c07a3f838a5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:54:08 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b72e80b4-ebd4-4e3f-b954-fad01aec92f2 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Acquiring lock "51554aab-44ec-4161-b926-9c07a3f838a5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:54:08 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b72e80b4-ebd4-4e3f-b954-fad01aec92f2 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Lock "51554aab-44ec-4161-b926-9c07a3f838a5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:54:08 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b72e80b4-ebd4-4e3f-b954-fad01aec92f2 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Lock "51554aab-44ec-4161-b926-9c07a3f838a5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:54:08 user nova-compute[103546]: INFO nova.compute.manager [None req-b72e80b4-ebd4-4e3f-b954-fad01aec92f2 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Terminating instance
Nov 16 03:54:08 user nova-compute[103546]: DEBUG nova.compute.manager [None req-b72e80b4-ebd4-4e3f-b954-fad01aec92f2 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Start destroying the instance on the hypervisor. {{(pid=103546) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 03:54:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:08 user nova-compute[103546]: DEBUG nova.compute.manager [req-73f3ab61-b68e-4996-9c55-546a1edc2ff5 req-33ed2a3c-6a34-434e-b2e8-608fef4fe1da service nova] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Received event network-vif-unplugged-e36fae5d-773f-47c0-b79a-5aadf6412cbc {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:54:08 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-73f3ab61-b68e-4996-9c55-546a1edc2ff5 req-33ed2a3c-6a34-434e-b2e8-608fef4fe1da service nova] Acquiring lock "51554aab-44ec-4161-b926-9c07a3f838a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:54:08 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-73f3ab61-b68e-4996-9c55-546a1edc2ff5 req-33ed2a3c-6a34-434e-b2e8-608fef4fe1da service nova] Lock "51554aab-44ec-4161-b926-9c07a3f838a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:54:08 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-73f3ab61-b68e-4996-9c55-546a1edc2ff5 req-33ed2a3c-6a34-434e-b2e8-608fef4fe1da service nova] Lock "51554aab-44ec-4161-b926-9c07a3f838a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:54:08 user nova-compute[103546]: DEBUG nova.compute.manager [req-73f3ab61-b68e-4996-9c55-546a1edc2ff5 req-33ed2a3c-6a34-434e-b2e8-608fef4fe1da service nova] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] No waiting events found dispatching network-vif-unplugged-e36fae5d-773f-47c0-b79a-5aadf6412cbc {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:54:08 user nova-compute[103546]: DEBUG nova.compute.manager [req-73f3ab61-b68e-4996-9c55-546a1edc2ff5 req-33ed2a3c-6a34-434e-b2e8-608fef4fe1da service nova] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Received event network-vif-unplugged-e36fae5d-773f-47c0-b79a-5aadf6412cbc for instance with task_state deleting. {{(pid=103546) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 03:54:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:08 user nova-compute[103546]: DEBUG os_brick.utils [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:54:08 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:08 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:08 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a8ac5b-2433-48ef-a011-06c682765ee8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af5c39b14ece\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:08 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:08 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:08 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2156bcd-da7f-4d65-81b0-48e951319608]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:08 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:08 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:08 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea90bc70-2fef-4fda-b631-9ba7d06c265c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:08 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[2473e204-9290-4a1b-a142-f74e7055ab4e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:08 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Running cmd (subprocess): nvme version {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:08 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] 'nvme version' failed. Not Retrying. {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] nvme not present on system {{(pid=103546) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:09 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Instance destroyed successfully.
Nov 16 03:54:09 user nova-compute[103546]: DEBUG nova.objects.instance [None req-b72e80b4-ebd4-4e3f-b954-fad01aec92f2 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Lazy-loading 'resources' on Instance uuid 51554aab-44ec-4161-b926-9c07a3f838a5 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:54:09 user nova-compute[103546]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 03:54:09 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6dfc49-3f5e-4d36-bbd3-c49fa167c102]: (4, '') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=103546) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] LIGHTOS: no hostnqn found. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG os_brick.utils [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af5c39b14ece', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG nova.virt.block_device [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Updating existing volume attachment record: e0bee130-28c9-4efb-b0c7-99be68216f20 {{(pid=103546) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-b72e80b4-ebd4-4e3f-b954-fad01aec92f2 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:46:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1580842921',display_name='tempest-ServerActionsTestOtherB-server-1580842921',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1580842921',id=2,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4BC4cHDV2fbJoL15YFOsrL3Jj/txUDoSxREB28Izf7niUsDWNVN4I6jw0qVmlW7BvPaNCWUAskE06oeKsT+2XD63IEOwvY2xtSda7L7/qiL3VY46L9X29CD+3k2W4RoA==',key_name='tempest-keypair-857843108',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:51:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f76ca2da0c584a7382040eb113da4c2a',ramdisk_id='',reservation_id='r-kl1f6eox',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-648062424',owner_user_name='tempest-ServerActionsTestOtherB-648062424-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T03:51:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4bf11ccac9f4203808f8dca52cde36c',uuid=51554aab-44ec-4161-b926-9c07a3f838a5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e36fae5d-773f-47c0-b79a-5aadf6412cbc", "address": "fa:16:3e:9a:45:d0", "network": {"id": "ef471a6e-7bd1-4a61-aa01-fd7557bfae1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-865941926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76ca2da0c584a7382040eb113da4c2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape36fae5d-77", "ovs_interfaceid": "e36fae5d-773f-47c0-b79a-5aadf6412cbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-b72e80b4-ebd4-4e3f-b954-fad01aec92f2 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Converting VIF {"id": "e36fae5d-773f-47c0-b79a-5aadf6412cbc", "address": "fa:16:3e:9a:45:d0", "network": {"id": "ef471a6e-7bd1-4a61-aa01-fd7557bfae1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-865941926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76ca2da0c584a7382040eb113da4c2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape36fae5d-77", "ovs_interfaceid": "e36fae5d-773f-47c0-b79a-5aadf6412cbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-b72e80b4-ebd4-4e3f-b954-fad01aec92f2 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:45:d0,bridge_name='br-int',has_traffic_filtering=True,id=e36fae5d-773f-47c0-b79a-5aadf6412cbc,network=Network(ef471a6e-7bd1-4a61-aa01-fd7557bfae1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape36fae5d-77') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG os_vif [None req-b72e80b4-ebd4-4e3f-b954-fad01aec92f2 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:45:d0,bridge_name='br-int',has_traffic_filtering=True,id=e36fae5d-773f-47c0-b79a-5aadf6412cbc,network=Network(ef471a6e-7bd1-4a61-aa01-fd7557bfae1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape36fae5d-77') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape36fae5d-77, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7f354419-fdc4-473f-97ed-85b5c78694c2) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:54:09 user nova-compute[103546]: INFO os_vif [None req-b72e80b4-ebd4-4e3f-b954-fad01aec92f2 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:45:d0,bridge_name='br-int',has_traffic_filtering=True,id=e36fae5d-773f-47c0-b79a-5aadf6412cbc,network=Network(ef471a6e-7bd1-4a61-aa01-fd7557bfae1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape36fae5d-77')
Nov 16 03:54:09 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b72e80b4-ebd4-4e3f-b954-fad01aec92f2 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72e80b4-ebd4-4e3f-b954-fad01aec92f2 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YukJztTB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:54:09 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-b72e80b4-ebd4-4e3f-b954-fad01aec92f2 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:54:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-b72e80b4-ebd4-4e3f-b954-fad01aec92f2 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-b72e80b4-ebd4-4e3f-b954-fad01aec92f2 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[25115025-ad54-44a0-a7f4-39a34cfeb4a8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72e80b4-ebd4-4e3f-b954-fad01aec92f2 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 03:54:09 user nova-compute[103546]: No targets found.
Nov 16 03:54:09 user nova-compute[103546]: iSNS:
Nov 16 03:54:09 user nova-compute[103546]: No targets found.
Nov 16 03:54:09 user nova-compute[103546]: STATIC:
Nov 16 03:54:09 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c
Nov 16 03:54:09 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:54:09 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:54:09 user nova-compute[103546]: FIRMWARE:
Nov 16 03:54:09 user nova-compute[103546]: No targets found.
Nov 16 03:54:09 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72e80b4-ebd4-4e3f-b954-fad01aec92f2 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 03:54:09 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 03:54:09 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72e80b4-ebd4-4e3f-b954-fad01aec92f2 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f0d7ed-d47d-47d6-8a12-9cc9401d02d1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[316ad762-3a94-4e83-b3d4-abf84dbfd804]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72e80b4-ebd4-4e3f-b954-fad01aec92f2 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)
Nov 16 03:54:09 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72e80b4-ebd4-4e3f-b954-fad01aec92f2 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c (non-flash)
Nov 16 03:54:09 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72e80b4-ebd4-4e3f-b954-fad01aec92f2 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60cc292c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c'): ({'sdb'}, set())}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-b72e80b4-ebd4-4e3f-b954-fad01aec92f2 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Removing single pathed devices sdb {{(pid=103546) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b57bddd-735e-49d3-aa1c-2d640f64a17f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7dc2301-9b9a-49c7-be79-5014f78ea18b]: (4, ('ok\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-b72e80b4-ebd4-4e3f-b954-fad01aec92f2 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Flushing IO for device /dev/sdb {{(pid=103546) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2db9bb-d287-4c92-b6ac-5c2a7c8757d7]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-b72e80b4-ebd4-4e3f-b954-fad01aec92f2 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=103546) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc112d9-6b68-4e6d-b6af-35cad8256835]: (4, ('1', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-b72e80b4-ebd4-4e3f-b954-fad01aec92f2 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-b72e80b4-ebd4-4e3f-b954-fad01aec92f2 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] SCSI volumes sdb have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72e80b4-ebd4-4e3f-b954-fad01aec92f2 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c')] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d084b0-65f7-4836-9b5d-fd9dc3a620c7]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72e80b4-ebd4-4e3f-b954-fad01aec92f2 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260 --logout {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[73dfe23c-12df-4b7c-a940-4294ca8c168b]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72e80b4-ebd4-4e3f-b954-fad01aec92f2 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c, portal: 172.16.0.220,3260]
Nov 16 03:54:09 user nova-compute[103546]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c, portal: 172.16.0.220,3260] successful.
Nov 16 03:54:09 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260 --op delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4156a8b3-4b47-48ef-ad34-1ace6437b49c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[124e8220-5a05-4667-8a9d-9e2e289d9acd]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72e80b4-ebd4-4e3f-b954-fad01aec92f2 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-b72e80b4-ebd4-4e3f-b954-fad01aec92f2 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72e80b4-ebd4-4e3f-b954-fad01aec92f2 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] <== disconnect_volume: return (294ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b72e80b4-ebd4-4e3f-b954-fad01aec92f2 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 03:54:09 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-b72e80b4-ebd4-4e3f-b954-fad01aec92f2 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Deleting instance files /opt/stack/data/nova/instances/51554aab-44ec-4161-b926-9c07a3f838a5_del
Nov 16 03:54:09 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-b72e80b4-ebd4-4e3f-b954-fad01aec92f2 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Deletion of /opt/stack/data/nova/instances/51554aab-44ec-4161-b926-9c07a3f838a5_del complete
Nov 16 03:54:09 user nova-compute[103546]: INFO nova.compute.manager [None req-b72e80b4-ebd4-4e3f-b954-fad01aec92f2 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Took 1.28 seconds to destroy the instance on the hypervisor.
Nov 16 03:54:09 user nova-compute[103546]: DEBUG oslo.service.loopingcall [None req-b72e80b4-ebd4-4e3f-b954-fad01aec92f2 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=103546) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG nova.compute.manager [-] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Deallocating network for instance {{(pid=103546) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 03:54:09 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] deallocate_for_instance() {{(pid=103546) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 03:54:10 user nova-compute[103546]: DEBUG nova.compute.manager [req-952fb1b7-e9f0-4416-8476-b8e1a4d6486a req-8f1a47e3-ae64-4198-a288-436530f93fa1 service nova] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Received event network-vif-plugged-e36fae5d-773f-47c0-b79a-5aadf6412cbc {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:54:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-952fb1b7-e9f0-4416-8476-b8e1a4d6486a req-8f1a47e3-ae64-4198-a288-436530f93fa1 service nova] Acquiring lock "51554aab-44ec-4161-b926-9c07a3f838a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:54:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-952fb1b7-e9f0-4416-8476-b8e1a4d6486a req-8f1a47e3-ae64-4198-a288-436530f93fa1 service nova] Lock "51554aab-44ec-4161-b926-9c07a3f838a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:54:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-952fb1b7-e9f0-4416-8476-b8e1a4d6486a req-8f1a47e3-ae64-4198-a288-436530f93fa1 service nova] Lock "51554aab-44ec-4161-b926-9c07a3f838a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:54:10 user nova-compute[103546]: DEBUG nova.compute.manager [req-952fb1b7-e9f0-4416-8476-b8e1a4d6486a req-8f1a47e3-ae64-4198-a288-436530f93fa1 service nova] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] No waiting events found dispatching network-vif-plugged-e36fae5d-773f-47c0-b79a-5aadf6412cbc {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:54:10 user nova-compute[103546]: WARNING nova.compute.manager [req-952fb1b7-e9f0-4416-8476-b8e1a4d6486a req-8f1a47e3-ae64-4198-a288-436530f93fa1 service nova] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Received unexpected event network-vif-plugged-e36fae5d-773f-47c0-b79a-5aadf6412cbc for instance with vm_state active and task_state deleting.
Nov 16 03:54:10 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:54:10 user nova-compute[103546]: INFO nova.compute.manager [-] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Took 1.35 seconds to deallocate network for instance.
Nov 16 03:54:11 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:54:12 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:54:12 user nova-compute[103546]: DEBUG nova.compute.manager [req-4562f416-0309-4fe5-b9a1-ba1a7b0a1c90 req-a4ced1d6-7df7-4965-b3fb-609a5e9cfd5f service nova] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Received event network-vif-deleted-e36fae5d-773f-47c0-b79a-5aadf6412cbc {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:54:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:13 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:54:13 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:54:13 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:54:13 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=103546) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 03:54:13 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager.update_available_resource {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:54:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:54:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:54:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:54:13 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Auditing locally available compute resources for user (node: user) {{(pid=103546) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 03:54:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63b95121-b211-42c3-831e-0392d4abd09a/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63b95121-b211-42c3-831e-0392d4abd09a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63b95121-b211-42c3-831e-0392d4abd09a/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63b95121-b211-42c3-831e-0392d4abd09a/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/164533fb-64e1-4aa5-b5fb-273817dd3e74/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-c868de54-358a-4b4e-ab4c-afa07e560c3a tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Acquiring lock "63b95121-b211-42c3-831e-0392d4abd09a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:54:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-c868de54-358a-4b4e-ab4c-afa07e560c3a tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "63b95121-b211-42c3-831e-0392d4abd09a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:54:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-c868de54-358a-4b4e-ab4c-afa07e560c3a tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Acquiring lock "63b95121-b211-42c3-831e-0392d4abd09a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:54:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-c868de54-358a-4b4e-ab4c-afa07e560c3a tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "63b95121-b211-42c3-831e-0392d4abd09a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:54:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-c868de54-358a-4b4e-ab4c-afa07e560c3a tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "63b95121-b211-42c3-831e-0392d4abd09a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:54:14 user nova-compute[103546]: INFO nova.compute.manager [None req-c868de54-358a-4b4e-ab4c-afa07e560c3a tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Terminating instance
Nov 16 03:54:14 user nova-compute[103546]: DEBUG nova.compute.manager [None req-c868de54-358a-4b4e-ab4c-afa07e560c3a tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Start destroying the instance on the hypervisor. {{(pid=103546) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 03:54:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:14 user nova-compute[103546]: INFO nova.compute.manager [None req-b72e80b4-ebd4-4e3f-b954-fad01aec92f2 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] [instance: 51554aab-44ec-4161-b926-9c07a3f838a5] Took 3.62 seconds to detach 1 volumes for instance.
Nov 16 03:54:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/164533fb-64e1-4aa5-b5fb-273817dd3e74/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/164533fb-64e1-4aa5-b5fb-273817dd3e74/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b72e80b4-ebd4-4e3f-b954-fad01aec92f2 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:54:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b72e80b4-ebd4-4e3f-b954-fad01aec92f2 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:54:14 user nova-compute[103546]: DEBUG nova.compute.manager [req-df917bc1-feac-49b7-9507-b6c6b5a7f0fc req-c28b884c-368b-45b4-855f-c138c2179b6f service nova] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Received event network-vif-unplugged-1d1c7496-0480-45a7-8490-bc581314a4b5 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:54:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-df917bc1-feac-49b7-9507-b6c6b5a7f0fc req-c28b884c-368b-45b4-855f-c138c2179b6f service nova] Acquiring lock "63b95121-b211-42c3-831e-0392d4abd09a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:54:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-df917bc1-feac-49b7-9507-b6c6b5a7f0fc req-c28b884c-368b-45b4-855f-c138c2179b6f service nova] Lock "63b95121-b211-42c3-831e-0392d4abd09a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:54:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-df917bc1-feac-49b7-9507-b6c6b5a7f0fc req-c28b884c-368b-45b4-855f-c138c2179b6f service nova] Lock "63b95121-b211-42c3-831e-0392d4abd09a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:54:14 user nova-compute[103546]: DEBUG nova.compute.manager [req-df917bc1-feac-49b7-9507-b6c6b5a7f0fc req-c28b884c-368b-45b4-855f-c138c2179b6f service nova] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] No waiting events found dispatching network-vif-unplugged-1d1c7496-0480-45a7-8490-bc581314a4b5 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:54:14 user nova-compute[103546]: DEBUG nova.compute.manager [req-df917bc1-feac-49b7-9507-b6c6b5a7f0fc req-c28b884c-368b-45b4-855f-c138c2179b6f service nova] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Received event network-vif-unplugged-1d1c7496-0480-45a7-8490-bc581314a4b5 for instance with task_state deleting. {{(pid=103546) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 03:54:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/164533fb-64e1-4aa5-b5fb-273817dd3e74/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e2954-d786-4544-903d-8edc63646e2d/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e2954-d786-4544-903d-8edc63646e2d/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e2954-d786-4544-903d-8edc63646e2d/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG nova.compute.manager [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Start spawning the instance on the hypervisor. {{(pid=103546) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Creating instance directory {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 03:54:15 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Creating image(s)
Nov 16 03:54:15 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Did not create local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Ensure instance console log exists: /opt/stack/data/nova/instances/fa7e5468-9dd4-407d-85ec-d45ec76f9e29/console.log {{(pid=103546) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Start _get_guest_xml network_info=[{"id": "764b22e9-e899-4d39-8bc7-903ff8a7c3f6", "address": "fa:16:3e:77:63:89", "network": {"id": "fdbb2d2c-9a54-4517-b33a-cf27ce7570b1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79661471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2a38a5eb514ce8a7569c8322657eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap764b22e9-e8", "ovs_interfaceid": "764b22e9-e899-4d39-8bc7-903ff8a7c3f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iCqEsNVr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fa7e5468-9dd4-407d-85ec-d45ec76f9e29', 'attached_at': '', 'detached_at': '', 'volume_id': '13e5eaa2-fe85-49ac-bbac-868f460052c4', 'serial': '13e5eaa2-fe85-49ac-bbac-868f460052c4'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': 'e0bee130-28c9-4efb-b0c7-99be68216f20', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 03:54:15 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:54:15 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:54:15 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iCqEsNVr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:54:15 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:54:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:54:15 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:54:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:54:15 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 03:54:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-b72e80b4-ebd4-4e3f-b954-fad01aec92f2 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[06bf39f0-cc3a-4b7f-adeb-c6afe8f10670]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 03:54:15 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 -p 172.16.0.220:3260 --interface default --op new {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-b72e80b4-ebd4-4e3f-b954-fad01aec92f2 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[440d5f56-3c3d-4366-88e1-ff0418b2abfa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4] added\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4] added
Nov 16 03:54:15 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279e2954-d786-4544-903d-8edc63646e2d/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:15 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Instance destroyed successfully.
Nov 16 03:54:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG nova.objects.instance [None req-c868de54-358a-4b4e-ab4c-afa07e560c3a tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lazy-loading 'resources' on Instance uuid 63b95121-b211-42c3-831e-0392d4abd09a {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ab2f87d-f9da-4490-8e23-2bd4a480ee5d/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f3dca5-4a18-40d4-a4b0-42fa55b926bd]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-c868de54-358a-4b4e-ab4c-afa07e560c3a tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:47:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1693518474',display_name='tempest-SnapshotDataIntegrityTests-server-1693518474',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1693518474',id=11,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBStc3SwhKriifb6Lf+wfleymdqv1HlD3cx17KRGI6YfZHuY3k/9b9YKDECdgiHY/Mo+bLSHsX34vv8MNK0zWVPsPqr0zxVWc36FyNVh2wu5bSUV/wGEn1LoJhZRQ546xA==',key_name='tempest-keypair-1255664858',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:47:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae61d862fd974779a8caf830313a724a',ramdisk_id='',reservation_id='r-9z7lvyq8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-459500828',owner_user_name='tempest-SnapshotDataIntegrityTests-459500828-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T03:47:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6867c00b4e574b09b3d1174d19b52ff5',uuid=63b95121-b211-42c3-831e-0392d4abd09a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1d1c7496-0480-45a7-8490-bc581314a4b5", "address": "fa:16:3e:d0:5b:e1", "network": {"id": "532683c8-74f9-43bb-a60f-7240b52da4d7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-747146599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae61d862fd974779a8caf830313a724a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d1c7496-04", "ovs_interfaceid": "1d1c7496-0480-45a7-8490-bc581314a4b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-c868de54-358a-4b4e-ab4c-afa07e560c3a tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Converting VIF {"id": "1d1c7496-0480-45a7-8490-bc581314a4b5", "address": "fa:16:3e:d0:5b:e1", "network": {"id": "532683c8-74f9-43bb-a60f-7240b52da4d7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-747146599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae61d862fd974779a8caf830313a724a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d1c7496-04", "ovs_interfaceid": "1d1c7496-0480-45a7-8490-bc581314a4b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-c868de54-358a-4b4e-ab4c-afa07e560c3a tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:5b:e1,bridge_name='br-int',has_traffic_filtering=True,id=1d1c7496-0480-45a7-8490-bc581314a4b5,network=Network(532683c8-74f9-43bb-a60f-7240b52da4d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d1c7496-04') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG os_vif [None req-c868de54-358a-4b4e-ab4c-afa07e560c3a tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:5b:e1,bridge_name='br-int',has_traffic_filtering=True,id=1d1c7496-0480-45a7-8490-bc581314a4b5,network=Network(532683c8-74f9-43bb-a60f-7240b52da4d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d1c7496-04') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b72e80b4-ebd4-4e3f-b954-fad01aec92f2 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.673s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7588ce-e07c-4ea3-9224-fcd910b6830a]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1d1c7496-04, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iCqEsNVr {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=38ac57f9-3adf-4b83-8606-2afcc5ebc10a) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:54:15 user nova-compute[103546]: INFO os_vif [None req-c868de54-358a-4b4e-ab4c-afa07e560c3a tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:5b:e1,bridge_name='br-int',has_traffic_filtering=True,id=1d1c7496-0480-45a7-8490-bc581314a4b5,network=Network(532683c8-74f9-43bb-a60f-7240b52da4d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d1c7496-04')
Nov 16 03:54:15 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-c868de54-358a-4b4e-ab4c-afa07e560c3a tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Deleting instance files /opt/stack/data/nova/instances/63b95121-b211-42c3-831e-0392d4abd09a_del
Nov 16 03:54:15 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-c868de54-358a-4b4e-ab4c-afa07e560c3a tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Deletion of /opt/stack/data/nova/instances/63b95121-b211-42c3-831e-0392d4abd09a_del complete
Nov 16 03:54:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iCqEsNVr" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[4567ab47-23c2-4298-b601-748d758c4e30]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iCqEsNVr'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:15 user nova-compute[103546]: INFO nova.scheduler.client.report [None req-b72e80b4-ebd4-4e3f-b954-fad01aec92f2 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Deleted allocations for instance 51554aab-44ec-4161-b926-9c07a3f838a5
Nov 16 03:54:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[7298e10d-54d3-4d03-95dd-350d1d9b646d]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.024s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[085d71fe-6524-4bf2-840f-bc8e472ab9c1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 03:54:15 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 03:54:15 user nova-compute[103546]:  {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:54:15 user nova-compute[103546]: WARNING os_brick.initiator.connectors.iscsi [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 03:54:15 user nova-compute[103546]: 
Nov 16 03:54:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 -p 172.16.0.220:3260 --login {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:15 user nova-compute[103546]: INFO nova.compute.manager [None req-c868de54-358a-4b4e-ab4c-afa07e560c3a tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 16 03:54:15 user nova-compute[103546]: DEBUG oslo.service.loopingcall [None req-c868de54-358a-4b4e-ab4c-afa07e560c3a tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=103546) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG nova.compute.manager [-] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Deallocating network for instance {{(pid=103546) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] deallocate_for_instance() {{(pid=103546) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6d7503-328d-4b9a-870e-1bb2bda85527]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4, portal: 172.16.0.220,3260]
Nov 16 03:54:15 user nova-compute[103546]: Login to [iface: default, target: iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4, portal: 172.16.0.220,3260] successful.
Nov 16 03:54:15 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ab2f87d-f9da-4490-8e23-2bd4a480ee5d/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ab2f87d-f9da-4490-8e23-2bd4a480ee5d/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f98ea74-4c76-4959-8796-bc654a032f88]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b72e80b4-ebd4-4e3f-b954-fad01aec92f2 tempest-ServerActionsTestOtherB-648062424 tempest-ServerActionsTestOtherB-648062424-project-member] Lock "51554aab-44ec-4161-b926-9c07a3f838a5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.327s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccdfdac5-478e-46db-b426-ba8ae46f64b5]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:54:15 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:54:15 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.398s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] HCTL ('33', '-', '-', 0) found on session 25 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.031s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[916f43e3-ff48-41c1-99e2-f87cdd264490]: (4, ('- - 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iCqEsNVr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ab2f87d-f9da-4490-8e23-2bd4a480ee5d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4edd4240-a8e3-4f7d-ad89-795d294b72df/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4edd4240-a8e3-4f7d-ad89-795d294b72df/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4edd4240-a8e3-4f7d-ad89-795d294b72df/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4edd4240-a8e3-4f7d-ad89-795d294b72df/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:16 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.449s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:54:16 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] <== connect_volume: return (1454ms) {'type': 'block', 'scsi_wwn': '23434316231663638', 'path': '/dev/sdb'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:54:16 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23434316231663638', 'path': '/dev/sdb'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 03:54:16 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:54:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1633576482',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1633576482',id=23,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f2a38a5eb514ce8a7569c8322657eac',ramdisk_id='',reservation_id='r-zp4ivzie',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1634874924',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:54:03Z,user_data=None,user_id='e1176a2817ef428ea81e2fb18299a306',uuid=fa7e5468-9dd4-407d-85ec-d45ec76f9e29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "764b22e9-e899-4d39-8bc7-903ff8a7c3f6", "address": "fa:16:3e:77:63:89", "network": {"id": "fdbb2d2c-9a54-4517-b33a-cf27ce7570b1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79661471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2a38a5eb514ce8a7569c8322657eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap764b22e9-e8", "ovs_interfaceid": "764b22e9-e899-4d39-8bc7-903ff8a7c3f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 03:54:16 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Converting VIF {"id": "764b22e9-e899-4d39-8bc7-903ff8a7c3f6", "address": "fa:16:3e:77:63:89", "network": {"id": "fdbb2d2c-9a54-4517-b33a-cf27ce7570b1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79661471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2a38a5eb514ce8a7569c8322657eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap764b22e9-e8", "ovs_interfaceid": "764b22e9-e899-4d39-8bc7-903ff8a7c3f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:54:16 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:63:89,bridge_name='br-int',has_traffic_filtering=True,id=764b22e9-e899-4d39-8bc7-903ff8a7c3f6,network=Network(fdbb2d2c-9a54-4517-b33a-cf27ce7570b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap764b22e9-e8') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:54:16 user nova-compute[103546]: DEBUG nova.objects.instance [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lazy-loading 'pci_devices' on Instance uuid fa7e5468-9dd4-407d-85ec-d45ec76f9e29 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:54:16 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] End _get_guest_xml xml=<domain type="kvm">
Nov 16 03:54:16 user nova-compute[103546]:   <uuid>fa7e5468-9dd4-407d-85ec-d45ec76f9e29</uuid>
Nov 16 03:54:16 user nova-compute[103546]:   <name>instance-00000017</name>
Nov 16 03:54:16 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 03:54:16 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 03:54:16 user nova-compute[103546]:   <metadata>
Nov 16 03:54:16 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 03:54:16 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 03:54:16 user nova-compute[103546]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1633576482</nova:name>
Nov 16 03:54:16 user nova-compute[103546]:       <nova:creationTime>2023-11-16 03:54:15</nova:creationTime>
Nov 16 03:54:16 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 03:54:16 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 03:54:16 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 03:54:16 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 03:54:16 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 03:54:16 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 03:54:16 user nova-compute[103546]:       </nova:flavor>
Nov 16 03:54:16 user nova-compute[103546]:       <nova:owner>
Nov 16 03:54:16 user nova-compute[103546]:         <nova:user uuid="e1176a2817ef428ea81e2fb18299a306">tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member</nova:user>
Nov 16 03:54:16 user nova-compute[103546]:         <nova:project uuid="6f2a38a5eb514ce8a7569c8322657eac">tempest-ServerBootFromVolumeStableRescueTest-1634874924</nova:project>
Nov 16 03:54:16 user nova-compute[103546]:       </nova:owner>
Nov 16 03:54:16 user nova-compute[103546]:       <nova:root type="image" uuid="5c6f539a-01e5-4478-bf8f-a14310b5d7dd"/>
Nov 16 03:54:16 user nova-compute[103546]:       <nova:ports>
Nov 16 03:54:16 user nova-compute[103546]:         <nova:port uuid="764b22e9-e899-4d39-8bc7-903ff8a7c3f6">
Nov 16 03:54:16 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 16 03:54:16 user nova-compute[103546]:         </nova:port>
Nov 16 03:54:16 user nova-compute[103546]:       </nova:ports>
Nov 16 03:54:16 user nova-compute[103546]:     </nova:instance>
Nov 16 03:54:16 user nova-compute[103546]:   </metadata>
Nov 16 03:54:16 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 03:54:16 user nova-compute[103546]:     <system>
Nov 16 03:54:16 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 03:54:16 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 03:54:16 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 03:54:16 user nova-compute[103546]:       <entry name="serial">fa7e5468-9dd4-407d-85ec-d45ec76f9e29</entry>
Nov 16 03:54:16 user nova-compute[103546]:       <entry name="uuid">fa7e5468-9dd4-407d-85ec-d45ec76f9e29</entry>
Nov 16 03:54:16 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 03:54:16 user nova-compute[103546]:     </system>
Nov 16 03:54:16 user nova-compute[103546]:   </sysinfo>
Nov 16 03:54:16 user nova-compute[103546]:   <os>
Nov 16 03:54:16 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 03:54:16 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 03:54:16 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 03:54:16 user nova-compute[103546]:   </os>
Nov 16 03:54:16 user nova-compute[103546]:   <features>
Nov 16 03:54:16 user nova-compute[103546]:     <acpi/>
Nov 16 03:54:16 user nova-compute[103546]:     <apic/>
Nov 16 03:54:16 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 03:54:16 user nova-compute[103546]:   </features>
Nov 16 03:54:16 user nova-compute[103546]:   <clock offset="utc">
Nov 16 03:54:16 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 03:54:16 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 03:54:16 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 03:54:16 user nova-compute[103546]:   </clock>
Nov 16 03:54:16 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 03:54:16 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 03:54:16 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 03:54:16 user nova-compute[103546]:   </cpu>
Nov 16 03:54:16 user nova-compute[103546]:   <devices>
Nov 16 03:54:16 user nova-compute[103546]:     <disk type="block" device="disk">
Nov 16 03:54:16 user nova-compute[103546]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 03:54:16 user nova-compute[103546]:       <source dev="/dev/sdb"/>
Nov 16 03:54:16 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 03:54:16 user nova-compute[103546]:       <serial>13e5eaa2-fe85-49ac-bbac-868f460052c4</serial>
Nov 16 03:54:16 user nova-compute[103546]:     </disk>
Nov 16 03:54:16 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 03:54:16 user nova-compute[103546]:       <mac address="fa:16:3e:77:63:89"/>
Nov 16 03:54:16 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:54:16 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 03:54:16 user nova-compute[103546]:       <target dev="tap764b22e9-e8"/>
Nov 16 03:54:16 user nova-compute[103546]:     </interface>
Nov 16 03:54:16 user nova-compute[103546]:     <serial type="pty">
Nov 16 03:54:16 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/fa7e5468-9dd4-407d-85ec-d45ec76f9e29/console.log" append="off"/>
Nov 16 03:54:16 user nova-compute[103546]:     </serial>
Nov 16 03:54:16 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 03:54:16 user nova-compute[103546]:     <video>
Nov 16 03:54:16 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:54:16 user nova-compute[103546]:     </video>
Nov 16 03:54:16 user nova-compute[103546]:     <rng model="virtio">
Nov 16 03:54:16 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 03:54:16 user nova-compute[103546]:     </rng>
Nov 16 03:54:16 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 03:54:16 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 03:54:16 user nova-compute[103546]:       <stats period="10"/>
Nov 16 03:54:16 user nova-compute[103546]:     </memballoon>
Nov 16 03:54:16 user nova-compute[103546]:   </devices>
Nov 16 03:54:16 user nova-compute[103546]: </domain>
Nov 16 03:54:16 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 03:54:16 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:54:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1633576482',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1633576482',id=23,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f2a38a5eb514ce8a7569c8322657eac',ramdisk_id='',reservation_id='r-zp4ivzie',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1634874924',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:54:03Z,user_data=None,user_id='e1176a2817ef428ea81e2fb18299a306',uuid=fa7e5468-9dd4-407d-85ec-d45ec76f9e29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "764b22e9-e899-4d39-8bc7-903ff8a7c3f6", "address": "fa:16:3e:77:63:89", "network": {"id": "fdbb2d2c-9a54-4517-b33a-cf27ce7570b1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79661471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2a38a5eb514ce8a7569c8322657eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap764b22e9-e8", "ovs_interfaceid": "764b22e9-e899-4d39-8bc7-903ff8a7c3f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 03:54:16 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Converting VIF {"id": "764b22e9-e899-4d39-8bc7-903ff8a7c3f6", "address": "fa:16:3e:77:63:89", "network": {"id": "fdbb2d2c-9a54-4517-b33a-cf27ce7570b1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79661471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2a38a5eb514ce8a7569c8322657eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap764b22e9-e8", "ovs_interfaceid": "764b22e9-e899-4d39-8bc7-903ff8a7c3f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:54:16 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:63:89,bridge_name='br-int',has_traffic_filtering=True,id=764b22e9-e899-4d39-8bc7-903ff8a7c3f6,network=Network(fdbb2d2c-9a54-4517-b33a-cf27ce7570b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap764b22e9-e8') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:54:16 user nova-compute[103546]: DEBUG os_vif [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:63:89,bridge_name='br-int',has_traffic_filtering=True,id=764b22e9-e899-4d39-8bc7-903ff8a7c3f6,network=Network(fdbb2d2c-9a54-4517-b33a-cf27ce7570b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap764b22e9-e8') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 03:54:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:54:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 03:54:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6593472d-3beb-5878-9d0d-4f1f1aae14db', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:54:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:16 user nova-compute[103546]: DEBUG nova.compute.manager [req-3a84fa45-b6d2-4fa6-b09f-92e0cad12c5e req-81617c70-3834-480f-85d9-e1845fae8ab7 service nova] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Received event network-vif-plugged-1d1c7496-0480-45a7-8490-bc581314a4b5 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:54:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3a84fa45-b6d2-4fa6-b09f-92e0cad12c5e req-81617c70-3834-480f-85d9-e1845fae8ab7 service nova] Acquiring lock "63b95121-b211-42c3-831e-0392d4abd09a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:54:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3a84fa45-b6d2-4fa6-b09f-92e0cad12c5e req-81617c70-3834-480f-85d9-e1845fae8ab7 service nova] Lock "63b95121-b211-42c3-831e-0392d4abd09a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:54:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3a84fa45-b6d2-4fa6-b09f-92e0cad12c5e req-81617c70-3834-480f-85d9-e1845fae8ab7 service nova] Lock "63b95121-b211-42c3-831e-0392d4abd09a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:54:16 user nova-compute[103546]: DEBUG nova.compute.manager [req-3a84fa45-b6d2-4fa6-b09f-92e0cad12c5e req-81617c70-3834-480f-85d9-e1845fae8ab7 service nova] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] No waiting events found dispatching network-vif-plugged-1d1c7496-0480-45a7-8490-bc581314a4b5 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:54:16 user nova-compute[103546]: WARNING nova.compute.manager [req-3a84fa45-b6d2-4fa6-b09f-92e0cad12c5e req-81617c70-3834-480f-85d9-e1845fae8ab7 service nova] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Received unexpected event network-vif-plugged-1d1c7496-0480-45a7-8490-bc581314a4b5 for instance with vm_state active and task_state deleting.
Nov 16 03:54:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap764b22e9-e8, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:54:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap764b22e9-e8, col_values=(('qos', UUID('ec63cb60-e2fb-419d-a2c8-95b71761cc2a')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:54:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap764b22e9-e8, col_values=(('external_ids', {'iface-id': '764b22e9-e899-4d39-8bc7-903ff8a7c3f6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:63:89', 'vm-uuid': 'fa7e5468-9dd4-407d-85ec-d45ec76f9e29'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:54:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:54:16 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:54:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:16 user nova-compute[103546]: INFO os_vif [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:63:89,bridge_name='br-int',has_traffic_filtering=True,id=764b22e9-e899-4d39-8bc7-903ff8a7c3f6,network=Network(fdbb2d2c-9a54-4517-b33a-cf27ce7570b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap764b22e9-e8')
Nov 16 03:54:16 user nova-compute[103546]: DEBUG nova.compute.manager [req-6c4cb842-e94f-49b1-a9b5-4234b82b134a req-e7555a96-fff8-49d1-bd24-b576deed47e0 service nova] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Received event network-vif-deleted-1d1c7496-0480-45a7-8490-bc581314a4b5 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:54:16 user nova-compute[103546]: INFO nova.compute.manager [req-6c4cb842-e94f-49b1-a9b5-4234b82b134a req-e7555a96-fff8-49d1-bd24-b576deed47e0 service nova] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Neutron deleted interface 1d1c7496-0480-45a7-8490-bc581314a4b5; detaching it from the instance and deleting it from the info cache
Nov 16 03:54:16 user nova-compute[103546]: DEBUG nova.network.neutron [req-6c4cb842-e94f-49b1-a9b5-4234b82b134a req-e7555a96-fff8-49d1-bd24-b576deed47e0 service nova] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:54:16 user nova-compute[103546]: INFO nova.compute.manager [-] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Took 1.39 seconds to deallocate network for instance.
Nov 16 03:54:16 user nova-compute[103546]: DEBUG nova.compute.manager [req-6c4cb842-e94f-49b1-a9b5-4234b82b134a req-e7555a96-fff8-49d1-bd24-b576deed47e0 service nova] [instance: 63b95121-b211-42c3-831e-0392d4abd09a] Detach interface failed, port_id=1d1c7496-0480-45a7-8490-bc581314a4b5, reason: Instance 63b95121-b211-42c3-831e-0392d4abd09a could not be found. {{(pid=103546) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 03:54:16 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:54:16 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] No VIF found with MAC fa:16:3e:77:63:89, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 03:54:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-c868de54-358a-4b4e-ab4c-afa07e560c3a tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:54:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-c868de54-358a-4b4e-ab4c-afa07e560c3a tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:54:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:17 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-c868de54-358a-4b4e-ab4c-afa07e560c3a tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:54:17 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-c868de54-358a-4b4e-ab4c-afa07e560c3a tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:54:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-c868de54-358a-4b4e-ab4c-afa07e560c3a tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.404s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:54:17 user nova-compute[103546]: INFO nova.scheduler.client.report [None req-c868de54-358a-4b4e-ab4c-afa07e560c3a tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Deleted allocations for instance 63b95121-b211-42c3-831e-0392d4abd09a
Nov 16 03:54:17 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:54:17 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:54:17 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Hypervisor/Node resource view: name=user free_ram=7700MB free_disk=25.354686737060547GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=103546) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 03:54:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:54:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:54:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-c868de54-358a-4b4e-ab4c-afa07e560c3a tempest-SnapshotDataIntegrityTests-459500828 tempest-SnapshotDataIntegrityTests-459500828-project-member] Lock "63b95121-b211-42c3-831e-0392d4abd09a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.554s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:54:17 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 279e2954-d786-4544-903d-8edc63646e2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:54:17 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 9a89970b-fc61-4419-8ff9-b48013dccf9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:54:17 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 04101512-7333-4581-add3-7af3821e335b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:54:17 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 164533fb-64e1-4aa5-b5fb-273817dd3e74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:54:17 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 4edd4240-a8e3-4f7d-ad89-795d294b72df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:54:17 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:54:17 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:54:17 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance fa7e5468-9dd4-407d-85ec-d45ec76f9e29 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:54:17 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 03:54:17 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 03:54:18 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:18 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:18 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:18 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Acquiring lock "f4065a1b-10a0-4b2a-9088-a703a7c4e064" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:54:18 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "f4065a1b-10a0-4b2a-9088-a703a7c4e064" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:54:18 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:54:18 user nova-compute[103546]: DEBUG nova.compute.manager [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Starting instance... {{(pid=103546) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 03:54:18 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:54:18 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Compute_service record updated for user:user {{(pid=103546) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 03:54:18 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.493s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:54:18 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:54:18 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:54:18 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=103546) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 03:54:18 user nova-compute[103546]: INFO nova.compute.claims [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Claim successful on node user
Nov 16 03:54:18 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:18 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:18 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:18 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:54:18 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:54:18 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.430s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:54:18 user nova-compute[103546]: DEBUG nova.compute.manager [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Start building networks asynchronously for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 03:54:18 user nova-compute[103546]: DEBUG nova.compute.manager [req-0f900420-8346-4eb8-904f-bbc300e42cb5 req-0ccb7ab7-4c3f-4729-8b6d-24af020dd567 service nova] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Received event network-vif-plugged-764b22e9-e899-4d39-8bc7-903ff8a7c3f6 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:54:18 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-0f900420-8346-4eb8-904f-bbc300e42cb5 req-0ccb7ab7-4c3f-4729-8b6d-24af020dd567 service nova] Acquiring lock "fa7e5468-9dd4-407d-85ec-d45ec76f9e29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:54:18 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-0f900420-8346-4eb8-904f-bbc300e42cb5 req-0ccb7ab7-4c3f-4729-8b6d-24af020dd567 service nova] Lock "fa7e5468-9dd4-407d-85ec-d45ec76f9e29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:54:18 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-0f900420-8346-4eb8-904f-bbc300e42cb5 req-0ccb7ab7-4c3f-4729-8b6d-24af020dd567 service nova] Lock "fa7e5468-9dd4-407d-85ec-d45ec76f9e29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:54:18 user nova-compute[103546]: DEBUG nova.compute.manager [req-0f900420-8346-4eb8-904f-bbc300e42cb5 req-0ccb7ab7-4c3f-4729-8b6d-24af020dd567 service nova] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] No waiting events found dispatching network-vif-plugged-764b22e9-e899-4d39-8bc7-903ff8a7c3f6 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:54:18 user nova-compute[103546]: WARNING nova.compute.manager [req-0f900420-8346-4eb8-904f-bbc300e42cb5 req-0ccb7ab7-4c3f-4729-8b6d-24af020dd567 service nova] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Received unexpected event network-vif-plugged-764b22e9-e899-4d39-8bc7-903ff8a7c3f6 for instance with vm_state building and task_state spawning.
Nov 16 03:54:18 user nova-compute[103546]: DEBUG nova.compute.manager [req-0f900420-8346-4eb8-904f-bbc300e42cb5 req-0ccb7ab7-4c3f-4729-8b6d-24af020dd567 service nova] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Received event network-vif-plugged-764b22e9-e899-4d39-8bc7-903ff8a7c3f6 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:54:18 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-0f900420-8346-4eb8-904f-bbc300e42cb5 req-0ccb7ab7-4c3f-4729-8b6d-24af020dd567 service nova] Acquiring lock "fa7e5468-9dd4-407d-85ec-d45ec76f9e29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:54:18 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-0f900420-8346-4eb8-904f-bbc300e42cb5 req-0ccb7ab7-4c3f-4729-8b6d-24af020dd567 service nova] Lock "fa7e5468-9dd4-407d-85ec-d45ec76f9e29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:54:18 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-0f900420-8346-4eb8-904f-bbc300e42cb5 req-0ccb7ab7-4c3f-4729-8b6d-24af020dd567 service nova] Lock "fa7e5468-9dd4-407d-85ec-d45ec76f9e29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:54:18 user nova-compute[103546]: DEBUG nova.compute.manager [req-0f900420-8346-4eb8-904f-bbc300e42cb5 req-0ccb7ab7-4c3f-4729-8b6d-24af020dd567 service nova] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] No waiting events found dispatching network-vif-plugged-764b22e9-e899-4d39-8bc7-903ff8a7c3f6 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:54:18 user nova-compute[103546]: WARNING nova.compute.manager [req-0f900420-8346-4eb8-904f-bbc300e42cb5 req-0ccb7ab7-4c3f-4729-8b6d-24af020dd567 service nova] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Received unexpected event network-vif-plugged-764b22e9-e899-4d39-8bc7-903ff8a7c3f6 for instance with vm_state building and task_state spawning.
Nov 16 03:54:18 user nova-compute[103546]: DEBUG nova.compute.manager [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Allocating IP information in the background. {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 03:54:18 user nova-compute[103546]: DEBUG nova.network.neutron [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] allocate_for_instance() {{(pid=103546) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 03:54:18 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 03:54:18 user nova-compute[103546]: DEBUG nova.compute.manager [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Start building block device mappings for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 03:54:18 user nova-compute[103546]: DEBUG nova.policy [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e471c69657c745bbbdfc82307a49946f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b30a015db444798ee72ff6fd14c69e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103546) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 03:54:18 user nova-compute[103546]: DEBUG nova.compute.manager [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Start spawning the instance on the hypervisor. {{(pid=103546) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 03:54:18 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Creating instance directory {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 03:54:18 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Creating image(s)
Nov 16 03:54:18 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Acquiring lock "/opt/stack/data/nova/instances/f4065a1b-10a0-4b2a-9088-a703a7c4e064/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:54:18 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "/opt/stack/data/nova/instances/f4065a1b-10a0-4b2a-9088-a703a7c4e064/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:54:18 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "/opt/stack/data/nova/instances/f4065a1b-10a0-4b2a-9088-a703a7c4e064/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:54:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.180s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Acquiring lock "8c9efafb670bfe5842ba1f4ce398924612164af7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:54:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:54:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:19 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:54:19 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:54:19 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Starting heal instance info cache {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 03:54:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.183s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/f4065a1b-10a0-4b2a-9088-a703a7c4e064/disk 1073741824 {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/f4065a1b-10a0-4b2a-9088-a703a7c4e064/disk 1073741824" returned: 0 in 0.061s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:54:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "refresh_cache-9a89970b-fc61-4419-8ff9-b48013dccf9f" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:54:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquired lock "refresh_cache-9a89970b-fc61-4419-8ff9-b48013dccf9f" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:54:19 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Forcefully refreshing network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 03:54:19 user nova-compute[103546]: DEBUG nova.network.neutron [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Successfully created port: 7471b1be-a897-4ef9-8dbe-8c6962cfbd31 {{(pid=103546) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 03:54:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.215s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:19 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f4065a1b-10a0-4b2a-9088-a703a7c4e064/disk. size=1073741824 {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 03:54:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4065a1b-10a0-4b2a-9088-a703a7c4e064/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4065a1b-10a0-4b2a-9088-a703a7c4e064/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:19 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Cannot resize image /opt/stack/data/nova/instances/f4065a1b-10a0-4b2a-9088-a703a7c4e064/disk to a smaller size. {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 03:54:19 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Created local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 03:54:19 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Ensure instance console log exists: /opt/stack/data/nova/instances/f4065a1b-10a0-4b2a-9088-a703a7c4e064/console.log {{(pid=103546) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 03:54:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:54:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:54:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:54:19 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Updating instance_info_cache with network_info: [{"id": "5f4e3564-4185-44d2-93f6-2e3803aaf0f8", "address": "fa:16:3e:56:e2:fb", "network": {"id": "29e9620f-313d-4679-89d7-459e7cf75b38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1690634205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72b30a015db444798ee72ff6fd14c69e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f4e3564-41", "ovs_interfaceid": "5f4e3564-4185-44d2-93f6-2e3803aaf0f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:54:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Releasing lock "refresh_cache-9a89970b-fc61-4419-8ff9-b48013dccf9f" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:54:19 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Updated the network info_cache for instance {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 03:54:19 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:54:19 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:54:20 user nova-compute[103546]: DEBUG nova.network.neutron [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Successfully updated port: 7471b1be-a897-4ef9-8dbe-8c6962cfbd31 {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 03:54:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Acquiring lock "refresh_cache-f4065a1b-10a0-4b2a-9088-a703a7c4e064" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:54:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Acquired lock "refresh_cache-f4065a1b-10a0-4b2a-9088-a703a7c4e064" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:54:20 user nova-compute[103546]: DEBUG nova.network.neutron [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 03:54:20 user nova-compute[103546]: DEBUG nova.network.neutron [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 03:54:20 user nova-compute[103546]: DEBUG nova.compute.manager [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 03:54:20 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Guest created on hypervisor {{(pid=103546) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 03:54:20 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Instance spawned successfully.
Nov 16 03:54:20 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 03:54:20 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Found default for hw_cdrom_bus of ide {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:54:20 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Found default for hw_disk_bus of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:54:20 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Found default for hw_input_bus of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:54:20 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Found default for hw_pointer_model of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:54:20 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Found default for hw_video_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:54:20 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Found default for hw_vif_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:54:20 user nova-compute[103546]: INFO nova.compute.manager [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Took 5.36 seconds to spawn the instance on the hypervisor.
Nov 16 03:54:20 user nova-compute[103546]: DEBUG nova.compute.manager [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 03:54:20 user nova-compute[103546]: INFO nova.compute.manager [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Took 18.28 seconds to build instance.
Nov 16 03:54:20 user nova-compute[103546]: DEBUG nova.network.neutron [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Updating instance_info_cache with network_info: [{"id": "7471b1be-a897-4ef9-8dbe-8c6962cfbd31", "address": "fa:16:3e:64:f3:d9", "network": {"id": "29e9620f-313d-4679-89d7-459e7cf75b38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1690634205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72b30a015db444798ee72ff6fd14c69e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7471b1be-a8", "ovs_interfaceid": "7471b1be-a897-4ef9-8dbe-8c6962cfbd31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:54:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d642552a-386a-434d-bea0-6a234c9e9a69 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "fa7e5468-9dd4-407d-85ec-d45ec76f9e29" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.407s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:54:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Releasing lock "refresh_cache-f4065a1b-10a0-4b2a-9088-a703a7c4e064" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:54:20 user nova-compute[103546]: DEBUG nova.compute.manager [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Instance network_info: |[{"id": "7471b1be-a897-4ef9-8dbe-8c6962cfbd31", "address": "fa:16:3e:64:f3:d9", "network": {"id": "29e9620f-313d-4679-89d7-459e7cf75b38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1690634205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72b30a015db444798ee72ff6fd14c69e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7471b1be-a8", "ovs_interfaceid": "7471b1be-a897-4ef9-8dbe-8c6962cfbd31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 03:54:20 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Start _get_guest_xml network_info=[{"id": "7471b1be-a897-4ef9-8dbe-8c6962cfbd31", "address": "fa:16:3e:64:f3:d9", "network": {"id": "29e9620f-313d-4679-89d7-459e7cf75b38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1690634205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72b30a015db444798ee72ff6fd14c69e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7471b1be-a8", "ovs_interfaceid": "7471b1be-a897-4ef9-8dbe-8c6962cfbd31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '5c6f539a-01e5-4478-bf8f-a14310b5d7dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 03:54:20 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:54:20 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:54:20 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 03:54:20 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 03:54:20 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 03:54:20 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 03:54:20 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 03:54:20 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 03:54:20 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 03:54:20 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 03:54:20 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 03:54:20 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 03:54:20 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 03:54:20 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 03:54:20 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 03:54:20 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 03:54:20 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 03:54:20 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 03:54:20 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:54:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1025315495',display_name='tempest-tempest.common.compute-instance-1025315495',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1025315495',id=24,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPsowU+DxXGj+EwRCt8oPsJDiFFQ1t3et4Wt5bZ1kwjAb+70RLl9mpMNr3QanWoL9YswsQhH0dcFmnUwAGlTlrni8Jn0NM/Wnv7EVtjYYBmh+ct83CyqQ55pikSB2BGp8A==',key_name='tempest-keypair-185377902',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72b30a015db444798ee72ff6fd14c69e',ramdisk_id='',reservation_id='r-dcagc0xa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1488667220',owner_user_name='tempest-ServerActionsTestOtherA-1488667220-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:54:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e471c69657c745bbbdfc82307a49946f',uuid=f4065a1b-10a0-4b2a-9088-a703a7c4e064,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7471b1be-a897-4ef9-8dbe-8c6962cfbd31", "address": "fa:16:3e:64:f3:d9", "network": {"id": "29e9620f-313d-4679-89d7-459e7cf75b38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1690634205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72b30a015db444798ee72ff6fd14c69e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7471b1be-a8", "ovs_interfaceid": "7471b1be-a897-4ef9-8dbe-8c6962cfbd31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 03:54:20 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Converting VIF {"id": "7471b1be-a897-4ef9-8dbe-8c6962cfbd31", "address": "fa:16:3e:64:f3:d9", "network": {"id": "29e9620f-313d-4679-89d7-459e7cf75b38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1690634205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72b30a015db444798ee72ff6fd14c69e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7471b1be-a8", "ovs_interfaceid": "7471b1be-a897-4ef9-8dbe-8c6962cfbd31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:54:20 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:f3:d9,bridge_name='br-int',has_traffic_filtering=True,id=7471b1be-a897-4ef9-8dbe-8c6962cfbd31,network=Network(29e9620f-313d-4679-89d7-459e7cf75b38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7471b1be-a8') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:54:20 user nova-compute[103546]: DEBUG nova.objects.instance [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lazy-loading 'pci_devices' on Instance uuid f4065a1b-10a0-4b2a-9088-a703a7c4e064 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:54:20 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] End _get_guest_xml xml=<domain type="kvm">
Nov 16 03:54:20 user nova-compute[103546]:   <uuid>f4065a1b-10a0-4b2a-9088-a703a7c4e064</uuid>
Nov 16 03:54:20 user nova-compute[103546]:   <name>instance-00000018</name>
Nov 16 03:54:20 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 03:54:20 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 03:54:20 user nova-compute[103546]:   <metadata>
Nov 16 03:54:20 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 03:54:20 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 03:54:20 user nova-compute[103546]:       <nova:name>tempest-tempest.common.compute-instance-1025315495</nova:name>
Nov 16 03:54:20 user nova-compute[103546]:       <nova:creationTime>2023-11-16 03:54:20</nova:creationTime>
Nov 16 03:54:20 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 03:54:20 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 03:54:20 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 03:54:20 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 03:54:20 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 03:54:20 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 03:54:20 user nova-compute[103546]:       </nova:flavor>
Nov 16 03:54:20 user nova-compute[103546]:       <nova:owner>
Nov 16 03:54:20 user nova-compute[103546]:         <nova:user uuid="e471c69657c745bbbdfc82307a49946f">tempest-ServerActionsTestOtherA-1488667220-project-member</nova:user>
Nov 16 03:54:20 user nova-compute[103546]:         <nova:project uuid="72b30a015db444798ee72ff6fd14c69e">tempest-ServerActionsTestOtherA-1488667220</nova:project>
Nov 16 03:54:20 user nova-compute[103546]:       </nova:owner>
Nov 16 03:54:20 user nova-compute[103546]:       <nova:root type="image" uuid="5c6f539a-01e5-4478-bf8f-a14310b5d7dd"/>
Nov 16 03:54:20 user nova-compute[103546]:       <nova:ports>
Nov 16 03:54:20 user nova-compute[103546]:         <nova:port uuid="7471b1be-a897-4ef9-8dbe-8c6962cfbd31">
Nov 16 03:54:20 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 16 03:54:20 user nova-compute[103546]:         </nova:port>
Nov 16 03:54:20 user nova-compute[103546]:       </nova:ports>
Nov 16 03:54:20 user nova-compute[103546]:     </nova:instance>
Nov 16 03:54:20 user nova-compute[103546]:   </metadata>
Nov 16 03:54:20 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 03:54:20 user nova-compute[103546]:     <system>
Nov 16 03:54:20 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 03:54:20 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 03:54:20 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 03:54:20 user nova-compute[103546]:       <entry name="serial">f4065a1b-10a0-4b2a-9088-a703a7c4e064</entry>
Nov 16 03:54:20 user nova-compute[103546]:       <entry name="uuid">f4065a1b-10a0-4b2a-9088-a703a7c4e064</entry>
Nov 16 03:54:20 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 03:54:20 user nova-compute[103546]:     </system>
Nov 16 03:54:20 user nova-compute[103546]:   </sysinfo>
Nov 16 03:54:20 user nova-compute[103546]:   <os>
Nov 16 03:54:20 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 03:54:20 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 03:54:20 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 03:54:20 user nova-compute[103546]:   </os>
Nov 16 03:54:20 user nova-compute[103546]:   <features>
Nov 16 03:54:20 user nova-compute[103546]:     <acpi/>
Nov 16 03:54:20 user nova-compute[103546]:     <apic/>
Nov 16 03:54:20 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 03:54:20 user nova-compute[103546]:   </features>
Nov 16 03:54:20 user nova-compute[103546]:   <clock offset="utc">
Nov 16 03:54:20 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 03:54:20 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 03:54:20 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 03:54:20 user nova-compute[103546]:   </clock>
Nov 16 03:54:20 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 03:54:20 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 03:54:20 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 03:54:20 user nova-compute[103546]:   </cpu>
Nov 16 03:54:20 user nova-compute[103546]:   <devices>
Nov 16 03:54:20 user nova-compute[103546]:     <disk type="file" device="disk">
Nov 16 03:54:20 user nova-compute[103546]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 03:54:20 user nova-compute[103546]:       <source file="/opt/stack/data/nova/instances/f4065a1b-10a0-4b2a-9088-a703a7c4e064/disk"/>
Nov 16 03:54:20 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 03:54:20 user nova-compute[103546]:     </disk>
Nov 16 03:54:20 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 03:54:20 user nova-compute[103546]:       <mac address="fa:16:3e:64:f3:d9"/>
Nov 16 03:54:20 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:54:20 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 03:54:20 user nova-compute[103546]:       <target dev="tap7471b1be-a8"/>
Nov 16 03:54:20 user nova-compute[103546]:     </interface>
Nov 16 03:54:20 user nova-compute[103546]:     <serial type="pty">
Nov 16 03:54:20 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/f4065a1b-10a0-4b2a-9088-a703a7c4e064/console.log" append="off"/>
Nov 16 03:54:20 user nova-compute[103546]:     </serial>
Nov 16 03:54:20 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 03:54:20 user nova-compute[103546]:     <video>
Nov 16 03:54:20 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:54:20 user nova-compute[103546]:     </video>
Nov 16 03:54:20 user nova-compute[103546]:     <rng model="virtio">
Nov 16 03:54:20 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 03:54:20 user nova-compute[103546]:     </rng>
Nov 16 03:54:20 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 03:54:20 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 03:54:20 user nova-compute[103546]:       <stats period="10"/>
Nov 16 03:54:20 user nova-compute[103546]:     </memballoon>
Nov 16 03:54:20 user nova-compute[103546]:   </devices>
Nov 16 03:54:20 user nova-compute[103546]: </domain>
Nov 16 03:54:20 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 03:54:20 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:54:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1025315495',display_name='tempest-tempest.common.compute-instance-1025315495',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1025315495',id=24,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPsowU+DxXGj+EwRCt8oPsJDiFFQ1t3et4Wt5bZ1kwjAb+70RLl9mpMNr3QanWoL9YswsQhH0dcFmnUwAGlTlrni8Jn0NM/Wnv7EVtjYYBmh+ct83CyqQ55pikSB2BGp8A==',key_name='tempest-keypair-185377902',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72b30a015db444798ee72ff6fd14c69e',ramdisk_id='',reservation_id='r-dcagc0xa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1488667220',owner_user_name='tempest-ServerActionsTestOtherA-1488667220-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:54:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e471c69657c745bbbdfc82307a49946f',uuid=f4065a1b-10a0-4b2a-9088-a703a7c4e064,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7471b1be-a897-4ef9-8dbe-8c6962cfbd31", "address": "fa:16:3e:64:f3:d9", "network": {"id": "29e9620f-313d-4679-89d7-459e7cf75b38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1690634205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72b30a015db444798ee72ff6fd14c69e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7471b1be-a8", "ovs_interfaceid": "7471b1be-a897-4ef9-8dbe-8c6962cfbd31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 03:54:20 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Converting VIF {"id": "7471b1be-a897-4ef9-8dbe-8c6962cfbd31", "address": "fa:16:3e:64:f3:d9", "network": {"id": "29e9620f-313d-4679-89d7-459e7cf75b38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1690634205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72b30a015db444798ee72ff6fd14c69e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7471b1be-a8", "ovs_interfaceid": "7471b1be-a897-4ef9-8dbe-8c6962cfbd31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:54:20 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:f3:d9,bridge_name='br-int',has_traffic_filtering=True,id=7471b1be-a897-4ef9-8dbe-8c6962cfbd31,network=Network(29e9620f-313d-4679-89d7-459e7cf75b38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7471b1be-a8') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:54:20 user nova-compute[103546]: DEBUG os_vif [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:f3:d9,bridge_name='br-int',has_traffic_filtering=True,id=7471b1be-a897-4ef9-8dbe-8c6962cfbd31,network=Network(29e9620f-313d-4679-89d7-459e7cf75b38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7471b1be-a8') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 03:54:20 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:20 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:54:20 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 03:54:20 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:20 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8f5320d1-f696-5384-b52c-21de5c1cadd1', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:54:20 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:20 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:20 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7471b1be-a8, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:54:20 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7471b1be-a8, col_values=(('qos', UUID('830bd1c7-cbcc-4bcd-a4bf-41598de65609')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:54:20 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7471b1be-a8, col_values=(('external_ids', {'iface-id': '7471b1be-a897-4ef9-8dbe-8c6962cfbd31', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:f3:d9', 'vm-uuid': 'f4065a1b-10a0-4b2a-9088-a703a7c4e064'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:54:20 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:20 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:54:20 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:20 user nova-compute[103546]: INFO os_vif [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:f3:d9,bridge_name='br-int',has_traffic_filtering=True,id=7471b1be-a897-4ef9-8dbe-8c6962cfbd31,network=Network(29e9620f-313d-4679-89d7-459e7cf75b38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7471b1be-a8')
Nov 16 03:54:20 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:54:20 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] No VIF found with MAC fa:16:3e:64:f3:d9, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 03:54:20 user nova-compute[103546]: DEBUG nova.compute.manager [req-ecedb3e4-eb13-4f24-a007-887d16382229 req-37ba5f39-7f62-44a5-affb-cf952494d82b service nova] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Received event network-changed-7471b1be-a897-4ef9-8dbe-8c6962cfbd31 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:54:20 user nova-compute[103546]: DEBUG nova.compute.manager [req-ecedb3e4-eb13-4f24-a007-887d16382229 req-37ba5f39-7f62-44a5-affb-cf952494d82b service nova] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Refreshing instance network info cache due to event network-changed-7471b1be-a897-4ef9-8dbe-8c6962cfbd31. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:54:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ecedb3e4-eb13-4f24-a007-887d16382229 req-37ba5f39-7f62-44a5-affb-cf952494d82b service nova] Acquiring lock "refresh_cache-f4065a1b-10a0-4b2a-9088-a703a7c4e064" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:54:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ecedb3e4-eb13-4f24-a007-887d16382229 req-37ba5f39-7f62-44a5-affb-cf952494d82b service nova] Acquired lock "refresh_cache-f4065a1b-10a0-4b2a-9088-a703a7c4e064" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:54:20 user nova-compute[103546]: DEBUG nova.network.neutron [req-ecedb3e4-eb13-4f24-a007-887d16382229 req-37ba5f39-7f62-44a5-affb-cf952494d82b service nova] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Refreshing network info cache for port 7471b1be-a897-4ef9-8dbe-8c6962cfbd31 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:54:21 user nova-compute[103546]: DEBUG nova.network.neutron [req-ecedb3e4-eb13-4f24-a007-887d16382229 req-37ba5f39-7f62-44a5-affb-cf952494d82b service nova] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Updated VIF entry in instance network info cache for port 7471b1be-a897-4ef9-8dbe-8c6962cfbd31. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 03:54:21 user nova-compute[103546]: DEBUG nova.network.neutron [req-ecedb3e4-eb13-4f24-a007-887d16382229 req-37ba5f39-7f62-44a5-affb-cf952494d82b service nova] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Updating instance_info_cache with network_info: [{"id": "7471b1be-a897-4ef9-8dbe-8c6962cfbd31", "address": "fa:16:3e:64:f3:d9", "network": {"id": "29e9620f-313d-4679-89d7-459e7cf75b38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1690634205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72b30a015db444798ee72ff6fd14c69e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7471b1be-a8", "ovs_interfaceid": "7471b1be-a897-4ef9-8dbe-8c6962cfbd31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:54:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ecedb3e4-eb13-4f24-a007-887d16382229 req-37ba5f39-7f62-44a5-affb-cf952494d82b service nova] Releasing lock "refresh_cache-f4065a1b-10a0-4b2a-9088-a703a7c4e064" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:54:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:22 user nova-compute[103546]: DEBUG nova.compute.manager [req-4865d32a-d5d4-48d0-ae68-7c044a5a780b req-59a3a6c0-eac8-42dd-abb9-b666037114ca service nova] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Received event network-vif-plugged-7471b1be-a897-4ef9-8dbe-8c6962cfbd31 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:54:22 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-4865d32a-d5d4-48d0-ae68-7c044a5a780b req-59a3a6c0-eac8-42dd-abb9-b666037114ca service nova] Acquiring lock "f4065a1b-10a0-4b2a-9088-a703a7c4e064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:54:22 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-4865d32a-d5d4-48d0-ae68-7c044a5a780b req-59a3a6c0-eac8-42dd-abb9-b666037114ca service nova] Lock "f4065a1b-10a0-4b2a-9088-a703a7c4e064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:54:22 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-4865d32a-d5d4-48d0-ae68-7c044a5a780b req-59a3a6c0-eac8-42dd-abb9-b666037114ca service nova] Lock "f4065a1b-10a0-4b2a-9088-a703a7c4e064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:54:22 user nova-compute[103546]: DEBUG nova.compute.manager [req-4865d32a-d5d4-48d0-ae68-7c044a5a780b req-59a3a6c0-eac8-42dd-abb9-b666037114ca service nova] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] No waiting events found dispatching network-vif-plugged-7471b1be-a897-4ef9-8dbe-8c6962cfbd31 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:54:22 user nova-compute[103546]: WARNING nova.compute.manager [req-4865d32a-d5d4-48d0-ae68-7c044a5a780b req-59a3a6c0-eac8-42dd-abb9-b666037114ca service nova] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Received unexpected event network-vif-plugged-7471b1be-a897-4ef9-8dbe-8c6962cfbd31 for instance with vm_state building and task_state spawning.
Nov 16 03:54:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:22 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Acquiring lock "2ab80244-d70d-41ce-9b7e-bb9c8a676ad6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:54:22 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Lock "2ab80244-d70d-41ce-9b7e-bb9c8a676ad6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:54:22 user nova-compute[103546]: DEBUG nova.compute.manager [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Starting instance... {{(pid=103546) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 03:54:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:54:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:54:23 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=103546) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 03:54:23 user nova-compute[103546]: INFO nova.compute.claims [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Claim successful on node user
Nov 16 03:54:23 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:54:23 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:23 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:54:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.401s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:54:23 user nova-compute[103546]: DEBUG nova.compute.manager [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Start building networks asynchronously for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 03:54:23 user nova-compute[103546]: DEBUG nova.compute.manager [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Allocating IP information in the background. {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 03:54:23 user nova-compute[103546]: DEBUG nova.network.neutron [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] allocate_for_instance() {{(pid=103546) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 03:54:23 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 03:54:23 user nova-compute[103546]: DEBUG nova.compute.manager [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Start building block device mappings for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 03:54:23 user nova-compute[103546]: DEBUG nova.policy [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fff2b2e712c1466991b73ead603bcf8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '957a9e268fe7460c97fce1e634015214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103546) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 03:54:23 user nova-compute[103546]: INFO nova.virt.block_device [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Booting with volume 5cdf8533-74a7-4737-b4af-2a9ae07490fc at /dev/vda
Nov 16 03:54:23 user nova-compute[103546]: DEBUG os_brick.utils [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:54:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:23 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[357f2783-f115-416f-adae-cbb3770016d4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af5c39b14ece\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:23 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc7487f7-d2de-4d81-9227-57554fba57f1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:23 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ed072b-586d-413b-b461-7f2cb7ba7797]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:23 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[8345f867-b6a7-4bcf-a7a5-88d632836e86]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Running cmd (subprocess): nvme version {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] 'nvme version' failed. Not Retrying. {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:54:23 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] nvme not present on system {{(pid=103546) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 03:54:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:54:23 user nova-compute[103546]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 03:54:23 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[7105a5fa-8df7-4ea7-91d9-014582b523e7]: (4, '') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:23 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=103546) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 03:54:23 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 03:54:23 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] LIGHTOS: no hostnqn found. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 03:54:23 user nova-compute[103546]: DEBUG os_brick.utils [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af5c39b14ece', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:54:23 user nova-compute[103546]: DEBUG nova.virt.block_device [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Updating existing volume attachment record: 2b7110f7-46ee-4c4d-b398-2770db01645f {{(pid=103546) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 03:54:24 user nova-compute[103546]: DEBUG nova.compute.manager [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 03:54:24 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Guest created on hypervisor {{(pid=103546) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 03:54:24 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Instance spawned successfully.
Nov 16 03:54:24 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 03:54:24 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Found default for hw_cdrom_bus of ide {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:54:24 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Found default for hw_disk_bus of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:54:24 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Found default for hw_input_bus of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:54:24 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Found default for hw_pointer_model of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:54:24 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Found default for hw_video_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:54:24 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Found default for hw_vif_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:54:24 user nova-compute[103546]: DEBUG nova.compute.manager [req-798eb6a1-7a8d-4262-b2f1-2ace1883f3dc req-ead0f16d-bd8b-43a0-8e17-ef904819e875 service nova] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Received event network-vif-plugged-7471b1be-a897-4ef9-8dbe-8c6962cfbd31 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:54:24 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-798eb6a1-7a8d-4262-b2f1-2ace1883f3dc req-ead0f16d-bd8b-43a0-8e17-ef904819e875 service nova] Acquiring lock "f4065a1b-10a0-4b2a-9088-a703a7c4e064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:54:24 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-798eb6a1-7a8d-4262-b2f1-2ace1883f3dc req-ead0f16d-bd8b-43a0-8e17-ef904819e875 service nova] Lock "f4065a1b-10a0-4b2a-9088-a703a7c4e064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:54:24 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-798eb6a1-7a8d-4262-b2f1-2ace1883f3dc req-ead0f16d-bd8b-43a0-8e17-ef904819e875 service nova] Lock "f4065a1b-10a0-4b2a-9088-a703a7c4e064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:54:24 user nova-compute[103546]: DEBUG nova.compute.manager [req-798eb6a1-7a8d-4262-b2f1-2ace1883f3dc req-ead0f16d-bd8b-43a0-8e17-ef904819e875 service nova] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] No waiting events found dispatching network-vif-plugged-7471b1be-a897-4ef9-8dbe-8c6962cfbd31 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:54:24 user nova-compute[103546]: WARNING nova.compute.manager [req-798eb6a1-7a8d-4262-b2f1-2ace1883f3dc req-ead0f16d-bd8b-43a0-8e17-ef904819e875 service nova] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Received unexpected event network-vif-plugged-7471b1be-a897-4ef9-8dbe-8c6962cfbd31 for instance with vm_state building and task_state spawning.
Nov 16 03:54:24 user nova-compute[103546]: DEBUG nova.network.neutron [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Successfully created port: 49c54f9c-e72e-4cdf-96d3-7c31d8ed5109 {{(pid=103546) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 03:54:24 user nova-compute[103546]: INFO nova.compute.manager [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Took 5.27 seconds to spawn the instance on the hypervisor.
Nov 16 03:54:24 user nova-compute[103546]: DEBUG nova.compute.manager [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 03:54:24 user nova-compute[103546]: INFO nova.compute.manager [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Took 6.05 seconds to build instance.
Nov 16 03:54:24 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b90da564-d018-4814-84fc-8e66d1549191 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "f4065a1b-10a0-4b2a-9088-a703a7c4e064" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.157s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:54:24 user nova-compute[103546]: DEBUG nova.network.neutron [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Successfully updated port: 49c54f9c-e72e-4cdf-96d3-7c31d8ed5109 {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 03:54:24 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Acquiring lock "refresh_cache-2ab80244-d70d-41ce-9b7e-bb9c8a676ad6" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:54:24 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Acquired lock "refresh_cache-2ab80244-d70d-41ce-9b7e-bb9c8a676ad6" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:54:24 user nova-compute[103546]: DEBUG nova.network.neutron [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 03:54:24 user nova-compute[103546]: DEBUG nova.compute.manager [req-cb79cbc0-b0c2-4c25-852e-cf378d918db4 req-f1b394bc-9da4-46bb-91ad-fd52c44f670f service nova] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Received event network-changed-49c54f9c-e72e-4cdf-96d3-7c31d8ed5109 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:54:24 user nova-compute[103546]: DEBUG nova.compute.manager [req-cb79cbc0-b0c2-4c25-852e-cf378d918db4 req-f1b394bc-9da4-46bb-91ad-fd52c44f670f service nova] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Refreshing instance network info cache due to event network-changed-49c54f9c-e72e-4cdf-96d3-7c31d8ed5109. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:54:24 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-cb79cbc0-b0c2-4c25-852e-cf378d918db4 req-f1b394bc-9da4-46bb-91ad-fd52c44f670f service nova] Acquiring lock "refresh_cache-2ab80244-d70d-41ce-9b7e-bb9c8a676ad6" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:54:24 user nova-compute[103546]: DEBUG nova.network.neutron [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 03:54:25 user nova-compute[103546]: DEBUG nova.network.neutron [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Updating instance_info_cache with network_info: [{"id": "49c54f9c-e72e-4cdf-96d3-7c31d8ed5109", "address": "fa:16:3e:5a:f3:7f", "network": {"id": "ad0d15aa-3eb9-452a-8c1e-f98a235beb89", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-981191229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "957a9e268fe7460c97fce1e634015214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49c54f9c-e7", "ovs_interfaceid": "49c54f9c-e72e-4cdf-96d3-7c31d8ed5109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:54:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Releasing lock "refresh_cache-2ab80244-d70d-41ce-9b7e-bb9c8a676ad6" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:54:25 user nova-compute[103546]: DEBUG nova.compute.manager [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Instance network_info: |[{"id": "49c54f9c-e72e-4cdf-96d3-7c31d8ed5109", "address": "fa:16:3e:5a:f3:7f", "network": {"id": "ad0d15aa-3eb9-452a-8c1e-f98a235beb89", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-981191229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "957a9e268fe7460c97fce1e634015214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49c54f9c-e7", "ovs_interfaceid": "49c54f9c-e72e-4cdf-96d3-7c31d8ed5109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 03:54:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-cb79cbc0-b0c2-4c25-852e-cf378d918db4 req-f1b394bc-9da4-46bb-91ad-fd52c44f670f service nova] Acquired lock "refresh_cache-2ab80244-d70d-41ce-9b7e-bb9c8a676ad6" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:54:25 user nova-compute[103546]: DEBUG nova.network.neutron [req-cb79cbc0-b0c2-4c25-852e-cf378d918db4 req-f1b394bc-9da4-46bb-91ad-fd52c44f670f service nova] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Refreshing network info cache for port 49c54f9c-e72e-4cdf-96d3-7c31d8ed5109 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:54:25 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:25 user nova-compute[103546]: DEBUG nova.network.neutron [req-cb79cbc0-b0c2-4c25-852e-cf378d918db4 req-f1b394bc-9da4-46bb-91ad-fd52c44f670f service nova] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Updated VIF entry in instance network info cache for port 49c54f9c-e72e-4cdf-96d3-7c31d8ed5109. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 03:54:25 user nova-compute[103546]: DEBUG nova.network.neutron [req-cb79cbc0-b0c2-4c25-852e-cf378d918db4 req-f1b394bc-9da4-46bb-91ad-fd52c44f670f service nova] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Updating instance_info_cache with network_info: [{"id": "49c54f9c-e72e-4cdf-96d3-7c31d8ed5109", "address": "fa:16:3e:5a:f3:7f", "network": {"id": "ad0d15aa-3eb9-452a-8c1e-f98a235beb89", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-981191229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "957a9e268fe7460c97fce1e634015214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49c54f9c-e7", "ovs_interfaceid": "49c54f9c-e72e-4cdf-96d3-7c31d8ed5109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:54:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-cb79cbc0-b0c2-4c25-852e-cf378d918db4 req-f1b394bc-9da4-46bb-91ad-fd52c44f670f service nova] Releasing lock "refresh_cache-2ab80244-d70d-41ce-9b7e-bb9c8a676ad6" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:54:28 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:28 user nova-compute[103546]: DEBUG nova.compute.manager [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Start spawning the instance on the hypervisor. {{(pid=103546) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 03:54:28 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Creating instance directory {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 03:54:28 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Creating image(s)
Nov 16 03:54:28 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Did not create local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 03:54:28 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Ensure instance console log exists: /opt/stack/data/nova/instances/2ab80244-d70d-41ce-9b7e-bb9c8a676ad6/console.log {{(pid=103546) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 03:54:28 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:54:28 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:54:28 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:54:28 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Start _get_guest_xml network_info=[{"id": "49c54f9c-e72e-4cdf-96d3-7c31d8ed5109", "address": "fa:16:3e:5a:f3:7f", "network": {"id": "ad0d15aa-3eb9-452a-8c1e-f98a235beb89", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-981191229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "957a9e268fe7460c97fce1e634015214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49c54f9c-e7", "ovs_interfaceid": "49c54f9c-e72e-4cdf-96d3-7c31d8ed5109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IwNpXAPB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2ab80244-d70d-41ce-9b7e-bb9c8a676ad6', 'attached_at': '', 'detached_at': '', 'volume_id': '5cdf8533-74a7-4737-b4af-2a9ae07490fc', 'serial': '5cdf8533-74a7-4737-b4af-2a9ae07490fc'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': '2b7110f7-46ee-4c4d-b398-2770db01645f', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 03:54:28 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:54:28 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:54:28 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 03:54:28 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 03:54:28 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 03:54:28 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 03:54:28 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 03:54:28 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 03:54:28 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 03:54:28 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 03:54:28 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 03:54:28 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 03:54:28 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 03:54:28 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 03:54:28 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 03:54:28 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 03:54:28 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 03:54:28 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 03:54:28 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 03:54:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IwNpXAPB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:54:28 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:54:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:54:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:54:28 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:54:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:54:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:54:28 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 03:54:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:28 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4247134-115e-4297-98ed-d711df077e67]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 03:54:28 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:54:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc -p 172.16.0.220:3260 --interface default --op new {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:28 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8dc732a-2f74-42b1-bacd-f56560d9b30d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc] added\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc] added
Nov 16 03:54:28 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:54:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:28 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac462c0-e392-4f39-ba1e-9c6b7972ab3f]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:54:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:29 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[937f4071-e778-464b-9c42-d6efb810c5c1]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:29 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:54:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IwNpXAPB {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IwNpXAPB" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:29 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5ffab1-d422-4964-b483-8f8e3d91fd73]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:29 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IwNpXAPB'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:54:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:29 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[eacb50f3-272f-454c-aeb3-ebc3e5766aac]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:29 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:54:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:29 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b41368-639c-4512-8a63-815f5bbe8b1f]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:29 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:54:29 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:54:29 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:54:29 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:54:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc -p 172.16.0.220:3260 --login {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:29 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[4022d7ed-a367-41d2-9fb9-fda265241466]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:29 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc, portal: 172.16.0.220,3260]
Nov 16 03:54:29 user nova-compute[103546]: Login to [iface: default, target: iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc, portal: 172.16.0.220,3260] successful.
Nov 16 03:54:29 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:54:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:29 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dcf6e13-31d1-4d74-8296-2186969f9b5c]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:29 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:54:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:29 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c7f0d2-c9e5-4f5c-a651-12cba8056072]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:29 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:54:29 user nova-compute[103546]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc (non-flash)
Nov 16 03:54:29 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:54:29 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:54:29 user nova-compute[103546]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc (non-flash)
Nov 16 03:54:29 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:54:29 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:54:29 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 03:54:29 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] HCTL ('34', '-', '-', 0) found on session 26 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 03:54:29 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 03:54:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:29 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f5e42b-13fa-4b5a-9e6d-b349f8e0d556]: (4, ('- - 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:29 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Searching for a device in session 26 and hctl ['34', '*', '*', 0] yield: None {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 03:54:30 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Searching for a device in session 26 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 03:54:30 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IwNpXAPB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 03:54:30 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:54:30 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '26434656135376334', 'path': '/dev/sdc'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:54:30 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434656135376334', 'path': '/dev/sdc'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 03:54:30 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:54:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-141615707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-141615707',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1Y2L2l3MWVbNwdnSdeRUxJz0N8le0D37MGjqwWaMwxA7R3Wdx+y5O8T7rTKllDINxi17uE0eTWUeh3EwdhWWGhIv3K2uMZjagCC2gLDhzEp415K3OXZdfZ5QqNTz5yjQ==',key_name='tempest-keypair-336828995',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='957a9e268fe7460c97fce1e634015214',ramdisk_id='',reservation_id='r-f4s0l7jd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-787129566',owner_user_name='tempest-ServerActionsV293TestJSON-787129566-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:54:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fff2b2e712c1466991b73ead603bcf8f',uuid=2ab80244-d70d-41ce-9b7e-bb9c8a676ad6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49c54f9c-e72e-4cdf-96d3-7c31d8ed5109", "address": "fa:16:3e:5a:f3:7f", "network": {"id": "ad0d15aa-3eb9-452a-8c1e-f98a235beb89", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-981191229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "957a9e268fe7460c97fce1e634015214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49c54f9c-e7", "ovs_interfaceid": "49c54f9c-e72e-4cdf-96d3-7c31d8ed5109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 03:54:30 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Converting VIF {"id": "49c54f9c-e72e-4cdf-96d3-7c31d8ed5109", "address": "fa:16:3e:5a:f3:7f", "network": {"id": "ad0d15aa-3eb9-452a-8c1e-f98a235beb89", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-981191229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "957a9e268fe7460c97fce1e634015214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49c54f9c-e7", "ovs_interfaceid": "49c54f9c-e72e-4cdf-96d3-7c31d8ed5109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:54:30 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:f3:7f,bridge_name='br-int',has_traffic_filtering=True,id=49c54f9c-e72e-4cdf-96d3-7c31d8ed5109,network=Network(ad0d15aa-3eb9-452a-8c1e-f98a235beb89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49c54f9c-e7') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:54:30 user nova-compute[103546]: DEBUG nova.objects.instance [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Lazy-loading 'pci_devices' on Instance uuid 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:54:30 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] End _get_guest_xml xml=<domain type="kvm">
Nov 16 03:54:30 user nova-compute[103546]:   <uuid>2ab80244-d70d-41ce-9b7e-bb9c8a676ad6</uuid>
Nov 16 03:54:30 user nova-compute[103546]:   <name>instance-00000019</name>
Nov 16 03:54:30 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 03:54:30 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 03:54:30 user nova-compute[103546]:   <metadata>
Nov 16 03:54:30 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 03:54:30 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 03:54:30 user nova-compute[103546]:       <nova:name>tempest-ServerActionsV293TestJSON-server-141615707</nova:name>
Nov 16 03:54:30 user nova-compute[103546]:       <nova:creationTime>2023-11-16 03:54:28</nova:creationTime>
Nov 16 03:54:30 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 03:54:30 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 03:54:30 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 03:54:30 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 03:54:30 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 03:54:30 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 03:54:30 user nova-compute[103546]:       </nova:flavor>
Nov 16 03:54:30 user nova-compute[103546]:       <nova:owner>
Nov 16 03:54:30 user nova-compute[103546]:         <nova:user uuid="fff2b2e712c1466991b73ead603bcf8f">tempest-ServerActionsV293TestJSON-787129566-project-member</nova:user>
Nov 16 03:54:30 user nova-compute[103546]:         <nova:project uuid="957a9e268fe7460c97fce1e634015214">tempest-ServerActionsV293TestJSON-787129566</nova:project>
Nov 16 03:54:30 user nova-compute[103546]:       </nova:owner>
Nov 16 03:54:30 user nova-compute[103546]:       <nova:ports>
Nov 16 03:54:30 user nova-compute[103546]:         <nova:port uuid="49c54f9c-e72e-4cdf-96d3-7c31d8ed5109">
Nov 16 03:54:30 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 16 03:54:30 user nova-compute[103546]:         </nova:port>
Nov 16 03:54:30 user nova-compute[103546]:       </nova:ports>
Nov 16 03:54:30 user nova-compute[103546]:     </nova:instance>
Nov 16 03:54:30 user nova-compute[103546]:   </metadata>
Nov 16 03:54:30 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 03:54:30 user nova-compute[103546]:     <system>
Nov 16 03:54:30 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 03:54:30 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 03:54:30 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 03:54:30 user nova-compute[103546]:       <entry name="serial">2ab80244-d70d-41ce-9b7e-bb9c8a676ad6</entry>
Nov 16 03:54:30 user nova-compute[103546]:       <entry name="uuid">2ab80244-d70d-41ce-9b7e-bb9c8a676ad6</entry>
Nov 16 03:54:30 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 03:54:30 user nova-compute[103546]:     </system>
Nov 16 03:54:30 user nova-compute[103546]:   </sysinfo>
Nov 16 03:54:30 user nova-compute[103546]:   <os>
Nov 16 03:54:30 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 03:54:30 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 03:54:30 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 03:54:30 user nova-compute[103546]:   </os>
Nov 16 03:54:30 user nova-compute[103546]:   <features>
Nov 16 03:54:30 user nova-compute[103546]:     <acpi/>
Nov 16 03:54:30 user nova-compute[103546]:     <apic/>
Nov 16 03:54:30 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 03:54:30 user nova-compute[103546]:   </features>
Nov 16 03:54:30 user nova-compute[103546]:   <clock offset="utc">
Nov 16 03:54:30 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 03:54:30 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 03:54:30 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 03:54:30 user nova-compute[103546]:   </clock>
Nov 16 03:54:30 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 03:54:30 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 03:54:30 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 03:54:30 user nova-compute[103546]:   </cpu>
Nov 16 03:54:30 user nova-compute[103546]:   <devices>
Nov 16 03:54:30 user nova-compute[103546]:     <disk type="block" device="disk">
Nov 16 03:54:30 user nova-compute[103546]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 03:54:30 user nova-compute[103546]:       <source dev="/dev/sdc"/>
Nov 16 03:54:30 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 03:54:30 user nova-compute[103546]:       <serial>5cdf8533-74a7-4737-b4af-2a9ae07490fc</serial>
Nov 16 03:54:30 user nova-compute[103546]:     </disk>
Nov 16 03:54:30 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 03:54:30 user nova-compute[103546]:       <mac address="fa:16:3e:5a:f3:7f"/>
Nov 16 03:54:30 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:54:30 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 03:54:30 user nova-compute[103546]:       <target dev="tap49c54f9c-e7"/>
Nov 16 03:54:30 user nova-compute[103546]:     </interface>
Nov 16 03:54:30 user nova-compute[103546]:     <serial type="pty">
Nov 16 03:54:30 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/2ab80244-d70d-41ce-9b7e-bb9c8a676ad6/console.log" append="off"/>
Nov 16 03:54:30 user nova-compute[103546]:     </serial>
Nov 16 03:54:30 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 03:54:30 user nova-compute[103546]:     <video>
Nov 16 03:54:30 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:54:30 user nova-compute[103546]:     </video>
Nov 16 03:54:30 user nova-compute[103546]:     <rng model="virtio">
Nov 16 03:54:30 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 03:54:30 user nova-compute[103546]:     </rng>
Nov 16 03:54:30 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 03:54:30 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 03:54:30 user nova-compute[103546]:       <stats period="10"/>
Nov 16 03:54:30 user nova-compute[103546]:     </memballoon>
Nov 16 03:54:30 user nova-compute[103546]:   </devices>
Nov 16 03:54:30 user nova-compute[103546]: </domain>
Nov 16 03:54:30 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 03:54:30 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:54:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-141615707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-141615707',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1Y2L2l3MWVbNwdnSdeRUxJz0N8le0D37MGjqwWaMwxA7R3Wdx+y5O8T7rTKllDINxi17uE0eTWUeh3EwdhWWGhIv3K2uMZjagCC2gLDhzEp415K3OXZdfZ5QqNTz5yjQ==',key_name='tempest-keypair-336828995',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='957a9e268fe7460c97fce1e634015214',ramdisk_id='',reservation_id='r-f4s0l7jd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-787129566',owner_user_name='tempest-ServerActionsV293TestJSON-787129566-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:54:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fff2b2e712c1466991b73ead603bcf8f',uuid=2ab80244-d70d-41ce-9b7e-bb9c8a676ad6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49c54f9c-e72e-4cdf-96d3-7c31d8ed5109", "address": "fa:16:3e:5a:f3:7f", "network": {"id": "ad0d15aa-3eb9-452a-8c1e-f98a235beb89", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-981191229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "957a9e268fe7460c97fce1e634015214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49c54f9c-e7", "ovs_interfaceid": "49c54f9c-e72e-4cdf-96d3-7c31d8ed5109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 03:54:30 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Converting VIF {"id": "49c54f9c-e72e-4cdf-96d3-7c31d8ed5109", "address": "fa:16:3e:5a:f3:7f", "network": {"id": "ad0d15aa-3eb9-452a-8c1e-f98a235beb89", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-981191229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "957a9e268fe7460c97fce1e634015214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49c54f9c-e7", "ovs_interfaceid": "49c54f9c-e72e-4cdf-96d3-7c31d8ed5109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:54:30 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:f3:7f,bridge_name='br-int',has_traffic_filtering=True,id=49c54f9c-e72e-4cdf-96d3-7c31d8ed5109,network=Network(ad0d15aa-3eb9-452a-8c1e-f98a235beb89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49c54f9c-e7') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:54:30 user nova-compute[103546]: DEBUG os_vif [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:f3:7f,bridge_name='br-int',has_traffic_filtering=True,id=49c54f9c-e72e-4cdf-96d3-7c31d8ed5109,network=Network(ad0d15aa-3eb9-452a-8c1e-f98a235beb89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49c54f9c-e7') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 03:54:30 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:30 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:54:30 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 03:54:30 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:30 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '362c5c70-c98d-5788-a5e8-8deeae2787d5', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:54:30 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:30 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:54:30 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:30 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap49c54f9c-e7, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:54:30 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap49c54f9c-e7, col_values=(('qos', UUID('8b86181c-3231-4894-bf7a-73bf158144d1')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:54:30 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap49c54f9c-e7, col_values=(('external_ids', {'iface-id': '49c54f9c-e72e-4cdf-96d3-7c31d8ed5109', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:f3:7f', 'vm-uuid': '2ab80244-d70d-41ce-9b7e-bb9c8a676ad6'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:54:30 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:30 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:54:30 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:30 user nova-compute[103546]: INFO os_vif [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:f3:7f,bridge_name='br-int',has_traffic_filtering=True,id=49c54f9c-e72e-4cdf-96d3-7c31d8ed5109,network=Network(ad0d15aa-3eb9-452a-8c1e-f98a235beb89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49c54f9c-e7')
Nov 16 03:54:30 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:54:30 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] No VIF found with MAC fa:16:3e:5a:f3:7f, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 03:54:31 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquiring lock "9c86c600-6277-4746-934d-c63e95616219" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:54:31 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "9c86c600-6277-4746-934d-c63e95616219" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:54:31 user nova-compute[103546]: DEBUG nova.compute.manager [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9c86c600-6277-4746-934d-c63e95616219] Starting instance... {{(pid=103546) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 03:54:31 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:54:31 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:54:31 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=103546) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 03:54:31 user nova-compute[103546]: INFO nova.compute.claims [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9c86c600-6277-4746-934d-c63e95616219] Claim successful on node user
Nov 16 03:54:31 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:31 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:31 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:31 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:32 user nova-compute[103546]: DEBUG nova.compute.manager [req-d649b922-e8fe-40af-b6fa-af65c9b2f8dc req-13696490-0206-4bb4-86b5-0e988a5fdc19 service nova] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Received event network-vif-plugged-49c54f9c-e72e-4cdf-96d3-7c31d8ed5109 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:54:32 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d649b922-e8fe-40af-b6fa-af65c9b2f8dc req-13696490-0206-4bb4-86b5-0e988a5fdc19 service nova] Acquiring lock "2ab80244-d70d-41ce-9b7e-bb9c8a676ad6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:54:32 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d649b922-e8fe-40af-b6fa-af65c9b2f8dc req-13696490-0206-4bb4-86b5-0e988a5fdc19 service nova] Lock "2ab80244-d70d-41ce-9b7e-bb9c8a676ad6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:54:32 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d649b922-e8fe-40af-b6fa-af65c9b2f8dc req-13696490-0206-4bb4-86b5-0e988a5fdc19 service nova] Lock "2ab80244-d70d-41ce-9b7e-bb9c8a676ad6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:54:32 user nova-compute[103546]: DEBUG nova.compute.manager [req-d649b922-e8fe-40af-b6fa-af65c9b2f8dc req-13696490-0206-4bb4-86b5-0e988a5fdc19 service nova] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] No waiting events found dispatching network-vif-plugged-49c54f9c-e72e-4cdf-96d3-7c31d8ed5109 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:54:32 user nova-compute[103546]: WARNING nova.compute.manager [req-d649b922-e8fe-40af-b6fa-af65c9b2f8dc req-13696490-0206-4bb4-86b5-0e988a5fdc19 service nova] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Received unexpected event network-vif-plugged-49c54f9c-e72e-4cdf-96d3-7c31d8ed5109 for instance with vm_state building and task_state spawning.
Nov 16 03:54:32 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:54:32 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:54:32 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.729s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:54:32 user nova-compute[103546]: DEBUG nova.compute.manager [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9c86c600-6277-4746-934d-c63e95616219] Start building networks asynchronously for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 03:54:32 user nova-compute[103546]: DEBUG nova.compute.manager [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9c86c600-6277-4746-934d-c63e95616219] Allocating IP information in the background. {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 03:54:32 user nova-compute[103546]: DEBUG nova.network.neutron [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9c86c600-6277-4746-934d-c63e95616219] allocate_for_instance() {{(pid=103546) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 03:54:32 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9c86c600-6277-4746-934d-c63e95616219] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 03:54:32 user nova-compute[103546]: DEBUG nova.compute.manager [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9c86c600-6277-4746-934d-c63e95616219] Start building block device mappings for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 03:54:32 user nova-compute[103546]: INFO nova.virt.block_device [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9c86c600-6277-4746-934d-c63e95616219] Booting with volume 0e06dd4b-d05c-4a7d-84a2-5801598f2925 at /dev/vda
Nov 16 03:54:32 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:32 user nova-compute[103546]: DEBUG nova.policy [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ab77040a7b9846d28dc08852d678d1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ce50192a9743b59a9430163dd6a51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103546) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 03:54:32 user nova-compute[103546]: DEBUG os_brick.utils [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:54:32 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:32 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f202da19-0638-4b51-9ae5-3d217dfd7d65]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af5c39b14ece\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:32 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf72853-33df-495d-8c05-263d09566fe1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:32 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4943d66-cf9e-410e-bc90-28d953b41bbe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:32 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[00cb381b-d22d-424f-ab86-e4a98e16b256]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Running cmd (subprocess): nvme version {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] 'nvme version' failed. Not Retrying. {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:54:32 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] nvme not present on system {{(pid=103546) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 03:54:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:54:32 user nova-compute[103546]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 03:54:32 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc50136-86ac-486b-bcb1-0d3d25c0b253]: (4, '') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:32 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=103546) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 03:54:32 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 03:54:32 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] LIGHTOS: no hostnqn found. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 03:54:32 user nova-compute[103546]: DEBUG os_brick.utils [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af5c39b14ece', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:54:32 user nova-compute[103546]: DEBUG nova.virt.block_device [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9c86c600-6277-4746-934d-c63e95616219] Updating existing volume attachment record: de7b2a41-1a42-4418-88bb-2e3ecff8291c {{(pid=103546) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 03:54:33 user nova-compute[103546]: DEBUG nova.network.neutron [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9c86c600-6277-4746-934d-c63e95616219] Successfully created port: 5d9f9a33-9288-41e9-9965-d9f2c768f57a {{(pid=103546) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 03:54:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:34 user nova-compute[103546]: DEBUG nova.compute.manager [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 03:54:34 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Guest created on hypervisor {{(pid=103546) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 03:54:34 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Instance spawned successfully.
Nov 16 03:54:34 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 03:54:34 user nova-compute[103546]: DEBUG nova.compute.manager [req-b892f5bc-ce5e-460c-9379-4966a60dba3e req-e2242c95-d1e2-4b67-85e9-b406e10cbbe6 service nova] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Received event network-vif-plugged-49c54f9c-e72e-4cdf-96d3-7c31d8ed5109 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:54:34 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-b892f5bc-ce5e-460c-9379-4966a60dba3e req-e2242c95-d1e2-4b67-85e9-b406e10cbbe6 service nova] Acquiring lock "2ab80244-d70d-41ce-9b7e-bb9c8a676ad6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:54:34 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-b892f5bc-ce5e-460c-9379-4966a60dba3e req-e2242c95-d1e2-4b67-85e9-b406e10cbbe6 service nova] Lock "2ab80244-d70d-41ce-9b7e-bb9c8a676ad6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:54:34 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-b892f5bc-ce5e-460c-9379-4966a60dba3e req-e2242c95-d1e2-4b67-85e9-b406e10cbbe6 service nova] Lock "2ab80244-d70d-41ce-9b7e-bb9c8a676ad6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:54:34 user nova-compute[103546]: DEBUG nova.compute.manager [req-b892f5bc-ce5e-460c-9379-4966a60dba3e req-e2242c95-d1e2-4b67-85e9-b406e10cbbe6 service nova] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] No waiting events found dispatching network-vif-plugged-49c54f9c-e72e-4cdf-96d3-7c31d8ed5109 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:54:34 user nova-compute[103546]: WARNING nova.compute.manager [req-b892f5bc-ce5e-460c-9379-4966a60dba3e req-e2242c95-d1e2-4b67-85e9-b406e10cbbe6 service nova] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Received unexpected event network-vif-plugged-49c54f9c-e72e-4cdf-96d3-7c31d8ed5109 for instance with vm_state building and task_state spawning.
Nov 16 03:54:34 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Found default for hw_cdrom_bus of ide {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:54:34 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Found default for hw_disk_bus of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:54:34 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Found default for hw_input_bus of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:54:34 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Found default for hw_pointer_model of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:54:34 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Found default for hw_video_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:54:34 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Found default for hw_vif_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:54:34 user nova-compute[103546]: DEBUG nova.network.neutron [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9c86c600-6277-4746-934d-c63e95616219] Successfully updated port: 5d9f9a33-9288-41e9-9965-d9f2c768f57a {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 03:54:34 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquiring lock "refresh_cache-9c86c600-6277-4746-934d-c63e95616219" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:54:34 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquired lock "refresh_cache-9c86c600-6277-4746-934d-c63e95616219" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:54:34 user nova-compute[103546]: DEBUG nova.network.neutron [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9c86c600-6277-4746-934d-c63e95616219] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 03:54:34 user nova-compute[103546]: DEBUG nova.compute.manager [req-0ff856f6-c081-4099-9d2b-7f7d884743db req-a074336a-7101-4e82-b8ba-90484f9a496b service nova] [instance: 9c86c600-6277-4746-934d-c63e95616219] Received event network-changed-5d9f9a33-9288-41e9-9965-d9f2c768f57a {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:54:34 user nova-compute[103546]: DEBUG nova.compute.manager [req-0ff856f6-c081-4099-9d2b-7f7d884743db req-a074336a-7101-4e82-b8ba-90484f9a496b service nova] [instance: 9c86c600-6277-4746-934d-c63e95616219] Refreshing instance network info cache due to event network-changed-5d9f9a33-9288-41e9-9965-d9f2c768f57a. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:54:34 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-0ff856f6-c081-4099-9d2b-7f7d884743db req-a074336a-7101-4e82-b8ba-90484f9a496b service nova] Acquiring lock "refresh_cache-9c86c600-6277-4746-934d-c63e95616219" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:54:34 user nova-compute[103546]: INFO nova.compute.manager [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Took 5.41 seconds to spawn the instance on the hypervisor.
Nov 16 03:54:34 user nova-compute[103546]: DEBUG nova.compute.manager [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 03:54:34 user nova-compute[103546]: DEBUG nova.network.neutron [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9c86c600-6277-4746-934d-c63e95616219] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 03:54:34 user nova-compute[103546]: INFO nova.compute.manager [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Took 11.33 seconds to build instance.
Nov 16 03:54:34 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e02eea2e-36a2-4fc1-af75-e71d7b0f278f tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Lock "2ab80244-d70d-41ce-9b7e-bb9c8a676ad6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.433s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:54:34 user nova-compute[103546]: DEBUG nova.network.neutron [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9c86c600-6277-4746-934d-c63e95616219] Updating instance_info_cache with network_info: [{"id": "5d9f9a33-9288-41e9-9965-d9f2c768f57a", "address": "fa:16:3e:ca:8d:04", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d9f9a33-92", "ovs_interfaceid": "5d9f9a33-9288-41e9-9965-d9f2c768f57a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:54:34 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Releasing lock "refresh_cache-9c86c600-6277-4746-934d-c63e95616219" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:54:34 user nova-compute[103546]: DEBUG nova.compute.manager [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9c86c600-6277-4746-934d-c63e95616219] Instance network_info: |[{"id": "5d9f9a33-9288-41e9-9965-d9f2c768f57a", "address": "fa:16:3e:ca:8d:04", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d9f9a33-92", "ovs_interfaceid": "5d9f9a33-9288-41e9-9965-d9f2c768f57a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 03:54:34 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-0ff856f6-c081-4099-9d2b-7f7d884743db req-a074336a-7101-4e82-b8ba-90484f9a496b service nova] Acquired lock "refresh_cache-9c86c600-6277-4746-934d-c63e95616219" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:54:34 user nova-compute[103546]: DEBUG nova.network.neutron [req-0ff856f6-c081-4099-9d2b-7f7d884743db req-a074336a-7101-4e82-b8ba-90484f9a496b service nova] [instance: 9c86c600-6277-4746-934d-c63e95616219] Refreshing network info cache for port 5d9f9a33-9288-41e9-9965-d9f2c768f57a {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:54:34 user nova-compute[103546]: DEBUG nova.network.neutron [req-0ff856f6-c081-4099-9d2b-7f7d884743db req-a074336a-7101-4e82-b8ba-90484f9a496b service nova] [instance: 9c86c600-6277-4746-934d-c63e95616219] Updated VIF entry in instance network info cache for port 5d9f9a33-9288-41e9-9965-d9f2c768f57a. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 03:54:34 user nova-compute[103546]: DEBUG nova.network.neutron [req-0ff856f6-c081-4099-9d2b-7f7d884743db req-a074336a-7101-4e82-b8ba-90484f9a496b service nova] [instance: 9c86c600-6277-4746-934d-c63e95616219] Updating instance_info_cache with network_info: [{"id": "5d9f9a33-9288-41e9-9965-d9f2c768f57a", "address": "fa:16:3e:ca:8d:04", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d9f9a33-92", "ovs_interfaceid": "5d9f9a33-9288-41e9-9965-d9f2c768f57a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:54:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-0ff856f6-c081-4099-9d2b-7f7d884743db req-a074336a-7101-4e82-b8ba-90484f9a496b service nova] Releasing lock "refresh_cache-9c86c600-6277-4746-934d-c63e95616219" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:54:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG nova.compute.manager [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9c86c600-6277-4746-934d-c63e95616219] Start spawning the instance on the hypervisor. {{(pid=103546) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9c86c600-6277-4746-934d-c63e95616219] Creating instance directory {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 03:54:38 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9c86c600-6277-4746-934d-c63e95616219] Creating image(s)
Nov 16 03:54:38 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9c86c600-6277-4746-934d-c63e95616219] Did not create local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9c86c600-6277-4746-934d-c63e95616219] Ensure instance console log exists: /opt/stack/data/nova/instances/9c86c600-6277-4746-934d-c63e95616219/console.log {{(pid=103546) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9c86c600-6277-4746-934d-c63e95616219] Start _get_guest_xml network_info=[{"id": "5d9f9a33-9288-41e9-9965-d9f2c768f57a", "address": "fa:16:3e:ca:8d:04", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d9f9a33-92", "ovs_interfaceid": "5d9f9a33-9288-41e9-9965-d9f2c768f57a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tfPpUYJD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9c86c600-6277-4746-934d-c63e95616219', 'attached_at': '', 'detached_at': '', 'volume_id': '0e06dd4b-d05c-4a7d-84a2-5801598f2925', 'serial': '0e06dd4b-d05c-4a7d-84a2-5801598f2925'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': 'de7b2a41-1a42-4418-88bb-2e3ecff8291c', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 03:54:38 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:54:38 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:54:38 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9c86c600-6277-4746-934d-c63e95616219] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tfPpUYJD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:54:38 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:54:38 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:54:38 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:54:38 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:54:38 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 03:54:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea542ef9-d715-4864-992a-729fb86a2c96]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 03:54:38 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 -p 172.16.0.220:3260 --interface default --op new {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[90fe7a3c-e3c4-4e64-88ce-98cff2c24e27]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925] added\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925] added
Nov 16 03:54:38 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c990a708-4bf0-40fe-96e0-5e6f1263f343]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c926fe-0e86-4677-b081-19749b1c675c]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tfPpUYJD {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tfPpUYJD" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a9b6c6-acce-451c-b6a7-53a39abc62f6]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tfPpUYJD'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[4716dfb0-6f2d-432f-8618-8c0d606a31c1]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f1c478-7ce5-4940-9141-a76e1c38e840]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:54:38 user nova-compute[103546]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc (non-flash)
Nov 16 03:54:38 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:54:38 user nova-compute[103546]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc (non-flash)
Nov 16 03:54:38 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 -p 172.16.0.220:3260 --login {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc25206e-5a86-44d0-a4a7-52712e254994]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925, portal: 172.16.0.220,3260]
Nov 16 03:54:38 user nova-compute[103546]: Login to [iface: default, target: iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925, portal: 172.16.0.220,3260] successful.
Nov 16 03:54:38 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ca9ada-cd67-4ec7-bc7f-b656679e9d30]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c0b464-c99b-4d24-b38a-7edafaad4662]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:54:38 user nova-compute[103546]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc (non-flash)
Nov 16 03:54:38 user nova-compute[103546]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)
Nov 16 03:54:38 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:54:38 user nova-compute[103546]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc (non-flash)
Nov 16 03:54:38 user nova-compute[103546]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)
Nov 16 03:54:38 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] HCTL ('35', '-', '-', 0) found on session 27 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e26a203-2809-4520-ba31-8dc89bd725c7]: (4, ('- - 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Searching for a device in session 27 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 03:54:38 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tfPpUYJD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 03:54:39 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:54:39 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '26665336635353933', 'path': '/dev/sdd'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:54:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9c86c600-6277-4746-934d-c63e95616219] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665336635353933', 'path': '/dev/sdd'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 03:54:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:54:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1526373307',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1526373307',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1526373307',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7nUqVdJvmnH7LQDMxVUr6ehgNHY3jQVGbY7JqwBiU54q4wNBiglmli+abZPfIvdkEzE97CKjHGu7VBVKB6tBg6LQ9oTiV027MnLn1e/iQR5tl6HZe1WbiOwCpAjpiaWg==',key_name='tempest-keypair-1140930886',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40ce50192a9743b59a9430163dd6a51c',ramdisk_id='',reservation_id='r-s100j9bi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1283031547',owner_user_name='tempest-TestVolumeBootPattern-1283031547-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:54:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ab77040a7b9846d28dc08852d678d1ed',uuid=9c86c600-6277-4746-934d-c63e95616219,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d9f9a33-9288-41e9-9965-d9f2c768f57a", "address": "fa:16:3e:ca:8d:04", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d9f9a33-92", "ovs_interfaceid": "5d9f9a33-9288-41e9-9965-d9f2c768f57a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 03:54:39 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Converting VIF {"id": "5d9f9a33-9288-41e9-9965-d9f2c768f57a", "address": "fa:16:3e:ca:8d:04", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d9f9a33-92", "ovs_interfaceid": "5d9f9a33-9288-41e9-9965-d9f2c768f57a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:54:39 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:8d:04,bridge_name='br-int',has_traffic_filtering=True,id=5d9f9a33-9288-41e9-9965-d9f2c768f57a,network=Network(a13f532d-a30d-4c06-83fe-760bcffae183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d9f9a33-92') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:54:39 user nova-compute[103546]: DEBUG nova.objects.instance [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lazy-loading 'pci_devices' on Instance uuid 9c86c600-6277-4746-934d-c63e95616219 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:54:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9c86c600-6277-4746-934d-c63e95616219] End _get_guest_xml xml=<domain type="kvm">
Nov 16 03:54:39 user nova-compute[103546]:   <uuid>9c86c600-6277-4746-934d-c63e95616219</uuid>
Nov 16 03:54:39 user nova-compute[103546]:   <name>instance-0000001a</name>
Nov 16 03:54:39 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 03:54:39 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 03:54:39 user nova-compute[103546]:   <metadata>
Nov 16 03:54:39 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 03:54:39 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 03:54:39 user nova-compute[103546]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1526373307</nova:name>
Nov 16 03:54:39 user nova-compute[103546]:       <nova:creationTime>2023-11-16 03:54:38</nova:creationTime>
Nov 16 03:54:39 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 03:54:39 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 03:54:39 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 03:54:39 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 03:54:39 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 03:54:39 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 03:54:39 user nova-compute[103546]:       </nova:flavor>
Nov 16 03:54:39 user nova-compute[103546]:       <nova:owner>
Nov 16 03:54:39 user nova-compute[103546]:         <nova:user uuid="ab77040a7b9846d28dc08852d678d1ed">tempest-TestVolumeBootPattern-1283031547-project-member</nova:user>
Nov 16 03:54:39 user nova-compute[103546]:         <nova:project uuid="40ce50192a9743b59a9430163dd6a51c">tempest-TestVolumeBootPattern-1283031547</nova:project>
Nov 16 03:54:39 user nova-compute[103546]:       </nova:owner>
Nov 16 03:54:39 user nova-compute[103546]:       <nova:ports>
Nov 16 03:54:39 user nova-compute[103546]:         <nova:port uuid="5d9f9a33-9288-41e9-9965-d9f2c768f57a">
Nov 16 03:54:39 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 03:54:39 user nova-compute[103546]:         </nova:port>
Nov 16 03:54:39 user nova-compute[103546]:       </nova:ports>
Nov 16 03:54:39 user nova-compute[103546]:     </nova:instance>
Nov 16 03:54:39 user nova-compute[103546]:   </metadata>
Nov 16 03:54:39 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 03:54:39 user nova-compute[103546]:     <system>
Nov 16 03:54:39 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 03:54:39 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 03:54:39 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 03:54:39 user nova-compute[103546]:       <entry name="serial">9c86c600-6277-4746-934d-c63e95616219</entry>
Nov 16 03:54:39 user nova-compute[103546]:       <entry name="uuid">9c86c600-6277-4746-934d-c63e95616219</entry>
Nov 16 03:54:39 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 03:54:39 user nova-compute[103546]:     </system>
Nov 16 03:54:39 user nova-compute[103546]:   </sysinfo>
Nov 16 03:54:39 user nova-compute[103546]:   <os>
Nov 16 03:54:39 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 03:54:39 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 03:54:39 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 03:54:39 user nova-compute[103546]:   </os>
Nov 16 03:54:39 user nova-compute[103546]:   <features>
Nov 16 03:54:39 user nova-compute[103546]:     <acpi/>
Nov 16 03:54:39 user nova-compute[103546]:     <apic/>
Nov 16 03:54:39 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 03:54:39 user nova-compute[103546]:   </features>
Nov 16 03:54:39 user nova-compute[103546]:   <clock offset="utc">
Nov 16 03:54:39 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 03:54:39 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 03:54:39 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 03:54:39 user nova-compute[103546]:   </clock>
Nov 16 03:54:39 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 03:54:39 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 03:54:39 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 03:54:39 user nova-compute[103546]:   </cpu>
Nov 16 03:54:39 user nova-compute[103546]:   <devices>
Nov 16 03:54:39 user nova-compute[103546]:     <disk type="block" device="disk">
Nov 16 03:54:39 user nova-compute[103546]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 03:54:39 user nova-compute[103546]:       <source dev="/dev/sdd"/>
Nov 16 03:54:39 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 03:54:39 user nova-compute[103546]:       <serial>0e06dd4b-d05c-4a7d-84a2-5801598f2925</serial>
Nov 16 03:54:39 user nova-compute[103546]:     </disk>
Nov 16 03:54:39 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 03:54:39 user nova-compute[103546]:       <mac address="fa:16:3e:ca:8d:04"/>
Nov 16 03:54:39 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:54:39 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 03:54:39 user nova-compute[103546]:       <target dev="tap5d9f9a33-92"/>
Nov 16 03:54:39 user nova-compute[103546]:     </interface>
Nov 16 03:54:39 user nova-compute[103546]:     <serial type="pty">
Nov 16 03:54:39 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/9c86c600-6277-4746-934d-c63e95616219/console.log" append="off"/>
Nov 16 03:54:39 user nova-compute[103546]:     </serial>
Nov 16 03:54:39 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 03:54:39 user nova-compute[103546]:     <video>
Nov 16 03:54:39 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:54:39 user nova-compute[103546]:     </video>
Nov 16 03:54:39 user nova-compute[103546]:     <rng model="virtio">
Nov 16 03:54:39 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 03:54:39 user nova-compute[103546]:     </rng>
Nov 16 03:54:39 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 03:54:39 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 03:54:39 user nova-compute[103546]:       <stats period="10"/>
Nov 16 03:54:39 user nova-compute[103546]:     </memballoon>
Nov 16 03:54:39 user nova-compute[103546]:   </devices>
Nov 16 03:54:39 user nova-compute[103546]: </domain>
Nov 16 03:54:39 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 03:54:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:54:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1526373307',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1526373307',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1526373307',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7nUqVdJvmnH7LQDMxVUr6ehgNHY3jQVGbY7JqwBiU54q4wNBiglmli+abZPfIvdkEzE97CKjHGu7VBVKB6tBg6LQ9oTiV027MnLn1e/iQR5tl6HZe1WbiOwCpAjpiaWg==',key_name='tempest-keypair-1140930886',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40ce50192a9743b59a9430163dd6a51c',ramdisk_id='',reservation_id='r-s100j9bi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1283031547',owner_user_name='tempest-TestVolumeBootPattern-1283031547-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:54:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ab77040a7b9846d28dc08852d678d1ed',uuid=9c86c600-6277-4746-934d-c63e95616219,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d9f9a33-9288-41e9-9965-d9f2c768f57a", "address": "fa:16:3e:ca:8d:04", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d9f9a33-92", "ovs_interfaceid": "5d9f9a33-9288-41e9-9965-d9f2c768f57a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 03:54:39 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Converting VIF {"id": "5d9f9a33-9288-41e9-9965-d9f2c768f57a", "address": "fa:16:3e:ca:8d:04", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d9f9a33-92", "ovs_interfaceid": "5d9f9a33-9288-41e9-9965-d9f2c768f57a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:54:39 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:8d:04,bridge_name='br-int',has_traffic_filtering=True,id=5d9f9a33-9288-41e9-9965-d9f2c768f57a,network=Network(a13f532d-a30d-4c06-83fe-760bcffae183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d9f9a33-92') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:54:39 user nova-compute[103546]: DEBUG os_vif [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:8d:04,bridge_name='br-int',has_traffic_filtering=True,id=5d9f9a33-9288-41e9-9965-d9f2c768f57a,network=Network(a13f532d-a30d-4c06-83fe-760bcffae183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d9f9a33-92') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 03:54:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:54:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 03:54:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0b89cfe3-7a7c-58e3-9ac8-b28a81a52328', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:54:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:54:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5d9f9a33-92, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:54:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5d9f9a33-92, col_values=(('qos', UUID('ed686a11-f69d-4a9c-8d5d-17c6c69af68d')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:54:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5d9f9a33-92, col_values=(('external_ids', {'iface-id': '5d9f9a33-9288-41e9-9965-d9f2c768f57a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:8d:04', 'vm-uuid': '9c86c600-6277-4746-934d-c63e95616219'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:54:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:54:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:39 user nova-compute[103546]: INFO os_vif [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:8d:04,bridge_name='br-int',has_traffic_filtering=True,id=5d9f9a33-9288-41e9-9965-d9f2c768f57a,network=Network(a13f532d-a30d-4c06-83fe-760bcffae183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d9f9a33-92')
Nov 16 03:54:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:54:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] No VIF found with MAC fa:16:3e:ca:8d:04, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 03:54:40 user nova-compute[103546]: DEBUG nova.compute.manager [req-e19f038a-ca9b-4a62-aafa-8453d0654187 req-ea0bef26-6e82-4f18-b279-597865cfc459 service nova] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Received event network-changed-ab9b5dca-ac92-42ef-a86f-20ea3ccaf7e0 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:54:40 user nova-compute[103546]: DEBUG nova.compute.manager [req-e19f038a-ca9b-4a62-aafa-8453d0654187 req-ea0bef26-6e82-4f18-b279-597865cfc459 service nova] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Refreshing instance network info cache due to event network-changed-ab9b5dca-ac92-42ef-a86f-20ea3ccaf7e0. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:54:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-e19f038a-ca9b-4a62-aafa-8453d0654187 req-ea0bef26-6e82-4f18-b279-597865cfc459 service nova] Acquiring lock "refresh_cache-164533fb-64e1-4aa5-b5fb-273817dd3e74" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:54:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-e19f038a-ca9b-4a62-aafa-8453d0654187 req-ea0bef26-6e82-4f18-b279-597865cfc459 service nova] Acquired lock "refresh_cache-164533fb-64e1-4aa5-b5fb-273817dd3e74" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:54:40 user nova-compute[103546]: DEBUG nova.network.neutron [req-e19f038a-ca9b-4a62-aafa-8453d0654187 req-ea0bef26-6e82-4f18-b279-597865cfc459 service nova] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Refreshing network info cache for port ab9b5dca-ac92-42ef-a86f-20ea3ccaf7e0 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:54:40 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:40 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:40 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:41 user nova-compute[103546]: DEBUG nova.network.neutron [req-e19f038a-ca9b-4a62-aafa-8453d0654187 req-ea0bef26-6e82-4f18-b279-597865cfc459 service nova] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Updated VIF entry in instance network info cache for port ab9b5dca-ac92-42ef-a86f-20ea3ccaf7e0. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 03:54:41 user nova-compute[103546]: DEBUG nova.network.neutron [req-e19f038a-ca9b-4a62-aafa-8453d0654187 req-ea0bef26-6e82-4f18-b279-597865cfc459 service nova] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Updating instance_info_cache with network_info: [{"id": "ab9b5dca-ac92-42ef-a86f-20ea3ccaf7e0", "address": "fa:16:3e:7b:45:4e", "network": {"id": "e6c6220f-786a-4445-981c-58cb30c01961", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1592167081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "697f0f13eb5e4681bfb4dbe0ad0bc9d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab9b5dca-ac", "ovs_interfaceid": "ab9b5dca-ac92-42ef-a86f-20ea3ccaf7e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:54:41 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-e19f038a-ca9b-4a62-aafa-8453d0654187 req-ea0bef26-6e82-4f18-b279-597865cfc459 service nova] Releasing lock "refresh_cache-164533fb-64e1-4aa5-b5fb-273817dd3e74" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:54:41 user nova-compute[103546]: DEBUG nova.compute.manager [req-b54bd7eb-c254-4761-b07b-2badffe4b7b2 req-f4ef9714-1b80-49f0-82c6-ace9775bc932 service nova] [instance: 9c86c600-6277-4746-934d-c63e95616219] Received event network-vif-plugged-5d9f9a33-9288-41e9-9965-d9f2c768f57a {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:54:41 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-b54bd7eb-c254-4761-b07b-2badffe4b7b2 req-f4ef9714-1b80-49f0-82c6-ace9775bc932 service nova] Acquiring lock "9c86c600-6277-4746-934d-c63e95616219-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:54:41 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-b54bd7eb-c254-4761-b07b-2badffe4b7b2 req-f4ef9714-1b80-49f0-82c6-ace9775bc932 service nova] Lock "9c86c600-6277-4746-934d-c63e95616219-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:54:41 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-b54bd7eb-c254-4761-b07b-2badffe4b7b2 req-f4ef9714-1b80-49f0-82c6-ace9775bc932 service nova] Lock "9c86c600-6277-4746-934d-c63e95616219-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:54:41 user nova-compute[103546]: DEBUG nova.compute.manager [req-b54bd7eb-c254-4761-b07b-2badffe4b7b2 req-f4ef9714-1b80-49f0-82c6-ace9775bc932 service nova] [instance: 9c86c600-6277-4746-934d-c63e95616219] No waiting events found dispatching network-vif-plugged-5d9f9a33-9288-41e9-9965-d9f2c768f57a {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:54:41 user nova-compute[103546]: WARNING nova.compute.manager [req-b54bd7eb-c254-4761-b07b-2badffe4b7b2 req-f4ef9714-1b80-49f0-82c6-ace9775bc932 service nova] [instance: 9c86c600-6277-4746-934d-c63e95616219] Received unexpected event network-vif-plugged-5d9f9a33-9288-41e9-9965-d9f2c768f57a for instance with vm_state building and task_state spawning.
Nov 16 03:54:41 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-c4035eef-6590-4aef-8b7a-ca79ff8d9f87 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Acquiring lock "164533fb-64e1-4aa5-b5fb-273817dd3e74" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:54:41 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-c4035eef-6590-4aef-8b7a-ca79ff8d9f87 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Lock "164533fb-64e1-4aa5-b5fb-273817dd3e74" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:54:41 user nova-compute[103546]: DEBUG nova.objects.instance [None req-c4035eef-6590-4aef-8b7a-ca79ff8d9f87 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Lazy-loading 'flavor' on Instance uuid 164533fb-64e1-4aa5-b5fb-273817dd3e74 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:54:41 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-c4035eef-6590-4aef-8b7a-ca79ff8d9f87 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Lock "164533fb-64e1-4aa5-b5fb-273817dd3e74" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.083s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:54:41 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-c4035eef-6590-4aef-8b7a-ca79ff8d9f87 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Acquiring lock "164533fb-64e1-4aa5-b5fb-273817dd3e74" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:54:41 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-c4035eef-6590-4aef-8b7a-ca79ff8d9f87 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Lock "164533fb-64e1-4aa5-b5fb-273817dd3e74" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:54:41 user nova-compute[103546]: INFO nova.compute.manager [None req-c4035eef-6590-4aef-8b7a-ca79ff8d9f87 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Attaching volume f25e1a13-9b02-47dc-8610-7676f6e22a55 to /dev/vdb
Nov 16 03:54:41 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:41 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:41 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:41 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:41 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:41 user nova-compute[103546]: DEBUG os_brick.utils [None req-c4035eef-6590-4aef-8b7a-ca79ff8d9f87 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:54:41 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:41 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:41 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[59480ae0-5075-4ee0-b473-73007478a73d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af5c39b14ece\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:41 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:41 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:41 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[142a93f4-bd40-46e1-ae51-f11d3397a48f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:41 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:41 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:41 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac02948-cb73-4311-9f78-a01042ae1226]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:41 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b81e9d-4e9b-40eb-8a3f-a18d30755691]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:41 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-c4035eef-6590-4aef-8b7a-ca79ff8d9f87 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Running cmd (subprocess): nvme version {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:41 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-c4035eef-6590-4aef-8b7a-ca79ff8d9f87 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] 'nvme version' failed. Not Retrying. {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:54:41 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c4035eef-6590-4aef-8b7a-ca79ff8d9f87 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] nvme not present on system {{(pid=103546) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 03:54:41 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:41 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:54:41 user nova-compute[103546]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 03:54:41 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c131d52-f59b-469d-bbc7-3e9b763a2ceb]: (4, '') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:41 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-c4035eef-6590-4aef-8b7a-ca79ff8d9f87 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=103546) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 03:54:41 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-c4035eef-6590-4aef-8b7a-ca79ff8d9f87 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 03:54:41 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-c4035eef-6590-4aef-8b7a-ca79ff8d9f87 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] LIGHTOS: no hostnqn found. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 03:54:41 user nova-compute[103546]: DEBUG os_brick.utils [None req-c4035eef-6590-4aef-8b7a-ca79ff8d9f87 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af5c39b14ece', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:54:41 user nova-compute[103546]: DEBUG nova.virt.block_device [None req-c4035eef-6590-4aef-8b7a-ca79ff8d9f87 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Updating existing volume attachment record: 5f7ab383-24cb-411c-8035-34420d29c366 {{(pid=103546) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 03:54:43 user nova-compute[103546]: DEBUG nova.compute.manager [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9c86c600-6277-4746-934d-c63e95616219] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 03:54:43 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9c86c600-6277-4746-934d-c63e95616219] Guest created on hypervisor {{(pid=103546) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 03:54:43 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 9c86c600-6277-4746-934d-c63e95616219] Instance spawned successfully.
Nov 16 03:54:43 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9c86c600-6277-4746-934d-c63e95616219] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 03:54:43 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9c86c600-6277-4746-934d-c63e95616219] Found default for hw_cdrom_bus of ide {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:54:43 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9c86c600-6277-4746-934d-c63e95616219] Found default for hw_disk_bus of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:54:43 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9c86c600-6277-4746-934d-c63e95616219] Found default for hw_input_bus of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:54:43 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9c86c600-6277-4746-934d-c63e95616219] Found default for hw_pointer_model of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:54:43 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9c86c600-6277-4746-934d-c63e95616219] Found default for hw_video_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:54:43 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9c86c600-6277-4746-934d-c63e95616219] Found default for hw_vif_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:54:43 user nova-compute[103546]: DEBUG nova.compute.manager [req-ffbd709d-cbff-4059-94ff-38fb6d99373b req-97eb2dec-46d4-4ac1-9d02-2bb7649f6ee6 service nova] [instance: 9c86c600-6277-4746-934d-c63e95616219] Received event network-vif-plugged-5d9f9a33-9288-41e9-9965-d9f2c768f57a {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:54:43 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ffbd709d-cbff-4059-94ff-38fb6d99373b req-97eb2dec-46d4-4ac1-9d02-2bb7649f6ee6 service nova] Acquiring lock "9c86c600-6277-4746-934d-c63e95616219-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:54:43 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ffbd709d-cbff-4059-94ff-38fb6d99373b req-97eb2dec-46d4-4ac1-9d02-2bb7649f6ee6 service nova] Lock "9c86c600-6277-4746-934d-c63e95616219-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:54:43 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ffbd709d-cbff-4059-94ff-38fb6d99373b req-97eb2dec-46d4-4ac1-9d02-2bb7649f6ee6 service nova] Lock "9c86c600-6277-4746-934d-c63e95616219-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:54:43 user nova-compute[103546]: DEBUG nova.compute.manager [req-ffbd709d-cbff-4059-94ff-38fb6d99373b req-97eb2dec-46d4-4ac1-9d02-2bb7649f6ee6 service nova] [instance: 9c86c600-6277-4746-934d-c63e95616219] No waiting events found dispatching network-vif-plugged-5d9f9a33-9288-41e9-9965-d9f2c768f57a {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:54:43 user nova-compute[103546]: WARNING nova.compute.manager [req-ffbd709d-cbff-4059-94ff-38fb6d99373b req-97eb2dec-46d4-4ac1-9d02-2bb7649f6ee6 service nova] [instance: 9c86c600-6277-4746-934d-c63e95616219] Received unexpected event network-vif-plugged-5d9f9a33-9288-41e9-9965-d9f2c768f57a for instance with vm_state building and task_state spawning.
Nov 16 03:54:43 user nova-compute[103546]: INFO nova.compute.manager [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9c86c600-6277-4746-934d-c63e95616219] Took 5.17 seconds to spawn the instance on the hypervisor.
Nov 16 03:54:43 user nova-compute[103546]: DEBUG nova.compute.manager [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9c86c600-6277-4746-934d-c63e95616219] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 03:54:43 user nova-compute[103546]: INFO nova.compute.manager [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9c86c600-6277-4746-934d-c63e95616219] Took 11.74 seconds to build instance.
Nov 16 03:54:43 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-6f5adadf-93ea-4eed-8e85-36d5aa0a29c5 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "9c86c600-6277-4746-934d-c63e95616219" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.859s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:54:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:44 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:47 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4035eef-6590-4aef-8b7a-ca79ff8d9f87 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 03:54:47 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4035eef-6590-4aef-8b7a-ca79ff8d9f87 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JEuWNUio', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:54:47 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-c4035eef-6590-4aef-8b7a-ca79ff8d9f87 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:54:47 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-c4035eef-6590-4aef-8b7a-ca79ff8d9f87 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:54:47 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-c4035eef-6590-4aef-8b7a-ca79ff8d9f87 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:54:47 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-c4035eef-6590-4aef-8b7a-ca79ff8d9f87 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:54:47 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-c4035eef-6590-4aef-8b7a-ca79ff8d9f87 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:54:47 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-c4035eef-6590-4aef-8b7a-ca79ff8d9f87 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:54:47 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-c4035eef-6590-4aef-8b7a-ca79ff8d9f87 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 03:54:47 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55 -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:47 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:47 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d8294e-a11f-4863-bd72-e44ee7da3c88]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:47 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4035eef-6590-4aef-8b7a-ca79ff8d9f87 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 03:54:47 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:54:47 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55 -p 172.16.0.220:3260 --interface default --op new {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:47 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:47 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[8300a94e-d5c1-4eed-b55a-f842b419ee68]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55] added\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:47 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4035eef-6590-4aef-8b7a-ca79ff8d9f87 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55] added
Nov 16 03:54:47 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:54:47 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:47 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:47 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b04350-7683-42e7-b5c9-1b41026c898c]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:47 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4035eef-6590-4aef-8b7a-ca79ff8d9f87 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:54:47 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:47 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:47 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[304ed9e9-0078-4ef2-8c8a-5e6fd94f5d9a]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:47 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4035eef-6590-4aef-8b7a-ca79ff8d9f87 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:54:47 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JEuWNUio {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:47 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JEuWNUio" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:47 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[67fece80-f198-4ff9-a95e-d8e9e51e25d7]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:47 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4035eef-6590-4aef-8b7a-ca79ff8d9f87 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JEuWNUio'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:54:47 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:47 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:47 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d491f22-3a21-4140-b9e3-d06f9b8a5e2d]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:47 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4035eef-6590-4aef-8b7a-ca79ff8d9f87 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:54:47 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:47 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:47 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[704a0f5f-88af-4c3a-974d-46bc011b983b]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:47 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4035eef-6590-4aef-8b7a-ca79ff8d9f87 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:54:47 user nova-compute[103546]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc (non-flash)
Nov 16 03:54:47 user nova-compute[103546]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)
Nov 16 03:54:47 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:54:47 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4035eef-6590-4aef-8b7a-ca79ff8d9f87 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:54:47 user nova-compute[103546]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc (non-flash)
Nov 16 03:54:47 user nova-compute[103546]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)
Nov 16 03:54:47 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:54:47 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55 -p 172.16.0.220:3260 --login {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:47 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:47 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9c5df4-3828-43e6-b09a-74c169590644]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:47 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4035eef-6590-4aef-8b7a-ca79ff8d9f87 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55, portal: 172.16.0.220,3260]
Nov 16 03:54:47 user nova-compute[103546]: Login to [iface: default, target: iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55, portal: 172.16.0.220,3260] successful.
Nov 16 03:54:47 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:54:47 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:47 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:47 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[200a8832-03bc-4d7d-9394-8e24d9168e65]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:47 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4035eef-6590-4aef-8b7a-ca79ff8d9f87 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:54:47 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:47 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:47 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0387c25-1641-4561-88a9-f0a122b86649]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:47 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4035eef-6590-4aef-8b7a-ca79ff8d9f87 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:54:47 user nova-compute[103546]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc (non-flash)
Nov 16 03:54:47 user nova-compute[103546]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)
Nov 16 03:54:47 user nova-compute[103546]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55 (non-flash)
Nov 16 03:54:47 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:54:47 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4035eef-6590-4aef-8b7a-ca79ff8d9f87 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:54:47 user nova-compute[103546]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc (non-flash)
Nov 16 03:54:47 user nova-compute[103546]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)
Nov 16 03:54:47 user nova-compute[103546]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55 (non-flash)
Nov 16 03:54:47 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:54:47 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-c4035eef-6590-4aef-8b7a-ca79ff8d9f87 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:54:47 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4035eef-6590-4aef-8b7a-ca79ff8d9f87 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 03:54:47 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-c4035eef-6590-4aef-8b7a-ca79ff8d9f87 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] HCTL ('36', '-', '-', 0) found on session 28 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 03:54:47 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-c4035eef-6590-4aef-8b7a-ca79ff8d9f87 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 03:54:47 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:47 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:47 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3af3f4-4bc6-4351-bf16-2fdd1d8b6dbb]: (4, ('- - 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:47 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-c4035eef-6590-4aef-8b7a-ca79ff8d9f87 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Searching for a device in session 28 and hctl ['36', '*', '*', 0] yield: sde {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 03:54:47 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4035eef-6590-4aef-8b7a-ca79ff8d9f87 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JEuWNUio', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 03:54:48 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:48 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-c4035eef-6590-4aef-8b7a-ca79ff8d9f87 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:54:48 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4035eef-6590-4aef-8b7a-ca79ff8d9f87 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '23833363063656662', 'path': '/dev/sde'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:54:48 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4035eef-6590-4aef-8b7a-ca79ff8d9f87 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833363063656662', 'path': '/dev/sde'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 03:54:48 user nova-compute[103546]: DEBUG nova.objects.instance [None req-c4035eef-6590-4aef-8b7a-ca79ff8d9f87 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Lazy-loading 'flavor' on Instance uuid 164533fb-64e1-4aa5-b5fb-273817dd3e74 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:54:48 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-c4035eef-6590-4aef-8b7a-ca79ff8d9f87 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 03:54:48 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 03:54:48 user nova-compute[103546]:   <source dev="/dev/sde"/>
Nov 16 03:54:48 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 03:54:48 user nova-compute[103546]:   <serial>f25e1a13-9b02-47dc-8610-7676f6e22a55</serial>
Nov 16 03:54:48 user nova-compute[103546]: </disk>
Nov 16 03:54:48 user nova-compute[103546]:  {{(pid=103546) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 03:54:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-c4035eef-6590-4aef-8b7a-ca79ff8d9f87 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:54:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-c4035eef-6590-4aef-8b7a-ca79ff8d9f87 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] No BDM found with device name vdb, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:54:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-c4035eef-6590-4aef-8b7a-ca79ff8d9f87 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] No VIF found with MAC fa:16:3e:7b:45:4e, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 03:54:49 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-c4035eef-6590-4aef-8b7a-ca79ff8d9f87 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Lock "164533fb-64e1-4aa5-b5fb-273817dd3e74" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.713s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:54:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:53 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-ec0e6349-384f-4281-93c6-99452f7752d9 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Acquiring lock "164533fb-64e1-4aa5-b5fb-273817dd3e74" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:54:53 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-ec0e6349-384f-4281-93c6-99452f7752d9 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Lock "164533fb-64e1-4aa5-b5fb-273817dd3e74" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:54:53 user nova-compute[103546]: DEBUG nova.objects.instance [None req-ec0e6349-384f-4281-93c6-99452f7752d9 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Lazy-loading 'flavor' on Instance uuid 164533fb-64e1-4aa5-b5fb-273817dd3e74 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:54:53 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-ec0e6349-384f-4281-93c6-99452f7752d9 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Lock "164533fb-64e1-4aa5-b5fb-273817dd3e74" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:54:53 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-ec0e6349-384f-4281-93c6-99452f7752d9 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Acquiring lock "164533fb-64e1-4aa5-b5fb-273817dd3e74" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:54:53 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-ec0e6349-384f-4281-93c6-99452f7752d9 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Lock "164533fb-64e1-4aa5-b5fb-273817dd3e74" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:54:53 user nova-compute[103546]: INFO nova.compute.manager [None req-ec0e6349-384f-4281-93c6-99452f7752d9 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Attaching volume 17547dd1-37b4-49b3-8741-5f77cfc8fd15 to /dev/vdc
Nov 16 03:54:53 user nova-compute[103546]: DEBUG os_brick.utils [None req-ec0e6349-384f-4281-93c6-99452f7752d9 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:54:53 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:53 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:53 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[504e7630-ada9-4d7b-a0fb-4ca15e12ad94]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af5c39b14ece\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:53 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:54 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:54 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1ceb62-5e55-4fbe-9401-e10acf31bc8b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:54 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:54 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:54 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc74bfb-158b-41ba-a8b6-61820c493e33]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:54 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5223f857-ca1e-4884-b754-8928414172af]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:54 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-ec0e6349-384f-4281-93c6-99452f7752d9 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Running cmd (subprocess): nvme version {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:54 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-ec0e6349-384f-4281-93c6-99452f7752d9 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] 'nvme version' failed. Not Retrying. {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:54:54 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ec0e6349-384f-4281-93c6-99452f7752d9 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] nvme not present on system {{(pid=103546) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 03:54:54 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:54 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:54:54 user nova-compute[103546]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 03:54:54 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[704ff33d-4ccb-42fc-8553-545ce3dca1e0]: (4, '') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:54 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-ec0e6349-384f-4281-93c6-99452f7752d9 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=103546) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 03:54:54 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-ec0e6349-384f-4281-93c6-99452f7752d9 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 03:54:54 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-ec0e6349-384f-4281-93c6-99452f7752d9 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] LIGHTOS: no hostnqn found. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 03:54:54 user nova-compute[103546]: DEBUG os_brick.utils [None req-ec0e6349-384f-4281-93c6-99452f7752d9 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af5c39b14ece', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:54:54 user nova-compute[103546]: DEBUG nova.virt.block_device [None req-ec0e6349-384f-4281-93c6-99452f7752d9 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Updating existing volume attachment record: 7b63bf8b-f939-4c5d-993c-36a4b9a2bf18 {{(pid=103546) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 03:54:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e9756664-8048-4f6d-8daa-04ca9845ad7f tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Acquiring lock "279e2954-d786-4544-903d-8edc63646e2d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:54:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e9756664-8048-4f6d-8daa-04ca9845ad7f tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Lock "279e2954-d786-4544-903d-8edc63646e2d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:54:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e9756664-8048-4f6d-8daa-04ca9845ad7f tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Acquiring lock "279e2954-d786-4544-903d-8edc63646e2d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:54:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e9756664-8048-4f6d-8daa-04ca9845ad7f tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Lock "279e2954-d786-4544-903d-8edc63646e2d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:54:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e9756664-8048-4f6d-8daa-04ca9845ad7f tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Lock "279e2954-d786-4544-903d-8edc63646e2d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:54:57 user nova-compute[103546]: INFO nova.compute.manager [None req-e9756664-8048-4f6d-8daa-04ca9845ad7f tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 279e2954-d786-4544-903d-8edc63646e2d] Terminating instance
Nov 16 03:54:57 user nova-compute[103546]: DEBUG nova.compute.manager [None req-e9756664-8048-4f6d-8daa-04ca9845ad7f tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 279e2954-d786-4544-903d-8edc63646e2d] Start destroying the instance on the hypervisor. {{(pid=103546) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 03:54:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:57 user nova-compute[103546]: DEBUG nova.compute.manager [req-1a40335d-4a85-4e35-853a-3f4013ea0a5a req-beb21353-d5ac-43a3-919e-9400955359ea service nova] [instance: 279e2954-d786-4544-903d-8edc63646e2d] Received event network-vif-unplugged-e60cc693-67d4-45a3-a97e-40bb5f753c9d {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:54:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-1a40335d-4a85-4e35-853a-3f4013ea0a5a req-beb21353-d5ac-43a3-919e-9400955359ea service nova] Acquiring lock "279e2954-d786-4544-903d-8edc63646e2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:54:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-1a40335d-4a85-4e35-853a-3f4013ea0a5a req-beb21353-d5ac-43a3-919e-9400955359ea service nova] Lock "279e2954-d786-4544-903d-8edc63646e2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:54:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-1a40335d-4a85-4e35-853a-3f4013ea0a5a req-beb21353-d5ac-43a3-919e-9400955359ea service nova] Lock "279e2954-d786-4544-903d-8edc63646e2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:54:57 user nova-compute[103546]: DEBUG nova.compute.manager [req-1a40335d-4a85-4e35-853a-3f4013ea0a5a req-beb21353-d5ac-43a3-919e-9400955359ea service nova] [instance: 279e2954-d786-4544-903d-8edc63646e2d] No waiting events found dispatching network-vif-unplugged-e60cc693-67d4-45a3-a97e-40bb5f753c9d {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:54:57 user nova-compute[103546]: DEBUG nova.compute.manager [req-1a40335d-4a85-4e35-853a-3f4013ea0a5a req-beb21353-d5ac-43a3-919e-9400955359ea service nova] [instance: 279e2954-d786-4544-903d-8edc63646e2d] Received event network-vif-unplugged-e60cc693-67d4-45a3-a97e-40bb5f753c9d for instance with task_state deleting. {{(pid=103546) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 03:54:58 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 279e2954-d786-4544-903d-8edc63646e2d] Instance destroyed successfully.
Nov 16 03:54:58 user nova-compute[103546]: DEBUG nova.objects.instance [None req-e9756664-8048-4f6d-8daa-04ca9845ad7f tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Lazy-loading 'resources' on Instance uuid 279e2954-d786-4544-903d-8edc63646e2d {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:54:58 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-e9756664-8048-4f6d-8daa-04ca9845ad7f tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:46:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1301859585',display_name='tempest-ServersNegativeTestJSON-server-1301859585',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1301859585',id=1,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:46:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c3f227c815224d55afdb3eba43e68757',ramdisk_id='',reservation_id='r-gi09kwkt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-740287726',owner_user_name='tempest-ServersNegativeTestJSON-740287726-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T03:46:27Z,user_data=None,user_id='fe3fb261884b45b0bdc984b79bc1dc96',uuid=279e2954-d786-4544-903d-8edc63646e2d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e60cc693-67d4-45a3-a97e-40bb5f753c9d", "address": "fa:16:3e:44:ef:27", "network": {"id": "56e4e469-bfda-4ab1-9fdd-e3aa1a0655fc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-669383710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f227c815224d55afdb3eba43e68757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape60cc693-67", "ovs_interfaceid": "e60cc693-67d4-45a3-a97e-40bb5f753c9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 03:54:58 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-e9756664-8048-4f6d-8daa-04ca9845ad7f tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Converting VIF {"id": "e60cc693-67d4-45a3-a97e-40bb5f753c9d", "address": "fa:16:3e:44:ef:27", "network": {"id": "56e4e469-bfda-4ab1-9fdd-e3aa1a0655fc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-669383710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f227c815224d55afdb3eba43e68757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape60cc693-67", "ovs_interfaceid": "e60cc693-67d4-45a3-a97e-40bb5f753c9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:54:58 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-e9756664-8048-4f6d-8daa-04ca9845ad7f tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:ef:27,bridge_name='br-int',has_traffic_filtering=True,id=e60cc693-67d4-45a3-a97e-40bb5f753c9d,network=Network(56e4e469-bfda-4ab1-9fdd-e3aa1a0655fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape60cc693-67') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:54:58 user nova-compute[103546]: DEBUG os_vif [None req-e9756664-8048-4f6d-8daa-04ca9845ad7f tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:ef:27,bridge_name='br-int',has_traffic_filtering=True,id=e60cc693-67d4-45a3-a97e-40bb5f753c9d,network=Network(56e4e469-bfda-4ab1-9fdd-e3aa1a0655fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape60cc693-67') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 03:54:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape60cc693-67, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:54:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:54:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8e74a104-0b7e-42c9-937a-5350e3416d82) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:54:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:58 user nova-compute[103546]: INFO os_vif [None req-e9756664-8048-4f6d-8daa-04ca9845ad7f tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:ef:27,bridge_name='br-int',has_traffic_filtering=True,id=e60cc693-67d4-45a3-a97e-40bb5f753c9d,network=Network(56e4e469-bfda-4ab1-9fdd-e3aa1a0655fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape60cc693-67')
Nov 16 03:54:58 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-e9756664-8048-4f6d-8daa-04ca9845ad7f tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 279e2954-d786-4544-903d-8edc63646e2d] Deleting instance files /opt/stack/data/nova/instances/279e2954-d786-4544-903d-8edc63646e2d_del
Nov 16 03:54:58 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-e9756664-8048-4f6d-8daa-04ca9845ad7f tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 279e2954-d786-4544-903d-8edc63646e2d] Deletion of /opt/stack/data/nova/instances/279e2954-d786-4544-903d-8edc63646e2d_del complete
Nov 16 03:54:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:54:58 user nova-compute[103546]: INFO nova.compute.manager [None req-e9756664-8048-4f6d-8daa-04ca9845ad7f tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] [instance: 279e2954-d786-4544-903d-8edc63646e2d] Took 0.83 seconds to destroy the instance on the hypervisor.
Nov 16 03:54:58 user nova-compute[103546]: DEBUG oslo.service.loopingcall [None req-e9756664-8048-4f6d-8daa-04ca9845ad7f tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=103546) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 03:54:58 user nova-compute[103546]: DEBUG nova.compute.manager [-] [instance: 279e2954-d786-4544-903d-8edc63646e2d] Deallocating network for instance {{(pid=103546) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 03:54:58 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 279e2954-d786-4544-903d-8edc63646e2d] deallocate_for_instance() {{(pid=103546) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 03:54:59 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 279e2954-d786-4544-903d-8edc63646e2d] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:54:59 user nova-compute[103546]: INFO nova.compute.manager [-] [instance: 279e2954-d786-4544-903d-8edc63646e2d] Took 0.53 seconds to deallocate network for instance.
Nov 16 03:54:59 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e9756664-8048-4f6d-8daa-04ca9845ad7f tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:54:59 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e9756664-8048-4f6d-8daa-04ca9845ad7f tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:54:59 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec0e6349-384f-4281-93c6-99452f7752d9 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 03:54:59 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0e6349-384f-4281-93c6-99452f7752d9 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:17547dd1-37b4-49b3-8741-5f77cfc8fd15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PxTOsgch', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:54:59 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-ec0e6349-384f-4281-93c6-99452f7752d9 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:54:59 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-ec0e6349-384f-4281-93c6-99452f7752d9 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:54:59 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-ec0e6349-384f-4281-93c6-99452f7752d9 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:54:59 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-ec0e6349-384f-4281-93c6-99452f7752d9 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:54:59 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-ec0e6349-384f-4281-93c6-99452f7752d9 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17547dd1-37b4-49b3-8741-5f77cfc8fd15" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:54:59 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-ec0e6349-384f-4281-93c6-99452f7752d9 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17547dd1-37b4-49b3-8741-5f77cfc8fd15" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:54:59 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-ec0e6349-384f-4281-93c6-99452f7752d9 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 03:54:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17547dd1-37b4-49b3-8741-5f77cfc8fd15 -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17547dd1-37b4-49b3-8741-5f77cfc8fd15 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:59 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e68cc2d-cea5-4010-8a90-4755aa115ea5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:59 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0e6349-384f-4281-93c6-99452f7752d9 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 03:54:59 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:54:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17547dd1-37b4-49b3-8741-5f77cfc8fd15 -p 172.16.0.220:3260 --interface default --op new {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17547dd1-37b4-49b3-8741-5f77cfc8fd15 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:59 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[79cced58-b03d-4f8d-be8a-e945ce5f4c04]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:17547dd1-37b4-49b3-8741-5f77cfc8fd15] added\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:59 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0e6349-384f-4281-93c6-99452f7752d9 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:17547dd1-37b4-49b3-8741-5f77cfc8fd15] added
Nov 16 03:54:59 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:54:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17547dd1-37b4-49b3-8741-5f77cfc8fd15 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17547dd1-37b4-49b3-8741-5f77cfc8fd15 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:59 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e2dda2-baf0-4cb6-8935-615e4db00fc0]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:59 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0e6349-384f-4281-93c6-99452f7752d9 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:54:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17547dd1-37b4-49b3-8741-5f77cfc8fd15 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17547dd1-37b4-49b3-8741-5f77cfc8fd15 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:59 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[915d5c88-7e81-40d8-8f14-542ccdc7729b]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:59 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0e6349-384f-4281-93c6-99452f7752d9 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:54:59 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-e9756664-8048-4f6d-8daa-04ca9845ad7f tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:54:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17547dd1-37b4-49b3-8741-5f77cfc8fd15 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PxTOsgch {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:59 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-e9756664-8048-4f6d-8daa-04ca9845ad7f tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:54:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17547dd1-37b4-49b3-8741-5f77cfc8fd15 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PxTOsgch" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:59 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e08d45c-180e-4898-b70f-61734eb4ea83]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:59 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0e6349-384f-4281-93c6-99452f7752d9 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PxTOsgch'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:54:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17547dd1-37b4-49b3-8741-5f77cfc8fd15 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17547dd1-37b4-49b3-8741-5f77cfc8fd15 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:59 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2ae807-2eab-48a0-b16c-39b1016bbdba]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:59 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0e6349-384f-4281-93c6-99452f7752d9 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:54:59 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e9756664-8048-4f6d-8daa-04ca9845ad7f tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.370s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:54:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:59 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[366ca32a-e369-4b52-855e-2d8a098437e8]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:59 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0e6349-384f-4281-93c6-99452f7752d9 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:54:59 user nova-compute[103546]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc (non-flash)
Nov 16 03:54:59 user nova-compute[103546]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)
Nov 16 03:54:59 user nova-compute[103546]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55 (non-flash)
Nov 16 03:54:59 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:54:59 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0e6349-384f-4281-93c6-99452f7752d9 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:54:59 user nova-compute[103546]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc (non-flash)
Nov 16 03:54:59 user nova-compute[103546]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)
Nov 16 03:54:59 user nova-compute[103546]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55 (non-flash)
Nov 16 03:54:59 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:54:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17547dd1-37b4-49b3-8741-5f77cfc8fd15 -p 172.16.0.220:3260 --login {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:59 user nova-compute[103546]: INFO nova.scheduler.client.report [None req-e9756664-8048-4f6d-8daa-04ca9845ad7f tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Deleted allocations for instance 279e2954-d786-4544-903d-8edc63646e2d
Nov 16 03:54:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17547dd1-37b4-49b3-8741-5f77cfc8fd15 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:59 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd099935-5044-44d5-9d1f-a967fd7e07be]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:17547dd1-37b4-49b3-8741-5f77cfc8fd15, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:17547dd1-37b4-49b3-8741-5f77cfc8fd15, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:59 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0e6349-384f-4281-93c6-99452f7752d9 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:17547dd1-37b4-49b3-8741-5f77cfc8fd15, portal: 172.16.0.220,3260]
Nov 16 03:54:59 user nova-compute[103546]: Login to [iface: default, target: iqn.2010-10.org.openstack:17547dd1-37b4-49b3-8741-5f77cfc8fd15, portal: 172.16.0.220,3260] successful.
Nov 16 03:54:59 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:54:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17547dd1-37b4-49b3-8741-5f77cfc8fd15 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17547dd1-37b4-49b3-8741-5f77cfc8fd15 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:59 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91350e3-c95c-4166-8039-b6cd5749c8a0]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:59 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0e6349-384f-4281-93c6-99452f7752d9 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:54:59 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e9756664-8048-4f6d-8daa-04ca9845ad7f tempest-ServersNegativeTestJSON-740287726 tempest-ServersNegativeTestJSON-740287726-project-member] Lock "279e2954-d786-4544-903d-8edc63646e2d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.940s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:54:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:59 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd76b43-fc06-46bf-8ef3-65ddb9b8db1c]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17547dd1-37b4-49b3-8741-5f77cfc8fd15 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:59 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0e6349-384f-4281-93c6-99452f7752d9 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:54:59 user nova-compute[103546]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc (non-flash)
Nov 16 03:54:59 user nova-compute[103546]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)
Nov 16 03:54:59 user nova-compute[103546]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55 (non-flash)
Nov 16 03:54:59 user nova-compute[103546]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17547dd1-37b4-49b3-8741-5f77cfc8fd15 (non-flash)
Nov 16 03:54:59 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:54:59 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0e6349-384f-4281-93c6-99452f7752d9 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:54:59 user nova-compute[103546]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc (non-flash)
Nov 16 03:54:59 user nova-compute[103546]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)
Nov 16 03:54:59 user nova-compute[103546]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55 (non-flash)
Nov 16 03:54:59 user nova-compute[103546]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17547dd1-37b4-49b3-8741-5f77cfc8fd15 (non-flash)
Nov 16 03:54:59 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:54:59 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-ec0e6349-384f-4281-93c6-99452f7752d9 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17547dd1-37b4-49b3-8741-5f77cfc8fd15" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:54:59 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0e6349-384f-4281-93c6-99452f7752d9 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 03:54:59 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-ec0e6349-384f-4281-93c6-99452f7752d9 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] HCTL ('37', '-', '-', 0) found on session 29 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 03:54:59 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-ec0e6349-384f-4281-93c6-99452f7752d9 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 03:54:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:54:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:54:59 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f009c43-4f17-478b-a063-0d2151854cd1]: (4, ('- - 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:54:59 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-ec0e6349-384f-4281-93c6-99452f7752d9 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Searching for a device in session 29 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 03:54:59 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0e6349-384f-4281-93c6-99452f7752d9 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:17547dd1-37b4-49b3-8741-5f77cfc8fd15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PxTOsgch', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 03:55:00 user nova-compute[103546]: DEBUG nova.compute.manager [req-70fc3664-67bc-4446-9b9e-c631f5d20706 req-33bd079b-6b19-4706-885d-339cfbcf703d service nova] [instance: 279e2954-d786-4544-903d-8edc63646e2d] Received event network-vif-plugged-e60cc693-67d4-45a3-a97e-40bb5f753c9d {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:55:00 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-70fc3664-67bc-4446-9b9e-c631f5d20706 req-33bd079b-6b19-4706-885d-339cfbcf703d service nova] Acquiring lock "279e2954-d786-4544-903d-8edc63646e2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:55:00 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-70fc3664-67bc-4446-9b9e-c631f5d20706 req-33bd079b-6b19-4706-885d-339cfbcf703d service nova] Lock "279e2954-d786-4544-903d-8edc63646e2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:55:00 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-70fc3664-67bc-4446-9b9e-c631f5d20706 req-33bd079b-6b19-4706-885d-339cfbcf703d service nova] Lock "279e2954-d786-4544-903d-8edc63646e2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:55:00 user nova-compute[103546]: DEBUG nova.compute.manager [req-70fc3664-67bc-4446-9b9e-c631f5d20706 req-33bd079b-6b19-4706-885d-339cfbcf703d service nova] [instance: 279e2954-d786-4544-903d-8edc63646e2d] No waiting events found dispatching network-vif-plugged-e60cc693-67d4-45a3-a97e-40bb5f753c9d {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:55:00 user nova-compute[103546]: WARNING nova.compute.manager [req-70fc3664-67bc-4446-9b9e-c631f5d20706 req-33bd079b-6b19-4706-885d-339cfbcf703d service nova] [instance: 279e2954-d786-4544-903d-8edc63646e2d] Received unexpected event network-vif-plugged-e60cc693-67d4-45a3-a97e-40bb5f753c9d for instance with vm_state deleted and task_state None.
Nov 16 03:55:00 user nova-compute[103546]: DEBUG nova.compute.manager [req-70fc3664-67bc-4446-9b9e-c631f5d20706 req-33bd079b-6b19-4706-885d-339cfbcf703d service nova] [instance: 279e2954-d786-4544-903d-8edc63646e2d] Received event network-vif-deleted-e60cc693-67d4-45a3-a97e-40bb5f753c9d {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:55:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-ec0e6349-384f-4281-93c6-99452f7752d9 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:55:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec0e6349-384f-4281-93c6-99452f7752d9 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '26562336666363165', 'path': '/dev/sdf'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:55:00 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec0e6349-384f-4281-93c6-99452f7752d9 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562336666363165', 'path': '/dev/sdf'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 03:55:00 user nova-compute[103546]: DEBUG nova.objects.instance [None req-ec0e6349-384f-4281-93c6-99452f7752d9 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Lazy-loading 'flavor' on Instance uuid 164533fb-64e1-4aa5-b5fb-273817dd3e74 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:55:00 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-ec0e6349-384f-4281-93c6-99452f7752d9 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 03:55:00 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 03:55:00 user nova-compute[103546]:   <source dev="/dev/sdf"/>
Nov 16 03:55:00 user nova-compute[103546]:   <target dev="vdc" bus="virtio"/>
Nov 16 03:55:00 user nova-compute[103546]:   <serial>17547dd1-37b4-49b3-8741-5f77cfc8fd15</serial>
Nov 16 03:55:00 user nova-compute[103546]: </disk>
Nov 16 03:55:00 user nova-compute[103546]:  {{(pid=103546) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 03:55:01 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-ec0e6349-384f-4281-93c6-99452f7752d9 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:55:01 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-ec0e6349-384f-4281-93c6-99452f7752d9 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] No BDM found with device name vdb, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:55:01 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-ec0e6349-384f-4281-93c6-99452f7752d9 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] No BDM found with device name vdc, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:55:01 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-ec0e6349-384f-4281-93c6-99452f7752d9 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] No VIF found with MAC fa:16:3e:7b:45:4e, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 03:55:01 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-ec0e6349-384f-4281-93c6-99452f7752d9 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Lock "164533fb-64e1-4aa5-b5fb-273817dd3e74" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.385s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:55:01 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f24615d8-8892-4ea1-af24-0f1570ba936c tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Acquiring lock "164533fb-64e1-4aa5-b5fb-273817dd3e74" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:55:01 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f24615d8-8892-4ea1-af24-0f1570ba936c tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Lock "164533fb-64e1-4aa5-b5fb-273817dd3e74" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:55:01 user nova-compute[103546]: INFO nova.compute.manager [None req-f24615d8-8892-4ea1-af24-0f1570ba936c tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Detaching volume 17547dd1-37b4-49b3-8741-5f77cfc8fd15
Nov 16 03:55:01 user nova-compute[103546]: INFO nova.virt.block_device [None req-f24615d8-8892-4ea1-af24-0f1570ba936c tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Attempting to driver detach volume 17547dd1-37b4-49b3-8741-5f77cfc8fd15 from mountpoint /dev/vdc
Nov 16 03:55:01 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-f24615d8-8892-4ea1-af24-0f1570ba936c tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Attempting to detach device vdc from instance 164533fb-64e1-4aa5-b5fb-273817dd3e74 from the persistent domain config. {{(pid=103546) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 03:55:01 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-f24615d8-8892-4ea1-af24-0f1570ba936c tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 03:55:01 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 03:55:01 user nova-compute[103546]:   <source dev="/dev/sdf"/>
Nov 16 03:55:01 user nova-compute[103546]:   <target dev="vdc" bus="virtio"/>
Nov 16 03:55:01 user nova-compute[103546]:   <serial>17547dd1-37b4-49b3-8741-5f77cfc8fd15</serial>
Nov 16 03:55:01 user nova-compute[103546]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 16 03:55:01 user nova-compute[103546]: </disk>
Nov 16 03:55:01 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 03:55:01 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-f24615d8-8892-4ea1-af24-0f1570ba936c tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Successfully detached device vdc from instance 164533fb-64e1-4aa5-b5fb-273817dd3e74 from the persistent domain config.
Nov 16 03:55:01 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-f24615d8-8892-4ea1-af24-0f1570ba936c tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 164533fb-64e1-4aa5-b5fb-273817dd3e74 from the live domain config. {{(pid=103546) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 03:55:01 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-f24615d8-8892-4ea1-af24-0f1570ba936c tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 03:55:01 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 03:55:01 user nova-compute[103546]:   <source dev="/dev/sdf"/>
Nov 16 03:55:01 user nova-compute[103546]:   <target dev="vdc" bus="virtio"/>
Nov 16 03:55:01 user nova-compute[103546]:   <serial>17547dd1-37b4-49b3-8741-5f77cfc8fd15</serial>
Nov 16 03:55:01 user nova-compute[103546]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 16 03:55:01 user nova-compute[103546]: </disk>
Nov 16 03:55:01 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 03:55:02 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-f24615d8-8892-4ea1-af24-0f1570ba936c tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 164533fb-64e1-4aa5-b5fb-273817dd3e74 {{(pid=103546) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 03:55:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:11 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:11 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:12 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:55:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Acquiring lock "246ccf69-847c-4ab2-b709-ad1a85e81eab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:55:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "246ccf69-847c-4ab2-b709-ad1a85e81eab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:55:12 user nova-compute[103546]: DEBUG nova.compute.manager [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Starting instance... {{(pid=103546) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 03:55:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:55:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:55:12 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=103546) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 03:55:12 user nova-compute[103546]: INFO nova.compute.claims [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Claim successful on node user
Nov 16 03:55:13 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:55:13 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:55:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.413s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:55:13 user nova-compute[103546]: DEBUG nova.compute.manager [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Start building networks asynchronously for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 03:55:13 user nova-compute[103546]: DEBUG nova.compute.manager [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Allocating IP information in the background. {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 03:55:13 user nova-compute[103546]: DEBUG nova.network.neutron [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] allocate_for_instance() {{(pid=103546) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 03:55:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:13 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 03:55:13 user nova-compute[103546]: DEBUG nova.compute.manager [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Start building block device mappings for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 03:55:13 user nova-compute[103546]: DEBUG nova.policy [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7626749c82fb4b5c81e696e4beeed858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca049d5674dc4c59814f98478752d73d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103546) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 03:55:13 user nova-compute[103546]: DEBUG nova.compute.manager [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Start spawning the instance on the hypervisor. {{(pid=103546) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 03:55:13 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Creating instance directory {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 03:55:13 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Creating image(s)
Nov 16 03:55:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Acquiring lock "/opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:55:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "/opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:55:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "/opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:55:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:55:13 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager.update_available_resource {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:55:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:55:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:55:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:55:13 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Auditing locally available compute resources for user (node: user) {{(pid=103546) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 03:55:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.197s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:55:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Acquiring lock "8c9efafb670bfe5842ba1f4ce398924612164af7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:55:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:55:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:55:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Acquiring lock "8d229d05-95f1-4997-8539-802ac65cff8b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:55:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "8d229d05-95f1-4997-8539-802ac65cff8b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:55:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/164533fb-64e1-4aa5-b5fb-273817dd3e74/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:55:14 user nova-compute[103546]: DEBUG nova.compute.manager [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Starting instance... {{(pid=103546) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 03:55:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.179s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:55:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk 1073741824 {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:55:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk 1073741824" returned: 0 in 0.053s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:55:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:55:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:55:14 user nova-compute[103546]: DEBUG nova.network.neutron [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Successfully created port: 84add44b-0c93-4ebc-b45d-2f30d63d900f {{(pid=103546) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 03:55:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/164533fb-64e1-4aa5-b5fb-273817dd3e74/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:55:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/164533fb-64e1-4aa5-b5fb-273817dd3e74/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:55:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:55:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:55:14 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=103546) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 03:55:14 user nova-compute[103546]: INFO nova.compute.claims [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Claim successful on node user
Nov 16 03:55:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.188s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:55:14 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Checking if we can resize image /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk. size=1073741824 {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 03:55:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:55:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/164533fb-64e1-4aa5-b5fb-273817dd3e74/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:55:14 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 03:55:14 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 03:55:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ab2f87d-f9da-4490-8e23-2bd4a480ee5d/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:55:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:55:14 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Cannot resize image /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk to a smaller size. {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 03:55:14 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Created local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 03:55:14 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Ensure instance console log exists: /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/console.log {{(pid=103546) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 03:55:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:55:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:55:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:55:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ab2f87d-f9da-4490-8e23-2bd4a480ee5d/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:55:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ab2f87d-f9da-4490-8e23-2bd4a480ee5d/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:55:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ab2f87d-f9da-4490-8e23-2bd4a480ee5d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:55:14 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:55:14 user nova-compute[103546]: DEBUG nova.network.neutron [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Successfully updated port: 84add44b-0c93-4ebc-b45d-2f30d63d900f {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 03:55:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:55:14 user nova-compute[103546]: DEBUG nova.compute.manager [req-45677872-6d32-48f7-b949-2962ef253a51 req-a5a8d512-bdad-4bc9-a263-ec0bbb45aa2f service nova] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Received event network-changed-84add44b-0c93-4ebc-b45d-2f30d63d900f {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:55:14 user nova-compute[103546]: DEBUG nova.compute.manager [req-45677872-6d32-48f7-b949-2962ef253a51 req-a5a8d512-bdad-4bc9-a263-ec0bbb45aa2f service nova] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Refreshing instance network info cache due to event network-changed-84add44b-0c93-4ebc-b45d-2f30d63d900f. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:55:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-45677872-6d32-48f7-b949-2962ef253a51 req-a5a8d512-bdad-4bc9-a263-ec0bbb45aa2f service nova] Acquiring lock "refresh_cache-246ccf69-847c-4ab2-b709-ad1a85e81eab" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:55:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-45677872-6d32-48f7-b949-2962ef253a51 req-a5a8d512-bdad-4bc9-a263-ec0bbb45aa2f service nova] Acquired lock "refresh_cache-246ccf69-847c-4ab2-b709-ad1a85e81eab" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:55:14 user nova-compute[103546]: DEBUG nova.network.neutron [req-45677872-6d32-48f7-b949-2962ef253a51 req-a5a8d512-bdad-4bc9-a263-ec0bbb45aa2f service nova] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Refreshing network info cache for port 84add44b-0c93-4ebc-b45d-2f30d63d900f {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:55:14 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:55:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Acquiring lock "refresh_cache-246ccf69-847c-4ab2-b709-ad1a85e81eab" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:55:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.648s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:55:14 user nova-compute[103546]: DEBUG nova.compute.manager [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Start building networks asynchronously for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 03:55:14 user nova-compute[103546]: DEBUG nova.network.neutron [req-45677872-6d32-48f7-b949-2962ef253a51 req-a5a8d512-bdad-4bc9-a263-ec0bbb45aa2f service nova] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 03:55:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:55:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:55:15 user nova-compute[103546]: DEBUG nova.compute.manager [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Allocating IP information in the background. {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 03:55:15 user nova-compute[103546]: DEBUG nova.network.neutron [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] allocate_for_instance() {{(pid=103546) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 03:55:15 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 03:55:15 user nova-compute[103546]: DEBUG nova.compute.manager [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Start building block device mappings for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 03:55:15 user nova-compute[103546]: DEBUG nova.network.neutron [req-45677872-6d32-48f7-b949-2962ef253a51 req-a5a8d512-bdad-4bc9-a263-ec0bbb45aa2f service nova] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:55:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-45677872-6d32-48f7-b949-2962ef253a51 req-a5a8d512-bdad-4bc9-a263-ec0bbb45aa2f service nova] Releasing lock "refresh_cache-246ccf69-847c-4ab2-b709-ad1a85e81eab" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:55:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Acquired lock "refresh_cache-246ccf69-847c-4ab2-b709-ad1a85e81eab" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:55:15 user nova-compute[103546]: DEBUG nova.network.neutron [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 03:55:15 user nova-compute[103546]: DEBUG nova.policy [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7626749c82fb4b5c81e696e4beeed858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca049d5674dc4c59814f98478752d73d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103546) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 03:55:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:55:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4065a1b-10a0-4b2a-9088-a703a7c4e064/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:55:15 user nova-compute[103546]: DEBUG nova.network.neutron [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 03:55:15 user nova-compute[103546]: DEBUG nova.compute.manager [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Start spawning the instance on the hypervisor. {{(pid=103546) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 03:55:15 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Creating instance directory {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 03:55:15 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Creating image(s)
Nov 16 03:55:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Acquiring lock "/opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:55:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "/opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:55:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "/opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:55:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:55:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4065a1b-10a0-4b2a-9088-a703a7c4e064/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:55:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4065a1b-10a0-4b2a-9088-a703a7c4e064/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:55:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.174s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:55:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Acquiring lock "8c9efafb670bfe5842ba1f4ce398924612164af7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:55:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:55:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:55:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4065a1b-10a0-4b2a-9088-a703a7c4e064/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:55:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4edd4240-a8e3-4f7d-ad89-795d294b72df/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:55:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.201s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:55:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk 1073741824 {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:55:15 user nova-compute[103546]: DEBUG nova.network.neutron [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Successfully created port: 5c802613-81ea-4855-a8ee-d851a4ab2ff5 {{(pid=103546) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 03:55:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk 1073741824" returned: 0 in 0.058s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:55:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:55:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:55:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4edd4240-a8e3-4f7d-ad89-795d294b72df/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:55:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4edd4240-a8e3-4f7d-ad89-795d294b72df/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:55:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.168s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:55:15 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk. size=1073741824 {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 03:55:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:55:15 user nova-compute[103546]: DEBUG nova.network.neutron [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Updating instance_info_cache with network_info: [{"id": "84add44b-0c93-4ebc-b45d-2f30d63d900f", "address": "fa:16:3e:13:18:5f", "network": {"id": "337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-40560053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca049d5674dc4c59814f98478752d73d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84add44b-0c", "ovs_interfaceid": "84add44b-0c93-4ebc-b45d-2f30d63d900f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:55:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Releasing lock "refresh_cache-246ccf69-847c-4ab2-b709-ad1a85e81eab" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:55:15 user nova-compute[103546]: DEBUG nova.compute.manager [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Instance network_info: |[{"id": "84add44b-0c93-4ebc-b45d-2f30d63d900f", "address": "fa:16:3e:13:18:5f", "network": {"id": "337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-40560053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca049d5674dc4c59814f98478752d73d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84add44b-0c", "ovs_interfaceid": "84add44b-0c93-4ebc-b45d-2f30d63d900f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 03:55:15 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Start _get_guest_xml network_info=[{"id": "84add44b-0c93-4ebc-b45d-2f30d63d900f", "address": "fa:16:3e:13:18:5f", "network": {"id": "337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-40560053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca049d5674dc4c59814f98478752d73d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84add44b-0c", "ovs_interfaceid": "84add44b-0c93-4ebc-b45d-2f30d63d900f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '5c6f539a-01e5-4478-bf8f-a14310b5d7dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 03:55:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4edd4240-a8e3-4f7d-ad89-795d294b72df/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:55:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:55:15 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:55:15 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:55:15 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 03:55:15 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 03:55:15 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 03:55:15 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 03:55:15 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 03:55:15 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 03:55:15 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 03:55:15 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 03:55:15 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 03:55:15 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 03:55:15 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 03:55:15 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 03:55:15 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 03:55:15 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 03:55:15 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 03:55:15 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 03:55:15 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:55:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2068912145',display_name='tempest-ServerRescueNegativeTestJSON-server-2068912145',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2068912145',id=27,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca049d5674dc4c59814f98478752d73d',ramdisk_id='',reservation_id='r-rkqsk0gl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1943614153',owner_user_name='tempest-ServerRescueNegativeTestJSON-1943614153-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:55:14Z,user_data=None,user_id='7626749c82fb4b5c81e696e4beeed858',uuid=246ccf69-847c-4ab2-b709-ad1a85e81eab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84add44b-0c93-4ebc-b45d-2f30d63d900f", "address": "fa:16:3e:13:18:5f", "network": {"id": "337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-40560053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca049d5674dc4c59814f98478752d73d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84add44b-0c", "ovs_interfaceid": "84add44b-0c93-4ebc-b45d-2f30d63d900f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 03:55:15 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Converting VIF {"id": "84add44b-0c93-4ebc-b45d-2f30d63d900f", "address": "fa:16:3e:13:18:5f", "network": {"id": "337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-40560053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca049d5674dc4c59814f98478752d73d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84add44b-0c", "ovs_interfaceid": "84add44b-0c93-4ebc-b45d-2f30d63d900f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:18:5f,bridge_name='br-int',has_traffic_filtering=True,id=84add44b-0c93-4ebc-b45d-2f30d63d900f,network=Network(337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84add44b-0c') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG nova.objects.instance [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lazy-loading 'pci_devices' on Instance uuid 246ccf69-847c-4ab2-b709-ad1a85e81eab {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Cannot resize image /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk to a smaller size. {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Created local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Ensure instance console log exists: /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/console.log {{(pid=103546) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] End _get_guest_xml xml=<domain type="kvm">
Nov 16 03:55:16 user nova-compute[103546]:   <uuid>246ccf69-847c-4ab2-b709-ad1a85e81eab</uuid>
Nov 16 03:55:16 user nova-compute[103546]:   <name>instance-0000001b</name>
Nov 16 03:55:16 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 03:55:16 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 03:55:16 user nova-compute[103546]:   <metadata>
Nov 16 03:55:16 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 03:55:16 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 03:55:16 user nova-compute[103546]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2068912145</nova:name>
Nov 16 03:55:16 user nova-compute[103546]:       <nova:creationTime>2023-11-16 03:55:15</nova:creationTime>
Nov 16 03:55:16 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 03:55:16 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 03:55:16 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 03:55:16 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 03:55:16 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 03:55:16 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 03:55:16 user nova-compute[103546]:       </nova:flavor>
Nov 16 03:55:16 user nova-compute[103546]:       <nova:owner>
Nov 16 03:55:16 user nova-compute[103546]:         <nova:user uuid="7626749c82fb4b5c81e696e4beeed858">tempest-ServerRescueNegativeTestJSON-1943614153-project-member</nova:user>
Nov 16 03:55:16 user nova-compute[103546]:         <nova:project uuid="ca049d5674dc4c59814f98478752d73d">tempest-ServerRescueNegativeTestJSON-1943614153</nova:project>
Nov 16 03:55:16 user nova-compute[103546]:       </nova:owner>
Nov 16 03:55:16 user nova-compute[103546]:       <nova:root type="image" uuid="5c6f539a-01e5-4478-bf8f-a14310b5d7dd"/>
Nov 16 03:55:16 user nova-compute[103546]:       <nova:ports>
Nov 16 03:55:16 user nova-compute[103546]:         <nova:port uuid="84add44b-0c93-4ebc-b45d-2f30d63d900f">
Nov 16 03:55:16 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 16 03:55:16 user nova-compute[103546]:         </nova:port>
Nov 16 03:55:16 user nova-compute[103546]:       </nova:ports>
Nov 16 03:55:16 user nova-compute[103546]:     </nova:instance>
Nov 16 03:55:16 user nova-compute[103546]:   </metadata>
Nov 16 03:55:16 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 03:55:16 user nova-compute[103546]:     <system>
Nov 16 03:55:16 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 03:55:16 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 03:55:16 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 03:55:16 user nova-compute[103546]:       <entry name="serial">246ccf69-847c-4ab2-b709-ad1a85e81eab</entry>
Nov 16 03:55:16 user nova-compute[103546]:       <entry name="uuid">246ccf69-847c-4ab2-b709-ad1a85e81eab</entry>
Nov 16 03:55:16 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 03:55:16 user nova-compute[103546]:     </system>
Nov 16 03:55:16 user nova-compute[103546]:   </sysinfo>
Nov 16 03:55:16 user nova-compute[103546]:   <os>
Nov 16 03:55:16 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 03:55:16 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 03:55:16 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 03:55:16 user nova-compute[103546]:   </os>
Nov 16 03:55:16 user nova-compute[103546]:   <features>
Nov 16 03:55:16 user nova-compute[103546]:     <acpi/>
Nov 16 03:55:16 user nova-compute[103546]:     <apic/>
Nov 16 03:55:16 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 03:55:16 user nova-compute[103546]:   </features>
Nov 16 03:55:16 user nova-compute[103546]:   <clock offset="utc">
Nov 16 03:55:16 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 03:55:16 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 03:55:16 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 03:55:16 user nova-compute[103546]:   </clock>
Nov 16 03:55:16 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 03:55:16 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 03:55:16 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 03:55:16 user nova-compute[103546]:   </cpu>
Nov 16 03:55:16 user nova-compute[103546]:   <devices>
Nov 16 03:55:16 user nova-compute[103546]:     <disk type="file" device="disk">
Nov 16 03:55:16 user nova-compute[103546]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 03:55:16 user nova-compute[103546]:       <source file="/opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk"/>
Nov 16 03:55:16 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 03:55:16 user nova-compute[103546]:     </disk>
Nov 16 03:55:16 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 03:55:16 user nova-compute[103546]:       <mac address="fa:16:3e:13:18:5f"/>
Nov 16 03:55:16 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:55:16 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 03:55:16 user nova-compute[103546]:       <target dev="tap84add44b-0c"/>
Nov 16 03:55:16 user nova-compute[103546]:     </interface>
Nov 16 03:55:16 user nova-compute[103546]:     <serial type="pty">
Nov 16 03:55:16 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/console.log" append="off"/>
Nov 16 03:55:16 user nova-compute[103546]:     </serial>
Nov 16 03:55:16 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 03:55:16 user nova-compute[103546]:     <video>
Nov 16 03:55:16 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:55:16 user nova-compute[103546]:     </video>
Nov 16 03:55:16 user nova-compute[103546]:     <rng model="virtio">
Nov 16 03:55:16 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 03:55:16 user nova-compute[103546]:     </rng>
Nov 16 03:55:16 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 03:55:16 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 03:55:16 user nova-compute[103546]:       <stats period="10"/>
Nov 16 03:55:16 user nova-compute[103546]:     </memballoon>
Nov 16 03:55:16 user nova-compute[103546]:   </devices>
Nov 16 03:55:16 user nova-compute[103546]: </domain>
Nov 16 03:55:16 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:55:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2068912145',display_name='tempest-ServerRescueNegativeTestJSON-server-2068912145',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2068912145',id=27,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca049d5674dc4c59814f98478752d73d',ramdisk_id='',reservation_id='r-rkqsk0gl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1943614153',owner_user_name='tempest-ServerRescueNegativeTestJSON-1943614153-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:55:14Z,user_data=None,user_id='7626749c82fb4b5c81e696e4beeed858',uuid=246ccf69-847c-4ab2-b709-ad1a85e81eab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84add44b-0c93-4ebc-b45d-2f30d63d900f", "address": "fa:16:3e:13:18:5f", "network": {"id": "337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-40560053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca049d5674dc4c59814f98478752d73d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84add44b-0c", "ovs_interfaceid": "84add44b-0c93-4ebc-b45d-2f30d63d900f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Converting VIF {"id": "84add44b-0c93-4ebc-b45d-2f30d63d900f", "address": "fa:16:3e:13:18:5f", "network": {"id": "337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-40560053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca049d5674dc4c59814f98478752d73d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84add44b-0c", "ovs_interfaceid": "84add44b-0c93-4ebc-b45d-2f30d63d900f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:18:5f,bridge_name='br-int',has_traffic_filtering=True,id=84add44b-0c93-4ebc-b45d-2f30d63d900f,network=Network(337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84add44b-0c') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG os_vif [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:18:5f,bridge_name='br-int',has_traffic_filtering=True,id=84add44b-0c93-4ebc-b45d-2f30d63d900f,network=Network(337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84add44b-0c') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '866d756d-d37a-500d-bae6-7f573e6b308e', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84add44b-0c, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap84add44b-0c, col_values=(('qos', UUID('3a7bf80e-881a-47a5-bcab-4eb2b4d5fc40')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap84add44b-0c, col_values=(('external_ids', {'iface-id': '84add44b-0c93-4ebc-b45d-2f30d63d900f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:18:5f', 'vm-uuid': '246ccf69-847c-4ab2-b709-ad1a85e81eab'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:16 user nova-compute[103546]: INFO os_vif [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:18:5f,bridge_name='br-int',has_traffic_filtering=True,id=84add44b-0c93-4ebc-b45d-2f30d63d900f,network=Network(337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84add44b-0c')
Nov 16 03:55:16 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] No VIF found with MAC fa:16:3e:13:18:5f, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG nova.network.neutron [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Successfully updated port: 5c802613-81ea-4855-a8ee-d851a4ab2ff5 {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Acquiring lock "refresh_cache-8d229d05-95f1-4997-8539-802ac65cff8b" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Acquired lock "refresh_cache-8d229d05-95f1-4997-8539-802ac65cff8b" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG nova.network.neutron [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG nova.compute.manager [req-6f8beb53-638f-46e6-8290-6951cd89db89 req-f6e06994-8c91-4953-a57b-0a0e6acff582 service nova] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Received event network-changed-5c802613-81ea-4855-a8ee-d851a4ab2ff5 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG nova.compute.manager [req-6f8beb53-638f-46e6-8290-6951cd89db89 req-f6e06994-8c91-4953-a57b-0a0e6acff582 service nova] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Refreshing instance network info cache due to event network-changed-5c802613-81ea-4855-a8ee-d851a4ab2ff5. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6f8beb53-638f-46e6-8290-6951cd89db89 req-f6e06994-8c91-4953-a57b-0a0e6acff582 service nova] Acquiring lock "refresh_cache-8d229d05-95f1-4997-8539-802ac65cff8b" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG nova.network.neutron [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG nova.network.neutron [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Updating instance_info_cache with network_info: [{"id": "5c802613-81ea-4855-a8ee-d851a4ab2ff5", "address": "fa:16:3e:01:69:11", "network": {"id": "337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-40560053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca049d5674dc4c59814f98478752d73d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c802613-81", "ovs_interfaceid": "5c802613-81ea-4855-a8ee-d851a4ab2ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Releasing lock "refresh_cache-8d229d05-95f1-4997-8539-802ac65cff8b" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG nova.compute.manager [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Instance network_info: |[{"id": "5c802613-81ea-4855-a8ee-d851a4ab2ff5", "address": "fa:16:3e:01:69:11", "network": {"id": "337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-40560053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca049d5674dc4c59814f98478752d73d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c802613-81", "ovs_interfaceid": "5c802613-81ea-4855-a8ee-d851a4ab2ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6f8beb53-638f-46e6-8290-6951cd89db89 req-f6e06994-8c91-4953-a57b-0a0e6acff582 service nova] Acquired lock "refresh_cache-8d229d05-95f1-4997-8539-802ac65cff8b" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG nova.network.neutron [req-6f8beb53-638f-46e6-8290-6951cd89db89 req-f6e06994-8c91-4953-a57b-0a0e6acff582 service nova] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Refreshing network info cache for port 5c802613-81ea-4855-a8ee-d851a4ab2ff5 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Start _get_guest_xml network_info=[{"id": "5c802613-81ea-4855-a8ee-d851a4ab2ff5", "address": "fa:16:3e:01:69:11", "network": {"id": "337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-40560053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca049d5674dc4c59814f98478752d73d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c802613-81", "ovs_interfaceid": "5c802613-81ea-4855-a8ee-d851a4ab2ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '5c6f539a-01e5-4478-bf8f-a14310b5d7dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 03:55:16 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:55:16 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:55:16 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:55:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-293131064',display_name='tempest-ServerRescueNegativeTestJSON-server-293131064',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-293131064',id=28,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca049d5674dc4c59814f98478752d73d',ramdisk_id='',reservation_id='r-cqeuglk4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1943614153',owner_user_name='tempest-ServerRescueNegativeTestJSON-1943614153-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:55:15Z,user_data=None,user_id='7626749c82fb4b5c81e696e4beeed858',uuid=8d229d05-95f1-4997-8539-802ac65cff8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c802613-81ea-4855-a8ee-d851a4ab2ff5", "address": "fa:16:3e:01:69:11", "network": {"id": "337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-40560053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca049d5674dc4c59814f98478752d73d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c802613-81", "ovs_interfaceid": "5c802613-81ea-4855-a8ee-d851a4ab2ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Converting VIF {"id": "5c802613-81ea-4855-a8ee-d851a4ab2ff5", "address": "fa:16:3e:01:69:11", "network": {"id": "337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-40560053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca049d5674dc4c59814f98478752d73d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c802613-81", "ovs_interfaceid": "5c802613-81ea-4855-a8ee-d851a4ab2ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:69:11,bridge_name='br-int',has_traffic_filtering=True,id=5c802613-81ea-4855-a8ee-d851a4ab2ff5,network=Network(337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c802613-81') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG nova.objects.instance [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lazy-loading 'pci_devices' on Instance uuid 8d229d05-95f1-4997-8539-802ac65cff8b {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] End _get_guest_xml xml=<domain type="kvm">
Nov 16 03:55:16 user nova-compute[103546]:   <uuid>8d229d05-95f1-4997-8539-802ac65cff8b</uuid>
Nov 16 03:55:16 user nova-compute[103546]:   <name>instance-0000001c</name>
Nov 16 03:55:16 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 03:55:16 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 03:55:16 user nova-compute[103546]:   <metadata>
Nov 16 03:55:16 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 03:55:16 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 03:55:16 user nova-compute[103546]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-293131064</nova:name>
Nov 16 03:55:16 user nova-compute[103546]:       <nova:creationTime>2023-11-16 03:55:16</nova:creationTime>
Nov 16 03:55:16 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 03:55:16 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 03:55:16 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 03:55:16 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 03:55:16 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 03:55:16 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 03:55:16 user nova-compute[103546]:       </nova:flavor>
Nov 16 03:55:16 user nova-compute[103546]:       <nova:owner>
Nov 16 03:55:16 user nova-compute[103546]:         <nova:user uuid="7626749c82fb4b5c81e696e4beeed858">tempest-ServerRescueNegativeTestJSON-1943614153-project-member</nova:user>
Nov 16 03:55:16 user nova-compute[103546]:         <nova:project uuid="ca049d5674dc4c59814f98478752d73d">tempest-ServerRescueNegativeTestJSON-1943614153</nova:project>
Nov 16 03:55:16 user nova-compute[103546]:       </nova:owner>
Nov 16 03:55:16 user nova-compute[103546]:       <nova:root type="image" uuid="5c6f539a-01e5-4478-bf8f-a14310b5d7dd"/>
Nov 16 03:55:16 user nova-compute[103546]:       <nova:ports>
Nov 16 03:55:16 user nova-compute[103546]:         <nova:port uuid="5c802613-81ea-4855-a8ee-d851a4ab2ff5">
Nov 16 03:55:16 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 16 03:55:16 user nova-compute[103546]:         </nova:port>
Nov 16 03:55:16 user nova-compute[103546]:       </nova:ports>
Nov 16 03:55:16 user nova-compute[103546]:     </nova:instance>
Nov 16 03:55:16 user nova-compute[103546]:   </metadata>
Nov 16 03:55:16 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 03:55:16 user nova-compute[103546]:     <system>
Nov 16 03:55:16 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 03:55:16 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 03:55:16 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 03:55:16 user nova-compute[103546]:       <entry name="serial">8d229d05-95f1-4997-8539-802ac65cff8b</entry>
Nov 16 03:55:16 user nova-compute[103546]:       <entry name="uuid">8d229d05-95f1-4997-8539-802ac65cff8b</entry>
Nov 16 03:55:16 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 03:55:16 user nova-compute[103546]:     </system>
Nov 16 03:55:16 user nova-compute[103546]:   </sysinfo>
Nov 16 03:55:16 user nova-compute[103546]:   <os>
Nov 16 03:55:16 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 03:55:16 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 03:55:16 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 03:55:16 user nova-compute[103546]:   </os>
Nov 16 03:55:16 user nova-compute[103546]:   <features>
Nov 16 03:55:16 user nova-compute[103546]:     <acpi/>
Nov 16 03:55:16 user nova-compute[103546]:     <apic/>
Nov 16 03:55:16 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 03:55:16 user nova-compute[103546]:   </features>
Nov 16 03:55:16 user nova-compute[103546]:   <clock offset="utc">
Nov 16 03:55:16 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 03:55:16 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 03:55:16 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 03:55:16 user nova-compute[103546]:   </clock>
Nov 16 03:55:16 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 03:55:16 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 03:55:16 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 03:55:16 user nova-compute[103546]:   </cpu>
Nov 16 03:55:16 user nova-compute[103546]:   <devices>
Nov 16 03:55:16 user nova-compute[103546]:     <disk type="file" device="disk">
Nov 16 03:55:16 user nova-compute[103546]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 03:55:16 user nova-compute[103546]:       <source file="/opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk"/>
Nov 16 03:55:16 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 03:55:16 user nova-compute[103546]:     </disk>
Nov 16 03:55:16 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 03:55:16 user nova-compute[103546]:       <mac address="fa:16:3e:01:69:11"/>
Nov 16 03:55:16 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:55:16 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 03:55:16 user nova-compute[103546]:       <target dev="tap5c802613-81"/>
Nov 16 03:55:16 user nova-compute[103546]:     </interface>
Nov 16 03:55:16 user nova-compute[103546]:     <serial type="pty">
Nov 16 03:55:16 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/console.log" append="off"/>
Nov 16 03:55:16 user nova-compute[103546]:     </serial>
Nov 16 03:55:16 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 03:55:16 user nova-compute[103546]:     <video>
Nov 16 03:55:16 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:55:16 user nova-compute[103546]:     </video>
Nov 16 03:55:16 user nova-compute[103546]:     <rng model="virtio">
Nov 16 03:55:16 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 03:55:16 user nova-compute[103546]:     </rng>
Nov 16 03:55:16 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 03:55:16 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 03:55:16 user nova-compute[103546]:       <stats period="10"/>
Nov 16 03:55:16 user nova-compute[103546]:     </memballoon>
Nov 16 03:55:16 user nova-compute[103546]:   </devices>
Nov 16 03:55:16 user nova-compute[103546]: </domain>
Nov 16 03:55:16 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:55:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-293131064',display_name='tempest-ServerRescueNegativeTestJSON-server-293131064',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-293131064',id=28,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca049d5674dc4c59814f98478752d73d',ramdisk_id='',reservation_id='r-cqeuglk4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1943614153',owner_user_name='tempest-ServerRescueNegativeTestJSON-1943614153-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:55:15Z,user_data=None,user_id='7626749c82fb4b5c81e696e4beeed858',uuid=8d229d05-95f1-4997-8539-802ac65cff8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c802613-81ea-4855-a8ee-d851a4ab2ff5", "address": "fa:16:3e:01:69:11", "network": {"id": "337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-40560053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca049d5674dc4c59814f98478752d73d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c802613-81", "ovs_interfaceid": "5c802613-81ea-4855-a8ee-d851a4ab2ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Converting VIF {"id": "5c802613-81ea-4855-a8ee-d851a4ab2ff5", "address": "fa:16:3e:01:69:11", "network": {"id": "337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-40560053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca049d5674dc4c59814f98478752d73d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c802613-81", "ovs_interfaceid": "5c802613-81ea-4855-a8ee-d851a4ab2ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:69:11,bridge_name='br-int',has_traffic_filtering=True,id=5c802613-81ea-4855-a8ee-d851a4ab2ff5,network=Network(337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c802613-81') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG os_vif [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:69:11,bridge_name='br-int',has_traffic_filtering=True,id=5c802613-81ea-4855-a8ee-d851a4ab2ff5,network=Network(337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c802613-81') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a37016f5-7ad7-51e2-a83a-3e39624065d0', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5c802613-81, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5c802613-81, col_values=(('qos', UUID('e4b5c03e-ce6f-4fdc-969c-0a60976b96b1')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5c802613-81, col_values=(('external_ids', {'iface-id': '5c802613-81ea-4855-a8ee-d851a4ab2ff5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:69:11', 'vm-uuid': '8d229d05-95f1-4997-8539-802ac65cff8b'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:55:19 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:19 user nova-compute[103546]: DEBUG nova.compute.manager [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 03:55:19 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Guest created on hypervisor {{(pid=103546) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 03:55:19 user nova-compute[103546]: DEBUG nova.compute.manager [req-6947ef67-37c4-40c7-a33a-2fb95233b9ec req-bb9b595d-4ccc-4844-8870-ad0e81ff950f service nova] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Received event network-vif-plugged-84add44b-0c93-4ebc-b45d-2f30d63d900f {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:55:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6947ef67-37c4-40c7-a33a-2fb95233b9ec req-bb9b595d-4ccc-4844-8870-ad0e81ff950f service nova] Acquiring lock "246ccf69-847c-4ab2-b709-ad1a85e81eab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:55:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6947ef67-37c4-40c7-a33a-2fb95233b9ec req-bb9b595d-4ccc-4844-8870-ad0e81ff950f service nova] Lock "246ccf69-847c-4ab2-b709-ad1a85e81eab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:55:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6947ef67-37c4-40c7-a33a-2fb95233b9ec req-bb9b595d-4ccc-4844-8870-ad0e81ff950f service nova] Lock "246ccf69-847c-4ab2-b709-ad1a85e81eab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:55:19 user nova-compute[103546]: DEBUG nova.compute.manager [req-6947ef67-37c4-40c7-a33a-2fb95233b9ec req-bb9b595d-4ccc-4844-8870-ad0e81ff950f service nova] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] No waiting events found dispatching network-vif-plugged-84add44b-0c93-4ebc-b45d-2f30d63d900f {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:55:19 user nova-compute[103546]: WARNING nova.compute.manager [req-6947ef67-37c4-40c7-a33a-2fb95233b9ec req-bb9b595d-4ccc-4844-8870-ad0e81ff950f service nova] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Received unexpected event network-vif-plugged-84add44b-0c93-4ebc-b45d-2f30d63d900f for instance with vm_state building and task_state spawning.
Nov 16 03:55:19 user nova-compute[103546]: DEBUG nova.compute.manager [req-a0e85dec-89db-48fb-b5f5-2e5fc060d17c req-68edbbf8-3bab-4772-b766-7679e53012ef service nova] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Received event network-vif-plugged-84add44b-0c93-4ebc-b45d-2f30d63d900f {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:55:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a0e85dec-89db-48fb-b5f5-2e5fc060d17c req-68edbbf8-3bab-4772-b766-7679e53012ef service nova] Acquiring lock "246ccf69-847c-4ab2-b709-ad1a85e81eab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:55:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a0e85dec-89db-48fb-b5f5-2e5fc060d17c req-68edbbf8-3bab-4772-b766-7679e53012ef service nova] Lock "246ccf69-847c-4ab2-b709-ad1a85e81eab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:55:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a0e85dec-89db-48fb-b5f5-2e5fc060d17c req-68edbbf8-3bab-4772-b766-7679e53012ef service nova] Lock "246ccf69-847c-4ab2-b709-ad1a85e81eab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:55:19 user nova-compute[103546]: DEBUG nova.compute.manager [req-a0e85dec-89db-48fb-b5f5-2e5fc060d17c req-68edbbf8-3bab-4772-b766-7679e53012ef service nova] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] No waiting events found dispatching network-vif-plugged-84add44b-0c93-4ebc-b45d-2f30d63d900f {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:55:19 user nova-compute[103546]: WARNING nova.compute.manager [req-a0e85dec-89db-48fb-b5f5-2e5fc060d17c req-68edbbf8-3bab-4772-b766-7679e53012ef service nova] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Received unexpected event network-vif-plugged-84add44b-0c93-4ebc-b45d-2f30d63d900f for instance with vm_state building and task_state spawning.
Nov 16 03:55:19 user nova-compute[103546]: INFO os_vif [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:69:11,bridge_name='br-int',has_traffic_filtering=True,id=5c802613-81ea-4855-a8ee-d851a4ab2ff5,network=Network(337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c802613-81')
Nov 16 03:55:19 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:55:19 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:55:19 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Hypervisor/Node resource view: name=user free_ram=7379MB free_disk=25.358020782470703GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=103546) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 03:55:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:55:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:55:19 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Instance spawned successfully.
Nov 16 03:55:19 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 03:55:19 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Found default for hw_cdrom_bus of ide {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:55:19 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Found default for hw_disk_bus of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:55:19 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Found default for hw_input_bus of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:55:19 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Found default for hw_pointer_model of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:55:19 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Found default for hw_video_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:55:19 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Found default for hw_vif_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:55:19 user nova-compute[103546]: INFO nova.compute.manager [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Took 6.26 seconds to spawn the instance on the hypervisor.
Nov 16 03:55:19 user nova-compute[103546]: DEBUG nova.compute.manager [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 03:55:19 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:55:19 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] No VIF found with MAC fa:16:3e:01:69:11, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 03:55:19 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 9a89970b-fc61-4419-8ff9-b48013dccf9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:55:19 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 04101512-7333-4581-add3-7af3821e335b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:55:19 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 164533fb-64e1-4aa5-b5fb-273817dd3e74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:55:19 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 4edd4240-a8e3-4f7d-ad89-795d294b72df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:55:19 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:55:19 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:55:19 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance fa7e5468-9dd4-407d-85ec-d45ec76f9e29 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:55:19 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance f4065a1b-10a0-4b2a-9088-a703a7c4e064 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:55:19 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:55:19 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 9c86c600-6277-4746-934d-c63e95616219 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:55:19 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 246ccf69-847c-4ab2-b709-ad1a85e81eab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:55:19 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 8d229d05-95f1-4997-8539-802ac65cff8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:55:19 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 03:55:19 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 03:55:20 user nova-compute[103546]: INFO nova.compute.manager [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Took 7.09 seconds to build instance.
Nov 16 03:55:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d5f3304b-ec2e-4fc4-a7fe-4951633a3329 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "246ccf69-847c-4ab2-b709-ad1a85e81eab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.181s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:55:20 user nova-compute[103546]: DEBUG nova.network.neutron [req-6f8beb53-638f-46e6-8290-6951cd89db89 req-f6e06994-8c91-4953-a57b-0a0e6acff582 service nova] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Updated VIF entry in instance network info cache for port 5c802613-81ea-4855-a8ee-d851a4ab2ff5. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 03:55:20 user nova-compute[103546]: DEBUG nova.network.neutron [req-6f8beb53-638f-46e6-8290-6951cd89db89 req-f6e06994-8c91-4953-a57b-0a0e6acff582 service nova] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Updating instance_info_cache with network_info: [{"id": "5c802613-81ea-4855-a8ee-d851a4ab2ff5", "address": "fa:16:3e:01:69:11", "network": {"id": "337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-40560053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca049d5674dc4c59814f98478752d73d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c802613-81", "ovs_interfaceid": "5c802613-81ea-4855-a8ee-d851a4ab2ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:55:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6f8beb53-638f-46e6-8290-6951cd89db89 req-f6e06994-8c91-4953-a57b-0a0e6acff582 service nova] Releasing lock "refresh_cache-8d229d05-95f1-4997-8539-802ac65cff8b" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:55:20 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:55:20 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:55:20 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Compute_service record updated for user:user {{(pid=103546) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 03:55:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.561s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:55:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:21 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:55:21 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:55:21 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Starting heal instance info cache {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 03:55:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "refresh_cache-04101512-7333-4581-add3-7af3821e335b" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:55:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquired lock "refresh_cache-04101512-7333-4581-add3-7af3821e335b" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:55:21 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 04101512-7333-4581-add3-7af3821e335b] Forcefully refreshing network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 03:55:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:21 user nova-compute[103546]: DEBUG nova.compute.manager [req-f559d2a1-6e08-487f-8be9-c134c38f824d req-5a6e4176-e0be-4ab7-89a3-74fcbc06ec4e service nova] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Received event network-vif-plugged-5c802613-81ea-4855-a8ee-d851a4ab2ff5 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:55:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-f559d2a1-6e08-487f-8be9-c134c38f824d req-5a6e4176-e0be-4ab7-89a3-74fcbc06ec4e service nova] Acquiring lock "8d229d05-95f1-4997-8539-802ac65cff8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:55:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-f559d2a1-6e08-487f-8be9-c134c38f824d req-5a6e4176-e0be-4ab7-89a3-74fcbc06ec4e service nova] Lock "8d229d05-95f1-4997-8539-802ac65cff8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:55:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-f559d2a1-6e08-487f-8be9-c134c38f824d req-5a6e4176-e0be-4ab7-89a3-74fcbc06ec4e service nova] Lock "8d229d05-95f1-4997-8539-802ac65cff8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:55:21 user nova-compute[103546]: DEBUG nova.compute.manager [req-f559d2a1-6e08-487f-8be9-c134c38f824d req-5a6e4176-e0be-4ab7-89a3-74fcbc06ec4e service nova] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] No waiting events found dispatching network-vif-plugged-5c802613-81ea-4855-a8ee-d851a4ab2ff5 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:55:21 user nova-compute[103546]: WARNING nova.compute.manager [req-f559d2a1-6e08-487f-8be9-c134c38f824d req-5a6e4176-e0be-4ab7-89a3-74fcbc06ec4e service nova] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Received unexpected event network-vif-plugged-5c802613-81ea-4855-a8ee-d851a4ab2ff5 for instance with vm_state building and task_state spawning.
Nov 16 03:55:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:21 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 04101512-7333-4581-add3-7af3821e335b] Updating instance_info_cache with network_info: [{"id": "20bc48cc-9db0-49c8-8dd5-246c685c6884", "address": "fa:16:3e:a5:d9:dc", "network": {"id": "fdbb2d2c-9a54-4517-b33a-cf27ce7570b1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79661471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2a38a5eb514ce8a7569c8322657eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20bc48cc-9d", "ovs_interfaceid": "20bc48cc-9db0-49c8-8dd5-246c685c6884", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:55:22 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Releasing lock "refresh_cache-04101512-7333-4581-add3-7af3821e335b" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:55:22 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 04101512-7333-4581-add3-7af3821e335b] Updated the network info_cache for instance {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 03:55:22 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:55:22 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:55:22 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:55:22 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:55:22 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:55:22 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=103546) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 03:55:22 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-f24615d8-8892-4ea1-af24-0f1570ba936c tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 164533fb-64e1-4aa5-b5fb-273817dd3e74 is timed out.
Nov 16 03:55:22 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-f24615d8-8892-4ea1-af24-0f1570ba936c tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Successfully detached device vdc from instance 164533fb-64e1-4aa5-b5fb-273817dd3e74 from the live domain config.
Nov 16 03:55:22 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f24615d8-8892-4ea1-af24-0f1570ba936c tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 03:55:22 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f24615d8-8892-4ea1-af24-0f1570ba936c tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:17547dd1-37b4-49b3-8741-5f77cfc8fd15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PxTOsgch', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:55:22 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-f24615d8-8892-4ea1-af24-0f1570ba936c tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:55:22 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-f24615d8-8892-4ea1-af24-0f1570ba936c tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:55:22 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-f24615d8-8892-4ea1-af24-0f1570ba936c tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:55:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:55:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:55:22 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb666ec2-bbd2-4e55-976d-90530ef08ad8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:17547dd1-37b4-49b3-8741-5f77cfc8fd15\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:55:22 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f24615d8-8892-4ea1-af24-0f1570ba936c tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 03:55:22 user nova-compute[103546]: No targets found.
Nov 16 03:55:22 user nova-compute[103546]: iSNS:
Nov 16 03:55:22 user nova-compute[103546]: No targets found.
Nov 16 03:55:22 user nova-compute[103546]: STATIC:
Nov 16 03:55:22 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55
Nov 16 03:55:22 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:55:22 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:55:22 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4
Nov 16 03:55:22 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:55:22 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:55:22 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc
Nov 16 03:55:22 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:55:22 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:55:22 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925
Nov 16 03:55:22 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:55:22 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:55:22 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:17547dd1-37b4-49b3-8741-5f77cfc8fd15
Nov 16 03:55:22 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:55:22 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:55:22 user nova-compute[103546]: FIRMWARE:
Nov 16 03:55:22 user nova-compute[103546]: No targets found.
Nov 16 03:55:22 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:55:22 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f24615d8-8892-4ea1-af24-0f1570ba936c tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 03:55:22 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 03:55:22 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 03:55:22 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f24615d8-8892-4ea1-af24-0f1570ba936c tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17547dd1-37b4-49b3-8741-5f77cfc8fd15', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 03:55:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:55:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:55:22 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[622bd74d-fa9b-4a4a-8139-3115fe415c61]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17547dd1-37b4-49b3-8741-5f77cfc8fd15\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:55:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:55:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:55:22 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9adf116-9d43-4dc1-a5f5-d66eb4e3816f]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17547dd1-37b4-49b3-8741-5f77cfc8fd15 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:55:22 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f24615d8-8892-4ea1-af24-0f1570ba936c tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:55:22 user nova-compute[103546]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc (non-flash)
Nov 16 03:55:22 user nova-compute[103546]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)
Nov 16 03:55:22 user nova-compute[103546]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55 (non-flash)
Nov 16 03:55:22 user nova-compute[103546]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17547dd1-37b4-49b3-8741-5f77cfc8fd15 (non-flash)
Nov 16 03:55:22 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:55:22 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f24615d8-8892-4ea1-af24-0f1570ba936c tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:55:22 user nova-compute[103546]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc (non-flash)
Nov 16 03:55:22 user nova-compute[103546]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)
Nov 16 03:55:22 user nova-compute[103546]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55 (non-flash)
Nov 16 03:55:22 user nova-compute[103546]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17547dd1-37b4-49b3-8741-5f77cfc8fd15 (non-flash)
Nov 16 03:55:22 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:55:22 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f24615d8-8892-4ea1-af24-0f1570ba936c tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60cc38fd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17547dd1-37b4-49b3-8741-5f77cfc8fd15'): ({'sdf'}, set())}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 03:55:22 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-f24615d8-8892-4ea1-af24-0f1570ba936c tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Removing single pathed devices sdf {{(pid=103546) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 03:55:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:55:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:55:22 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[269e418b-28db-4f24-8313-bf03a6930c5a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:55:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:55:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:55:22 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d83fba-47b6-4b17-af2b-6527b78c7803]: (4, ('ok\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:55:22 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-f24615d8-8892-4ea1-af24-0f1570ba936c tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Flushing IO for device /dev/sdf {{(pid=103546) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 03:55:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:55:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:55:22 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a26e892-259f-47ed-9629-789e98ee71f1]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:55:22 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-f24615d8-8892-4ea1-af24-0f1570ba936c tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=103546) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 03:55:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:55:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:55:22 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[db042d64-8cd2-4025-b221-827f9fc7d3d0]: (4, ('1', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:55:22 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-f24615d8-8892-4ea1-af24-0f1570ba936c tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 03:55:22 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-f24615d8-8892-4ea1-af24-0f1570ba936c tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] SCSI volumes sdf have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 03:55:22 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f24615d8-8892-4ea1-af24-0f1570ba936c tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17547dd1-37b4-49b3-8741-5f77cfc8fd15')] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 03:55:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17547dd1-37b4-49b3-8741-5f77cfc8fd15 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:55:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17547dd1-37b4-49b3-8741-5f77cfc8fd15 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:55:22 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[646da96e-ea5b-46b4-a746-1902e1ff861e]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:55:22 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f24615d8-8892-4ea1-af24-0f1570ba936c tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:55:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17547dd1-37b4-49b3-8741-5f77cfc8fd15 -p 172.16.0.220:3260 --logout {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:55:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17547dd1-37b4-49b3-8741-5f77cfc8fd15 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:55:22 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[13703414-5909-49db-854f-efb2213a966b]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:17547dd1-37b4-49b3-8741-5f77cfc8fd15, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:17547dd1-37b4-49b3-8741-5f77cfc8fd15, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:55:22 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f24615d8-8892-4ea1-af24-0f1570ba936c tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:17547dd1-37b4-49b3-8741-5f77cfc8fd15, portal: 172.16.0.220,3260]
Nov 16 03:55:22 user nova-compute[103546]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:17547dd1-37b4-49b3-8741-5f77cfc8fd15, portal: 172.16.0.220,3260] successful.
Nov 16 03:55:22 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:55:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17547dd1-37b4-49b3-8741-5f77cfc8fd15 -p 172.16.0.220:3260 --op delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:55:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17547dd1-37b4-49b3-8741-5f77cfc8fd15 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:55:22 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1f4670-7fb2-4387-96d6-ca4d1f3eb3d8]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:55:22 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f24615d8-8892-4ea1-af24-0f1570ba936c tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:55:22 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-f24615d8-8892-4ea1-af24-0f1570ba936c tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:55:22 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f24615d8-8892-4ea1-af24-0f1570ba936c tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] <== disconnect_volume: return (349ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:55:22 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f24615d8-8892-4ea1-af24-0f1570ba936c tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 03:55:23 user nova-compute[103546]: DEBUG nova.objects.instance [None req-f24615d8-8892-4ea1-af24-0f1570ba936c tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Lazy-loading 'flavor' on Instance uuid 164533fb-64e1-4aa5-b5fb-273817dd3e74 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:55:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f24615d8-8892-4ea1-af24-0f1570ba936c tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Lock "164533fb-64e1-4aa5-b5fb-273817dd3e74" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.677s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:55:23 user nova-compute[103546]: DEBUG nova.compute.manager [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 03:55:23 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Guest created on hypervisor {{(pid=103546) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 03:55:23 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Instance spawned successfully.
Nov 16 03:55:23 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 03:55:23 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:23 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Found default for hw_cdrom_bus of ide {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:55:23 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Found default for hw_disk_bus of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:55:23 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Found default for hw_input_bus of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:55:23 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Found default for hw_pointer_model of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:55:23 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Found default for hw_video_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:55:23 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Found default for hw_vif_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:55:23 user nova-compute[103546]: INFO nova.compute.manager [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Took 8.34 seconds to spawn the instance on the hypervisor.
Nov 16 03:55:23 user nova-compute[103546]: DEBUG nova.compute.manager [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 03:55:23 user nova-compute[103546]: INFO nova.compute.manager [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Took 9.53 seconds to build instance.
Nov 16 03:55:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a397e7ce-30c7-4327-8e17-f1b0a6e30376 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "8d229d05-95f1-4997-8539-802ac65cff8b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.698s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:55:23 user nova-compute[103546]: DEBUG nova.compute.manager [req-4ac036d3-9d19-4c5c-bcc7-6577668f4d3f req-69298b8f-e06b-4d13-b3f8-62f6b921df17 service nova] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Received event network-vif-plugged-5c802613-81ea-4855-a8ee-d851a4ab2ff5 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:55:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-4ac036d3-9d19-4c5c-bcc7-6577668f4d3f req-69298b8f-e06b-4d13-b3f8-62f6b921df17 service nova] Acquiring lock "8d229d05-95f1-4997-8539-802ac65cff8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:55:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-4ac036d3-9d19-4c5c-bcc7-6577668f4d3f req-69298b8f-e06b-4d13-b3f8-62f6b921df17 service nova] Lock "8d229d05-95f1-4997-8539-802ac65cff8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:55:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-4ac036d3-9d19-4c5c-bcc7-6577668f4d3f req-69298b8f-e06b-4d13-b3f8-62f6b921df17 service nova] Lock "8d229d05-95f1-4997-8539-802ac65cff8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:55:23 user nova-compute[103546]: DEBUG nova.compute.manager [req-4ac036d3-9d19-4c5c-bcc7-6577668f4d3f req-69298b8f-e06b-4d13-b3f8-62f6b921df17 service nova] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] No waiting events found dispatching network-vif-plugged-5c802613-81ea-4855-a8ee-d851a4ab2ff5 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:55:23 user nova-compute[103546]: WARNING nova.compute.manager [req-4ac036d3-9d19-4c5c-bcc7-6577668f4d3f req-69298b8f-e06b-4d13-b3f8-62f6b921df17 service nova] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Received unexpected event network-vif-plugged-5c802613-81ea-4855-a8ee-d851a4ab2ff5 for instance with vm_state active and task_state None.
Nov 16 03:55:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b9ddd079-3ddc-4623-a213-780601ba6881 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Acquiring lock "4edd4240-a8e3-4f7d-ad89-795d294b72df" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:55:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b9ddd079-3ddc-4623-a213-780601ba6881 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Lock "4edd4240-a8e3-4f7d-ad89-795d294b72df" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:55:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b9ddd079-3ddc-4623-a213-780601ba6881 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Acquiring lock "4edd4240-a8e3-4f7d-ad89-795d294b72df-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:55:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b9ddd079-3ddc-4623-a213-780601ba6881 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Lock "4edd4240-a8e3-4f7d-ad89-795d294b72df-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:55:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b9ddd079-3ddc-4623-a213-780601ba6881 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Lock "4edd4240-a8e3-4f7d-ad89-795d294b72df-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:55:25 user nova-compute[103546]: INFO nova.compute.manager [None req-b9ddd079-3ddc-4623-a213-780601ba6881 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] Terminating instance
Nov 16 03:55:25 user nova-compute[103546]: DEBUG nova.compute.manager [None req-b9ddd079-3ddc-4623-a213-780601ba6881 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] Start destroying the instance on the hypervisor. {{(pid=103546) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 03:55:25 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:25 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:25 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:25 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:25 user nova-compute[103546]: DEBUG nova.compute.manager [req-85fb4cef-3585-460e-ba59-10aae11f41ef req-f188f26c-175b-4acb-8700-36dcd1b6f3e6 service nova] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] Received event network-vif-unplugged-c7a5f1de-8036-4fb3-aaf0-78dce691474a {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:55:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-85fb4cef-3585-460e-ba59-10aae11f41ef req-f188f26c-175b-4acb-8700-36dcd1b6f3e6 service nova] Acquiring lock "4edd4240-a8e3-4f7d-ad89-795d294b72df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:55:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-85fb4cef-3585-460e-ba59-10aae11f41ef req-f188f26c-175b-4acb-8700-36dcd1b6f3e6 service nova] Lock "4edd4240-a8e3-4f7d-ad89-795d294b72df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:55:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-85fb4cef-3585-460e-ba59-10aae11f41ef req-f188f26c-175b-4acb-8700-36dcd1b6f3e6 service nova] Lock "4edd4240-a8e3-4f7d-ad89-795d294b72df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:55:25 user nova-compute[103546]: DEBUG nova.compute.manager [req-85fb4cef-3585-460e-ba59-10aae11f41ef req-f188f26c-175b-4acb-8700-36dcd1b6f3e6 service nova] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] No waiting events found dispatching network-vif-unplugged-c7a5f1de-8036-4fb3-aaf0-78dce691474a {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:55:25 user nova-compute[103546]: DEBUG nova.compute.manager [req-85fb4cef-3585-460e-ba59-10aae11f41ef req-f188f26c-175b-4acb-8700-36dcd1b6f3e6 service nova] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] Received event network-vif-unplugged-c7a5f1de-8036-4fb3-aaf0-78dce691474a for instance with task_state deleting. {{(pid=103546) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 03:55:26 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] Instance destroyed successfully.
Nov 16 03:55:26 user nova-compute[103546]: DEBUG nova.objects.instance [None req-b9ddd079-3ddc-4623-a213-780601ba6881 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Lazy-loading 'resources' on Instance uuid 4edd4240-a8e3-4f7d-ad89-795d294b72df {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:55:26 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-b9ddd079-3ddc-4623-a213-780601ba6881 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-915501901',display_name='tempest-VolumesActionsTest-instance-915501901',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-915501901',id=20,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:53:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8db9ce0a02204d269a3beac9459f5c8a',ramdisk_id='',reservation_id='r-q1kaocuy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1514502681',owner_user_name='tempest-VolumesActionsTest-1514502681-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T03:53:41Z,user_data=None,user_id='29f86d0d50ff44e79cf3c37416a5b632',uuid=4edd4240-a8e3-4f7d-ad89-795d294b72df,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c7a5f1de-8036-4fb3-aaf0-78dce691474a", "address": "fa:16:3e:28:80:5b", "network": {"id": "f27a9ae1-0635-4b3b-858d-fa6524d15c2d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-73312216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8db9ce0a02204d269a3beac9459f5c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7a5f1de-80", "ovs_interfaceid": "c7a5f1de-8036-4fb3-aaf0-78dce691474a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 03:55:26 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-b9ddd079-3ddc-4623-a213-780601ba6881 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Converting VIF {"id": "c7a5f1de-8036-4fb3-aaf0-78dce691474a", "address": "fa:16:3e:28:80:5b", "network": {"id": "f27a9ae1-0635-4b3b-858d-fa6524d15c2d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-73312216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8db9ce0a02204d269a3beac9459f5c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7a5f1de-80", "ovs_interfaceid": "c7a5f1de-8036-4fb3-aaf0-78dce691474a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:55:26 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-b9ddd079-3ddc-4623-a213-780601ba6881 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:80:5b,bridge_name='br-int',has_traffic_filtering=True,id=c7a5f1de-8036-4fb3-aaf0-78dce691474a,network=Network(f27a9ae1-0635-4b3b-858d-fa6524d15c2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7a5f1de-80') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:55:26 user nova-compute[103546]: DEBUG os_vif [None req-b9ddd079-3ddc-4623-a213-780601ba6881 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:80:5b,bridge_name='br-int',has_traffic_filtering=True,id=c7a5f1de-8036-4fb3-aaf0-78dce691474a,network=Network(f27a9ae1-0635-4b3b-858d-fa6524d15c2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7a5f1de-80') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 03:55:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc7a5f1de-80, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:55:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=07af4d4a-a77f-4c31-af2c-5a14465b0cbc) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:55:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:26 user nova-compute[103546]: INFO os_vif [None req-b9ddd079-3ddc-4623-a213-780601ba6881 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:80:5b,bridge_name='br-int',has_traffic_filtering=True,id=c7a5f1de-8036-4fb3-aaf0-78dce691474a,network=Network(f27a9ae1-0635-4b3b-858d-fa6524d15c2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7a5f1de-80')
Nov 16 03:55:26 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-b9ddd079-3ddc-4623-a213-780601ba6881 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] Deleting instance files /opt/stack/data/nova/instances/4edd4240-a8e3-4f7d-ad89-795d294b72df_del
Nov 16 03:55:26 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-b9ddd079-3ddc-4623-a213-780601ba6881 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] Deletion of /opt/stack/data/nova/instances/4edd4240-a8e3-4f7d-ad89-795d294b72df_del complete
Nov 16 03:55:26 user nova-compute[103546]: INFO nova.compute.manager [None req-b9ddd079-3ddc-4623-a213-780601ba6881 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 16 03:55:26 user nova-compute[103546]: DEBUG oslo.service.loopingcall [None req-b9ddd079-3ddc-4623-a213-780601ba6881 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=103546) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 03:55:26 user nova-compute[103546]: DEBUG nova.compute.manager [-] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] Deallocating network for instance {{(pid=103546) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 03:55:26 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] deallocate_for_instance() {{(pid=103546) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 03:55:26 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:55:26 user nova-compute[103546]: INFO nova.compute.manager [-] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] Took 0.45 seconds to deallocate network for instance.
Nov 16 03:55:26 user nova-compute[103546]: DEBUG nova.compute.manager [req-604e68e2-7797-4cef-ade0-c22c7c56c88f req-e57272e9-e1c4-46b4-acf2-cad2c21fd84f service nova] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] Received event network-vif-deleted-c7a5f1de-8036-4fb3-aaf0-78dce691474a {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:55:26 user nova-compute[103546]: INFO nova.compute.manager [req-604e68e2-7797-4cef-ade0-c22c7c56c88f req-e57272e9-e1c4-46b4-acf2-cad2c21fd84f service nova] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] Neutron deleted interface c7a5f1de-8036-4fb3-aaf0-78dce691474a; detaching it from the instance and deleting it from the info cache
Nov 16 03:55:26 user nova-compute[103546]: DEBUG nova.network.neutron [req-604e68e2-7797-4cef-ade0-c22c7c56c88f req-e57272e9-e1c4-46b4-acf2-cad2c21fd84f service nova] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:55:26 user nova-compute[103546]: DEBUG nova.compute.manager [req-604e68e2-7797-4cef-ade0-c22c7c56c88f req-e57272e9-e1c4-46b4-acf2-cad2c21fd84f service nova] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] Detach interface failed, port_id=c7a5f1de-8036-4fb3-aaf0-78dce691474a, reason: Instance 4edd4240-a8e3-4f7d-ad89-795d294b72df could not be found. {{(pid=103546) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 03:55:26 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b9ddd079-3ddc-4623-a213-780601ba6881 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:55:26 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b9ddd079-3ddc-4623-a213-780601ba6881 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:55:27 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-b9ddd079-3ddc-4623-a213-780601ba6881 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:55:27 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-b9ddd079-3ddc-4623-a213-780601ba6881 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:55:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b9ddd079-3ddc-4623-a213-780601ba6881 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.348s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:55:27 user nova-compute[103546]: INFO nova.scheduler.client.report [None req-b9ddd079-3ddc-4623-a213-780601ba6881 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Deleted allocations for instance 4edd4240-a8e3-4f7d-ad89-795d294b72df
Nov 16 03:55:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b9ddd079-3ddc-4623-a213-780601ba6881 tempest-VolumesActionsTest-1514502681 tempest-VolumesActionsTest-1514502681-project-member] Lock "4edd4240-a8e3-4f7d-ad89-795d294b72df" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.891s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:55:27 user nova-compute[103546]: DEBUG nova.compute.manager [req-4f8e23a5-3c3c-4ac6-81b6-1214dbb5de8f req-8f1516cc-c9cf-4951-a559-a658daa50980 service nova] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] Received event network-vif-plugged-c7a5f1de-8036-4fb3-aaf0-78dce691474a {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:55:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-4f8e23a5-3c3c-4ac6-81b6-1214dbb5de8f req-8f1516cc-c9cf-4951-a559-a658daa50980 service nova] Acquiring lock "4edd4240-a8e3-4f7d-ad89-795d294b72df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:55:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-4f8e23a5-3c3c-4ac6-81b6-1214dbb5de8f req-8f1516cc-c9cf-4951-a559-a658daa50980 service nova] Lock "4edd4240-a8e3-4f7d-ad89-795d294b72df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:55:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-4f8e23a5-3c3c-4ac6-81b6-1214dbb5de8f req-8f1516cc-c9cf-4951-a559-a658daa50980 service nova] Lock "4edd4240-a8e3-4f7d-ad89-795d294b72df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:55:27 user nova-compute[103546]: DEBUG nova.compute.manager [req-4f8e23a5-3c3c-4ac6-81b6-1214dbb5de8f req-8f1516cc-c9cf-4951-a559-a658daa50980 service nova] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] No waiting events found dispatching network-vif-plugged-c7a5f1de-8036-4fb3-aaf0-78dce691474a {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:55:27 user nova-compute[103546]: WARNING nova.compute.manager [req-4f8e23a5-3c3c-4ac6-81b6-1214dbb5de8f req-8f1516cc-c9cf-4951-a559-a658daa50980 service nova] [instance: 4edd4240-a8e3-4f7d-ad89-795d294b72df] Received unexpected event network-vif-plugged-c7a5f1de-8036-4fb3-aaf0-78dce691474a for instance with vm_state deleted and task_state None.
Nov 16 03:55:28 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:31 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:35 user nova-compute[103546]: DEBUG nova.compute.manager [req-e6d73dfc-98ef-4e1e-953f-cba781652bbd req-d1e1d638-270c-4d63-9169-b15e6cb1abdc service nova] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Received event network-changed-757f4202-bbf9-42cf-8ccc-7e970b892f1f {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:55:35 user nova-compute[103546]: DEBUG nova.compute.manager [req-e6d73dfc-98ef-4e1e-953f-cba781652bbd req-d1e1d638-270c-4d63-9169-b15e6cb1abdc service nova] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Refreshing instance network info cache due to event network-changed-757f4202-bbf9-42cf-8ccc-7e970b892f1f. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:55:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-e6d73dfc-98ef-4e1e-953f-cba781652bbd req-d1e1d638-270c-4d63-9169-b15e6cb1abdc service nova] Acquiring lock "refresh_cache-ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:55:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-e6d73dfc-98ef-4e1e-953f-cba781652bbd req-d1e1d638-270c-4d63-9169-b15e6cb1abdc service nova] Acquired lock "refresh_cache-ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:55:35 user nova-compute[103546]: DEBUG nova.network.neutron [req-e6d73dfc-98ef-4e1e-953f-cba781652bbd req-d1e1d638-270c-4d63-9169-b15e6cb1abdc service nova] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Refreshing network info cache for port 757f4202-bbf9-42cf-8ccc-7e970b892f1f {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:55:35 user nova-compute[103546]: DEBUG nova.network.neutron [req-e6d73dfc-98ef-4e1e-953f-cba781652bbd req-d1e1d638-270c-4d63-9169-b15e6cb1abdc service nova] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Updated VIF entry in instance network info cache for port 757f4202-bbf9-42cf-8ccc-7e970b892f1f. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 03:55:35 user nova-compute[103546]: DEBUG nova.network.neutron [req-e6d73dfc-98ef-4e1e-953f-cba781652bbd req-d1e1d638-270c-4d63-9169-b15e6cb1abdc service nova] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Updating instance_info_cache with network_info: [{"id": "757f4202-bbf9-42cf-8ccc-7e970b892f1f", "address": "fa:16:3e:db:d6:71", "network": {"id": "b2fca984-f1e9-4c86-a3a5-b8d5b9950555", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-172535633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63722fdf17e4408299de8c215c133812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap757f4202-bb", "ovs_interfaceid": "757f4202-bbf9-42cf-8ccc-7e970b892f1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:55:36 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-e6d73dfc-98ef-4e1e-953f-cba781652bbd req-d1e1d638-270c-4d63-9169-b15e6cb1abdc service nova] Releasing lock "refresh_cache-ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:55:36 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:55:36 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-eb06c7f9-ac67-4e7a-8290-b7e9c5b1d652 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Acquiring lock "2ab2f87d-f9da-4490-8e23-2bd4a480ee5d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:55:36 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-eb06c7f9-ac67-4e7a-8290-b7e9c5b1d652 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Lock "2ab2f87d-f9da-4490-8e23-2bd4a480ee5d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:55:36 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-eb06c7f9-ac67-4e7a-8290-b7e9c5b1d652 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Acquiring lock "2ab2f87d-f9da-4490-8e23-2bd4a480ee5d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:55:36 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-eb06c7f9-ac67-4e7a-8290-b7e9c5b1d652 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Lock "2ab2f87d-f9da-4490-8e23-2bd4a480ee5d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:55:36 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-eb06c7f9-ac67-4e7a-8290-b7e9c5b1d652 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Lock "2ab2f87d-f9da-4490-8e23-2bd4a480ee5d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:55:36 user nova-compute[103546]: INFO nova.compute.manager [None req-eb06c7f9-ac67-4e7a-8290-b7e9c5b1d652 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] [instance: 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d] Terminating instance
Nov 16 03:55:36 user nova-compute[103546]: DEBUG nova.compute.manager [None req-eb06c7f9-ac67-4e7a-8290-b7e9c5b1d652 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] [instance: 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d] Start destroying the instance on the hypervisor. {{(pid=103546) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 03:55:36 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:36 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:36 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:36 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:36 user nova-compute[103546]: DEBUG nova.compute.manager [req-a5db441b-f5dd-4562-bb03-bff6b3f4be25 req-697b6655-9938-4e10-91dd-79d1d0759923 service nova] [instance: 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d] Received event network-vif-unplugged-a353a80b-d493-414f-b459-38227f8fc64b {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:55:36 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a5db441b-f5dd-4562-bb03-bff6b3f4be25 req-697b6655-9938-4e10-91dd-79d1d0759923 service nova] Acquiring lock "2ab2f87d-f9da-4490-8e23-2bd4a480ee5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:55:36 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a5db441b-f5dd-4562-bb03-bff6b3f4be25 req-697b6655-9938-4e10-91dd-79d1d0759923 service nova] Lock "2ab2f87d-f9da-4490-8e23-2bd4a480ee5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:55:36 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a5db441b-f5dd-4562-bb03-bff6b3f4be25 req-697b6655-9938-4e10-91dd-79d1d0759923 service nova] Lock "2ab2f87d-f9da-4490-8e23-2bd4a480ee5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:55:36 user nova-compute[103546]: DEBUG nova.compute.manager [req-a5db441b-f5dd-4562-bb03-bff6b3f4be25 req-697b6655-9938-4e10-91dd-79d1d0759923 service nova] [instance: 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d] No waiting events found dispatching network-vif-unplugged-a353a80b-d493-414f-b459-38227f8fc64b {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:55:36 user nova-compute[103546]: DEBUG nova.compute.manager [req-a5db441b-f5dd-4562-bb03-bff6b3f4be25 req-697b6655-9938-4e10-91dd-79d1d0759923 service nova] [instance: 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d] Received event network-vif-unplugged-a353a80b-d493-414f-b459-38227f8fc64b for instance with task_state deleting. {{(pid=103546) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 03:55:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:37 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d] Instance destroyed successfully.
Nov 16 03:55:37 user nova-compute[103546]: DEBUG nova.objects.instance [None req-eb06c7f9-ac67-4e7a-8290-b7e9c5b1d652 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Lazy-loading 'resources' on Instance uuid 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:55:37 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-eb06c7f9-ac67-4e7a-8290-b7e9c5b1d652 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:53:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2095380072',display_name='tempest-VolumesActionsTest-instance-2095380072',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2095380072',id=21,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:53:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6c8ecdd929f64310a04b173f17f69667',ramdisk_id='',reservation_id='r-etn1ysit',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1397867412',owner_user_name='tempest-VolumesActionsTest-1397867412-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T03:53:47Z,user_data=None,user_id='3ebecaf10cd8491e929be94a76246660',uuid=2ab2f87d-f9da-4490-8e23-2bd4a480ee5d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a353a80b-d493-414f-b459-38227f8fc64b", "address": "fa:16:3e:e8:14:4a", "network": {"id": "6d63abf1-29d1-47a9-b2ff-8f894dde1dcf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1773810435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8ecdd929f64310a04b173f17f69667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa353a80b-d4", "ovs_interfaceid": "a353a80b-d493-414f-b459-38227f8fc64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 03:55:37 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-eb06c7f9-ac67-4e7a-8290-b7e9c5b1d652 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Converting VIF {"id": "a353a80b-d493-414f-b459-38227f8fc64b", "address": "fa:16:3e:e8:14:4a", "network": {"id": "6d63abf1-29d1-47a9-b2ff-8f894dde1dcf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1773810435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8ecdd929f64310a04b173f17f69667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa353a80b-d4", "ovs_interfaceid": "a353a80b-d493-414f-b459-38227f8fc64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:55:37 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-eb06c7f9-ac67-4e7a-8290-b7e9c5b1d652 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:14:4a,bridge_name='br-int',has_traffic_filtering=True,id=a353a80b-d493-414f-b459-38227f8fc64b,network=Network(6d63abf1-29d1-47a9-b2ff-8f894dde1dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa353a80b-d4') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:55:37 user nova-compute[103546]: DEBUG os_vif [None req-eb06c7f9-ac67-4e7a-8290-b7e9c5b1d652 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:14:4a,bridge_name='br-int',has_traffic_filtering=True,id=a353a80b-d493-414f-b459-38227f8fc64b,network=Network(6d63abf1-29d1-47a9-b2ff-8f894dde1dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa353a80b-d4') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 03:55:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa353a80b-d4, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:55:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:55:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=43254a63-ff41-4a8e-aa87-a27a28ac4d85) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:55:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:37 user nova-compute[103546]: INFO os_vif [None req-eb06c7f9-ac67-4e7a-8290-b7e9c5b1d652 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:14:4a,bridge_name='br-int',has_traffic_filtering=True,id=a353a80b-d493-414f-b459-38227f8fc64b,network=Network(6d63abf1-29d1-47a9-b2ff-8f894dde1dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa353a80b-d4')
Nov 16 03:55:37 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-eb06c7f9-ac67-4e7a-8290-b7e9c5b1d652 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] [instance: 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d] Deleting instance files /opt/stack/data/nova/instances/2ab2f87d-f9da-4490-8e23-2bd4a480ee5d_del
Nov 16 03:55:37 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-eb06c7f9-ac67-4e7a-8290-b7e9c5b1d652 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] [instance: 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d] Deletion of /opt/stack/data/nova/instances/2ab2f87d-f9da-4490-8e23-2bd4a480ee5d_del complete
Nov 16 03:55:37 user nova-compute[103546]: INFO nova.compute.manager [None req-eb06c7f9-ac67-4e7a-8290-b7e9c5b1d652 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] [instance: 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d] Took 0.82 seconds to destroy the instance on the hypervisor.
Nov 16 03:55:37 user nova-compute[103546]: DEBUG oslo.service.loopingcall [None req-eb06c7f9-ac67-4e7a-8290-b7e9c5b1d652 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=103546) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 03:55:37 user nova-compute[103546]: DEBUG nova.compute.manager [-] [instance: 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d] Deallocating network for instance {{(pid=103546) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 03:55:37 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d] deallocate_for_instance() {{(pid=103546) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 03:55:37 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:55:37 user nova-compute[103546]: INFO nova.compute.manager [-] [instance: 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d] Took 0.46 seconds to deallocate network for instance.
Nov 16 03:55:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-eb06c7f9-ac67-4e7a-8290-b7e9c5b1d652 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:55:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-eb06c7f9-ac67-4e7a-8290-b7e9c5b1d652 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:55:38 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-eb06c7f9-ac67-4e7a-8290-b7e9c5b1d652 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:55:38 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-eb06c7f9-ac67-4e7a-8290-b7e9c5b1d652 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:55:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-eb06c7f9-ac67-4e7a-8290-b7e9c5b1d652 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.343s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:55:38 user nova-compute[103546]: INFO nova.scheduler.client.report [None req-eb06c7f9-ac67-4e7a-8290-b7e9c5b1d652 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Deleted allocations for instance 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d
Nov 16 03:55:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-eb06c7f9-ac67-4e7a-8290-b7e9c5b1d652 tempest-VolumesActionsTest-1397867412 tempest-VolumesActionsTest-1397867412-project-member] Lock "2ab2f87d-f9da-4490-8e23-2bd4a480ee5d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.802s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:55:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-51303efa-3904-4f27-8747-77baa2e20477 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Acquiring lock "ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:55:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-51303efa-3904-4f27-8747-77baa2e20477 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:55:38 user nova-compute[103546]: INFO nova.compute.manager [None req-51303efa-3904-4f27-8747-77baa2e20477 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Shelving
Nov 16 03:55:38 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:38 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:38 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:38 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:38 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:38 user nova-compute[103546]: DEBUG nova.compute.manager [req-ba6ef34d-6758-4fc4-b23e-43ad99000b76 req-1a42f6d0-54ac-4c9b-bf54-5a7b2a0b4e4e service nova] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Received event network-vif-unplugged-757f4202-bbf9-42cf-8ccc-7e970b892f1f {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:55:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ba6ef34d-6758-4fc4-b23e-43ad99000b76 req-1a42f6d0-54ac-4c9b-bf54-5a7b2a0b4e4e service nova] Acquiring lock "ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:55:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ba6ef34d-6758-4fc4-b23e-43ad99000b76 req-1a42f6d0-54ac-4c9b-bf54-5a7b2a0b4e4e service nova] Lock "ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:55:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ba6ef34d-6758-4fc4-b23e-43ad99000b76 req-1a42f6d0-54ac-4c9b-bf54-5a7b2a0b4e4e service nova] Lock "ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:55:38 user nova-compute[103546]: DEBUG nova.compute.manager [req-ba6ef34d-6758-4fc4-b23e-43ad99000b76 req-1a42f6d0-54ac-4c9b-bf54-5a7b2a0b4e4e service nova] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] No waiting events found dispatching network-vif-unplugged-757f4202-bbf9-42cf-8ccc-7e970b892f1f {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:55:38 user nova-compute[103546]: WARNING nova.compute.manager [req-ba6ef34d-6758-4fc4-b23e-43ad99000b76 req-1a42f6d0-54ac-4c9b-bf54-5a7b2a0b4e4e service nova] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Received unexpected event network-vif-unplugged-757f4202-bbf9-42cf-8ccc-7e970b892f1f for instance with vm_state active and task_state shelving.
Nov 16 03:55:38 user nova-compute[103546]: DEBUG nova.compute.manager [req-826ca9fa-eaaf-4682-a9a6-521a1b988c1c req-ad0544b7-bf4b-4ff5-907f-0665555590dd service nova] [instance: 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d] Received event network-vif-plugged-a353a80b-d493-414f-b459-38227f8fc64b {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:55:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-826ca9fa-eaaf-4682-a9a6-521a1b988c1c req-ad0544b7-bf4b-4ff5-907f-0665555590dd service nova] Acquiring lock "2ab2f87d-f9da-4490-8e23-2bd4a480ee5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:55:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-826ca9fa-eaaf-4682-a9a6-521a1b988c1c req-ad0544b7-bf4b-4ff5-907f-0665555590dd service nova] Lock "2ab2f87d-f9da-4490-8e23-2bd4a480ee5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:55:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-826ca9fa-eaaf-4682-a9a6-521a1b988c1c req-ad0544b7-bf4b-4ff5-907f-0665555590dd service nova] Lock "2ab2f87d-f9da-4490-8e23-2bd4a480ee5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:55:38 user nova-compute[103546]: DEBUG nova.compute.manager [req-826ca9fa-eaaf-4682-a9a6-521a1b988c1c req-ad0544b7-bf4b-4ff5-907f-0665555590dd service nova] [instance: 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d] No waiting events found dispatching network-vif-plugged-a353a80b-d493-414f-b459-38227f8fc64b {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:55:38 user nova-compute[103546]: WARNING nova.compute.manager [req-826ca9fa-eaaf-4682-a9a6-521a1b988c1c req-ad0544b7-bf4b-4ff5-907f-0665555590dd service nova] [instance: 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d] Received unexpected event network-vif-plugged-a353a80b-d493-414f-b459-38227f8fc64b for instance with vm_state deleted and task_state None.
Nov 16 03:55:38 user nova-compute[103546]: DEBUG nova.compute.manager [req-826ca9fa-eaaf-4682-a9a6-521a1b988c1c req-ad0544b7-bf4b-4ff5-907f-0665555590dd service nova] [instance: 2ab2f87d-f9da-4490-8e23-2bd4a480ee5d] Received event network-vif-deleted-a353a80b-d493-414f-b459-38227f8fc64b {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:55:38 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:39 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Instance destroyed successfully.
Nov 16 03:55:39 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-51303efa-3904-4f27-8747-77baa2e20477 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Beginning cold snapshot process
Nov 16 03:55:39 user nova-compute[103546]: DEBUG nova.privsep.utils [None req-51303efa-3904-4f27-8747-77baa2e20477 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=103546) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 03:55:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-51303efa-3904-4f27-8747-77baa2e20477 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c/disk /opt/stack/data/nova/instances/snapshots/tmp3fa_g3bk/a4a6a0c6316f4b2e9d4baf872141f675 {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:55:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-51303efa-3904-4f27-8747-77baa2e20477 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c/disk /opt/stack/data/nova/instances/snapshots/tmp3fa_g3bk/a4a6a0c6316f4b2e9d4baf872141f675" returned: 0 in 0.605s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:55:39 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-51303efa-3904-4f27-8747-77baa2e20477 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Snapshot extracted, beginning image upload
Nov 16 03:55:40 user nova-compute[103546]: DEBUG nova.compute.manager [req-104e12f2-bec9-4f4b-a3eb-df031cb5290b req-bb6872d0-c387-4366-85ef-078ff9e860c7 service nova] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Received event network-vif-plugged-757f4202-bbf9-42cf-8ccc-7e970b892f1f {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:55:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-104e12f2-bec9-4f4b-a3eb-df031cb5290b req-bb6872d0-c387-4366-85ef-078ff9e860c7 service nova] Acquiring lock "ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:55:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-104e12f2-bec9-4f4b-a3eb-df031cb5290b req-bb6872d0-c387-4366-85ef-078ff9e860c7 service nova] Lock "ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:55:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-104e12f2-bec9-4f4b-a3eb-df031cb5290b req-bb6872d0-c387-4366-85ef-078ff9e860c7 service nova] Lock "ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:55:40 user nova-compute[103546]: DEBUG nova.compute.manager [req-104e12f2-bec9-4f4b-a3eb-df031cb5290b req-bb6872d0-c387-4366-85ef-078ff9e860c7 service nova] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] No waiting events found dispatching network-vif-plugged-757f4202-bbf9-42cf-8ccc-7e970b892f1f {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:55:40 user nova-compute[103546]: WARNING nova.compute.manager [req-104e12f2-bec9-4f4b-a3eb-df031cb5290b req-bb6872d0-c387-4366-85ef-078ff9e860c7 service nova] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Received unexpected event network-vif-plugged-757f4202-bbf9-42cf-8ccc-7e970b892f1f for instance with vm_state active and task_state shelving_image_uploading.
Nov 16 03:55:42 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:42 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-51303efa-3904-4f27-8747-77baa2e20477 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Snapshot image upload complete
Nov 16 03:55:42 user nova-compute[103546]: DEBUG nova.compute.manager [None req-51303efa-3904-4f27-8747-77baa2e20477 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 03:55:42 user nova-compute[103546]: INFO nova.compute.manager [None req-51303efa-3904-4f27-8747-77baa2e20477 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Shelve offloading
Nov 16 03:55:42 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Instance destroyed successfully.
Nov 16 03:55:42 user nova-compute[103546]: DEBUG nova.compute.manager [None req-51303efa-3904-4f27-8747-77baa2e20477 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 03:55:42 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-51303efa-3904-4f27-8747-77baa2e20477 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Acquiring lock "refresh_cache-ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:55:42 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-51303efa-3904-4f27-8747-77baa2e20477 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Acquired lock "refresh_cache-ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:55:42 user nova-compute[103546]: DEBUG nova.network.neutron [None req-51303efa-3904-4f27-8747-77baa2e20477 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 03:55:43 user nova-compute[103546]: DEBUG nova.network.neutron [None req-51303efa-3904-4f27-8747-77baa2e20477 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Updating instance_info_cache with network_info: [{"id": "757f4202-bbf9-42cf-8ccc-7e970b892f1f", "address": "fa:16:3e:db:d6:71", "network": {"id": "b2fca984-f1e9-4c86-a3a5-b8d5b9950555", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-172535633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63722fdf17e4408299de8c215c133812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap757f4202-bb", "ovs_interfaceid": "757f4202-bbf9-42cf-8ccc-7e970b892f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:55:43 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-51303efa-3904-4f27-8747-77baa2e20477 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Releasing lock "refresh_cache-ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:55:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:43 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Instance destroyed successfully.
Nov 16 03:55:43 user nova-compute[103546]: DEBUG nova.objects.instance [None req-51303efa-3904-4f27-8747-77baa2e20477 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lazy-loading 'resources' on Instance uuid ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:55:43 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-51303efa-3904-4f27-8747-77baa2e20477 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:53:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-131803665',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-131803665',id=22,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCpMkDeLog7bvOvwKkIjqfS8179Rp5Wy/oiCfL7hNx4ACLwn8Ka5bKgRH8IHZl2m0/RN2qLs1wVx1qnT5sRNlnObDaB0h+OIqSDqvVheIpq1rj9KpUcFGrgypySriGKxIw==',key_name='tempest-keypair-1198627758',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:53:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='63722fdf17e4408299de8c215c133812',ramdisk_id='',reservation_id='r-gew0pxlb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1382373405',owner_user_name='tempest-AttachVolumeShelveTestJSON-1382373405-project-member',shelved_at='2023-11-16T03:55:42.538464',shelved_host='user',shelved_image_id='a10cd2a1-7c3b-44fd-a21c-316f8df9774b'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T03:55:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21d4e9052a614968bda331f028920ca7',uuid=ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "757f4202-bbf9-42cf-8ccc-7e970b892f1f", "address": "fa:16:3e:db:d6:71", "network": {"id": "b2fca984-f1e9-4c86-a3a5-b8d5b9950555", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-172535633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63722fdf17e4408299de8c215c133812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap757f4202-bb", "ovs_interfaceid": "757f4202-bbf9-42cf-8ccc-7e970b892f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 03:55:43 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-51303efa-3904-4f27-8747-77baa2e20477 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Converting VIF {"id": "757f4202-bbf9-42cf-8ccc-7e970b892f1f", "address": "fa:16:3e:db:d6:71", "network": {"id": "b2fca984-f1e9-4c86-a3a5-b8d5b9950555", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-172535633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63722fdf17e4408299de8c215c133812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap757f4202-bb", "ovs_interfaceid": "757f4202-bbf9-42cf-8ccc-7e970b892f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:55:43 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-51303efa-3904-4f27-8747-77baa2e20477 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:d6:71,bridge_name='br-int',has_traffic_filtering=True,id=757f4202-bbf9-42cf-8ccc-7e970b892f1f,network=Network(b2fca984-f1e9-4c86-a3a5-b8d5b9950555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap757f4202-bb') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:55:43 user nova-compute[103546]: DEBUG os_vif [None req-51303efa-3904-4f27-8747-77baa2e20477 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:d6:71,bridge_name='br-int',has_traffic_filtering=True,id=757f4202-bbf9-42cf-8ccc-7e970b892f1f,network=Network(b2fca984-f1e9-4c86-a3a5-b8d5b9950555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap757f4202-bb') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 03:55:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap757f4202-bb, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:55:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:55:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=232933c2-a217-4bf7-82c5-9213c38cc21f) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:55:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:55:43 user nova-compute[103546]: INFO os_vif [None req-51303efa-3904-4f27-8747-77baa2e20477 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:d6:71,bridge_name='br-int',has_traffic_filtering=True,id=757f4202-bbf9-42cf-8ccc-7e970b892f1f,network=Network(b2fca984-f1e9-4c86-a3a5-b8d5b9950555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap757f4202-bb')
Nov 16 03:55:43 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-51303efa-3904-4f27-8747-77baa2e20477 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Deleting instance files /opt/stack/data/nova/instances/ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c_del
Nov 16 03:55:43 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-51303efa-3904-4f27-8747-77baa2e20477 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Deletion of /opt/stack/data/nova/instances/ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c_del complete
Nov 16 03:55:43 user nova-compute[103546]: DEBUG nova.compute.manager [req-7d0dd9f3-54b4-4022-be4c-768e352786f0 req-d5d1dc03-719c-4901-9a55-63a39ba0303d service nova] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Received event network-changed-757f4202-bbf9-42cf-8ccc-7e970b892f1f {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:55:43 user nova-compute[103546]: DEBUG nova.compute.manager [req-7d0dd9f3-54b4-4022-be4c-768e352786f0 req-d5d1dc03-719c-4901-9a55-63a39ba0303d service nova] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Refreshing instance network info cache due to event network-changed-757f4202-bbf9-42cf-8ccc-7e970b892f1f. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:55:43 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-7d0dd9f3-54b4-4022-be4c-768e352786f0 req-d5d1dc03-719c-4901-9a55-63a39ba0303d service nova] Acquiring lock "refresh_cache-ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:55:43 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-7d0dd9f3-54b4-4022-be4c-768e352786f0 req-d5d1dc03-719c-4901-9a55-63a39ba0303d service nova] Acquired lock "refresh_cache-ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:55:43 user nova-compute[103546]: DEBUG nova.network.neutron [req-7d0dd9f3-54b4-4022-be4c-768e352786f0 req-d5d1dc03-719c-4901-9a55-63a39ba0303d service nova] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Refreshing network info cache for port 757f4202-bbf9-42cf-8ccc-7e970b892f1f {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:55:43 user nova-compute[103546]: INFO nova.scheduler.client.report [None req-51303efa-3904-4f27-8747-77baa2e20477 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Deleted allocations for instance ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c
Nov 16 03:55:43 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-51303efa-3904-4f27-8747-77baa2e20477 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:55:43 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-51303efa-3904-4f27-8747-77baa2e20477 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:55:43 user nova-compute[103546]: DEBUG nova.objects.instance [None req-51303efa-3904-4f27-8747-77baa2e20477 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lazy-loading 'numa_topology' on Instance uuid ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:55:43 user nova-compute[103546]: DEBUG nova.objects.base [None req-51303efa-3904-4f27-8747-77baa2e20477 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Object Instance<ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c> lazy-loaded attributes: resources,numa_topology {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 03:55:44 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-51303efa-3904-4f27-8747-77baa2e20477 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:55:44 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-51303efa-3904-4f27-8747-77baa2e20477 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:55:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-51303efa-3904-4f27-8747-77baa2e20477 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.353s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:55:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-51303efa-3904-4f27-8747-77baa2e20477 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.931s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:55:44 user nova-compute[103546]: DEBUG nova.network.neutron [req-7d0dd9f3-54b4-4022-be4c-768e352786f0 req-d5d1dc03-719c-4901-9a55-63a39ba0303d service nova] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Updated VIF entry in instance network info cache for port 757f4202-bbf9-42cf-8ccc-7e970b892f1f. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 03:55:44 user nova-compute[103546]: DEBUG nova.network.neutron [req-7d0dd9f3-54b4-4022-be4c-768e352786f0 req-d5d1dc03-719c-4901-9a55-63a39ba0303d service nova] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Updating instance_info_cache with network_info: [{"id": "757f4202-bbf9-42cf-8ccc-7e970b892f1f", "address": "fa:16:3e:db:d6:71", "network": {"id": "b2fca984-f1e9-4c86-a3a5-b8d5b9950555", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-172535633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63722fdf17e4408299de8c215c133812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap757f4202-bb", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:55:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-7d0dd9f3-54b4-4022-be4c-768e352786f0 req-d5d1dc03-719c-4901-9a55-63a39ba0303d service nova] Releasing lock "refresh_cache-ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:55:48 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:48 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:50 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:52 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d0d6e065-86f6-4995-a6fc-a3502ffb73c6 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Acquiring lock "164533fb-64e1-4aa5-b5fb-273817dd3e74" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:55:52 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d0d6e065-86f6-4995-a6fc-a3502ffb73c6 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Lock "164533fb-64e1-4aa5-b5fb-273817dd3e74" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:55:52 user nova-compute[103546]: INFO nova.compute.manager [None req-d0d6e065-86f6-4995-a6fc-a3502ffb73c6 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Detaching volume f25e1a13-9b02-47dc-8610-7676f6e22a55
Nov 16 03:55:52 user nova-compute[103546]: INFO nova.virt.block_device [None req-d0d6e065-86f6-4995-a6fc-a3502ffb73c6 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Attempting to driver detach volume f25e1a13-9b02-47dc-8610-7676f6e22a55 from mountpoint /dev/vdb
Nov 16 03:55:52 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d0d6e065-86f6-4995-a6fc-a3502ffb73c6 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Attempting to detach device vdb from instance 164533fb-64e1-4aa5-b5fb-273817dd3e74 from the persistent domain config. {{(pid=103546) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 03:55:52 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-d0d6e065-86f6-4995-a6fc-a3502ffb73c6 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 03:55:52 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 03:55:52 user nova-compute[103546]:   <source dev="/dev/sde"/>
Nov 16 03:55:52 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 03:55:52 user nova-compute[103546]:   <serial>f25e1a13-9b02-47dc-8610-7676f6e22a55</serial>
Nov 16 03:55:52 user nova-compute[103546]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 03:55:52 user nova-compute[103546]: </disk>
Nov 16 03:55:52 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 03:55:52 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-d0d6e065-86f6-4995-a6fc-a3502ffb73c6 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Successfully detached device vdb from instance 164533fb-64e1-4aa5-b5fb-273817dd3e74 from the persistent domain config.
Nov 16 03:55:52 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d0d6e065-86f6-4995-a6fc-a3502ffb73c6 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 164533fb-64e1-4aa5-b5fb-273817dd3e74 from the live domain config. {{(pid=103546) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 03:55:52 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-d0d6e065-86f6-4995-a6fc-a3502ffb73c6 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 03:55:52 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 03:55:52 user nova-compute[103546]:   <source dev="/dev/sde"/>
Nov 16 03:55:52 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 03:55:52 user nova-compute[103546]:   <serial>f25e1a13-9b02-47dc-8610-7676f6e22a55</serial>
Nov 16 03:55:52 user nova-compute[103546]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 03:55:52 user nova-compute[103546]: </disk>
Nov 16 03:55:52 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 03:55:53 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d0d6e065-86f6-4995-a6fc-a3502ffb73c6 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 164533fb-64e1-4aa5-b5fb-273817dd3e74 {{(pid=103546) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 03:55:53 user nova-compute[103546]: INFO nova.compute.manager [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Rescuing
Nov 16 03:55:53 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Acquiring lock "refresh_cache-fa7e5468-9dd4-407d-85ec-d45ec76f9e29" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:55:53 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Acquired lock "refresh_cache-fa7e5468-9dd4-407d-85ec-d45ec76f9e29" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:55:53 user nova-compute[103546]: DEBUG nova.network.neutron [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 03:55:53 user nova-compute[103546]: DEBUG nova.network.neutron [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Updating instance_info_cache with network_info: [{"id": "764b22e9-e899-4d39-8bc7-903ff8a7c3f6", "address": "fa:16:3e:77:63:89", "network": {"id": "fdbb2d2c-9a54-4517-b33a-cf27ce7570b1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79661471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2a38a5eb514ce8a7569c8322657eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap764b22e9-e8", "ovs_interfaceid": "764b22e9-e899-4d39-8bc7-903ff8a7c3f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:55:53 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Releasing lock "refresh_cache-fa7e5468-9dd4-407d-85ec-d45ec76f9e29" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:55:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:53 user nova-compute[103546]: DEBUG nova.compute.manager [req-2f960d5e-de7b-4cbd-9081-5fbfc7712717 req-3d651774-12a1-4255-8a46-ba3ee9c45fff service nova] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Received event network-vif-unplugged-764b22e9-e899-4d39-8bc7-903ff8a7c3f6 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:55:53 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-2f960d5e-de7b-4cbd-9081-5fbfc7712717 req-3d651774-12a1-4255-8a46-ba3ee9c45fff service nova] Acquiring lock "fa7e5468-9dd4-407d-85ec-d45ec76f9e29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:55:53 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-2f960d5e-de7b-4cbd-9081-5fbfc7712717 req-3d651774-12a1-4255-8a46-ba3ee9c45fff service nova] Lock "fa7e5468-9dd4-407d-85ec-d45ec76f9e29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:55:53 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-2f960d5e-de7b-4cbd-9081-5fbfc7712717 req-3d651774-12a1-4255-8a46-ba3ee9c45fff service nova] Lock "fa7e5468-9dd4-407d-85ec-d45ec76f9e29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:55:53 user nova-compute[103546]: DEBUG nova.compute.manager [req-2f960d5e-de7b-4cbd-9081-5fbfc7712717 req-3d651774-12a1-4255-8a46-ba3ee9c45fff service nova] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] No waiting events found dispatching network-vif-unplugged-764b22e9-e899-4d39-8bc7-903ff8a7c3f6 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:55:53 user nova-compute[103546]: WARNING nova.compute.manager [req-2f960d5e-de7b-4cbd-9081-5fbfc7712717 req-3d651774-12a1-4255-8a46-ba3ee9c45fff service nova] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Received unexpected event network-vif-unplugged-764b22e9-e899-4d39-8bc7-903ff8a7c3f6 for instance with vm_state active and task_state rescuing.
Nov 16 03:55:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:54 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Instance destroyed successfully.
Nov 16 03:55:54 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Attempting a stable device rescue
Nov 16 03:55:54 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=103546) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 16 03:55:54 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Instance directory exists: not creating {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 16 03:55:54 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Creating image(s)
Nov 16 03:55:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Acquiring lock "/opt/stack/data/nova/instances/fa7e5468-9dd4-407d-85ec-d45ec76f9e29/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:55:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "/opt/stack/data/nova/instances/fa7e5468-9dd4-407d-85ec-d45ec76f9e29/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:55:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "/opt/stack/data/nova/instances/fa7e5468-9dd4-407d-85ec-d45ec76f9e29/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:55:54 user nova-compute[103546]: DEBUG nova.objects.instance [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lazy-loading 'trusted_certs' on Instance uuid fa7e5468-9dd4-407d-85ec-d45ec76f9e29 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:55:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Acquiring lock "aff2fecfa733fdaa8a82d537599b00ae87291713" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:55:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "aff2fecfa733fdaa8a82d537599b00ae87291713" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:55:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aff2fecfa733fdaa8a82d537599b00ae87291713.part --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:55:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aff2fecfa733fdaa8a82d537599b00ae87291713.part --force-share --output=json" returned: 0 in 0.169s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:55:55 user nova-compute[103546]: DEBUG nova.virt.images [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] dfe54771-4b4d-4b29-9cfc-a6166a68a7a5 was qcow2, converting to raw {{(pid=103546) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 03:55:55 user nova-compute[103546]: DEBUG nova.privsep.utils [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=103546) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 03:55:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/aff2fecfa733fdaa8a82d537599b00ae87291713.part /opt/stack/data/nova/instances/_base/aff2fecfa733fdaa8a82d537599b00ae87291713.converted {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:55:55 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:55 user nova-compute[103546]: DEBUG nova.compute.manager [req-91dc41dc-1292-4e2b-a2c8-a6c99194426a req-56b86d39-459b-4a8e-b6cc-c1da87945932 service nova] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Received event network-vif-plugged-764b22e9-e899-4d39-8bc7-903ff8a7c3f6 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:55:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-91dc41dc-1292-4e2b-a2c8-a6c99194426a req-56b86d39-459b-4a8e-b6cc-c1da87945932 service nova] Acquiring lock "fa7e5468-9dd4-407d-85ec-d45ec76f9e29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:55:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-91dc41dc-1292-4e2b-a2c8-a6c99194426a req-56b86d39-459b-4a8e-b6cc-c1da87945932 service nova] Lock "fa7e5468-9dd4-407d-85ec-d45ec76f9e29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:55:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-91dc41dc-1292-4e2b-a2c8-a6c99194426a req-56b86d39-459b-4a8e-b6cc-c1da87945932 service nova] Lock "fa7e5468-9dd4-407d-85ec-d45ec76f9e29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:55:55 user nova-compute[103546]: DEBUG nova.compute.manager [req-91dc41dc-1292-4e2b-a2c8-a6c99194426a req-56b86d39-459b-4a8e-b6cc-c1da87945932 service nova] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] No waiting events found dispatching network-vif-plugged-764b22e9-e899-4d39-8bc7-903ff8a7c3f6 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:55:55 user nova-compute[103546]: WARNING nova.compute.manager [req-91dc41dc-1292-4e2b-a2c8-a6c99194426a req-56b86d39-459b-4a8e-b6cc-c1da87945932 service nova] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Received unexpected event network-vif-plugged-764b22e9-e899-4d39-8bc7-903ff8a7c3f6 for instance with vm_state active and task_state rescuing.
Nov 16 03:55:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/aff2fecfa733fdaa8a82d537599b00ae87291713.part /opt/stack/data/nova/instances/_base/aff2fecfa733fdaa8a82d537599b00ae87291713.converted" returned: 0 in 0.549s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:55:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aff2fecfa733fdaa8a82d537599b00ae87291713.converted --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:55:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aff2fecfa733fdaa8a82d537599b00ae87291713.converted --force-share --output=json" returned: 0 in 0.172s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:55:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "aff2fecfa733fdaa8a82d537599b00ae87291713" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.713s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:55:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Acquiring lock "aff2fecfa733fdaa8a82d537599b00ae87291713" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:55:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "aff2fecfa733fdaa8a82d537599b00ae87291713" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:55:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aff2fecfa733fdaa8a82d537599b00ae87291713 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aff2fecfa733fdaa8a82d537599b00ae87291713 --force-share --output=json" returned: 0 in 0.171s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aff2fecfa733fdaa8a82d537599b00ae87291713,backing_fmt=raw /opt/stack/data/nova/instances/fa7e5468-9dd4-407d-85ec-d45ec76f9e29/disk.rescue {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aff2fecfa733fdaa8a82d537599b00ae87291713,backing_fmt=raw /opt/stack/data/nova/instances/fa7e5468-9dd4-407d-85ec-d45ec76f9e29/disk.rescue" returned: 0 in 0.055s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "aff2fecfa733fdaa8a82d537599b00ae87291713" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG nova.objects.instance [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lazy-loading 'migration_context' on Instance uuid fa7e5468-9dd4-407d-85ec-d45ec76f9e29 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG nova.objects.base [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Object Instance<fa7e5468-9dd4-407d-85ec-d45ec76f9e29> lazy-loaded attributes: trusted_certs,migration_context {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Created local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Start _get_guest_xml network_info=[{"id": "764b22e9-e899-4d39-8bc7-903ff8a7c3f6", "address": "fa:16:3e:77:63:89", "network": {"id": "fdbb2d2c-9a54-4517-b33a-cf27ce7570b1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79661471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-79661471-network", "vif_mac": "fa:16:3e:77:63:89"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2a38a5eb514ce8a7569c8322657eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap764b22e9-e8", "ovs_interfaceid": "764b22e9-e899-4d39-8bc7-903ff8a7c3f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'dfe54771-4b4d-4b29-9cfc-a6166a68a7a5', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iCqEsNVr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'fa7e5468-9dd4-407d-85ec-d45ec76f9e29', 'attached_at': '', 'detached_at': '', 'volume_id': '13e5eaa2-fe85-49ac-bbac-868f460052c4', 'serial': '13e5eaa2-fe85-49ac-bbac-868f460052c4'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': 'e0bee130-28c9-4efb-b0c7-99be68216f20', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG nova.objects.instance [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lazy-loading 'resources' on Instance uuid fa7e5468-9dd4-407d-85ec-d45ec76f9e29 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG nova.objects.base [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Object Instance<fa7e5468-9dd4-407d-85ec-d45ec76f9e29> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG nova.objects.instance [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lazy-loading 'numa_topology' on Instance uuid fa7e5468-9dd4-407d-85ec-d45ec76f9e29 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG nova.objects.base [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Object Instance<fa7e5468-9dd4-407d-85ec-d45ec76f9e29> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 03:55:56 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:55:56 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:55:56 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG nova.objects.instance [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lazy-loading 'vcpu_model' on Instance uuid fa7e5468-9dd4-407d-85ec-d45ec76f9e29 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG nova.objects.base [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Object Instance<fa7e5468-9dd4-407d-85ec-d45ec76f9e29> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iCqEsNVr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:55:56 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:55:56 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:55:56 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:55:56 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:55:56 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 03:55:56 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ac5aeb-1a88-4591-b9c6-191e32966912]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = iCqEsNVr\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 16 03:55:56 user nova-compute[103546]: node.name = iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4
Nov 16 03:55:56 user nova-compute[103546]: node.tpgt = -1
Nov 16 03:55:56 user nova-compute[103546]: node.startup = automatic
Nov 16 03:55:56 user nova-compute[103546]: node.leading_login = No
Nov 16 03:55:56 user nova-compute[103546]: iface.iscsi_ifacename = default
Nov 16 03:55:56 user nova-compute[103546]: iface.net_ifacename = <empty>
Nov 16 03:55:56 user nova-compute[103546]: iface.ipaddress = <empty>
Nov 16 03:55:56 user nova-compute[103546]: iface.prefix_len = 0
Nov 16 03:55:56 user nova-compute[103546]: iface.hwaddress = <empty>
Nov 16 03:55:56 user nova-compute[103546]: iface.transport_name = tcp
Nov 16 03:55:56 user nova-compute[103546]: iface.initiatorname = <empty>
Nov 16 03:55:56 user nova-compute[103546]: iface.state = <empty>
Nov 16 03:55:56 user nova-compute[103546]: iface.vlan_id = 0
Nov 16 03:55:56 user nova-compute[103546]: iface.vlan_priority = 0
Nov 16 03:55:56 user nova-compute[103546]: iface.vlan_state = <empty>
Nov 16 03:55:56 user nova-compute[103546]: iface.iface_num = 0
Nov 16 03:55:56 user nova-compute[103546]: iface.mtu = 0
Nov 16 03:55:56 user nova-compute[103546]: iface.port = 0
Nov 16 03:55:56 user nova-compute[103546]: iface.bootproto = <empty>
Nov 16 03:55:56 user nova-compute[103546]: iface.subnet_mask = <empty>
Nov 16 03:55:56 user nova-compute[103546]: iface.gateway = <empty>
Nov 16 03:55:56 user nova-compute[103546]: iface.dhcp_alt_client_id_state = <empty>
Nov 16 03:55:56 user nova-compute[103546]: iface.dhcp_alt_client_id = <empty>
Nov 16 03:55:56 user nova-compute[103546]: iface.dhcp_dns = <empty>
Nov 16 03:55:56 user nova-compute[103546]: iface.dhcp_learn_iqn = <empty>
Nov 16 03:55:56 user nova-compute[103546]: iface.dhcp_req_vendor_id_state = <empty>
Nov 16 03:55:56 user nova-compute[103546]: iface.dhcp_vendor_id_state = <empty>
Nov 16 03:55:56 user nova-compute[103546]: iface.dhcp_vendor_id = <empty>
Nov 16 03:55:56 user nova-compute[103546]: iface.dhcp_slp_da = <empty>
Nov 16 03:55:56 user nova-compute[103546]: iface.fragmentation = <empty>
Nov 16 03:55:56 user nova-compute[103546]: iface.gratuitous_arp = <empty>
Nov 16 03:55:56 user nova-compute[103546]: iface.incoming_forwarding = <empty>
Nov 16 03:55:56 user nova-compute[103546]: iface.tos_state = <empty>
Nov 16 03:55:56 user nova-compute[103546]: iface.tos = 0
Nov 16 03:55:56 user nova-compute[103546]: iface.ttl = 0
Nov 16 03:55:56 user nova-compute[103546]: iface.delayed_ack = <empty>
Nov 16 03:55:56 user nova-compute[103546]: iface.tcp_nagle = <empty>
Nov 16 03:55:56 user nova-compute[103546]: iface.tcp_wsf_state = <empty>
Nov 16 03:55:56 user nova-compute[103546]: iface.tcp_wsf = 0
Nov 16 03:55:56 user nova-compute[103546]: iface.tcp_timer_scale = 0
Nov 16 03:55:56 user nova-compute[103546]: iface.tcp_timestamp = <empty>
Nov 16 03:55:56 user nova-compute[103546]: iface.redirect = <empty>
Nov 16 03:55:56 user nova-compute[103546]: iface.def_task_mgmt_timeout = 0
Nov 16 03:55:56 user nova-compute[103546]: iface.header_digest = <empty>
Nov 16 03:55:56 user nova-compute[103546]: iface.data_digest = <empty>
Nov 16 03:55:56 user nova-compute[103546]: iface.immediate_data = <empty>
Nov 16 03:55:56 user nova-compute[103546]: iface.initial_r2t = <empty>
Nov 16 03:55:56 user nova-compute[103546]: iface.data_seq_inorder = <empty>
Nov 16 03:55:56 user nova-compute[103546]: iface.data_pdu_inorder = <empty>
Nov 16 03:55:56 user nova-compute[103546]: iface.erl = 0
Nov 16 03:55:56 user nova-compute[103546]: iface.max_receive_data_len = 0
Nov 16 03:55:56 user nova-compute[103546]: iface.first_burst_len = 0
Nov 16 03:55:56 user nova-compute[103546]: iface.max_outstanding_r2t = 0
Nov 16 03:55:56 user nova-compute[103546]: iface.max_burst_len = 0
Nov 16 03:55:56 user nova-compute[103546]: iface.chap_auth = <empty>
Nov 16 03:55:56 user nova-compute[103546]: iface.bidi_chap = <empty>
Nov 16 03:55:56 user nova-compute[103546]: iface.strict_login_compliance = <empty>
Nov 16 03:55:56 user nova-compute[103546]: iface.discovery_auth = <empty>
Nov 16 03:55:56 user nova-compute[103546]: iface.discovery_logout = <empty>
Nov 16 03:55:56 user nova-compute[103546]: node.discovery_address = <empty>
Nov 16 03:55:56 user nova-compute[103546]: node.discovery_port = 0
Nov 16 03:55:56 user nova-compute[103546]: node.discovery_type = static
Nov 16 03:55:56 user nova-compute[103546]: node.session.initial_cmdsn = 0
Nov 16 03:55:56 user nova-compute[103546]: node.session.initial_login_retry_max = 8
Nov 16 03:55:56 user nova-compute[103546]: node.session.xmit_thread_priority = -20
Nov 16 03:55:56 user nova-compute[103546]: node.session.cmds_max = 128
Nov 16 03:55:56 user nova-compute[103546]: node.session.queue_depth = 32
Nov 16 03:55:56 user nova-compute[103546]: node.session.nr_sessions = 1
Nov 16 03:55:56 user nova-compute[103546]: node.session.auth.authmethod = CHAP
Nov 16 03:55:56 user nova-compute[103546]: node.session.auth.username = iCqEsNVr
Nov 16 03:55:56 user nova-compute[103546]: node.session.auth.password = ***
Nov 16 03:55:56 user nova-compute[103546]: node.session.auth.username_in = <empty>
Nov 16 03:55:56 user nova-compute[103546]: node.session.auth.password_in = <empty>
Nov 16 03:55:56 user nova-compute[103546]: node.session.auth.chap_algs = MD5
Nov 16 03:55:56 user nova-compute[103546]: node.session.timeo.replacement_timeout = 120
Nov 16 03:55:56 user nova-compute[103546]: node.session.err_timeo.abort_timeout = 15
Nov 16 03:55:56 user nova-compute[103546]: node.session.err_timeo.lu_reset_timeout = 30
Nov 16 03:55:56 user nova-compute[103546]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 16 03:55:56 user nova-compute[103546]: node.session.err_timeo.host_reset_timeout = 60
Nov 16 03:55:56 user nova-compute[103546]: node.session.iscsi.FastAbort = Yes
Nov 16 03:55:56 user nova-compute[103546]: node.session.iscsi.InitialR2T = No
Nov 16 03:55:56 user nova-compute[103546]: node.session.iscsi.ImmediateData = Yes
Nov 16 03:55:56 user nova-compute[103546]: node.session.iscsi.FirstBurstLength = 262144
Nov 16 03:55:56 user nova-compute[103546]: node.session.iscsi.MaxBurstLength = 16776192
Nov 16 03:55:56 user nova-compute[103546]: node.session.iscsi.DefaultTime2Retain = 0
Nov 16 03:55:56 user nova-compute[103546]: node.session.iscsi.DefaultTime2Wait = 2
Nov 16 03:55:56 user nova-compute[103546]: node.session.iscsi.MaxConnections = 1
Nov 16 03:55:56 user nova-compute[103546]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 16 03:55:56 user nova-compute[103546]: node.session.iscsi.ERL = 0
Nov 16 03:55:56 user nova-compute[103546]: node.session.scan = manual
Nov 16 03:55:56 user nova-compute[103546]: node.session.reopen_max = 0
Nov 16 03:55:56 user nova-compute[103546]: node.conn[0].address = 172.16.0.220
Nov 16 03:55:56 user nova-compute[103546]: node.conn[0].port = 3260
Nov 16 03:55:56 user nova-compute[103546]: node.conn[0].startup = manual
Nov 16 03:55:56 user nova-compute[103546]: node.conn[0].tcp.window_size = 524288
Nov 16 03:55:56 user nova-compute[103546]: node.conn[0].tcp.type_of_service = 0
Nov 16 03:55:56 user nova-compute[103546]: node.conn[0].timeo.logout_timeout = 15
Nov 16 03:55:56 user nova-compute[103546]: node.conn[0].timeo.login_timeout = 15
Nov 16 03:55:56 user nova-compute[103546]: node.conn[0].timeo.auth_timeout = 45
Nov 16 03:55:56 user nova-compute[103546]: node.conn[0].timeo.noop_out_interval = 5
Nov 16 03:55:56 user nova-compute[103546]: node.conn[0].timeo.noop_out_timeout = 5
Nov 16 03:55:56 user nova-compute[103546]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 16 03:55:56 user nova-compute[103546]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 16 03:55:56 user nova-compute[103546]: node.conn[0].iscsi.HeaderDigest = None
Nov 16 03:55:56 user nova-compute[103546]: node.conn[0].iscsi.DataDigest = None
Nov 16 03:55:56 user nova-compute[103546]: node.conn[0].iscsi.IFMarker = No
Nov 16 03:55:56 user nova-compute[103546]: node.conn[0].iscsi.OFMarker = No
Nov 16 03:55:56 user nova-compute[103546]: # END RECORD
Nov 16 03:55:56 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e07d3e-0da6-4567-92ab-4ebfe8f753d7]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7fe53bf-438d-49db-b54f-29ed7a98f3be]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iCqEsNVr {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iCqEsNVr" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d024c3f1-acd2-4226-b0b8-55ee6db9d0ef]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iCqEsNVr'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2f976c-6293-4cb7-8fc6-48960da7d6ef]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[227b6dee-c552-4fbc-b0c0-264498f38172]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:55:56 user nova-compute[103546]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc (non-flash)
Nov 16 03:55:56 user nova-compute[103546]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)
Nov 16 03:55:56 user nova-compute[103546]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55 (non-flash)
Nov 16 03:55:56 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:55:56 user nova-compute[103546]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc (non-flash)
Nov 16 03:55:56 user nova-compute[103546]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)
Nov 16 03:55:56 user nova-compute[103546]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55 (non-flash)
Nov 16 03:55:56 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.158s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] HCTL ('33', '0', '0', 0) found on session 25 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87635e7-570d-4c8b-aa23-154dd0552f56]: (4, ('0 0 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Searching for a device in session 25 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iCqEsNVr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.183s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] <== connect_volume: return (184ms) {'type': 'block', 'scsi_wwn': '23434316231663638', 'path': '/dev/sdb'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23434316231663638', 'path': '/dev/sdb'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:54:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1633576482',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1633576482',id=23,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:54:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6f2a38a5eb514ce8a7569c8322657eac',ramdisk_id='',reservation_id='r-zp4ivzie',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1634874924',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:54:20Z,user_data=None,user_id='e1176a2817ef428ea81e2fb18299a306',uuid=fa7e5468-9dd4-407d-85ec-d45ec76f9e29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "764b22e9-e899-4d39-8bc7-903ff8a7c3f6", "address": "fa:16:3e:77:63:89", "network": {"id": "fdbb2d2c-9a54-4517-b33a-cf27ce7570b1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79661471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-79661471-network", "vif_mac": "fa:16:3e:77:63:89"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2a38a5eb514ce8a7569c8322657eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap764b22e9-e8", "ovs_interfaceid": "764b22e9-e899-4d39-8bc7-903ff8a7c3f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Converting VIF {"id": "764b22e9-e899-4d39-8bc7-903ff8a7c3f6", "address": "fa:16:3e:77:63:89", "network": {"id": "fdbb2d2c-9a54-4517-b33a-cf27ce7570b1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79661471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-79661471-network", "vif_mac": "fa:16:3e:77:63:89"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2a38a5eb514ce8a7569c8322657eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap764b22e9-e8", "ovs_interfaceid": "764b22e9-e899-4d39-8bc7-903ff8a7c3f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:77:63:89,bridge_name='br-int',has_traffic_filtering=True,id=764b22e9-e899-4d39-8bc7-903ff8a7c3f6,network=Network(fdbb2d2c-9a54-4517-b33a-cf27ce7570b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap764b22e9-e8') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG nova.objects.instance [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lazy-loading 'pci_devices' on Instance uuid fa7e5468-9dd4-407d-85ec-d45ec76f9e29 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG nova.objects.base [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Object Instance<fa7e5468-9dd4-407d-85ec-d45ec76f9e29> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] End _get_guest_xml xml=<domain type="kvm">
Nov 16 03:55:56 user nova-compute[103546]:   <uuid>fa7e5468-9dd4-407d-85ec-d45ec76f9e29</uuid>
Nov 16 03:55:56 user nova-compute[103546]:   <name>instance-00000017</name>
Nov 16 03:55:56 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 03:55:56 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 03:55:56 user nova-compute[103546]:   <metadata>
Nov 16 03:55:56 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 03:55:56 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 03:55:56 user nova-compute[103546]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1633576482</nova:name>
Nov 16 03:55:56 user nova-compute[103546]:       <nova:creationTime>2023-11-16 03:55:56</nova:creationTime>
Nov 16 03:55:56 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 03:55:56 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 03:55:56 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 03:55:56 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 03:55:56 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 03:55:56 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 03:55:56 user nova-compute[103546]:       </nova:flavor>
Nov 16 03:55:56 user nova-compute[103546]:       <nova:owner>
Nov 16 03:55:56 user nova-compute[103546]:         <nova:user uuid="e1176a2817ef428ea81e2fb18299a306">tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member</nova:user>
Nov 16 03:55:56 user nova-compute[103546]:         <nova:project uuid="6f2a38a5eb514ce8a7569c8322657eac">tempest-ServerBootFromVolumeStableRescueTest-1634874924</nova:project>
Nov 16 03:55:56 user nova-compute[103546]:       </nova:owner>
Nov 16 03:55:56 user nova-compute[103546]:       <nova:root type="image" uuid="5c6f539a-01e5-4478-bf8f-a14310b5d7dd"/>
Nov 16 03:55:56 user nova-compute[103546]:       <nova:ports>
Nov 16 03:55:56 user nova-compute[103546]:         <nova:port uuid="764b22e9-e899-4d39-8bc7-903ff8a7c3f6">
Nov 16 03:55:56 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 16 03:55:56 user nova-compute[103546]:         </nova:port>
Nov 16 03:55:56 user nova-compute[103546]:       </nova:ports>
Nov 16 03:55:56 user nova-compute[103546]:     </nova:instance>
Nov 16 03:55:56 user nova-compute[103546]:   </metadata>
Nov 16 03:55:56 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 03:55:56 user nova-compute[103546]:     <system>
Nov 16 03:55:56 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 03:55:56 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 03:55:56 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 03:55:56 user nova-compute[103546]:       <entry name="serial">fa7e5468-9dd4-407d-85ec-d45ec76f9e29</entry>
Nov 16 03:55:56 user nova-compute[103546]:       <entry name="uuid">fa7e5468-9dd4-407d-85ec-d45ec76f9e29</entry>
Nov 16 03:55:56 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 03:55:56 user nova-compute[103546]:     </system>
Nov 16 03:55:56 user nova-compute[103546]:   </sysinfo>
Nov 16 03:55:56 user nova-compute[103546]:   <os>
Nov 16 03:55:56 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 03:55:56 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 03:55:56 user nova-compute[103546]:   </os>
Nov 16 03:55:56 user nova-compute[103546]:   <features>
Nov 16 03:55:56 user nova-compute[103546]:     <acpi/>
Nov 16 03:55:56 user nova-compute[103546]:     <apic/>
Nov 16 03:55:56 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 03:55:56 user nova-compute[103546]:   </features>
Nov 16 03:55:56 user nova-compute[103546]:   <clock offset="utc">
Nov 16 03:55:56 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 03:55:56 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 03:55:56 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 03:55:56 user nova-compute[103546]:   </clock>
Nov 16 03:55:56 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 03:55:56 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 03:55:56 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 03:55:56 user nova-compute[103546]:   </cpu>
Nov 16 03:55:56 user nova-compute[103546]:   <devices>
Nov 16 03:55:56 user nova-compute[103546]:     <disk type="block" device="disk">
Nov 16 03:55:56 user nova-compute[103546]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 03:55:56 user nova-compute[103546]:       <source dev="/dev/sdb"/>
Nov 16 03:55:56 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 03:55:56 user nova-compute[103546]:       <serial>13e5eaa2-fe85-49ac-bbac-868f460052c4</serial>
Nov 16 03:55:56 user nova-compute[103546]:     </disk>
Nov 16 03:55:56 user nova-compute[103546]:     <disk type="file" device="disk">
Nov 16 03:55:56 user nova-compute[103546]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 03:55:56 user nova-compute[103546]:       <source file="/opt/stack/data/nova/instances/fa7e5468-9dd4-407d-85ec-d45ec76f9e29/disk.rescue"/>
Nov 16 03:55:56 user nova-compute[103546]:       <target dev="vdb" bus="virtio"/>
Nov 16 03:55:56 user nova-compute[103546]:       <boot order="1"/>
Nov 16 03:55:56 user nova-compute[103546]:     </disk>
Nov 16 03:55:56 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 03:55:56 user nova-compute[103546]:       <mac address="fa:16:3e:77:63:89"/>
Nov 16 03:55:56 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:55:56 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 03:55:56 user nova-compute[103546]:       <target dev="tap764b22e9-e8"/>
Nov 16 03:55:56 user nova-compute[103546]:     </interface>
Nov 16 03:55:56 user nova-compute[103546]:     <serial type="pty">
Nov 16 03:55:56 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/fa7e5468-9dd4-407d-85ec-d45ec76f9e29/console.log" append="off"/>
Nov 16 03:55:56 user nova-compute[103546]:     </serial>
Nov 16 03:55:56 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 03:55:56 user nova-compute[103546]:     <video>
Nov 16 03:55:56 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:55:56 user nova-compute[103546]:     </video>
Nov 16 03:55:56 user nova-compute[103546]:     <rng model="virtio">
Nov 16 03:55:56 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 03:55:56 user nova-compute[103546]:     </rng>
Nov 16 03:55:56 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 03:55:56 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 03:55:56 user nova-compute[103546]:       <stats period="10"/>
Nov 16 03:55:56 user nova-compute[103546]:     </memballoon>
Nov 16 03:55:56 user nova-compute[103546]:   </devices>
Nov 16 03:55:56 user nova-compute[103546]: </domain>
Nov 16 03:55:56 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 03:55:56 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Instance destroyed successfully.
Nov 16 03:55:56 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] No BDM found with device name vdb, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:55:56 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] No VIF found with MAC fa:16:3e:77:63:89, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 03:55:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:55:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:00 user nova-compute[103546]: DEBUG nova.compute.manager [None req-ff5f29af-d2da-44c8-81b2-f7abdca6436d tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 03:56:00 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Acquiring lock "d2781221-b5e3-468a-a9f5-436a04285f38" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:56:00 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "d2781221-b5e3-468a-a9f5-436a04285f38" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:56:00 user nova-compute[103546]: DEBUG nova.compute.manager [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Starting instance... {{(pid=103546) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 03:56:01 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:56:01 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:56:01 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=103546) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 03:56:01 user nova-compute[103546]: INFO nova.compute.claims [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Claim successful on node user
Nov 16 03:56:01 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:56:01 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:56:01 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.432s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:56:01 user nova-compute[103546]: DEBUG nova.compute.manager [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Start building networks asynchronously for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 03:56:01 user nova-compute[103546]: DEBUG nova.compute.manager [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Allocating IP information in the background. {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 03:56:01 user nova-compute[103546]: DEBUG nova.network.neutron [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] allocate_for_instance() {{(pid=103546) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 03:56:01 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 03:56:01 user nova-compute[103546]: DEBUG nova.compute.manager [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Start building block device mappings for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 03:56:01 user nova-compute[103546]: DEBUG nova.policy [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9d186163bddc48319b97f186f7c65e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e30b7ac9515458aa8a6eb1a34cc543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103546) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 03:56:01 user nova-compute[103546]: DEBUG nova.compute.manager [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Start spawning the instance on the hypervisor. {{(pid=103546) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 03:56:01 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Creating instance directory {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 03:56:01 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Creating image(s)
Nov 16 03:56:01 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Acquiring lock "/opt/stack/data/nova/instances/d2781221-b5e3-468a-a9f5-436a04285f38/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:56:01 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "/opt/stack/data/nova/instances/d2781221-b5e3-468a-a9f5-436a04285f38/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:56:01 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "/opt/stack/data/nova/instances/d2781221-b5e3-468a-a9f5-436a04285f38/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:56:01 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:01 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.188s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:01 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Acquiring lock "8c9efafb670bfe5842ba1f4ce398924612164af7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:56:01 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:56:01 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.189s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/d2781221-b5e3-468a-a9f5-436a04285f38/disk 1073741824 {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/d2781221-b5e3-468a-a9f5-436a04285f38/disk 1073741824" returned: 0 in 0.054s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:02 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:56:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:02 user nova-compute[103546]: DEBUG nova.network.neutron [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Successfully created port: eb9c9c0a-9b82-4cdf-8500-4ee860f7af29 {{(pid=103546) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 03:56:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.203s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:02 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d2781221-b5e3-468a-a9f5-436a04285f38/disk. size=1073741824 {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 03:56:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2781221-b5e3-468a-a9f5-436a04285f38/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2781221-b5e3-468a-a9f5-436a04285f38/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:02 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Cannot resize image /opt/stack/data/nova/instances/d2781221-b5e3-468a-a9f5-436a04285f38/disk to a smaller size. {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 03:56:02 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Created local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 03:56:02 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Ensure instance console log exists: /opt/stack/data/nova/instances/d2781221-b5e3-468a-a9f5-436a04285f38/console.log {{(pid=103546) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 03:56:02 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:56:02 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:56:02 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:56:02 user nova-compute[103546]: DEBUG nova.network.neutron [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Successfully updated port: eb9c9c0a-9b82-4cdf-8500-4ee860f7af29 {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 03:56:02 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Acquiring lock "refresh_cache-d2781221-b5e3-468a-a9f5-436a04285f38" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:56:02 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Acquired lock "refresh_cache-d2781221-b5e3-468a-a9f5-436a04285f38" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:56:02 user nova-compute[103546]: DEBUG nova.network.neutron [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 03:56:02 user nova-compute[103546]: DEBUG nova.compute.manager [req-3a3bcf38-388f-42ea-bb59-e1762396b7ee req-4cd27441-d89f-45a0-b352-b2b38a51ee7c service nova] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Received event network-changed-eb9c9c0a-9b82-4cdf-8500-4ee860f7af29 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:56:02 user nova-compute[103546]: DEBUG nova.compute.manager [req-3a3bcf38-388f-42ea-bb59-e1762396b7ee req-4cd27441-d89f-45a0-b352-b2b38a51ee7c service nova] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Refreshing instance network info cache due to event network-changed-eb9c9c0a-9b82-4cdf-8500-4ee860f7af29. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:56:02 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3a3bcf38-388f-42ea-bb59-e1762396b7ee req-4cd27441-d89f-45a0-b352-b2b38a51ee7c service nova] Acquiring lock "refresh_cache-d2781221-b5e3-468a-a9f5-436a04285f38" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:56:02 user nova-compute[103546]: DEBUG nova.network.neutron [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 03:56:03 user nova-compute[103546]: DEBUG nova.compute.manager [req-a41b8167-b3ae-4023-b994-2ee3ec371b97 req-170f0772-52ab-4d3a-9126-6639f2c57af5 service nova] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Received event network-vif-plugged-764b22e9-e899-4d39-8bc7-903ff8a7c3f6 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:56:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a41b8167-b3ae-4023-b994-2ee3ec371b97 req-170f0772-52ab-4d3a-9126-6639f2c57af5 service nova] Acquiring lock "fa7e5468-9dd4-407d-85ec-d45ec76f9e29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:56:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a41b8167-b3ae-4023-b994-2ee3ec371b97 req-170f0772-52ab-4d3a-9126-6639f2c57af5 service nova] Lock "fa7e5468-9dd4-407d-85ec-d45ec76f9e29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:56:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a41b8167-b3ae-4023-b994-2ee3ec371b97 req-170f0772-52ab-4d3a-9126-6639f2c57af5 service nova] Lock "fa7e5468-9dd4-407d-85ec-d45ec76f9e29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:56:03 user nova-compute[103546]: DEBUG nova.compute.manager [req-a41b8167-b3ae-4023-b994-2ee3ec371b97 req-170f0772-52ab-4d3a-9126-6639f2c57af5 service nova] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] No waiting events found dispatching network-vif-plugged-764b22e9-e899-4d39-8bc7-903ff8a7c3f6 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:56:03 user nova-compute[103546]: WARNING nova.compute.manager [req-a41b8167-b3ae-4023-b994-2ee3ec371b97 req-170f0772-52ab-4d3a-9126-6639f2c57af5 service nova] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Received unexpected event network-vif-plugged-764b22e9-e899-4d39-8bc7-903ff8a7c3f6 for instance with vm_state rescued and task_state None.
Nov 16 03:56:03 user nova-compute[103546]: DEBUG nova.network.neutron [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Updating instance_info_cache with network_info: [{"id": "eb9c9c0a-9b82-4cdf-8500-4ee860f7af29", "address": "fa:16:3e:28:2f:a8", "network": {"id": "6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038318316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e30b7ac9515458aa8a6eb1a34cc543a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb9c9c0a-9b", "ovs_interfaceid": "eb9c9c0a-9b82-4cdf-8500-4ee860f7af29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:56:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Releasing lock "refresh_cache-d2781221-b5e3-468a-a9f5-436a04285f38" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:56:03 user nova-compute[103546]: DEBUG nova.compute.manager [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Instance network_info: |[{"id": "eb9c9c0a-9b82-4cdf-8500-4ee860f7af29", "address": "fa:16:3e:28:2f:a8", "network": {"id": "6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038318316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e30b7ac9515458aa8a6eb1a34cc543a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb9c9c0a-9b", "ovs_interfaceid": "eb9c9c0a-9b82-4cdf-8500-4ee860f7af29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 03:56:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3a3bcf38-388f-42ea-bb59-e1762396b7ee req-4cd27441-d89f-45a0-b352-b2b38a51ee7c service nova] Acquired lock "refresh_cache-d2781221-b5e3-468a-a9f5-436a04285f38" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:56:03 user nova-compute[103546]: DEBUG nova.network.neutron [req-3a3bcf38-388f-42ea-bb59-e1762396b7ee req-4cd27441-d89f-45a0-b352-b2b38a51ee7c service nova] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Refreshing network info cache for port eb9c9c0a-9b82-4cdf-8500-4ee860f7af29 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:56:03 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Start _get_guest_xml network_info=[{"id": "eb9c9c0a-9b82-4cdf-8500-4ee860f7af29", "address": "fa:16:3e:28:2f:a8", "network": {"id": "6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038318316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e30b7ac9515458aa8a6eb1a34cc543a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb9c9c0a-9b", "ovs_interfaceid": "eb9c9c0a-9b82-4cdf-8500-4ee860f7af29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '5c6f539a-01e5-4478-bf8f-a14310b5d7dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 03:56:03 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:56:03 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:56:03 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 03:56:03 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 03:56:03 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 03:56:03 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 03:56:03 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 03:56:03 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 03:56:03 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 03:56:03 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 03:56:03 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 03:56:03 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 03:56:03 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 03:56:03 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 03:56:03 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 03:56:03 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 03:56:03 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 03:56:03 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 03:56:03 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:56:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1295336225',display_name='tempest-AttachVolumeNegativeTest-server-1295336225',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1295336225',id=29,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmFqW9Ya5huTzoeMqLWjm2iOiVpkMs9WeDX03O1VPlo9epVFzumZLl0TMAcD6CuUM4LCSbHULqHqP3ONdSQ3LH/y987ruX6Ior2qKUuAU3l1rCYF025N+ZX9LsQ7uZXbA==',key_name='tempest-keypair-379855101',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8e30b7ac9515458aa8a6eb1a34cc543a',ramdisk_id='',reservation_id='r-96jdt4g0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-64216432',owner_user_name='tempest-AttachVolumeNegativeTest-64216432-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:56:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d186163bddc48319b97f186f7c65e80',uuid=d2781221-b5e3-468a-a9f5-436a04285f38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb9c9c0a-9b82-4cdf-8500-4ee860f7af29", "address": "fa:16:3e:28:2f:a8", "network": {"id": "6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038318316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e30b7ac9515458aa8a6eb1a34cc543a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb9c9c0a-9b", "ovs_interfaceid": "eb9c9c0a-9b82-4cdf-8500-4ee860f7af29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 03:56:03 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Converting VIF {"id": "eb9c9c0a-9b82-4cdf-8500-4ee860f7af29", "address": "fa:16:3e:28:2f:a8", "network": {"id": "6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038318316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e30b7ac9515458aa8a6eb1a34cc543a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb9c9c0a-9b", "ovs_interfaceid": "eb9c9c0a-9b82-4cdf-8500-4ee860f7af29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:56:03 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:2f:a8,bridge_name='br-int',has_traffic_filtering=True,id=eb9c9c0a-9b82-4cdf-8500-4ee860f7af29,network=Network(6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb9c9c0a-9b') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:56:03 user nova-compute[103546]: DEBUG nova.objects.instance [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lazy-loading 'pci_devices' on Instance uuid d2781221-b5e3-468a-a9f5-436a04285f38 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:56:03 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] End _get_guest_xml xml=<domain type="kvm">
Nov 16 03:56:03 user nova-compute[103546]:   <uuid>d2781221-b5e3-468a-a9f5-436a04285f38</uuid>
Nov 16 03:56:03 user nova-compute[103546]:   <name>instance-0000001d</name>
Nov 16 03:56:03 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 03:56:03 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 03:56:03 user nova-compute[103546]:   <metadata>
Nov 16 03:56:03 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 03:56:03 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 03:56:03 user nova-compute[103546]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1295336225</nova:name>
Nov 16 03:56:03 user nova-compute[103546]:       <nova:creationTime>2023-11-16 03:56:03</nova:creationTime>
Nov 16 03:56:03 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 03:56:03 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 03:56:03 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 03:56:03 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 03:56:03 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 03:56:03 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 03:56:03 user nova-compute[103546]:       </nova:flavor>
Nov 16 03:56:03 user nova-compute[103546]:       <nova:owner>
Nov 16 03:56:03 user nova-compute[103546]:         <nova:user uuid="9d186163bddc48319b97f186f7c65e80">tempest-AttachVolumeNegativeTest-64216432-project-member</nova:user>
Nov 16 03:56:03 user nova-compute[103546]:         <nova:project uuid="8e30b7ac9515458aa8a6eb1a34cc543a">tempest-AttachVolumeNegativeTest-64216432</nova:project>
Nov 16 03:56:03 user nova-compute[103546]:       </nova:owner>
Nov 16 03:56:03 user nova-compute[103546]:       <nova:root type="image" uuid="5c6f539a-01e5-4478-bf8f-a14310b5d7dd"/>
Nov 16 03:56:03 user nova-compute[103546]:       <nova:ports>
Nov 16 03:56:03 user nova-compute[103546]:         <nova:port uuid="eb9c9c0a-9b82-4cdf-8500-4ee860f7af29">
Nov 16 03:56:03 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 16 03:56:03 user nova-compute[103546]:         </nova:port>
Nov 16 03:56:03 user nova-compute[103546]:       </nova:ports>
Nov 16 03:56:03 user nova-compute[103546]:     </nova:instance>
Nov 16 03:56:03 user nova-compute[103546]:   </metadata>
Nov 16 03:56:03 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 03:56:03 user nova-compute[103546]:     <system>
Nov 16 03:56:03 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 03:56:03 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 03:56:03 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 03:56:03 user nova-compute[103546]:       <entry name="serial">d2781221-b5e3-468a-a9f5-436a04285f38</entry>
Nov 16 03:56:03 user nova-compute[103546]:       <entry name="uuid">d2781221-b5e3-468a-a9f5-436a04285f38</entry>
Nov 16 03:56:03 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 03:56:03 user nova-compute[103546]:     </system>
Nov 16 03:56:03 user nova-compute[103546]:   </sysinfo>
Nov 16 03:56:03 user nova-compute[103546]:   <os>
Nov 16 03:56:03 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 03:56:03 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 03:56:03 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 03:56:03 user nova-compute[103546]:   </os>
Nov 16 03:56:03 user nova-compute[103546]:   <features>
Nov 16 03:56:03 user nova-compute[103546]:     <acpi/>
Nov 16 03:56:03 user nova-compute[103546]:     <apic/>
Nov 16 03:56:03 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 03:56:03 user nova-compute[103546]:   </features>
Nov 16 03:56:03 user nova-compute[103546]:   <clock offset="utc">
Nov 16 03:56:03 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 03:56:03 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 03:56:03 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 03:56:03 user nova-compute[103546]:   </clock>
Nov 16 03:56:03 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 03:56:03 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 03:56:03 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 03:56:03 user nova-compute[103546]:   </cpu>
Nov 16 03:56:03 user nova-compute[103546]:   <devices>
Nov 16 03:56:03 user nova-compute[103546]:     <disk type="file" device="disk">
Nov 16 03:56:03 user nova-compute[103546]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 03:56:03 user nova-compute[103546]:       <source file="/opt/stack/data/nova/instances/d2781221-b5e3-468a-a9f5-436a04285f38/disk"/>
Nov 16 03:56:03 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 03:56:03 user nova-compute[103546]:     </disk>
Nov 16 03:56:03 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 03:56:03 user nova-compute[103546]:       <mac address="fa:16:3e:28:2f:a8"/>
Nov 16 03:56:03 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:56:03 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 03:56:03 user nova-compute[103546]:       <target dev="tapeb9c9c0a-9b"/>
Nov 16 03:56:03 user nova-compute[103546]:     </interface>
Nov 16 03:56:03 user nova-compute[103546]:     <serial type="pty">
Nov 16 03:56:03 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/d2781221-b5e3-468a-a9f5-436a04285f38/console.log" append="off"/>
Nov 16 03:56:03 user nova-compute[103546]:     </serial>
Nov 16 03:56:03 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 03:56:03 user nova-compute[103546]:     <video>
Nov 16 03:56:03 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:56:03 user nova-compute[103546]:     </video>
Nov 16 03:56:03 user nova-compute[103546]:     <rng model="virtio">
Nov 16 03:56:03 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 03:56:03 user nova-compute[103546]:     </rng>
Nov 16 03:56:03 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 03:56:03 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 03:56:03 user nova-compute[103546]:       <stats period="10"/>
Nov 16 03:56:03 user nova-compute[103546]:     </memballoon>
Nov 16 03:56:03 user nova-compute[103546]:   </devices>
Nov 16 03:56:03 user nova-compute[103546]: </domain>
Nov 16 03:56:03 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 03:56:03 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:56:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1295336225',display_name='tempest-AttachVolumeNegativeTest-server-1295336225',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1295336225',id=29,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmFqW9Ya5huTzoeMqLWjm2iOiVpkMs9WeDX03O1VPlo9epVFzumZLl0TMAcD6CuUM4LCSbHULqHqP3ONdSQ3LH/y987ruX6Ior2qKUuAU3l1rCYF025N+ZX9LsQ7uZXbA==',key_name='tempest-keypair-379855101',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8e30b7ac9515458aa8a6eb1a34cc543a',ramdisk_id='',reservation_id='r-96jdt4g0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-64216432',owner_user_name='tempest-AttachVolumeNegativeTest-64216432-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:56:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d186163bddc48319b97f186f7c65e80',uuid=d2781221-b5e3-468a-a9f5-436a04285f38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb9c9c0a-9b82-4cdf-8500-4ee860f7af29", "address": "fa:16:3e:28:2f:a8", "network": {"id": "6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038318316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e30b7ac9515458aa8a6eb1a34cc543a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb9c9c0a-9b", "ovs_interfaceid": "eb9c9c0a-9b82-4cdf-8500-4ee860f7af29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 03:56:03 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Converting VIF {"id": "eb9c9c0a-9b82-4cdf-8500-4ee860f7af29", "address": "fa:16:3e:28:2f:a8", "network": {"id": "6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038318316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e30b7ac9515458aa8a6eb1a34cc543a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb9c9c0a-9b", "ovs_interfaceid": "eb9c9c0a-9b82-4cdf-8500-4ee860f7af29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:56:03 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:2f:a8,bridge_name='br-int',has_traffic_filtering=True,id=eb9c9c0a-9b82-4cdf-8500-4ee860f7af29,network=Network(6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb9c9c0a-9b') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:56:03 user nova-compute[103546]: DEBUG os_vif [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:2f:a8,bridge_name='br-int',has_traffic_filtering=True,id=eb9c9c0a-9b82-4cdf-8500-4ee860f7af29,network=Network(6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb9c9c0a-9b') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 03:56:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:56:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 03:56:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'af5e584b-24cc-5d74-b14e-3074841068bd', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:56:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:56:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeb9c9c0a-9b, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:56:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeb9c9c0a-9b, col_values=(('qos', UUID('343bc408-cc2b-420e-8dfc-79c08c582c3a')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:56:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeb9c9c0a-9b, col_values=(('external_ids', {'iface-id': 'eb9c9c0a-9b82-4cdf-8500-4ee860f7af29', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:2f:a8', 'vm-uuid': 'd2781221-b5e3-468a-a9f5-436a04285f38'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:56:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:56:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:03 user nova-compute[103546]: INFO os_vif [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:2f:a8,bridge_name='br-int',has_traffic_filtering=True,id=eb9c9c0a-9b82-4cdf-8500-4ee860f7af29,network=Network(6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb9c9c0a-9b')
Nov 16 03:56:03 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:56:03 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] No VIF found with MAC fa:16:3e:28:2f:a8, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 03:56:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:03 user nova-compute[103546]: DEBUG nova.network.neutron [req-3a3bcf38-388f-42ea-bb59-e1762396b7ee req-4cd27441-d89f-45a0-b352-b2b38a51ee7c service nova] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Updated VIF entry in instance network info cache for port eb9c9c0a-9b82-4cdf-8500-4ee860f7af29. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 03:56:03 user nova-compute[103546]: DEBUG nova.network.neutron [req-3a3bcf38-388f-42ea-bb59-e1762396b7ee req-4cd27441-d89f-45a0-b352-b2b38a51ee7c service nova] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Updating instance_info_cache with network_info: [{"id": "eb9c9c0a-9b82-4cdf-8500-4ee860f7af29", "address": "fa:16:3e:28:2f:a8", "network": {"id": "6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038318316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e30b7ac9515458aa8a6eb1a34cc543a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb9c9c0a-9b", "ovs_interfaceid": "eb9c9c0a-9b82-4cdf-8500-4ee860f7af29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:56:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3a3bcf38-388f-42ea-bb59-e1762396b7ee req-4cd27441-d89f-45a0-b352-b2b38a51ee7c service nova] Releasing lock "refresh_cache-d2781221-b5e3-468a-a9f5-436a04285f38" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:56:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:05 user nova-compute[103546]: DEBUG nova.compute.manager [req-cd152167-8f21-4707-8f2a-b293268726f6 req-c49dafd3-fd95-4aa0-9e77-fe4d1c6c237b service nova] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Received event network-vif-plugged-eb9c9c0a-9b82-4cdf-8500-4ee860f7af29 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:56:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-cd152167-8f21-4707-8f2a-b293268726f6 req-c49dafd3-fd95-4aa0-9e77-fe4d1c6c237b service nova] Acquiring lock "d2781221-b5e3-468a-a9f5-436a04285f38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:56:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-cd152167-8f21-4707-8f2a-b293268726f6 req-c49dafd3-fd95-4aa0-9e77-fe4d1c6c237b service nova] Lock "d2781221-b5e3-468a-a9f5-436a04285f38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:56:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-cd152167-8f21-4707-8f2a-b293268726f6 req-c49dafd3-fd95-4aa0-9e77-fe4d1c6c237b service nova] Lock "d2781221-b5e3-468a-a9f5-436a04285f38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:56:05 user nova-compute[103546]: DEBUG nova.compute.manager [req-cd152167-8f21-4707-8f2a-b293268726f6 req-c49dafd3-fd95-4aa0-9e77-fe4d1c6c237b service nova] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] No waiting events found dispatching network-vif-plugged-eb9c9c0a-9b82-4cdf-8500-4ee860f7af29 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:56:05 user nova-compute[103546]: WARNING nova.compute.manager [req-cd152167-8f21-4707-8f2a-b293268726f6 req-c49dafd3-fd95-4aa0-9e77-fe4d1c6c237b service nova] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Received unexpected event network-vif-plugged-eb9c9c0a-9b82-4cdf-8500-4ee860f7af29 for instance with vm_state building and task_state spawning.
Nov 16 03:56:05 user nova-compute[103546]: DEBUG nova.compute.manager [req-d7261e66-609c-4a86-b24d-9db7abf0ebac req-40f55be2-208a-4f24-9728-fb08977ed3ed service nova] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Received event network-vif-plugged-764b22e9-e899-4d39-8bc7-903ff8a7c3f6 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:56:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d7261e66-609c-4a86-b24d-9db7abf0ebac req-40f55be2-208a-4f24-9728-fb08977ed3ed service nova] Acquiring lock "fa7e5468-9dd4-407d-85ec-d45ec76f9e29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:56:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d7261e66-609c-4a86-b24d-9db7abf0ebac req-40f55be2-208a-4f24-9728-fb08977ed3ed service nova] Lock "fa7e5468-9dd4-407d-85ec-d45ec76f9e29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:56:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d7261e66-609c-4a86-b24d-9db7abf0ebac req-40f55be2-208a-4f24-9728-fb08977ed3ed service nova] Lock "fa7e5468-9dd4-407d-85ec-d45ec76f9e29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:56:05 user nova-compute[103546]: DEBUG nova.compute.manager [req-d7261e66-609c-4a86-b24d-9db7abf0ebac req-40f55be2-208a-4f24-9728-fb08977ed3ed service nova] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] No waiting events found dispatching network-vif-plugged-764b22e9-e899-4d39-8bc7-903ff8a7c3f6 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:56:05 user nova-compute[103546]: WARNING nova.compute.manager [req-d7261e66-609c-4a86-b24d-9db7abf0ebac req-40f55be2-208a-4f24-9728-fb08977ed3ed service nova] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Received unexpected event network-vif-plugged-764b22e9-e899-4d39-8bc7-903ff8a7c3f6 for instance with vm_state rescued and task_state None.
Nov 16 03:56:05 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:05 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:05 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:05 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:06 user nova-compute[103546]: DEBUG nova.compute.manager [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 03:56:06 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Guest created on hypervisor {{(pid=103546) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 03:56:06 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Instance spawned successfully.
Nov 16 03:56:06 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 03:56:06 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Found default for hw_cdrom_bus of ide {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:56:06 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Found default for hw_disk_bus of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:56:06 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Found default for hw_input_bus of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:56:06 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Found default for hw_pointer_model of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:56:06 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Found default for hw_video_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:56:06 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Found default for hw_vif_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:56:07 user nova-compute[103546]: INFO nova.compute.manager [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Took 5.30 seconds to spawn the instance on the hypervisor.
Nov 16 03:56:07 user nova-compute[103546]: DEBUG nova.compute.manager [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 03:56:07 user nova-compute[103546]: DEBUG nova.compute.manager [req-efac0432-bd3b-4fc4-be87-de6212156bc0 req-d3499253-e72b-4bf0-b3e3-e7795d215a9c service nova] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Received event network-vif-plugged-eb9c9c0a-9b82-4cdf-8500-4ee860f7af29 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:56:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-efac0432-bd3b-4fc4-be87-de6212156bc0 req-d3499253-e72b-4bf0-b3e3-e7795d215a9c service nova] Acquiring lock "d2781221-b5e3-468a-a9f5-436a04285f38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:56:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-efac0432-bd3b-4fc4-be87-de6212156bc0 req-d3499253-e72b-4bf0-b3e3-e7795d215a9c service nova] Lock "d2781221-b5e3-468a-a9f5-436a04285f38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:56:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-efac0432-bd3b-4fc4-be87-de6212156bc0 req-d3499253-e72b-4bf0-b3e3-e7795d215a9c service nova] Lock "d2781221-b5e3-468a-a9f5-436a04285f38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:56:07 user nova-compute[103546]: DEBUG nova.compute.manager [req-efac0432-bd3b-4fc4-be87-de6212156bc0 req-d3499253-e72b-4bf0-b3e3-e7795d215a9c service nova] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] No waiting events found dispatching network-vif-plugged-eb9c9c0a-9b82-4cdf-8500-4ee860f7af29 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:56:07 user nova-compute[103546]: WARNING nova.compute.manager [req-efac0432-bd3b-4fc4-be87-de6212156bc0 req-d3499253-e72b-4bf0-b3e3-e7795d215a9c service nova] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Received unexpected event network-vif-plugged-eb9c9c0a-9b82-4cdf-8500-4ee860f7af29 for instance with vm_state building and task_state spawning.
Nov 16 03:56:07 user nova-compute[103546]: INFO nova.compute.manager [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Took 6.11 seconds to build instance.
Nov 16 03:56:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-6440182c-4184-452e-81e9-25c9badd0ac9 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "d2781221-b5e3-468a-a9f5-436a04285f38" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.200s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:56:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:09 user nova-compute[103546]: DEBUG nova.compute.manager [req-ad11278f-f966-457f-b863-a429c3bf5bf1 req-acb5375d-6563-475a-b0e0-7bc9a2b7147c service nova] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Received event network-changed-7471b1be-a897-4ef9-8dbe-8c6962cfbd31 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:56:09 user nova-compute[103546]: DEBUG nova.compute.manager [req-ad11278f-f966-457f-b863-a429c3bf5bf1 req-acb5375d-6563-475a-b0e0-7bc9a2b7147c service nova] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Refreshing instance network info cache due to event network-changed-7471b1be-a897-4ef9-8dbe-8c6962cfbd31. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:56:09 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ad11278f-f966-457f-b863-a429c3bf5bf1 req-acb5375d-6563-475a-b0e0-7bc9a2b7147c service nova] Acquiring lock "refresh_cache-f4065a1b-10a0-4b2a-9088-a703a7c4e064" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:56:09 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ad11278f-f966-457f-b863-a429c3bf5bf1 req-acb5375d-6563-475a-b0e0-7bc9a2b7147c service nova] Acquired lock "refresh_cache-f4065a1b-10a0-4b2a-9088-a703a7c4e064" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:56:09 user nova-compute[103546]: DEBUG nova.network.neutron [req-ad11278f-f966-457f-b863-a429c3bf5bf1 req-acb5375d-6563-475a-b0e0-7bc9a2b7147c service nova] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Refreshing network info cache for port 7471b1be-a897-4ef9-8dbe-8c6962cfbd31 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:56:09 user nova-compute[103546]: DEBUG nova.network.neutron [req-ad11278f-f966-457f-b863-a429c3bf5bf1 req-acb5375d-6563-475a-b0e0-7bc9a2b7147c service nova] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Updated VIF entry in instance network info cache for port 7471b1be-a897-4ef9-8dbe-8c6962cfbd31. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 03:56:09 user nova-compute[103546]: DEBUG nova.network.neutron [req-ad11278f-f966-457f-b863-a429c3bf5bf1 req-acb5375d-6563-475a-b0e0-7bc9a2b7147c service nova] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Updating instance_info_cache with network_info: [{"id": "7471b1be-a897-4ef9-8dbe-8c6962cfbd31", "address": "fa:16:3e:64:f3:d9", "network": {"id": "29e9620f-313d-4679-89d7-459e7cf75b38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1690634205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72b30a015db444798ee72ff6fd14c69e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7471b1be-a8", "ovs_interfaceid": "7471b1be-a897-4ef9-8dbe-8c6962cfbd31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:56:09 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ad11278f-f966-457f-b863-a429c3bf5bf1 req-acb5375d-6563-475a-b0e0-7bc9a2b7147c service nova] Releasing lock "refresh_cache-f4065a1b-10a0-4b2a-9088-a703a7c4e064" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:56:09 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f9be5989-f15f-44c0-88ba-83d7fdd2f58d tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Acquiring lock "f4065a1b-10a0-4b2a-9088-a703a7c4e064" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:56:09 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f9be5989-f15f-44c0-88ba-83d7fdd2f58d tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "f4065a1b-10a0-4b2a-9088-a703a7c4e064" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:56:09 user nova-compute[103546]: DEBUG nova.objects.instance [None req-f9be5989-f15f-44c0-88ba-83d7fdd2f58d tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lazy-loading 'flavor' on Instance uuid f4065a1b-10a0-4b2a-9088-a703a7c4e064 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:56:09 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f9be5989-f15f-44c0-88ba-83d7fdd2f58d tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "f4065a1b-10a0-4b2a-9088-a703a7c4e064" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.135s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:56:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f9be5989-f15f-44c0-88ba-83d7fdd2f58d tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Acquiring lock "f4065a1b-10a0-4b2a-9088-a703a7c4e064" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:56:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f9be5989-f15f-44c0-88ba-83d7fdd2f58d tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "f4065a1b-10a0-4b2a-9088-a703a7c4e064" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:56:10 user nova-compute[103546]: INFO nova.compute.manager [None req-f9be5989-f15f-44c0-88ba-83d7fdd2f58d tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Attaching volume 80738ad2-a7e0-4996-bda9-07784deca229 to /dev/vdb
Nov 16 03:56:10 user nova-compute[103546]: DEBUG os_brick.utils [None req-f9be5989-f15f-44c0-88ba-83d7fdd2f58d tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:56:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:10 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1bd7677-1324-498c-afb9-45040761f219]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af5c39b14ece\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:10 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[34cbab9b-80ab-4977-b6d6-611fbb0d4d10]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:10 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb5830f-cba7-44cb-ab3f-2a41c10c3892]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:10 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c7c9167-66e0-4200-89e2-a566b373c81b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-f9be5989-f15f-44c0-88ba-83d7fdd2f58d tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Running cmd (subprocess): nvme version {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-f9be5989-f15f-44c0-88ba-83d7fdd2f58d tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] 'nvme version' failed. Not Retrying. {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:56:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f9be5989-f15f-44c0-88ba-83d7fdd2f58d tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] nvme not present on system {{(pid=103546) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 03:56:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:56:10 user nova-compute[103546]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 03:56:10 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[68eee109-5b5a-4904-99e3-778ad43aab5b]: (4, '') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-f9be5989-f15f-44c0-88ba-83d7fdd2f58d tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=103546) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 03:56:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-f9be5989-f15f-44c0-88ba-83d7fdd2f58d tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 03:56:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-f9be5989-f15f-44c0-88ba-83d7fdd2f58d tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] LIGHTOS: no hostnqn found. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 03:56:10 user nova-compute[103546]: DEBUG os_brick.utils [None req-f9be5989-f15f-44c0-88ba-83d7fdd2f58d tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af5c39b14ece', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:56:10 user nova-compute[103546]: DEBUG nova.virt.block_device [None req-f9be5989-f15f-44c0-88ba-83d7fdd2f58d tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Updating existing volume attachment record: 886b8eda-500e-41da-97d6-bf5f11fbe99c {{(pid=103546) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 03:56:13 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-d0d6e065-86f6-4995-a6fc-a3502ffb73c6 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 164533fb-64e1-4aa5-b5fb-273817dd3e74 is timed out.
Nov 16 03:56:13 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-d0d6e065-86f6-4995-a6fc-a3502ffb73c6 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Successfully detached device vdb from instance 164533fb-64e1-4aa5-b5fb-273817dd3e74 from the live domain config.
Nov 16 03:56:13 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0d6e065-86f6-4995-a6fc-a3502ffb73c6 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 03:56:13 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d6e065-86f6-4995-a6fc-a3502ffb73c6 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JEuWNUio', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:56:13 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-d0d6e065-86f6-4995-a6fc-a3502ffb73c6 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:56:13 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-d0d6e065-86f6-4995-a6fc-a3502ffb73c6 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:56:13 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-d0d6e065-86f6-4995-a6fc-a3502ffb73c6 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:56:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:13 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[23388094-0295-4c77-9abf-fe6d9d5486d2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:13 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d6e065-86f6-4995-a6fc-a3502ffb73c6 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 03:56:13 user nova-compute[103546]: No targets found.
Nov 16 03:56:13 user nova-compute[103546]: iSNS:
Nov 16 03:56:13 user nova-compute[103546]: No targets found.
Nov 16 03:56:13 user nova-compute[103546]: STATIC:
Nov 16 03:56:13 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55
Nov 16 03:56:13 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:56:13 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:56:13 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4
Nov 16 03:56:13 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:56:13 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:56:13 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc
Nov 16 03:56:13 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:56:13 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:56:13 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925
Nov 16 03:56:13 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:56:13 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:56:13 user nova-compute[103546]: FIRMWARE:
Nov 16 03:56:13 user nova-compute[103546]: No targets found.
Nov 16 03:56:13 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:56:13 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d6e065-86f6-4995-a6fc-a3502ffb73c6 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 03:56:13 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 03:56:13 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 03:56:13 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d6e065-86f6-4995-a6fc-a3502ffb73c6 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 03:56:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:13 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac360a1-b214-4e04-9c82-96e45b65c69f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:13 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6514046-5e73-4987-b28a-5973799538d7]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:13 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d6e065-86f6-4995-a6fc-a3502ffb73c6 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:56:13 user nova-compute[103546]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc (non-flash)
Nov 16 03:56:13 user nova-compute[103546]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)
Nov 16 03:56:13 user nova-compute[103546]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55 (non-flash)
Nov 16 03:56:13 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:56:13 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d6e065-86f6-4995-a6fc-a3502ffb73c6 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:56:13 user nova-compute[103546]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc (non-flash)
Nov 16 03:56:13 user nova-compute[103546]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)
Nov 16 03:56:13 user nova-compute[103546]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55 (non-flash)
Nov 16 03:56:13 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:56:13 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d6e065-86f6-4995-a6fc-a3502ffb73c6 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60c4116b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55'): ({'sde'}, set())}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 03:56:13 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-d0d6e065-86f6-4995-a6fc-a3502ffb73c6 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Removing single pathed devices sde {{(pid=103546) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 03:56:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:13 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d98572-419f-4b8b-b468-90f817468c98]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:13 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[55101f66-46bc-4e07-a203-6e82e8deb1ef]: (4, ('ok\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:13 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-d0d6e065-86f6-4995-a6fc-a3502ffb73c6 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Flushing IO for device /dev/sde {{(pid=103546) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 03:56:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:13 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a744eb-b864-4c5a-9038-2869caa2cf41]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:13 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-d0d6e065-86f6-4995-a6fc-a3502ffb73c6 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=103546) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 03:56:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.054s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:13 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdfe9015-8c81-446b-832c-7bbbea43656a]: (4, ('1', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:13 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-d0d6e065-86f6-4995-a6fc-a3502ffb73c6 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 03:56:13 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-d0d6e065-86f6-4995-a6fc-a3502ffb73c6 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] SCSI volumes sde have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 03:56:13 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d6e065-86f6-4995-a6fc-a3502ffb73c6 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55')] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 03:56:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:13 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[6303c772-f7e4-4874-9dfe-2f9705afc3a5]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:13 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d6e065-86f6-4995-a6fc-a3502ffb73c6 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:56:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55 -p 172.16.0.220:3260 --logout {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:13 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3be3ca6-7be8-41a6-8437-99fd6616501a]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:13 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d6e065-86f6-4995-a6fc-a3502ffb73c6 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55, portal: 172.16.0.220,3260]
Nov 16 03:56:13 user nova-compute[103546]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55, portal: 172.16.0.220,3260] successful.
Nov 16 03:56:13 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:56:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55 -p 172.16.0.220:3260 --op delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f25e1a13-9b02-47dc-8610-7676f6e22a55 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:13 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[62fdb83f-c11a-4183-8a78-1c5aff648648]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:13 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d6e065-86f6-4995-a6fc-a3502ffb73c6 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:56:13 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-d0d6e065-86f6-4995-a6fc-a3502ffb73c6 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:56:13 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d6e065-86f6-4995-a6fc-a3502ffb73c6 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] <== disconnect_volume: return (346ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:56:13 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0d6e065-86f6-4995-a6fc-a3502ffb73c6 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 03:56:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:13 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager.update_available_resource {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:56:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:56:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:56:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:56:13 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Auditing locally available compute resources for user (node: user) {{(pid=103546) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 03:56:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/164533fb-64e1-4aa5-b5fb-273817dd3e74/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:14 user nova-compute[103546]: DEBUG nova.objects.instance [None req-d0d6e065-86f6-4995-a6fc-a3502ffb73c6 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Lazy-loading 'flavor' on Instance uuid 164533fb-64e1-4aa5-b5fb-273817dd3e74 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:56:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d0d6e065-86f6-4995-a6fc-a3502ffb73c6 tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Lock "164533fb-64e1-4aa5-b5fb-273817dd3e74" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.746s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:56:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/164533fb-64e1-4aa5-b5fb-273817dd3e74/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/164533fb-64e1-4aa5-b5fb-273817dd3e74/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:14 user nova-compute[103546]: DEBUG nova.compute.manager [req-ee33299f-e0c3-494c-89b0-83d5756556b6 req-219bdf86-4f16-4831-b4eb-cdc157b89500 service nova] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Received event network-changed-49c54f9c-e72e-4cdf-96d3-7c31d8ed5109 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:56:14 user nova-compute[103546]: DEBUG nova.compute.manager [req-ee33299f-e0c3-494c-89b0-83d5756556b6 req-219bdf86-4f16-4831-b4eb-cdc157b89500 service nova] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Refreshing instance network info cache due to event network-changed-49c54f9c-e72e-4cdf-96d3-7c31d8ed5109. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:56:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ee33299f-e0c3-494c-89b0-83d5756556b6 req-219bdf86-4f16-4831-b4eb-cdc157b89500 service nova] Acquiring lock "refresh_cache-2ab80244-d70d-41ce-9b7e-bb9c8a676ad6" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:56:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ee33299f-e0c3-494c-89b0-83d5756556b6 req-219bdf86-4f16-4831-b4eb-cdc157b89500 service nova] Acquired lock "refresh_cache-2ab80244-d70d-41ce-9b7e-bb9c8a676ad6" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:56:14 user nova-compute[103546]: DEBUG nova.network.neutron [req-ee33299f-e0c3-494c-89b0-83d5756556b6 req-219bdf86-4f16-4831-b4eb-cdc157b89500 service nova] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Refreshing network info cache for port 49c54f9c-e72e-4cdf-96d3-7c31d8ed5109 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:56:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/164533fb-64e1-4aa5-b5fb-273817dd3e74/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:14 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 03:56:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG nova.network.neutron [req-ee33299f-e0c3-494c-89b0-83d5756556b6 req-219bdf86-4f16-4831-b4eb-cdc157b89500 service nova] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Updated VIF entry in instance network info cache for port 49c54f9c-e72e-4cdf-96d3-7c31d8ed5109. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG nova.network.neutron [req-ee33299f-e0c3-494c-89b0-83d5756556b6 req-219bdf86-4f16-4831-b4eb-cdc157b89500 service nova] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Updating instance_info_cache with network_info: [{"id": "49c54f9c-e72e-4cdf-96d3-7c31d8ed5109", "address": "fa:16:3e:5a:f3:7f", "network": {"id": "ad0d15aa-3eb9-452a-8c1e-f98a235beb89", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-981191229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "957a9e268fe7460c97fce1e634015214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49c54f9c-e7", "ovs_interfaceid": "49c54f9c-e72e-4cdf-96d3-7c31d8ed5109", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4065a1b-10a0-4b2a-9088-a703a7c4e064/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ee33299f-e0c3-494c-89b0-83d5756556b6 req-219bdf86-4f16-4831-b4eb-cdc157b89500 service nova] Releasing lock "refresh_cache-2ab80244-d70d-41ce-9b7e-bb9c8a676ad6" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4065a1b-10a0-4b2a-9088-a703a7c4e064/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4065a1b-10a0-4b2a-9088-a703a7c4e064/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9be5989-f15f-44c0-88ba-83d7fdd2f58d tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9be5989-f15f-44c0-88ba-83d7fdd2f58d tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GxzRICWM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:56:15 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-f9be5989-f15f-44c0-88ba-83d7fdd2f58d tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:56:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-f9be5989-f15f-44c0-88ba-83d7fdd2f58d tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-f9be5989-f15f-44c0-88ba-83d7fdd2f58d tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:56:15 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-f9be5989-f15f-44c0-88ba-83d7fdd2f58d tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:56:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-f9be5989-f15f-44c0-88ba-83d7fdd2f58d tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-f9be5989-f15f-44c0-88ba-83d7fdd2f58d tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:56:15 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-f9be5989-f15f-44c0-88ba-83d7fdd2f58d tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 03:56:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[22764842-8917-4bab-b3da-1fb0e314a271]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9be5989-f15f-44c0-88ba-83d7fdd2f58d tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 03:56:15 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 -p 172.16.0.220:3260 --interface default --op new {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[187b26f5-4ca4-4d74-af1f-06d2d2b81f22]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229] added\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9be5989-f15f-44c0-88ba-83d7fdd2f58d tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229] added
Nov 16 03:56:15 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:15 user nova-compute[103546]: INFO nova.compute.manager [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Rebuilding instance
Nov 16 03:56:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[114fdf60-ab6b-44d1-9d9f-b7a3742da3a7]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9be5989-f15f-44c0-88ba-83d7fdd2f58d tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e314c32-e927-4a93-b5b7-d24395731c74]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9be5989-f15f-44c0-88ba-83d7fdd2f58d tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4065a1b-10a0-4b2a-9088-a703a7c4e064/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GxzRICWM {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2781221-b5e3-468a-a9f5-436a04285f38/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG nova.compute.manager [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GxzRICWM" returned: 0 in 0.027s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3caa126f-9092-486c-9421-a78a58b58b9d]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9be5989-f15f-44c0-88ba-83d7fdd2f58d tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GxzRICWM'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[7482d45d-42bd-4685-a7b2-a29507b10e3c]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9be5989-f15f-44c0-88ba-83d7fdd2f58d tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b0bc88-22bc-4b92-a6a1-f4b0bdb3d96b]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9be5989-f15f-44c0-88ba-83d7fdd2f58d tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:56:15 user nova-compute[103546]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc (non-flash)
Nov 16 03:56:15 user nova-compute[103546]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)
Nov 16 03:56:15 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9be5989-f15f-44c0-88ba-83d7fdd2f58d tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:56:15 user nova-compute[103546]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc (non-flash)
Nov 16 03:56:15 user nova-compute[103546]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)
Nov 16 03:56:15 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 -p 172.16.0.220:3260 --login {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2781221-b5e3-468a-a9f5-436a04285f38/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2781221-b5e3-468a-a9f5-436a04285f38/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[88aa26c2-9d9f-4f41-97e4-107887ef0a5a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9be5989-f15f-44c0-88ba-83d7fdd2f58d tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229, portal: 172.16.0.220,3260]
Nov 16 03:56:15 user nova-compute[103546]: Login to [iface: default, target: iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229, portal: 172.16.0.220,3260] successful.
Nov 16 03:56:15 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[493fe137-89fa-41f4-83f5-2a7cf9bb0bde]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9be5989-f15f-44c0-88ba-83d7fdd2f58d tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20f2aa6-3259-4a56-8aaa-9f435fcfbdbc]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9be5989-f15f-44c0-88ba-83d7fdd2f58d tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:56:15 user nova-compute[103546]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc (non-flash)
Nov 16 03:56:15 user nova-compute[103546]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)
Nov 16 03:56:15 user nova-compute[103546]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 (non-flash)
Nov 16 03:56:15 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9be5989-f15f-44c0-88ba-83d7fdd2f58d tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:56:15 user nova-compute[103546]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc (non-flash)
Nov 16 03:56:15 user nova-compute[103546]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)
Nov 16 03:56:15 user nova-compute[103546]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 (non-flash)
Nov 16 03:56:15 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-f9be5989-f15f-44c0-88ba-83d7fdd2f58d tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.429s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9be5989-f15f-44c0-88ba-83d7fdd2f58d tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-f9be5989-f15f-44c0-88ba-83d7fdd2f58d tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] HCTL ('36', '-', '-', 0) found on session 30 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 03:56:15 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-f9be5989-f15f-44c0-88ba-83d7fdd2f58d tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 03:56:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.024s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:16 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d1536d-81ff-486a-aab1-fa560a16d5d3]: (4, ('- - 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:16 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-f9be5989-f15f-44c0-88ba-83d7fdd2f58d tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: sde {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 03:56:16 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9be5989-f15f-44c0-88ba-83d7fdd2f58d tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GxzRICWM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 03:56:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2781221-b5e3-468a-a9f5-436a04285f38/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:16 user nova-compute[103546]: DEBUG nova.compute.manager [req-bd595063-f5a6-42f0-9bbf-de65c5eebe76 req-e20ea104-0f04-4d4f-94c3-b05ace797801 service nova] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Received event network-vif-unplugged-49c54f9c-e72e-4cdf-96d3-7c31d8ed5109 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:56:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-bd595063-f5a6-42f0-9bbf-de65c5eebe76 req-e20ea104-0f04-4d4f-94c3-b05ace797801 service nova] Acquiring lock "2ab80244-d70d-41ce-9b7e-bb9c8a676ad6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:56:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-bd595063-f5a6-42f0-9bbf-de65c5eebe76 req-e20ea104-0f04-4d4f-94c3-b05ace797801 service nova] Lock "2ab80244-d70d-41ce-9b7e-bb9c8a676ad6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:56:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-bd595063-f5a6-42f0-9bbf-de65c5eebe76 req-e20ea104-0f04-4d4f-94c3-b05ace797801 service nova] Lock "2ab80244-d70d-41ce-9b7e-bb9c8a676ad6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:56:16 user nova-compute[103546]: DEBUG nova.compute.manager [req-bd595063-f5a6-42f0-9bbf-de65c5eebe76 req-e20ea104-0f04-4d4f-94c3-b05ace797801 service nova] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] No waiting events found dispatching network-vif-unplugged-49c54f9c-e72e-4cdf-96d3-7c31d8ed5109 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:56:16 user nova-compute[103546]: WARNING nova.compute.manager [req-bd595063-f5a6-42f0-9bbf-de65c5eebe76 req-e20ea104-0f04-4d4f-94c3-b05ace797801 service nova] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Received unexpected event network-vif-unplugged-49c54f9c-e72e-4cdf-96d3-7c31d8ed5109 for instance with vm_state active and task_state rebuilding.
Nov 16 03:56:16 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 03:56:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:16 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Instance destroyed successfully.
Nov 16 03:56:16 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Instance destroyed successfully.
Nov 16 03:56:16 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:54:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-209964559',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-141615707',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1Y2L2l3MWVbNwdnSdeRUxJz0N8le0D37MGjqwWaMwxA7R3Wdx+y5O8T7rTKllDINxi17uE0eTWUeh3EwdhWWGhIv3K2uMZjagCC2gLDhzEp415K3OXZdfZ5QqNTz5yjQ==',key_name='tempest-keypair-336828995',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:54:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='957a9e268fe7460c97fce1e634015214',ramdisk_id='',reservation_id='r-f4s0l7jd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-787129566',owner_user_name='tempest-ServerActionsV293TestJSON-787129566-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:56:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fff2b2e712c1466991b73ead603bcf8f',uuid=2ab80244-d70d-41ce-9b7e-bb9c8a676ad6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "49c54f9c-e72e-4cdf-96d3-7c31d8ed5109", "address": "fa:16:3e:5a:f3:7f", "network": {"id": "ad0d15aa-3eb9-452a-8c1e-f98a235beb89", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-981191229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "957a9e268fe7460c97fce1e634015214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49c54f9c-e7", "ovs_interfaceid": "49c54f9c-e72e-4cdf-96d3-7c31d8ed5109", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 03:56:16 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Converting VIF {"id": "49c54f9c-e72e-4cdf-96d3-7c31d8ed5109", "address": "fa:16:3e:5a:f3:7f", "network": {"id": "ad0d15aa-3eb9-452a-8c1e-f98a235beb89", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-981191229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "957a9e268fe7460c97fce1e634015214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49c54f9c-e7", "ovs_interfaceid": "49c54f9c-e72e-4cdf-96d3-7c31d8ed5109", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:56:16 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5a:f3:7f,bridge_name='br-int',has_traffic_filtering=True,id=49c54f9c-e72e-4cdf-96d3-7c31d8ed5109,network=Network(ad0d15aa-3eb9-452a-8c1e-f98a235beb89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49c54f9c-e7') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:56:16 user nova-compute[103546]: DEBUG os_vif [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:f3:7f,bridge_name='br-int',has_traffic_filtering=True,id=49c54f9c-e72e-4cdf-96d3-7c31d8ed5109,network=Network(ad0d15aa-3eb9-452a-8c1e-f98a235beb89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49c54f9c-e7') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 03:56:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap49c54f9c-e7, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:56:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:56:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8b86181c-3231-4894-bf7a-73bf158144d1) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:56:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:16 user nova-compute[103546]: INFO os_vif [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:f3:7f,bridge_name='br-int',has_traffic_filtering=True,id=49c54f9c-e72e-4cdf-96d3-7c31d8ed5109,network=Network(ad0d15aa-3eb9-452a-8c1e-f98a235beb89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49c54f9c-e7')
Nov 16 03:56:16 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 03:56:16 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IwNpXAPB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:56:16 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 03:56:16 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:56:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:17 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-f9be5989-f15f-44c0-88ba-83d7fdd2f58d tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.475s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:56:17 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9be5989-f15f-44c0-88ba-83d7fdd2f58d tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] <== connect_volume: return (1478ms) {'type': 'block', 'scsi_wwn': '23233346161316231', 'path': '/dev/sde'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:56:17 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9be5989-f15f-44c0-88ba-83d7fdd2f58d tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233346161316231', 'path': '/dev/sde'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 03:56:17 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.381s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:56:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:17 user nova-compute[103546]: DEBUG nova.objects.instance [None req-f9be5989-f15f-44c0-88ba-83d7fdd2f58d tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lazy-loading 'flavor' on Instance uuid f4065a1b-10a0-4b2a-9088-a703a7c4e064 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:56:17 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 03:56:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa7e5468-9dd4-407d-85ec-d45ec76f9e29/disk.rescue --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:17 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b991dc-e41a-46ac-b97e-51a0bec49f05]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:17 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 03:56:17 user nova-compute[103546]: No targets found.
Nov 16 03:56:17 user nova-compute[103546]: iSNS:
Nov 16 03:56:17 user nova-compute[103546]: No targets found.
Nov 16 03:56:17 user nova-compute[103546]: STATIC:
Nov 16 03:56:17 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229
Nov 16 03:56:17 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:56:17 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:56:17 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4
Nov 16 03:56:17 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:56:17 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:56:17 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc
Nov 16 03:56:17 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:56:17 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:56:17 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925
Nov 16 03:56:17 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:56:17 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:56:17 user nova-compute[103546]: FIRMWARE:
Nov 16 03:56:17 user nova-compute[103546]: No targets found.
Nov 16 03:56:17 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:56:17 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 03:56:17 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 03:56:17 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 03:56:17 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 03:56:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:17 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-f9be5989-f15f-44c0-88ba-83d7fdd2f58d tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 03:56:17 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 03:56:17 user nova-compute[103546]:   <source dev="/dev/sde"/>
Nov 16 03:56:17 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 03:56:17 user nova-compute[103546]:   <serial>80738ad2-a7e0-4996-bda9-07784deca229</serial>
Nov 16 03:56:17 user nova-compute[103546]: </disk>
Nov 16 03:56:17 user nova-compute[103546]:  {{(pid=103546) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 03:56:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:17 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3251e73c-b0ac-4eb8-bc54-ef408433ce58]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:17 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[123fcca8-6741-4bb5-8eb8-9f05224a122a]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:17 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:56:17 user nova-compute[103546]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc (non-flash)
Nov 16 03:56:17 user nova-compute[103546]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)
Nov 16 03:56:17 user nova-compute[103546]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 (non-flash)
Nov 16 03:56:17 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:56:17 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:56:17 user nova-compute[103546]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc (non-flash)
Nov 16 03:56:17 user nova-compute[103546]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)
Nov 16 03:56:17 user nova-compute[103546]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 (non-flash)
Nov 16 03:56:17 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:56:17 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60ac3a9240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc'): ({'sdc'}, set())}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 03:56:17 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Removing single pathed devices sdc {{(pid=103546) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 03:56:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:17 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bcc67fe-4add-46fd-aceb-894cf00f8db1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:17 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89c4813-8f25-463b-a127-73e85e3192e8]: (4, ('ok\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:17 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Flushing IO for device /dev/sdc {{(pid=103546) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 03:56:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:17 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[143299ce-00d8-4276-9f15-f5904ab4ffb5]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:17 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=103546) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 03:56:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa7e5468-9dd4-407d-85ec-d45ec76f9e29/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa7e5468-9dd4-407d-85ec-d45ec76f9e29/disk.rescue --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.034s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:17 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3b604f-ba7f-4aea-9a23-90048751deff]: (4, ('1', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:17 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 03:56:17 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] SCSI volumes sdc have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 03:56:17 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc')] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 03:56:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:17 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[60812e42-a1a4-48af-964f-f9bb2f126c01]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:17 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:56:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc -p 172.16.0.220:3260 --logout {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:17 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a3d190-f633-47ca-8f92-318c29e658f4]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:17 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc, portal: 172.16.0.220,3260]
Nov 16 03:56:17 user nova-compute[103546]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc, portal: 172.16.0.220,3260] successful.
Nov 16 03:56:17 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:56:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc -p 172.16.0.220:3260 --op delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa7e5468-9dd4-407d-85ec-d45ec76f9e29/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.130s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:17 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[2218d290-ea5c-4973-9665-4f594f1addd7]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:17 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:56:17 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.509s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:56:17 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] <== disconnect_volume: return (890ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:56:17 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 03:56:17 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Deleting instance files /opt/stack/data/nova/instances/2ab80244-d70d-41ce-9b7e-bb9c8a676ad6_del
Nov 16 03:56:17 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Deletion of /opt/stack/data/nova/instances/2ab80244-d70d-41ce-9b7e-bb9c8a676ad6_del complete
Nov 16 03:56:17 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:56:17 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:56:17 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Hypervisor/Node resource view: name=user free_ram=7473MB free_disk=25.235973358154297GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=103546) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 03:56:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:56:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:56:18 user nova-compute[103546]: DEBUG nova.compute.manager [req-0312689d-4548-474b-b3df-43558021c9fb req-e391c568-4beb-4cd9-b588-19059d2bf146 service nova] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Received event network-vif-plugged-49c54f9c-e72e-4cdf-96d3-7c31d8ed5109 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:56:18 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-0312689d-4548-474b-b3df-43558021c9fb req-e391c568-4beb-4cd9-b588-19059d2bf146 service nova] Acquiring lock "2ab80244-d70d-41ce-9b7e-bb9c8a676ad6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:56:18 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-0312689d-4548-474b-b3df-43558021c9fb req-e391c568-4beb-4cd9-b588-19059d2bf146 service nova] Lock "2ab80244-d70d-41ce-9b7e-bb9c8a676ad6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:56:18 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-0312689d-4548-474b-b3df-43558021c9fb req-e391c568-4beb-4cd9-b588-19059d2bf146 service nova] Lock "2ab80244-d70d-41ce-9b7e-bb9c8a676ad6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:56:18 user nova-compute[103546]: DEBUG nova.compute.manager [req-0312689d-4548-474b-b3df-43558021c9fb req-e391c568-4beb-4cd9-b588-19059d2bf146 service nova] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] No waiting events found dispatching network-vif-plugged-49c54f9c-e72e-4cdf-96d3-7c31d8ed5109 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:56:18 user nova-compute[103546]: WARNING nova.compute.manager [req-0312689d-4548-474b-b3df-43558021c9fb req-e391c568-4beb-4cd9-b588-19059d2bf146 service nova] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Received unexpected event network-vif-plugged-49c54f9c-e72e-4cdf-96d3-7c31d8ed5109 for instance with vm_state active and task_state rebuilding.
Nov 16 03:56:18 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-f9be5989-f15f-44c0-88ba-83d7fdd2f58d tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:56:18 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-f9be5989-f15f-44c0-88ba-83d7fdd2f58d tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] No BDM found with device name vdb, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:56:18 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-f9be5989-f15f-44c0-88ba-83d7fdd2f58d tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] No VIF found with MAC fa:16:3e:64:f3:d9, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 03:56:18 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 9a89970b-fc61-4419-8ff9-b48013dccf9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:56:18 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 04101512-7333-4581-add3-7af3821e335b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:56:18 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 164533fb-64e1-4aa5-b5fb-273817dd3e74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:56:18 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance fa7e5468-9dd4-407d-85ec-d45ec76f9e29 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:56:18 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance f4065a1b-10a0-4b2a-9088-a703a7c4e064 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:56:18 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:56:18 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 9c86c600-6277-4746-934d-c63e95616219 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:56:18 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 246ccf69-847c-4ab2-b709-ad1a85e81eab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:56:18 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 8d229d05-95f1-4997-8539-802ac65cff8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:56:18 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance d2781221-b5e3-468a-a9f5-436a04285f38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:56:18 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 03:56:18 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 03:56:18 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6 could not be found.
Nov 16 03:56:18 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 03:56:18 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IwNpXAPB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:56:18 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 03:56:18 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:56:18 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:56:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:18 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5a2e30-5121-4fc1-9218-8ce2cdb09267]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:18 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 03:56:18 user nova-compute[103546]: No targets found.
Nov 16 03:56:18 user nova-compute[103546]: iSNS:
Nov 16 03:56:18 user nova-compute[103546]: No targets found.
Nov 16 03:56:18 user nova-compute[103546]: STATIC:
Nov 16 03:56:18 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229
Nov 16 03:56:18 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:56:18 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:56:18 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4
Nov 16 03:56:18 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:56:18 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:56:18 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925
Nov 16 03:56:18 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:56:18 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:56:18 user nova-compute[103546]: FIRMWARE:
Nov 16 03:56:18 user nova-compute[103546]: No targets found.
Nov 16 03:56:18 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:56:18 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 03:56:18 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 03:56:18 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 03:56:18 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 03:56:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:18 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b619779-c12a-4c65-b16e-e9135b2c4c89]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:18 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f9be5989-f15f-44c0-88ba-83d7fdd2f58d tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "f4065a1b-10a0-4b2a-9088-a703a7c4e064" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.411s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:56:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:18 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[05259ff6-bde9-4b73-abe6-995fb3a1d09e]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:18 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:56:18 user nova-compute[103546]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)
Nov 16 03:56:18 user nova-compute[103546]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 (non-flash)
Nov 16 03:56:18 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:56:18 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:56:18 user nova-compute[103546]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)
Nov 16 03:56:18 user nova-compute[103546]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 (non-flash)
Nov 16 03:56:18 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:56:18 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60cc568280>, {}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 03:56:18 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Disconnecting from: [] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 03:56:18 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.079s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:56:18 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] <== disconnect_volume: return (80ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:56:18 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 03:56:18 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:18 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:56:18 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:56:18 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Compute_service record updated for user:user {{(pid=103546) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 03:56:18 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.766s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:56:19 user nova-compute[103546]: DEBUG nova.compute.manager [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Preparing to wait for external event volume-reimaged-5cdf8533-74a7-4737-b4af-2a9ae07490fc {{(pid=103546) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 16 03:56:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Acquiring lock "2ab80244-d70d-41ce-9b7e-bb9c8a676ad6-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:56:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Lock "2ab80244-d70d-41ce-9b7e-bb9c8a676ad6-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:56:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Lock "2ab80244-d70d-41ce-9b7e-bb9c8a676ad6-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:56:19 user nova-compute[103546]: INFO nova.compute.manager [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Rebuilding instance
Nov 16 03:56:19 user nova-compute[103546]: DEBUG nova.compute.manager [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 03:56:19 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:19 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:19 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:56:19 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:56:19 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:56:19 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Starting heal instance info cache {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 03:56:19 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Didn't find any instances for network info cache update. {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 03:56:19 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:56:19 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:56:19 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:56:19 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:56:19 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:56:19 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:56:19 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=103546) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 03:56:19 user nova-compute[103546]: DEBUG nova.compute.manager [req-cc0277c4-1f39-43a4-8b44-38f2e0a53248 req-8f5294fb-db9a-4da8-8690-82b4e857065d service nova] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Received event network-vif-unplugged-7471b1be-a897-4ef9-8dbe-8c6962cfbd31 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:56:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-cc0277c4-1f39-43a4-8b44-38f2e0a53248 req-8f5294fb-db9a-4da8-8690-82b4e857065d service nova] Acquiring lock "f4065a1b-10a0-4b2a-9088-a703a7c4e064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:56:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-cc0277c4-1f39-43a4-8b44-38f2e0a53248 req-8f5294fb-db9a-4da8-8690-82b4e857065d service nova] Lock "f4065a1b-10a0-4b2a-9088-a703a7c4e064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:56:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-cc0277c4-1f39-43a4-8b44-38f2e0a53248 req-8f5294fb-db9a-4da8-8690-82b4e857065d service nova] Lock "f4065a1b-10a0-4b2a-9088-a703a7c4e064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:56:19 user nova-compute[103546]: DEBUG nova.compute.manager [req-cc0277c4-1f39-43a4-8b44-38f2e0a53248 req-8f5294fb-db9a-4da8-8690-82b4e857065d service nova] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] No waiting events found dispatching network-vif-unplugged-7471b1be-a897-4ef9-8dbe-8c6962cfbd31 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:56:19 user nova-compute[103546]: WARNING nova.compute.manager [req-cc0277c4-1f39-43a4-8b44-38f2e0a53248 req-8f5294fb-db9a-4da8-8690-82b4e857065d service nova] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Received unexpected event network-vif-unplugged-7471b1be-a897-4ef9-8dbe-8c6962cfbd31 for instance with vm_state active and task_state rebuilding.
Nov 16 03:56:19 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:19 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:20 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Instance destroyed successfully.
Nov 16 03:56:20 user nova-compute[103546]: INFO nova.compute.manager [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Detaching volume 80738ad2-a7e0-4996-bda9-07784deca229
Nov 16 03:56:20 user nova-compute[103546]: INFO nova.virt.block_device [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Attempting to driver detach volume 80738ad2-a7e0-4996-bda9-07784deca229 from mountpoint /dev/vdb
Nov 16 03:56:20 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Attempting to detach device vdb from instance f4065a1b-10a0-4b2a-9088-a703a7c4e064 from the persistent domain config. {{(pid=103546) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 03:56:20 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 03:56:20 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 03:56:20 user nova-compute[103546]:   <source dev="/dev/sde"/>
Nov 16 03:56:20 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 03:56:20 user nova-compute[103546]:   <serial>80738ad2-a7e0-4996-bda9-07784deca229</serial>
Nov 16 03:56:20 user nova-compute[103546]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 03:56:20 user nova-compute[103546]: </disk>
Nov 16 03:56:20 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 03:56:20 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Successfully detached device vdb from instance f4065a1b-10a0-4b2a-9088-a703a7c4e064 from the persistent domain config.
Nov 16 03:56:20 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 03:56:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GxzRICWM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:56:20 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 03:56:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:56:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:56:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:20 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa7b13e-6722-4605-8f3a-94ebdd57e987]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 03:56:20 user nova-compute[103546]: No targets found.
Nov 16 03:56:20 user nova-compute[103546]: iSNS:
Nov 16 03:56:20 user nova-compute[103546]: No targets found.
Nov 16 03:56:20 user nova-compute[103546]: STATIC:
Nov 16 03:56:20 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229
Nov 16 03:56:20 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:56:20 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:56:20 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4
Nov 16 03:56:20 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:56:20 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:56:20 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925
Nov 16 03:56:20 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:56:20 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:56:20 user nova-compute[103546]: FIRMWARE:
Nov 16 03:56:20 user nova-compute[103546]: No targets found.
Nov 16 03:56:20 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:56:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 03:56:20 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 03:56:20 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 03:56:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 03:56:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:20 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f94f16-a8d2-412e-92cb-e6fdbc3556e3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:20 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b6ea90d-c2d9-48d2-8161-bbf110d5e53f]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:56:20 user nova-compute[103546]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)
Nov 16 03:56:20 user nova-compute[103546]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 (non-flash)
Nov 16 03:56:20 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:56:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:56:20 user nova-compute[103546]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)
Nov 16 03:56:20 user nova-compute[103546]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 (non-flash)
Nov 16 03:56:20 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:56:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60cc2792d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229'): ({'sde'}, set())}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 03:56:20 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Removing single pathed devices sde {{(pid=103546) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 03:56:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:20 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1bb07a7-fc29-40a3-9eb1-ce6bc2771189]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:20 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eef45fd-3c1d-4b03-9fc3-f9218e463abe]: (4, ('ok\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:20 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Flushing IO for device /dev/sde {{(pid=103546) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 03:56:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:20 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f797e8f2-2ca5-460a-acfa-c4040204ba82]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:20 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=103546) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 03:56:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:20 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca72f206-06b8-45f8-b903-01f7e5a471fb]: (4, ('1', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:20 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 03:56:20 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] SCSI volumes sde have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 03:56:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229')] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 03:56:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:20 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99cdd31-8834-4cd4-9168-38628b8a4426]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:56:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 -p 172.16.0.220:3260 --logout {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:20 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3dfbf72-b7ca-4e2d-b034-e7ca268c9e91]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229, portal: 172.16.0.220,3260]
Nov 16 03:56:20 user nova-compute[103546]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229, portal: 172.16.0.220,3260] successful.
Nov 16 03:56:20 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:56:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 -p 172.16.0.220:3260 --op delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:20 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29115d5-106e-448a-85d9-8602d1fc21b6]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:56:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:56:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] <== disconnect_volume: return (296ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:56:20 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 03:56:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:21 user nova-compute[103546]: DEBUG nova.compute.manager [req-4dc06877-e3aa-425f-bf5a-1697995c17ce req-76e9abe2-0ab4-4dae-a264-98dfd0cc6321 service nova] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Received event network-vif-plugged-7471b1be-a897-4ef9-8dbe-8c6962cfbd31 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:56:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-4dc06877-e3aa-425f-bf5a-1697995c17ce req-76e9abe2-0ab4-4dae-a264-98dfd0cc6321 service nova] Acquiring lock "f4065a1b-10a0-4b2a-9088-a703a7c4e064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:56:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-4dc06877-e3aa-425f-bf5a-1697995c17ce req-76e9abe2-0ab4-4dae-a264-98dfd0cc6321 service nova] Lock "f4065a1b-10a0-4b2a-9088-a703a7c4e064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:56:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-4dc06877-e3aa-425f-bf5a-1697995c17ce req-76e9abe2-0ab4-4dae-a264-98dfd0cc6321 service nova] Lock "f4065a1b-10a0-4b2a-9088-a703a7c4e064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:56:21 user nova-compute[103546]: DEBUG nova.compute.manager [req-4dc06877-e3aa-425f-bf5a-1697995c17ce req-76e9abe2-0ab4-4dae-a264-98dfd0cc6321 service nova] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] No waiting events found dispatching network-vif-plugged-7471b1be-a897-4ef9-8dbe-8c6962cfbd31 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:56:21 user nova-compute[103546]: WARNING nova.compute.manager [req-4dc06877-e3aa-425f-bf5a-1697995c17ce req-76e9abe2-0ab4-4dae-a264-98dfd0cc6321 service nova] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Received unexpected event network-vif-plugged-7471b1be-a897-4ef9-8dbe-8c6962cfbd31 for instance with vm_state active and task_state rebuilding.
Nov 16 03:56:22 user nova-compute[103546]: DEBUG nova.compute.manager [req-86a80c8c-70f1-4cb2-abc1-733fbfb53de4 req-47b2dd5e-8ba5-4f8c-993d-8ab274ae8e22 service nova] [instance: 9c86c600-6277-4746-934d-c63e95616219] Received event network-changed-5d9f9a33-9288-41e9-9965-d9f2c768f57a {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:56:22 user nova-compute[103546]: DEBUG nova.compute.manager [req-86a80c8c-70f1-4cb2-abc1-733fbfb53de4 req-47b2dd5e-8ba5-4f8c-993d-8ab274ae8e22 service nova] [instance: 9c86c600-6277-4746-934d-c63e95616219] Refreshing instance network info cache due to event network-changed-5d9f9a33-9288-41e9-9965-d9f2c768f57a. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:56:22 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-86a80c8c-70f1-4cb2-abc1-733fbfb53de4 req-47b2dd5e-8ba5-4f8c-993d-8ab274ae8e22 service nova] Acquiring lock "refresh_cache-9c86c600-6277-4746-934d-c63e95616219" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:56:22 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-86a80c8c-70f1-4cb2-abc1-733fbfb53de4 req-47b2dd5e-8ba5-4f8c-993d-8ab274ae8e22 service nova] Acquired lock "refresh_cache-9c86c600-6277-4746-934d-c63e95616219" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:56:22 user nova-compute[103546]: DEBUG nova.network.neutron [req-86a80c8c-70f1-4cb2-abc1-733fbfb53de4 req-47b2dd5e-8ba5-4f8c-993d-8ab274ae8e22 service nova] [instance: 9c86c600-6277-4746-934d-c63e95616219] Refreshing network info cache for port 5d9f9a33-9288-41e9-9965-d9f2c768f57a {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:56:22 user nova-compute[103546]: DEBUG nova.network.neutron [req-86a80c8c-70f1-4cb2-abc1-733fbfb53de4 req-47b2dd5e-8ba5-4f8c-993d-8ab274ae8e22 service nova] [instance: 9c86c600-6277-4746-934d-c63e95616219] Updated VIF entry in instance network info cache for port 5d9f9a33-9288-41e9-9965-d9f2c768f57a. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 03:56:22 user nova-compute[103546]: DEBUG nova.network.neutron [req-86a80c8c-70f1-4cb2-abc1-733fbfb53de4 req-47b2dd5e-8ba5-4f8c-993d-8ab274ae8e22 service nova] [instance: 9c86c600-6277-4746-934d-c63e95616219] Updating instance_info_cache with network_info: [{"id": "5d9f9a33-9288-41e9-9965-d9f2c768f57a", "address": "fa:16:3e:ca:8d:04", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d9f9a33-92", "ovs_interfaceid": "5d9f9a33-9288-41e9-9965-d9f2c768f57a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:56:22 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-86a80c8c-70f1-4cb2-abc1-733fbfb53de4 req-47b2dd5e-8ba5-4f8c-993d-8ab274ae8e22 service nova] Releasing lock "refresh_cache-9c86c600-6277-4746-934d-c63e95616219" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:56:23 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:25 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Instance destroyed successfully.
Nov 16 03:56:25 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:54:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1025315495',display_name='tempest-ServerActionsTestOtherA-server-266370165',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1025315495',id=24,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPsowU+DxXGj+EwRCt8oPsJDiFFQ1t3et4Wt5bZ1kwjAb+70RLl9mpMNr3QanWoL9YswsQhH0dcFmnUwAGlTlrni8Jn0NM/Wnv7EVtjYYBmh+ct83CyqQ55pikSB2BGp8A==',key_name='tempest-keypair-185377902',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:54:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='72b30a015db444798ee72ff6fd14c69e',ramdisk_id='',reservation_id='r-dcagc0xa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1488667220',owner_user_name='tempest-ServerActionsTestOtherA-1488667220-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:56:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e471c69657c745bbbdfc82307a49946f',uuid=f4065a1b-10a0-4b2a-9088-a703a7c4e064,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7471b1be-a897-4ef9-8dbe-8c6962cfbd31", "address": "fa:16:3e:64:f3:d9", "network": {"id": "29e9620f-313d-4679-89d7-459e7cf75b38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1690634205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72b30a015db444798ee72ff6fd14c69e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7471b1be-a8", "ovs_interfaceid": "7471b1be-a897-4ef9-8dbe-8c6962cfbd31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 03:56:25 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Converting VIF {"id": "7471b1be-a897-4ef9-8dbe-8c6962cfbd31", "address": "fa:16:3e:64:f3:d9", "network": {"id": "29e9620f-313d-4679-89d7-459e7cf75b38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1690634205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72b30a015db444798ee72ff6fd14c69e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7471b1be-a8", "ovs_interfaceid": "7471b1be-a897-4ef9-8dbe-8c6962cfbd31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:56:25 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:64:f3:d9,bridge_name='br-int',has_traffic_filtering=True,id=7471b1be-a897-4ef9-8dbe-8c6962cfbd31,network=Network(29e9620f-313d-4679-89d7-459e7cf75b38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7471b1be-a8') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:56:25 user nova-compute[103546]: DEBUG os_vif [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:f3:d9,bridge_name='br-int',has_traffic_filtering=True,id=7471b1be-a897-4ef9-8dbe-8c6962cfbd31,network=Network(29e9620f-313d-4679-89d7-459e7cf75b38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7471b1be-a8') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 03:56:25 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:25 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7471b1be-a8, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:56:25 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:25 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:56:25 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:25 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=830bd1c7-cbcc-4bcd-a4bf-41598de65609) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:56:25 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:25 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:25 user nova-compute[103546]: INFO os_vif [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:f3:d9,bridge_name='br-int',has_traffic_filtering=True,id=7471b1be-a897-4ef9-8dbe-8c6962cfbd31,network=Network(29e9620f-313d-4679-89d7-459e7cf75b38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7471b1be-a8')
Nov 16 03:56:25 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 03:56:25 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GxzRICWM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:56:25 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 03:56:25 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:56:25 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:56:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:25 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e590bc-2458-43c6-aba3-3679daee4a28]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:235569e3-9fba-4ba0-96cf-bd755d85e87b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:25 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 03:56:25 user nova-compute[103546]: No targets found.
Nov 16 03:56:25 user nova-compute[103546]: iSNS:
Nov 16 03:56:25 user nova-compute[103546]: No targets found.
Nov 16 03:56:25 user nova-compute[103546]: STATIC:
Nov 16 03:56:25 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:235569e3-9fba-4ba0-96cf-bd755d85e87b
Nov 16 03:56:25 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:56:25 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:56:25 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4
Nov 16 03:56:25 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:56:25 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:56:25 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925
Nov 16 03:56:25 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:56:25 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:56:25 user nova-compute[103546]: FIRMWARE:
Nov 16 03:56:25 user nova-compute[103546]: No targets found.
Nov 16 03:56:25 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:56:25 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 03:56:25 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 03:56:25 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 03:56:25 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 03:56:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:25 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[8634b218-00e1-4cc2-9782-3f618d2bc2ac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:235569e3-9fba-4ba0-96cf-bd755d85e87b\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:25 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b571dca0-67f7-4cc0-a654-091501fe7227]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:235569e3-9fba-4ba0-96cf-bd755d85e87b (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:25 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:56:25 user nova-compute[103546]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)
Nov 16 03:56:25 user nova-compute[103546]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:235569e3-9fba-4ba0-96cf-bd755d85e87b (non-flash)
Nov 16 03:56:25 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:56:25 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:56:25 user nova-compute[103546]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)
Nov 16 03:56:25 user nova-compute[103546]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:235569e3-9fba-4ba0-96cf-bd755d85e87b (non-flash)
Nov 16 03:56:25 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:56:25 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60cc27ac20>, {}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 03:56:25 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Disconnecting from: [] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 03:56:25 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.071s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:56:25 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] <== disconnect_volume: return (74ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:56:25 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 03:56:25 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Deleting instance files /opt/stack/data/nova/instances/f4065a1b-10a0-4b2a-9088-a703a7c4e064_del
Nov 16 03:56:25 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Deletion of /opt/stack/data/nova/instances/f4065a1b-10a0-4b2a-9088-a703a7c4e064_del complete
Nov 16 03:56:25 user nova-compute[103546]: INFO nova.virt.block_device [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Booting with volume 80738ad2-a7e0-4996-bda9-07784deca229 at /dev/vdb
Nov 16 03:56:25 user nova-compute[103546]: DEBUG os_brick.utils [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:56:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:25 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0795a1-e6db-4c04-bd95-1df46a4bd888]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af5c39b14ece\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:25 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[17798364-cae2-4b1b-841c-468901af158d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:25 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[675744cb-c506-4e45-ba65-4cf69aecf058]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:25 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc031fa-66e8-4799-97df-bc14a5eaaa00]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Running cmd (subprocess): nvme version {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] 'nvme version' failed. Not Retrying. {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:56:25 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] nvme not present on system {{(pid=103546) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 03:56:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:56:25 user nova-compute[103546]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 03:56:25 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[577f2b68-3099-4010-8237-52646ff0ed1d]: (4, '') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:25 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=103546) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 03:56:25 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 03:56:25 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] LIGHTOS: no hostnqn found. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 03:56:25 user nova-compute[103546]: DEBUG os_brick.utils [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af5c39b14ece', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:56:25 user nova-compute[103546]: DEBUG nova.virt.block_device [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Updating existing volume attachment record: 7df94ae9-6891-4180-948f-019d940531fe {{(pid=103546) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 03:56:28 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:29 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquiring lock "709be95b-5dbf-4291-b68e-a1e8f077f91e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:56:29 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "709be95b-5dbf-4291-b68e-a1e8f077f91e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:56:29 user nova-compute[103546]: DEBUG nova.compute.manager [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] Starting instance... {{(pid=103546) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 03:56:29 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:56:29 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:56:29 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=103546) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 03:56:29 user nova-compute[103546]: INFO nova.compute.claims [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] Claim successful on node user
Nov 16 03:56:29 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:56:29 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:56:29 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.768s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:56:29 user nova-compute[103546]: DEBUG nova.compute.manager [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] Start building networks asynchronously for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 03:56:30 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:30 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 03:56:30 user nova-compute[103546]: DEBUG nova.compute.manager [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] Allocating IP information in the background. {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 03:56:30 user nova-compute[103546]: DEBUG nova.network.neutron [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] allocate_for_instance() {{(pid=103546) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 03:56:30 user nova-compute[103546]: DEBUG nova.compute.manager [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] Start building block device mappings for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 03:56:30 user nova-compute[103546]: INFO nova.virt.block_device [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] Booting with volume snapshot a86dbce2-3f21-4618-9b60-46b38ca50a14 at /dev/vda
Nov 16 03:56:30 user nova-compute[103546]: DEBUG nova.policy [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ab77040a7b9846d28dc08852d678d1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ce50192a9743b59a9430163dd6a51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103546) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 03:56:31 user nova-compute[103546]: DEBUG nova.network.neutron [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] Successfully created port: 75d34b6d-32ab-48bd-aa27-6fbf036ec234 {{(pid=103546) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 03:56:32 user nova-compute[103546]: DEBUG nova.network.neutron [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] Successfully updated port: 75d34b6d-32ab-48bd-aa27-6fbf036ec234 {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 03:56:32 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquiring lock "refresh_cache-709be95b-5dbf-4291-b68e-a1e8f077f91e" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:56:32 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquired lock "refresh_cache-709be95b-5dbf-4291-b68e-a1e8f077f91e" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:56:32 user nova-compute[103546]: DEBUG nova.network.neutron [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 03:56:32 user nova-compute[103546]: DEBUG nova.compute.manager [req-2f93020f-a533-4595-8d51-cc531d9ba401 req-0199d8dd-8c52-4713-b01f-a5203b53f009 service nova] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] Received event network-changed-75d34b6d-32ab-48bd-aa27-6fbf036ec234 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:56:32 user nova-compute[103546]: DEBUG nova.compute.manager [req-2f93020f-a533-4595-8d51-cc531d9ba401 req-0199d8dd-8c52-4713-b01f-a5203b53f009 service nova] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] Refreshing instance network info cache due to event network-changed-75d34b6d-32ab-48bd-aa27-6fbf036ec234. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:56:32 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-2f93020f-a533-4595-8d51-cc531d9ba401 req-0199d8dd-8c52-4713-b01f-a5203b53f009 service nova] Acquiring lock "refresh_cache-709be95b-5dbf-4291-b68e-a1e8f077f91e" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:56:32 user nova-compute[103546]: DEBUG nova.network.neutron [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 03:56:33 user nova-compute[103546]: DEBUG nova.network.neutron [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] Updating instance_info_cache with network_info: [{"id": "75d34b6d-32ab-48bd-aa27-6fbf036ec234", "address": "fa:16:3e:6a:08:16", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75d34b6d-32", "ovs_interfaceid": "75d34b6d-32ab-48bd-aa27-6fbf036ec234", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:56:33 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Releasing lock "refresh_cache-709be95b-5dbf-4291-b68e-a1e8f077f91e" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:56:33 user nova-compute[103546]: DEBUG nova.compute.manager [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] Instance network_info: |[{"id": "75d34b6d-32ab-48bd-aa27-6fbf036ec234", "address": "fa:16:3e:6a:08:16", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75d34b6d-32", "ovs_interfaceid": "75d34b6d-32ab-48bd-aa27-6fbf036ec234", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 03:56:33 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-2f93020f-a533-4595-8d51-cc531d9ba401 req-0199d8dd-8c52-4713-b01f-a5203b53f009 service nova] Acquired lock "refresh_cache-709be95b-5dbf-4291-b68e-a1e8f077f91e" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:56:33 user nova-compute[103546]: DEBUG nova.network.neutron [req-2f93020f-a533-4595-8d51-cc531d9ba401 req-0199d8dd-8c52-4713-b01f-a5203b53f009 service nova] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] Refreshing network info cache for port 75d34b6d-32ab-48bd-aa27-6fbf036ec234 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:56:33 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Creating instance directory {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 03:56:33 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Creating image(s)
Nov 16 03:56:33 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Acquiring lock "/opt/stack/data/nova/instances/f4065a1b-10a0-4b2a-9088-a703a7c4e064/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:56:33 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "/opt/stack/data/nova/instances/f4065a1b-10a0-4b2a-9088-a703a7c4e064/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:56:33 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "/opt/stack/data/nova/instances/f4065a1b-10a0-4b2a-9088-a703a7c4e064/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:56:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.309s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:33 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Acquiring lock "8c9efafb670bfe5842ba1f4ce398924612164af7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:56:33 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:56:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:33 user nova-compute[103546]: DEBUG nova.network.neutron [req-2f93020f-a533-4595-8d51-cc531d9ba401 req-0199d8dd-8c52-4713-b01f-a5203b53f009 service nova] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] Updated VIF entry in instance network info cache for port 75d34b6d-32ab-48bd-aa27-6fbf036ec234. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 03:56:33 user nova-compute[103546]: DEBUG nova.network.neutron [req-2f93020f-a533-4595-8d51-cc531d9ba401 req-0199d8dd-8c52-4713-b01f-a5203b53f009 service nova] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] Updating instance_info_cache with network_info: [{"id": "75d34b6d-32ab-48bd-aa27-6fbf036ec234", "address": "fa:16:3e:6a:08:16", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75d34b6d-32", "ovs_interfaceid": "75d34b6d-32ab-48bd-aa27-6fbf036ec234", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:56:33 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-2f93020f-a533-4595-8d51-cc531d9ba401 req-0199d8dd-8c52-4713-b01f-a5203b53f009 service nova] Releasing lock "refresh_cache-709be95b-5dbf-4291-b68e-a1e8f077f91e" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:56:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.221s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/f4065a1b-10a0-4b2a-9088-a703a7c4e064/disk 1073741824 {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/f4065a1b-10a0-4b2a-9088-a703a7c4e064/disk 1073741824" returned: 0 in 0.151s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:34 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.446s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:56:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.325s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:34 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f4065a1b-10a0-4b2a-9088-a703a7c4e064/disk. size=1073741824 {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 03:56:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4065a1b-10a0-4b2a-9088-a703a7c4e064/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4065a1b-10a0-4b2a-9088-a703a7c4e064/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:34 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Cannot resize image /opt/stack/data/nova/instances/f4065a1b-10a0-4b2a-9088-a703a7c4e064/disk to a smaller size. {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 03:56:34 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Created local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 03:56:34 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Ensure instance console log exists: /opt/stack/data/nova/instances/f4065a1b-10a0-4b2a-9088-a703a7c4e064/console.log {{(pid=103546) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 03:56:34 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:56:34 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:56:34 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:56:34 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Start _get_guest_xml network_info=[{"id": "7471b1be-a897-4ef9-8dbe-8c6962cfbd31", "address": "fa:16:3e:64:f3:d9", "network": {"id": "29e9620f-313d-4679-89d7-459e7cf75b38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1690634205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72b30a015db444798ee72ff6fd14c69e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7471b1be-a8", "ovs_interfaceid": "7471b1be-a897-4ef9-8dbe-8c6962cfbd31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '5c6f539a-01e5-4478-bf8f-a14310b5d7dd'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GxzRICWM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f4065a1b-10a0-4b2a-9088-a703a7c4e064', 'attached_at': '', 'detached_at': '', 'volume_id': '80738ad2-a7e0-4996-bda9-07784deca229', 'serial': '80738ad2-a7e0-4996-bda9-07784deca229'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'attachment_id': '7df94ae9-6891-4180-948f-019d940531fe', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 03:56:34 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 16 03:56:34 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 16 03:56:34 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 03:56:34 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 03:56:34 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 03:56:34 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 03:56:34 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 03:56:34 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 03:56:34 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 03:56:34 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 03:56:34 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 03:56:34 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 03:56:34 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 03:56:34 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 03:56:34 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 03:56:34 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 03:56:34 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 03:56:34 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 03:56:34 user nova-compute[103546]: DEBUG nova.objects.instance [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lazy-loading 'vcpu_model' on Instance uuid f4065a1b-10a0-4b2a-9088-a703a7c4e064 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:56:34 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 03:56:34 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GxzRICWM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:56:34 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 03:56:34 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:56:34 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:56:34 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 03:56:34 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:56:34 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:56:34 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 03:56:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:34 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1fb9f2-1f5e-4859-bc22-6eb5e5be4319]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:34 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 03:56:34 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:56:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 -p 172.16.0.220:3260 --interface default --op new {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:34 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46cab1c-4977-461b-aee9-84210bf040cf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229] added\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:34 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229] added
Nov 16 03:56:34 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:56:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:34 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf010dd3-f6fd-47dd-962f-33fa4b1f7a99]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:34 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:56:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:34 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[919416fa-27f9-4371-b5c0-a6bd8408c991]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:34 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:56:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GxzRICWM {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GxzRICWM" returned: 0 in 0.032s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:34 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d700535-624a-4f41-837d-6b1536a0d7e9]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:34 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GxzRICWM'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:56:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:34 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba6ed285-3b4d-491e-a0b7-0eca749b2340]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:34 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:56:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:35 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd024c6-6e7b-4c2e-8e03-dfacddd30989]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:235569e3-9fba-4ba0-96cf-bd755d85e87b (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:35 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:56:35 user nova-compute[103546]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)
Nov 16 03:56:35 user nova-compute[103546]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:235569e3-9fba-4ba0-96cf-bd755d85e87b (non-flash)
Nov 16 03:56:35 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:56:35 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:56:35 user nova-compute[103546]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)
Nov 16 03:56:35 user nova-compute[103546]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:235569e3-9fba-4ba0-96cf-bd755d85e87b (non-flash)
Nov 16 03:56:35 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:56:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 -p 172.16.0.220:3260 --login {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:35 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[969baee6-818b-4e41-b1f0-5c837d83f422]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:35 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229, portal: 172.16.0.220,3260]
Nov 16 03:56:35 user nova-compute[103546]: Login to [iface: default, target: iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229, portal: 172.16.0.220,3260] successful.
Nov 16 03:56:35 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:56:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.069s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:35 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5deb776e-f110-4017-8ef1-c6c50f56f16a]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:35 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:56:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.169s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:35 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf6336b-b508-4ff0-8d56-4437fd7ccb18]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:235569e3-9fba-4ba0-96cf-bd755d85e87b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:35 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:56:35 user nova-compute[103546]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)
Nov 16 03:56:35 user nova-compute[103546]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:235569e3-9fba-4ba0-96cf-bd755d85e87b (non-flash)
Nov 16 03:56:35 user nova-compute[103546]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 (non-flash)
Nov 16 03:56:35 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:56:35 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:56:35 user nova-compute[103546]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)
Nov 16 03:56:35 user nova-compute[103546]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:235569e3-9fba-4ba0-96cf-bd755d85e87b (non-flash)
Nov 16 03:56:35 user nova-compute[103546]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 (non-flash)
Nov 16 03:56:35 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:56:35 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.551s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:56:35 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 03:56:35 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] HCTL ('36', '-', '-', 0) found on session 33 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 03:56:35 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 03:56:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.088s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:35 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49d16ae-d72e-463e-b116-cddb423109a1]: (4, ('- - 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:35 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Searching for a device in session 33 and hctl ['36', '*', '*', 0] yield: None {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 03:56:35 user nova-compute[103546]: DEBUG nova.compute.manager [req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 req-880ce244-4a73-4dff-b9ee-d1d977ca2120 service nova] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Received event volume-reimaged-5cdf8533-74a7-4737-b4af-2a9ae07490fc {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:56:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 req-880ce244-4a73-4dff-b9ee-d1d977ca2120 service nova] Acquiring lock "2ab80244-d70d-41ce-9b7e-bb9c8a676ad6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:56:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 req-880ce244-4a73-4dff-b9ee-d1d977ca2120 service nova] Lock "2ab80244-d70d-41ce-9b7e-bb9c8a676ad6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:56:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 req-880ce244-4a73-4dff-b9ee-d1d977ca2120 service nova] Lock "2ab80244-d70d-41ce-9b7e-bb9c8a676ad6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:56:35 user nova-compute[103546]: DEBUG nova.compute.manager [req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 req-880ce244-4a73-4dff-b9ee-d1d977ca2120 service nova] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Processing event volume-reimaged-5cdf8533-74a7-4737-b4af-2a9ae07490fc {{(pid=103546) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 16 03:56:35 user nova-compute[103546]: DEBUG nova.compute.manager [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Instance event wait completed in 16 seconds for volume-reimaged {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 03:56:36 user nova-compute[103546]: INFO nova.virt.block_device [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Booting with volume 5cdf8533-74a7-4737-b4af-2a9ae07490fc at /dev/vda
Nov 16 03:56:36 user nova-compute[103546]: DEBUG os_brick.utils [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aae0fad-8307-4c26-8ad7-a80ce4bd503b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af5c39b14ece\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef3b56b-5f22-4e60-81f4-b7d7967c84a4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[198c3965-b155-463c-9403-057e6c7694e6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cdecca2-4b89-4440-a68e-56e69762fad3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Running cmd (subprocess): nvme version {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] 'nvme version' failed. Not Retrying. {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] nvme not present on system {{(pid=103546) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:56:36 user nova-compute[103546]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 03:56:36 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23d72ec-384d-4999-93fa-6add2956e3a1]: (4, '') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=103546) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] LIGHTOS: no hostnqn found. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG os_brick.utils [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af5c39b14ece', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG nova.virt.block_device [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Updating existing volume attachment record: e0d48bcb-414f-4318-aa8a-2145e4b73697 {{(pid=103546) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Searching for a device in session 33 and hctl ['36', '*', '*', 0] yield: sde {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GxzRICWM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.654s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] <== connect_volume: return (1656ms) {'type': 'block', 'scsi_wwn': '23233346161316231', 'path': '/dev/sde'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233346161316231', 'path': '/dev/sde'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T03:54:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1025315495',display_name='tempest-ServerActionsTestOtherA-server-266370165',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1025315495',id=24,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPsowU+DxXGj+EwRCt8oPsJDiFFQ1t3et4Wt5bZ1kwjAb+70RLl9mpMNr3QanWoL9YswsQhH0dcFmnUwAGlTlrni8Jn0NM/Wnv7EVtjYYBmh+ct83CyqQ55pikSB2BGp8A==',key_name='tempest-keypair-185377902',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:54:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='72b30a015db444798ee72ff6fd14c69e',ramdisk_id='',reservation_id='r-dcagc0xa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1488667220',owner_user_name='tempest-ServerActionsTestOtherA-1488667220-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:56:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e471c69657c745bbbdfc82307a49946f',uuid=f4065a1b-10a0-4b2a-9088-a703a7c4e064,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7471b1be-a897-4ef9-8dbe-8c6962cfbd31", "address": "fa:16:3e:64:f3:d9", "network": {"id": "29e9620f-313d-4679-89d7-459e7cf75b38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1690634205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72b30a015db444798ee72ff6fd14c69e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7471b1be-a8", "ovs_interfaceid": "7471b1be-a897-4ef9-8dbe-8c6962cfbd31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Converting VIF {"id": "7471b1be-a897-4ef9-8dbe-8c6962cfbd31", "address": "fa:16:3e:64:f3:d9", "network": {"id": "29e9620f-313d-4679-89d7-459e7cf75b38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1690634205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72b30a015db444798ee72ff6fd14c69e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7471b1be-a8", "ovs_interfaceid": "7471b1be-a897-4ef9-8dbe-8c6962cfbd31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:64:f3:d9,bridge_name='br-int',has_traffic_filtering=True,id=7471b1be-a897-4ef9-8dbe-8c6962cfbd31,network=Network(29e9620f-313d-4679-89d7-459e7cf75b38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7471b1be-a8') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] End _get_guest_xml xml=<domain type="kvm">
Nov 16 03:56:36 user nova-compute[103546]:   <uuid>f4065a1b-10a0-4b2a-9088-a703a7c4e064</uuid>
Nov 16 03:56:36 user nova-compute[103546]:   <name>instance-00000018</name>
Nov 16 03:56:36 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 03:56:36 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 03:56:36 user nova-compute[103546]:   <metadata>
Nov 16 03:56:36 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 03:56:36 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 03:56:36 user nova-compute[103546]:       <nova:name>tempest-ServerActionsTestOtherA-server-266370165</nova:name>
Nov 16 03:56:36 user nova-compute[103546]:       <nova:creationTime>2023-11-16 03:56:34</nova:creationTime>
Nov 16 03:56:36 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 03:56:36 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 03:56:36 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 03:56:36 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 03:56:36 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 03:56:36 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 03:56:36 user nova-compute[103546]:       </nova:flavor>
Nov 16 03:56:36 user nova-compute[103546]:       <nova:owner>
Nov 16 03:56:36 user nova-compute[103546]:         <nova:user uuid="e471c69657c745bbbdfc82307a49946f">tempest-ServerActionsTestOtherA-1488667220-project-member</nova:user>
Nov 16 03:56:36 user nova-compute[103546]:         <nova:project uuid="72b30a015db444798ee72ff6fd14c69e">tempest-ServerActionsTestOtherA-1488667220</nova:project>
Nov 16 03:56:36 user nova-compute[103546]:       </nova:owner>
Nov 16 03:56:36 user nova-compute[103546]:       <nova:root type="image" uuid="5c6f539a-01e5-4478-bf8f-a14310b5d7dd"/>
Nov 16 03:56:36 user nova-compute[103546]:       <nova:ports>
Nov 16 03:56:36 user nova-compute[103546]:         <nova:port uuid="7471b1be-a897-4ef9-8dbe-8c6962cfbd31">
Nov 16 03:56:36 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 16 03:56:36 user nova-compute[103546]:         </nova:port>
Nov 16 03:56:36 user nova-compute[103546]:       </nova:ports>
Nov 16 03:56:36 user nova-compute[103546]:     </nova:instance>
Nov 16 03:56:36 user nova-compute[103546]:   </metadata>
Nov 16 03:56:36 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 03:56:36 user nova-compute[103546]:     <system>
Nov 16 03:56:36 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 03:56:36 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 03:56:36 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 03:56:36 user nova-compute[103546]:       <entry name="serial">f4065a1b-10a0-4b2a-9088-a703a7c4e064</entry>
Nov 16 03:56:36 user nova-compute[103546]:       <entry name="uuid">f4065a1b-10a0-4b2a-9088-a703a7c4e064</entry>
Nov 16 03:56:36 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 03:56:36 user nova-compute[103546]:     </system>
Nov 16 03:56:36 user nova-compute[103546]:   </sysinfo>
Nov 16 03:56:36 user nova-compute[103546]:   <os>
Nov 16 03:56:36 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 03:56:36 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 03:56:36 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 03:56:36 user nova-compute[103546]:   </os>
Nov 16 03:56:36 user nova-compute[103546]:   <features>
Nov 16 03:56:36 user nova-compute[103546]:     <acpi/>
Nov 16 03:56:36 user nova-compute[103546]:     <apic/>
Nov 16 03:56:36 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 03:56:36 user nova-compute[103546]:   </features>
Nov 16 03:56:36 user nova-compute[103546]:   <clock offset="utc">
Nov 16 03:56:36 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 03:56:36 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 03:56:36 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 03:56:36 user nova-compute[103546]:   </clock>
Nov 16 03:56:36 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 03:56:36 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 03:56:36 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 03:56:36 user nova-compute[103546]:   </cpu>
Nov 16 03:56:36 user nova-compute[103546]:   <devices>
Nov 16 03:56:36 user nova-compute[103546]:     <disk type="file" device="disk">
Nov 16 03:56:36 user nova-compute[103546]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 03:56:36 user nova-compute[103546]:       <source file="/opt/stack/data/nova/instances/f4065a1b-10a0-4b2a-9088-a703a7c4e064/disk"/>
Nov 16 03:56:36 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 03:56:36 user nova-compute[103546]:     </disk>
Nov 16 03:56:36 user nova-compute[103546]:     <disk type="block" device="disk">
Nov 16 03:56:36 user nova-compute[103546]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 03:56:36 user nova-compute[103546]:       <source dev="/dev/sde"/>
Nov 16 03:56:36 user nova-compute[103546]:       <target dev="vdb" bus="virtio"/>
Nov 16 03:56:36 user nova-compute[103546]:       <serial>80738ad2-a7e0-4996-bda9-07784deca229</serial>
Nov 16 03:56:36 user nova-compute[103546]:     </disk>
Nov 16 03:56:36 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 03:56:36 user nova-compute[103546]:       <mac address="fa:16:3e:64:f3:d9"/>
Nov 16 03:56:36 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:56:36 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 03:56:36 user nova-compute[103546]:       <target dev="tap7471b1be-a8"/>
Nov 16 03:56:36 user nova-compute[103546]:     </interface>
Nov 16 03:56:36 user nova-compute[103546]:     <serial type="pty">
Nov 16 03:56:36 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/f4065a1b-10a0-4b2a-9088-a703a7c4e064/console.log" append="off"/>
Nov 16 03:56:36 user nova-compute[103546]:     </serial>
Nov 16 03:56:36 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 03:56:36 user nova-compute[103546]:     <video>
Nov 16 03:56:36 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:56:36 user nova-compute[103546]:     </video>
Nov 16 03:56:36 user nova-compute[103546]:     <rng model="virtio">
Nov 16 03:56:36 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 03:56:36 user nova-compute[103546]:     </rng>
Nov 16 03:56:36 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 03:56:36 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 03:56:36 user nova-compute[103546]:       <stats period="10"/>
Nov 16 03:56:36 user nova-compute[103546]:     </memballoon>
Nov 16 03:56:36 user nova-compute[103546]:   </devices>
Nov 16 03:56:36 user nova-compute[103546]: </domain>
Nov 16 03:56:36 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T03:54:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1025315495',display_name='tempest-ServerActionsTestOtherA-server-266370165',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1025315495',id=24,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPsowU+DxXGj+EwRCt8oPsJDiFFQ1t3et4Wt5bZ1kwjAb+70RLl9mpMNr3QanWoL9YswsQhH0dcFmnUwAGlTlrni8Jn0NM/Wnv7EVtjYYBmh+ct83CyqQ55pikSB2BGp8A==',key_name='tempest-keypair-185377902',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:54:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='72b30a015db444798ee72ff6fd14c69e',ramdisk_id='',reservation_id='r-dcagc0xa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1488667220',owner_user_name='tempest-ServerActionsTestOtherA-1488667220-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:56:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e471c69657c745bbbdfc82307a49946f',uuid=f4065a1b-10a0-4b2a-9088-a703a7c4e064,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7471b1be-a897-4ef9-8dbe-8c6962cfbd31", "address": "fa:16:3e:64:f3:d9", "network": {"id": "29e9620f-313d-4679-89d7-459e7cf75b38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1690634205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72b30a015db444798ee72ff6fd14c69e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7471b1be-a8", "ovs_interfaceid": "7471b1be-a897-4ef9-8dbe-8c6962cfbd31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Converting VIF {"id": "7471b1be-a897-4ef9-8dbe-8c6962cfbd31", "address": "fa:16:3e:64:f3:d9", "network": {"id": "29e9620f-313d-4679-89d7-459e7cf75b38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1690634205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72b30a015db444798ee72ff6fd14c69e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7471b1be-a8", "ovs_interfaceid": "7471b1be-a897-4ef9-8dbe-8c6962cfbd31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:64:f3:d9,bridge_name='br-int',has_traffic_filtering=True,id=7471b1be-a897-4ef9-8dbe-8c6962cfbd31,network=Network(29e9620f-313d-4679-89d7-459e7cf75b38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7471b1be-a8') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG os_vif [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:f3:d9,bridge_name='br-int',has_traffic_filtering=True,id=7471b1be-a897-4ef9-8dbe-8c6962cfbd31,network=Network(29e9620f-313d-4679-89d7-459e7cf75b38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7471b1be-a8') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8f5320d1-f696-5384-b52c-21de5c1cadd1', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7471b1be-a8, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7471b1be-a8, col_values=(('qos', UUID('42a03687-e21a-4c77-8a0c-dbda56047f5a')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7471b1be-a8, col_values=(('external_ids', {'iface-id': '7471b1be-a897-4ef9-8dbe-8c6962cfbd31', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:f3:d9', 'vm-uuid': 'f4065a1b-10a0-4b2a-9088-a703a7c4e064'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:36 user nova-compute[103546]: INFO os_vif [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:f3:d9,bridge_name='br-int',has_traffic_filtering=True,id=7471b1be-a897-4ef9-8dbe-8c6962cfbd31,network=Network(29e9620f-313d-4679-89d7-459e7cf75b38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7471b1be-a8')
Nov 16 03:56:36 user nova-compute[103546]: DEBUG os_brick.utils [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ccfa65-21b7-4c7d-923f-8ee351cf6621]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af5c39b14ece\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] No BDM found with device name vdb, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] No VIF found with MAC fa:16:3e:64:f3:d9, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e864b456-ddb5-4d59-bcd2-32b7b00fb2b0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[061eb8c8-da7d-4381-992e-ad843a679972]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a40f4a7-1b5f-4f1b-9211-143d574305a0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Running cmd (subprocess): nvme version {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] 'nvme version' failed. Not Retrying. {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] nvme not present on system {{(pid=103546) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:56:36 user nova-compute[103546]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 03:56:36 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5233ec0-5517-411e-9fee-9ac998ed2d29]: (4, '') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=103546) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] LIGHTOS: no hostnqn found. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG os_brick.utils [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af5c39b14ece', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:56:36 user nova-compute[103546]: DEBUG nova.virt.block_device [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] Updating existing volume attachment record: 5dd5de10-7797-4813-b2b5-9d96c6bc2bb8 {{(pid=103546) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 03:56:38 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:38 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:38 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:38 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:38 user nova-compute[103546]: DEBUG nova.compute.manager [req-195b4956-4a40-4626-b42c-2793134af91b req-5a895b28-2477-464d-ac4e-8b006d925998 service nova] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Received event network-vif-plugged-7471b1be-a897-4ef9-8dbe-8c6962cfbd31 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:56:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-195b4956-4a40-4626-b42c-2793134af91b req-5a895b28-2477-464d-ac4e-8b006d925998 service nova] Acquiring lock "f4065a1b-10a0-4b2a-9088-a703a7c4e064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:56:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-195b4956-4a40-4626-b42c-2793134af91b req-5a895b28-2477-464d-ac4e-8b006d925998 service nova] Lock "f4065a1b-10a0-4b2a-9088-a703a7c4e064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:56:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-195b4956-4a40-4626-b42c-2793134af91b req-5a895b28-2477-464d-ac4e-8b006d925998 service nova] Lock "f4065a1b-10a0-4b2a-9088-a703a7c4e064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:56:38 user nova-compute[103546]: DEBUG nova.compute.manager [req-195b4956-4a40-4626-b42c-2793134af91b req-5a895b28-2477-464d-ac4e-8b006d925998 service nova] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] No waiting events found dispatching network-vif-plugged-7471b1be-a897-4ef9-8dbe-8c6962cfbd31 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:56:38 user nova-compute[103546]: WARNING nova.compute.manager [req-195b4956-4a40-4626-b42c-2793134af91b req-5a895b28-2477-464d-ac4e-8b006d925998 service nova] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Received unexpected event network-vif-plugged-7471b1be-a897-4ef9-8dbe-8c6962cfbd31 for instance with vm_state active and task_state rebuild_spawning.
Nov 16 03:56:38 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:40 user nova-compute[103546]: DEBUG nova.compute.manager [req-8593be7b-4ec9-42b5-bc0b-21551929871d req-87490d4d-ef5e-4940-aae2-a851a0c952df service nova] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Received event network-vif-plugged-7471b1be-a897-4ef9-8dbe-8c6962cfbd31 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:56:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8593be7b-4ec9-42b5-bc0b-21551929871d req-87490d4d-ef5e-4940-aae2-a851a0c952df service nova] Acquiring lock "f4065a1b-10a0-4b2a-9088-a703a7c4e064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:56:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8593be7b-4ec9-42b5-bc0b-21551929871d req-87490d4d-ef5e-4940-aae2-a851a0c952df service nova] Lock "f4065a1b-10a0-4b2a-9088-a703a7c4e064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:56:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8593be7b-4ec9-42b5-bc0b-21551929871d req-87490d4d-ef5e-4940-aae2-a851a0c952df service nova] Lock "f4065a1b-10a0-4b2a-9088-a703a7c4e064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:56:40 user nova-compute[103546]: DEBUG nova.compute.manager [req-8593be7b-4ec9-42b5-bc0b-21551929871d req-87490d4d-ef5e-4940-aae2-a851a0c952df service nova] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] No waiting events found dispatching network-vif-plugged-7471b1be-a897-4ef9-8dbe-8c6962cfbd31 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:56:40 user nova-compute[103546]: WARNING nova.compute.manager [req-8593be7b-4ec9-42b5-bc0b-21551929871d req-87490d4d-ef5e-4940-aae2-a851a0c952df service nova] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Received unexpected event network-vif-plugged-7471b1be-a897-4ef9-8dbe-8c6962cfbd31 for instance with vm_state active and task_state rebuild_spawning.
Nov 16 03:56:41 user nova-compute[103546]: DEBUG nova.compute.manager [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 03:56:41 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Guest created on hypervisor {{(pid=103546) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 03:56:41 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Instance spawned successfully.
Nov 16 03:56:41 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 03:56:41 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Found default for hw_cdrom_bus of ide {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:56:41 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Found default for hw_disk_bus of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:56:41 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Found default for hw_input_bus of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:56:41 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Found default for hw_pointer_model of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:56:41 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Found default for hw_video_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:56:41 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Found default for hw_vif_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:56:41 user nova-compute[103546]: DEBUG nova.compute.manager [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 03:56:41 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:56:41 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:56:41 user nova-compute[103546]: DEBUG nova.objects.instance [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Trying to apply a migration context that does not seem to be set for this instance {{(pid=103546) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 16 03:56:41 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:41 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f174a41e-fc01-4e5e-958e-de86adef085a tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.093s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:56:42 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-2c5d9494-4c26-43ad-913a-bd4f35b0844d tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Acquiring lock "164533fb-64e1-4aa5-b5fb-273817dd3e74" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:56:42 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-2c5d9494-4c26-43ad-913a-bd4f35b0844d tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Lock "164533fb-64e1-4aa5-b5fb-273817dd3e74" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:56:42 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-2c5d9494-4c26-43ad-913a-bd4f35b0844d tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Acquiring lock "164533fb-64e1-4aa5-b5fb-273817dd3e74-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:56:42 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-2c5d9494-4c26-43ad-913a-bd4f35b0844d tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Lock "164533fb-64e1-4aa5-b5fb-273817dd3e74-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:56:42 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-2c5d9494-4c26-43ad-913a-bd4f35b0844d tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Lock "164533fb-64e1-4aa5-b5fb-273817dd3e74-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:56:42 user nova-compute[103546]: INFO nova.compute.manager [None req-2c5d9494-4c26-43ad-913a-bd4f35b0844d tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Terminating instance
Nov 16 03:56:42 user nova-compute[103546]: DEBUG nova.compute.manager [None req-2c5d9494-4c26-43ad-913a-bd4f35b0844d tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Start destroying the instance on the hypervisor. {{(pid=103546) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 03:56:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:43 user nova-compute[103546]: DEBUG nova.compute.manager [req-dd916494-a483-4232-9bb8-0f440969a2b1 req-3eb3d180-c724-41a3-86f1-4cca804b55c6 service nova] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Received event network-vif-unplugged-ab9b5dca-ac92-42ef-a86f-20ea3ccaf7e0 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:56:43 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-dd916494-a483-4232-9bb8-0f440969a2b1 req-3eb3d180-c724-41a3-86f1-4cca804b55c6 service nova] Acquiring lock "164533fb-64e1-4aa5-b5fb-273817dd3e74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:56:43 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-dd916494-a483-4232-9bb8-0f440969a2b1 req-3eb3d180-c724-41a3-86f1-4cca804b55c6 service nova] Lock "164533fb-64e1-4aa5-b5fb-273817dd3e74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:56:43 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-dd916494-a483-4232-9bb8-0f440969a2b1 req-3eb3d180-c724-41a3-86f1-4cca804b55c6 service nova] Lock "164533fb-64e1-4aa5-b5fb-273817dd3e74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:56:43 user nova-compute[103546]: DEBUG nova.compute.manager [req-dd916494-a483-4232-9bb8-0f440969a2b1 req-3eb3d180-c724-41a3-86f1-4cca804b55c6 service nova] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] No waiting events found dispatching network-vif-unplugged-ab9b5dca-ac92-42ef-a86f-20ea3ccaf7e0 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:56:43 user nova-compute[103546]: DEBUG nova.compute.manager [req-dd916494-a483-4232-9bb8-0f440969a2b1 req-3eb3d180-c724-41a3-86f1-4cca804b55c6 service nova] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Received event network-vif-unplugged-ab9b5dca-ac92-42ef-a86f-20ea3ccaf7e0 for instance with task_state deleting. {{(pid=103546) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 03:56:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:43 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Instance destroyed successfully.
Nov 16 03:56:43 user nova-compute[103546]: DEBUG nova.objects.instance [None req-2c5d9494-4c26-43ad-913a-bd4f35b0844d tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Lazy-loading 'resources' on Instance uuid 164533fb-64e1-4aa5-b5fb-273817dd3e74 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:56:43 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-2c5d9494-4c26-43ad-913a-bd4f35b0844d tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:52:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-524672440',display_name='tempest-TestServerVolumeAttachmentScenario-server-524672440',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-524672440',id=19,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFPXN0cjcjdu+HbblGQnvXuYiDAPeKI1oS5pvWB3H0HK1ye8W1jRurC78OiXPXnsGZKKqbYr8DK2B+Jc9EsWwL6GIxf7ANF7GpxGIpV6ECbKFo8L1Fk9kJ9tnWBO7h8EzA==',key_name='tempest-keypair-1213057093',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:52:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='697f0f13eb5e4681bfb4dbe0ad0bc9d2',ramdisk_id='',reservation_id='r-hcnxxi7y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1463401272',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1463401272-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T03:52:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81690bcb7edf4f74b1f712a253a9e946',uuid=164533fb-64e1-4aa5-b5fb-273817dd3e74,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab9b5dca-ac92-42ef-a86f-20ea3ccaf7e0", "address": "fa:16:3e:7b:45:4e", "network": {"id": "e6c6220f-786a-4445-981c-58cb30c01961", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1592167081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "697f0f13eb5e4681bfb4dbe0ad0bc9d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab9b5dca-ac", "ovs_interfaceid": "ab9b5dca-ac92-42ef-a86f-20ea3ccaf7e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 03:56:43 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-2c5d9494-4c26-43ad-913a-bd4f35b0844d tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Converting VIF {"id": "ab9b5dca-ac92-42ef-a86f-20ea3ccaf7e0", "address": "fa:16:3e:7b:45:4e", "network": {"id": "e6c6220f-786a-4445-981c-58cb30c01961", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1592167081-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "697f0f13eb5e4681bfb4dbe0ad0bc9d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab9b5dca-ac", "ovs_interfaceid": "ab9b5dca-ac92-42ef-a86f-20ea3ccaf7e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:56:43 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-2c5d9494-4c26-43ad-913a-bd4f35b0844d tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:45:4e,bridge_name='br-int',has_traffic_filtering=True,id=ab9b5dca-ac92-42ef-a86f-20ea3ccaf7e0,network=Network(e6c6220f-786a-4445-981c-58cb30c01961),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab9b5dca-ac') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:56:43 user nova-compute[103546]: DEBUG os_vif [None req-2c5d9494-4c26-43ad-913a-bd4f35b0844d tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:45:4e,bridge_name='br-int',has_traffic_filtering=True,id=ab9b5dca-ac92-42ef-a86f-20ea3ccaf7e0,network=Network(e6c6220f-786a-4445-981c-58cb30c01961),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab9b5dca-ac') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 03:56:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapab9b5dca-ac, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:56:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:56:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2e2d579d-d116-4069-b328-e79bd139a8a0) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:56:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:43 user nova-compute[103546]: INFO os_vif [None req-2c5d9494-4c26-43ad-913a-bd4f35b0844d tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:45:4e,bridge_name='br-int',has_traffic_filtering=True,id=ab9b5dca-ac92-42ef-a86f-20ea3ccaf7e0,network=Network(e6c6220f-786a-4445-981c-58cb30c01961),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab9b5dca-ac')
Nov 16 03:56:43 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-2c5d9494-4c26-43ad-913a-bd4f35b0844d tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Deleting instance files /opt/stack/data/nova/instances/164533fb-64e1-4aa5-b5fb-273817dd3e74_del
Nov 16 03:56:43 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-2c5d9494-4c26-43ad-913a-bd4f35b0844d tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Deletion of /opt/stack/data/nova/instances/164533fb-64e1-4aa5-b5fb-273817dd3e74_del complete
Nov 16 03:56:43 user nova-compute[103546]: INFO nova.compute.manager [None req-2c5d9494-4c26-43ad-913a-bd4f35b0844d tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 16 03:56:43 user nova-compute[103546]: DEBUG oslo.service.loopingcall [None req-2c5d9494-4c26-43ad-913a-bd4f35b0844d tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=103546) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 03:56:43 user nova-compute[103546]: DEBUG nova.compute.manager [-] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Deallocating network for instance {{(pid=103546) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 03:56:43 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] deallocate_for_instance() {{(pid=103546) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 03:56:44 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:56:44 user nova-compute[103546]: INFO nova.compute.manager [-] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Took 0.88 seconds to deallocate network for instance.
Nov 16 03:56:44 user nova-compute[103546]: DEBUG nova.compute.manager [req-cdde0cc8-3be2-4b39-a2ed-9f4056b7b972 req-7ac0284c-bc3f-461e-8fdc-df8ec61226f9 service nova] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Received event network-vif-deleted-ab9b5dca-ac92-42ef-a86f-20ea3ccaf7e0 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:56:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-2c5d9494-4c26-43ad-913a-bd4f35b0844d tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:56:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-2c5d9494-4c26-43ad-913a-bd4f35b0844d tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:56:45 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-2c5d9494-4c26-43ad-913a-bd4f35b0844d tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:56:45 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-2c5d9494-4c26-43ad-913a-bd4f35b0844d tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:56:45 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-2c5d9494-4c26-43ad-913a-bd4f35b0844d tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.433s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:56:45 user nova-compute[103546]: INFO nova.scheduler.client.report [None req-2c5d9494-4c26-43ad-913a-bd4f35b0844d tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Deleted allocations for instance 164533fb-64e1-4aa5-b5fb-273817dd3e74
Nov 16 03:56:45 user nova-compute[103546]: DEBUG nova.compute.manager [req-5734a4e0-0366-4e84-bf7d-b56ed084277a req-fd258fda-a9d8-43d4-83c1-bf39c162e325 service nova] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Received event network-vif-plugged-ab9b5dca-ac92-42ef-a86f-20ea3ccaf7e0 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:56:45 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-5734a4e0-0366-4e84-bf7d-b56ed084277a req-fd258fda-a9d8-43d4-83c1-bf39c162e325 service nova] Acquiring lock "164533fb-64e1-4aa5-b5fb-273817dd3e74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:56:45 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-5734a4e0-0366-4e84-bf7d-b56ed084277a req-fd258fda-a9d8-43d4-83c1-bf39c162e325 service nova] Lock "164533fb-64e1-4aa5-b5fb-273817dd3e74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:56:45 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-5734a4e0-0366-4e84-bf7d-b56ed084277a req-fd258fda-a9d8-43d4-83c1-bf39c162e325 service nova] Lock "164533fb-64e1-4aa5-b5fb-273817dd3e74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:56:45 user nova-compute[103546]: DEBUG nova.compute.manager [req-5734a4e0-0366-4e84-bf7d-b56ed084277a req-fd258fda-a9d8-43d4-83c1-bf39c162e325 service nova] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] No waiting events found dispatching network-vif-plugged-ab9b5dca-ac92-42ef-a86f-20ea3ccaf7e0 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:56:45 user nova-compute[103546]: WARNING nova.compute.manager [req-5734a4e0-0366-4e84-bf7d-b56ed084277a req-fd258fda-a9d8-43d4-83c1-bf39c162e325 service nova] [instance: 164533fb-64e1-4aa5-b5fb-273817dd3e74] Received unexpected event network-vif-plugged-ab9b5dca-ac92-42ef-a86f-20ea3ccaf7e0 for instance with vm_state deleted and task_state None.
Nov 16 03:56:45 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-2c5d9494-4c26-43ad-913a-bd4f35b0844d tempest-TestServerVolumeAttachmentScenario-1463401272 tempest-TestServerVolumeAttachmentScenario-1463401272-project-member] Lock "164533fb-64e1-4aa5-b5fb-273817dd3e74" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.442s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG nova.compute.manager [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] Start spawning the instance on the hypervisor. {{(pid=103546) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] Creating instance directory {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 03:56:48 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] Creating image(s)
Nov 16 03:56:48 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] Did not create local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] Ensure instance console log exists: /opt/stack/data/nova/instances/709be95b-5dbf-4291-b68e-a1e8f077f91e/console.log {{(pid=103546) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] Start _get_guest_xml network_info=[{"id": "75d34b6d-32ab-48bd-aa27-6fbf036ec234", "address": "fa:16:3e:6a:08:16", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75d34b6d-32", "ovs_interfaceid": "75d34b6d-32ab-48bd-aa27-6fbf036ec234", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-16T03:56:24Z,direct_url=<?>,disk_format='qcow2',id=e3a926cc-8023-44a2-84b7-d8211f0d8e26,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1280331765',owner='40ce50192a9743b59a9430163dd6a51c',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-16T03:56:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oqCvjOeu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '709be95b-5dbf-4291-b68e-a1e8f077f91e', 'attached_at': '', 'detached_at': '', 'volume_id': '28aeb543-e70b-479e-b1c9-65fb682c9283', 'serial': '28aeb543-e70b-479e-b1c9-65fb682c9283'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': '5dd5de10-7797-4813-b2b5-9d96c6bc2bb8', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Creating instance directory {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 03:56:48 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Creating image(s)
Nov 16 03:56:48 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Did not create local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Ensure instance console log exists: /opt/stack/data/nova/instances/2ab80244-d70d-41ce-9b7e-bb9c8a676ad6/console.log {{(pid=103546) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Start _get_guest_xml network_info=[{"id": "49c54f9c-e72e-4cdf-96d3-7c31d8ed5109", "address": "fa:16:3e:5a:f3:7f", "network": {"id": "ad0d15aa-3eb9-452a-8c1e-f98a235beb89", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-981191229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "957a9e268fe7460c97fce1e634015214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49c54f9c-e7", "ovs_interfaceid": "49c54f9c-e72e-4cdf-96d3-7c31d8ed5109", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IwNpXAPB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2ab80244-d70d-41ce-9b7e-bb9c8a676ad6', 'attached_at': '', 'detached_at': '', 'volume_id': '5cdf8533-74a7-4737-b4af-2a9ae07490fc', 'serial': '5cdf8533-74a7-4737-b4af-2a9ae07490fc'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': 'e0d48bcb-414f-4318-aa8a-2145e4b73697', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:48 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:56:48 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:56:48 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 16 03:56:48 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 16 03:56:48 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-16T03:56:24Z,direct_url=<?>,disk_format='qcow2',id=e3a926cc-8023-44a2-84b7-d8211f0d8e26,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1280331765',owner='40ce50192a9743b59a9430163dd6a51c',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-16T03:56:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oqCvjOeu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:56:48 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:56:48 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:56:48 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:56:48 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:56:48 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 03:56:48 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG nova.objects.instance [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283 -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IwNpXAPB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:56:48 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 03:56:48 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a126fab-be66-44d4-af50-7e1a2e21d145]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 03:56:48 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283 -p 172.16.0.220:3260 --interface default --op new {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.034s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f43ed6-4dd1-44e2-846c-4871b40de9ec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283] added\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283] added
Nov 16 03:56:48 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.054s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[deedecc7-0d27-40bc-9ef2-fb3b5c3aa99b]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:56:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:49 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[38734d91-9e72-49c9-8215-93958487c9a0]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:49 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:56:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oqCvjOeu {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oqCvjOeu" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:49 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e3ea67-b13f-4cfa-833f-e747ea490f6b]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:49 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oqCvjOeu'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:56:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:49 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa156d42-90b5-4280-9e2c-2d4e5a9a6dba]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:49 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:56:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:49 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5222a556-1a1f-4a61-9805-6ca4e0e2d144]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:49 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:56:49 user nova-compute[103546]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)
Nov 16 03:56:49 user nova-compute[103546]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 (non-flash)
Nov 16 03:56:49 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:56:49 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:56:49 user nova-compute[103546]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)
Nov 16 03:56:49 user nova-compute[103546]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 (non-flash)
Nov 16 03:56:49 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:56:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283 -p 172.16.0.220:3260 --login {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:49 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc81285f-1a24-4766-a290-4aacb765fc37]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:49 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283, portal: 172.16.0.220,3260]
Nov 16 03:56:49 user nova-compute[103546]: Login to [iface: default, target: iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283, portal: 172.16.0.220,3260] successful.
Nov 16 03:56:49 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:56:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:49 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da2c99b-6667-4a04-aa9b-5f4025ba3948]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:49 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:56:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:49 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22294b4-3b60-4687-b1bb-8eb2e4f474e4]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:49 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:56:49 user nova-compute[103546]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)
Nov 16 03:56:49 user nova-compute[103546]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 (non-flash)
Nov 16 03:56:49 user nova-compute[103546]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283 (non-flash)
Nov 16 03:56:49 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:56:49 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:56:49 user nova-compute[103546]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)
Nov 16 03:56:49 user nova-compute[103546]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 (non-flash)
Nov 16 03:56:49 user nova-compute[103546]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283 (non-flash)
Nov 16 03:56:49 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:56:49 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.404s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:56:49 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 03:56:49 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] HCTL ('34', '-', '-', 0) found on session 34 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 03:56:49 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 03:56:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.033s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:49 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[59111fa5-b413-47c7-8cc0-e13165fbfc7d]: (4, ('- - 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:49 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Searching for a device in session 34 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 03:56:49 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oqCvjOeu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.468s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] <== connect_volume: return (1470ms) {'type': 'block', 'scsi_wwn': '23735353436376666', 'path': '/dev/sdc'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735353436376666', 'path': '/dev/sdc'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.418s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:56:50 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 03:56:50 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:56:50 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 03:56:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:56:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-263568704',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-263568704',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-263568704',id=30,image_ref='e3a926cc-8023-44a2-84b7-d8211f0d8e26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJvQIzvXYHIpYfXfhd4U/osksmky+SFNQRPgvulHfz4FLBtDTFZIQDNMsPOpw0IHXC+c0NClsUnhpcAcH1s4l3q/6fZ5PsXOlgk6oCnbIjRFpNkJl/DeDGVS9pLYi8TG7Q==',key_name='tempest-keypair-1901490093',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40ce50192a9743b59a9430163dd6a51c',ramdisk_id='',reservation_id='r-jp00s4ms',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1283031547',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1283031547-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1283031547',owner_user_name='tempest-TestVolumeBootPattern-1283031547-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:56:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ab77040a7b9846d28dc08852d678d1ed',uuid=709be95b-5dbf-4291-b68e-a1e8f077f91e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75d34b6d-32ab-48bd-aa27-6fbf036ec234", "address": "fa:16:3e:6a:08:16", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75d34b6d-32", "ovs_interfaceid": "75d34b6d-32ab-48bd-aa27-6fbf036ec234", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Converting VIF {"id": "75d34b6d-32ab-48bd-aa27-6fbf036ec234", "address": "fa:16:3e:6a:08:16", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75d34b6d-32", "ovs_interfaceid": "75d34b6d-32ab-48bd-aa27-6fbf036ec234", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:08:16,bridge_name='br-int',has_traffic_filtering=True,id=75d34b6d-32ab-48bd-aa27-6fbf036ec234,network=Network(a13f532d-a30d-4c06-83fe-760bcffae183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75d34b6d-32') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG nova.objects.instance [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lazy-loading 'pci_devices' on Instance uuid 709be95b-5dbf-4291-b68e-a1e8f077f91e {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[8831434e-305a-4a92-b004-def85bea29ec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 03:56:50 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc -p 172.16.0.220:3260 --interface default --op new {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] End _get_guest_xml xml=<domain type="kvm">
Nov 16 03:56:50 user nova-compute[103546]:   <uuid>709be95b-5dbf-4291-b68e-a1e8f077f91e</uuid>
Nov 16 03:56:50 user nova-compute[103546]:   <name>instance-0000001e</name>
Nov 16 03:56:50 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 03:56:50 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 03:56:50 user nova-compute[103546]:   <metadata>
Nov 16 03:56:50 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 03:56:50 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 03:56:50 user nova-compute[103546]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-263568704</nova:name>
Nov 16 03:56:50 user nova-compute[103546]:       <nova:creationTime>2023-11-16 03:56:48</nova:creationTime>
Nov 16 03:56:50 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 03:56:50 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 03:56:50 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 03:56:50 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 03:56:50 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 03:56:50 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 03:56:50 user nova-compute[103546]:       </nova:flavor>
Nov 16 03:56:50 user nova-compute[103546]:       <nova:owner>
Nov 16 03:56:50 user nova-compute[103546]:         <nova:user uuid="ab77040a7b9846d28dc08852d678d1ed">tempest-TestVolumeBootPattern-1283031547-project-member</nova:user>
Nov 16 03:56:50 user nova-compute[103546]:         <nova:project uuid="40ce50192a9743b59a9430163dd6a51c">tempest-TestVolumeBootPattern-1283031547</nova:project>
Nov 16 03:56:50 user nova-compute[103546]:       </nova:owner>
Nov 16 03:56:50 user nova-compute[103546]:       <nova:root type="image" uuid="e3a926cc-8023-44a2-84b7-d8211f0d8e26"/>
Nov 16 03:56:50 user nova-compute[103546]:       <nova:ports>
Nov 16 03:56:50 user nova-compute[103546]:         <nova:port uuid="75d34b6d-32ab-48bd-aa27-6fbf036ec234">
Nov 16 03:56:50 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 03:56:50 user nova-compute[103546]:         </nova:port>
Nov 16 03:56:50 user nova-compute[103546]:       </nova:ports>
Nov 16 03:56:50 user nova-compute[103546]:     </nova:instance>
Nov 16 03:56:50 user nova-compute[103546]:   </metadata>
Nov 16 03:56:50 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 03:56:50 user nova-compute[103546]:     <system>
Nov 16 03:56:50 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 03:56:50 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 03:56:50 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 03:56:50 user nova-compute[103546]:       <entry name="serial">709be95b-5dbf-4291-b68e-a1e8f077f91e</entry>
Nov 16 03:56:50 user nova-compute[103546]:       <entry name="uuid">709be95b-5dbf-4291-b68e-a1e8f077f91e</entry>
Nov 16 03:56:50 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 03:56:50 user nova-compute[103546]:     </system>
Nov 16 03:56:50 user nova-compute[103546]:   </sysinfo>
Nov 16 03:56:50 user nova-compute[103546]:   <os>
Nov 16 03:56:50 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 03:56:50 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 03:56:50 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 03:56:50 user nova-compute[103546]:   </os>
Nov 16 03:56:50 user nova-compute[103546]:   <features>
Nov 16 03:56:50 user nova-compute[103546]:     <acpi/>
Nov 16 03:56:50 user nova-compute[103546]:     <apic/>
Nov 16 03:56:50 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 03:56:50 user nova-compute[103546]:   </features>
Nov 16 03:56:50 user nova-compute[103546]:   <clock offset="utc">
Nov 16 03:56:50 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 03:56:50 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 03:56:50 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 03:56:50 user nova-compute[103546]:   </clock>
Nov 16 03:56:50 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 03:56:50 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 03:56:50 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 03:56:50 user nova-compute[103546]:   </cpu>
Nov 16 03:56:50 user nova-compute[103546]:   <devices>
Nov 16 03:56:50 user nova-compute[103546]:     <disk type="block" device="disk">
Nov 16 03:56:50 user nova-compute[103546]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 03:56:50 user nova-compute[103546]:       <source dev="/dev/sdc"/>
Nov 16 03:56:50 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 03:56:50 user nova-compute[103546]:       <serial>28aeb543-e70b-479e-b1c9-65fb682c9283</serial>
Nov 16 03:56:50 user nova-compute[103546]:     </disk>
Nov 16 03:56:50 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 03:56:50 user nova-compute[103546]:       <mac address="fa:16:3e:6a:08:16"/>
Nov 16 03:56:50 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:56:50 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 03:56:50 user nova-compute[103546]:       <target dev="tap75d34b6d-32"/>
Nov 16 03:56:50 user nova-compute[103546]:     </interface>
Nov 16 03:56:50 user nova-compute[103546]:     <serial type="pty">
Nov 16 03:56:50 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/709be95b-5dbf-4291-b68e-a1e8f077f91e/console.log" append="off"/>
Nov 16 03:56:50 user nova-compute[103546]:     </serial>
Nov 16 03:56:50 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 03:56:50 user nova-compute[103546]:     <video>
Nov 16 03:56:50 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:56:50 user nova-compute[103546]:     </video>
Nov 16 03:56:50 user nova-compute[103546]:     <rng model="virtio">
Nov 16 03:56:50 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 03:56:50 user nova-compute[103546]:     </rng>
Nov 16 03:56:50 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 03:56:50 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 03:56:50 user nova-compute[103546]:       <stats period="10"/>
Nov 16 03:56:50 user nova-compute[103546]:     </memballoon>
Nov 16 03:56:50 user nova-compute[103546]:   </devices>
Nov 16 03:56:50 user nova-compute[103546]: </domain>
Nov 16 03:56:50 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:56:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-263568704',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-263568704',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-263568704',id=30,image_ref='e3a926cc-8023-44a2-84b7-d8211f0d8e26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJvQIzvXYHIpYfXfhd4U/osksmky+SFNQRPgvulHfz4FLBtDTFZIQDNMsPOpw0IHXC+c0NClsUnhpcAcH1s4l3q/6fZ5PsXOlgk6oCnbIjRFpNkJl/DeDGVS9pLYi8TG7Q==',key_name='tempest-keypair-1901490093',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40ce50192a9743b59a9430163dd6a51c',ramdisk_id='',reservation_id='r-jp00s4ms',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1283031547',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1283031547-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1283031547',owner_user_name='tempest-TestVolumeBootPattern-1283031547-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:56:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ab77040a7b9846d28dc08852d678d1ed',uuid=709be95b-5dbf-4291-b68e-a1e8f077f91e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75d34b6d-32ab-48bd-aa27-6fbf036ec234", "address": "fa:16:3e:6a:08:16", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75d34b6d-32", "ovs_interfaceid": "75d34b6d-32ab-48bd-aa27-6fbf036ec234", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Converting VIF {"id": "75d34b6d-32ab-48bd-aa27-6fbf036ec234", "address": "fa:16:3e:6a:08:16", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75d34b6d-32", "ovs_interfaceid": "75d34b6d-32ab-48bd-aa27-6fbf036ec234", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:08:16,bridge_name='br-int',has_traffic_filtering=True,id=75d34b6d-32ab-48bd-aa27-6fbf036ec234,network=Network(a13f532d-a30d-4c06-83fe-760bcffae183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75d34b6d-32') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG os_vif [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:08:16,bridge_name='br-int',has_traffic_filtering=True,id=75d34b6d-32ab-48bd-aa27-6fbf036ec234,network=Network(a13f532d-a30d-4c06-83fe-760bcffae183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75d34b6d-32') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1e9774e8-cbf5-5137-bca2-3649b3791bb6', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2f3d63-7388-40d4-a03b-01ac64f44246]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc] added\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc] added
Nov 16 03:56:50 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap75d34b6d-32, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap75d34b6d-32, col_values=(('qos', UUID('9a2249df-2faa-4198-9c8c-2a265a048a5e')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap75d34b6d-32, col_values=(('external_ids', {'iface-id': '75d34b6d-32ab-48bd-aa27-6fbf036ec234', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:08:16', 'vm-uuid': '709be95b-5dbf-4291-b68e-a1e8f077f91e'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:50 user nova-compute[103546]: INFO os_vif [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:08:16,bridge_name='br-int',has_traffic_filtering=True,id=75d34b6d-32ab-48bd-aa27-6fbf036ec234,network=Network(a13f532d-a30d-4c06-83fe-760bcffae183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75d34b6d-32')
Nov 16 03:56:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[06cea1a2-7932-43d3-a99e-cff3336075a7]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3285eb-d30b-4a43-8389-a240f162862d]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IwNpXAPB {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IwNpXAPB" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[1120c109-4a8e-4228-a401-65fb10224f9b]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IwNpXAPB'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] No VIF found with MAC fa:16:3e:6a:08:16, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a569cee3-784d-4719-82eb-2734fc090d5b]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[98af4b10-0585-481e-afe5-19d3f7c32d11]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:56:50 user nova-compute[103546]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)
Nov 16 03:56:50 user nova-compute[103546]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 (non-flash)
Nov 16 03:56:50 user nova-compute[103546]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283 (non-flash)
Nov 16 03:56:50 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:56:50 user nova-compute[103546]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)
Nov 16 03:56:50 user nova-compute[103546]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 (non-flash)
Nov 16 03:56:50 user nova-compute[103546]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283 (non-flash)
Nov 16 03:56:50 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc -p 172.16.0.220:3260 --login {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a47297-2035-44a1-8d67-4f70c4064c3f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc, portal: 172.16.0.220,3260]
Nov 16 03:56:50 user nova-compute[103546]: Login to [iface: default, target: iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc, portal: 172.16.0.220,3260] successful.
Nov 16 03:56:50 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[538132f6-2069-42b7-b4be-5021f85215dd]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeffee27-8927-4e4e-ac12-d7d321bcd1ce]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:56:50 user nova-compute[103546]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)
Nov 16 03:56:50 user nova-compute[103546]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 (non-flash)
Nov 16 03:56:50 user nova-compute[103546]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283 (non-flash)
Nov 16 03:56:50 user nova-compute[103546]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc (non-flash)
Nov 16 03:56:50 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:56:50 user nova-compute[103546]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)
Nov 16 03:56:50 user nova-compute[103546]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 (non-flash)
Nov 16 03:56:50 user nova-compute[103546]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283 (non-flash)
Nov 16 03:56:50 user nova-compute[103546]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc (non-flash)
Nov 16 03:56:50 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.387s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] HCTL ('37', '-', '-', 0) found on session 35 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1100d4-e32e-422e-b969-d2bfc2e299e2]: (4, ('- - 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Searching for a device in session 35 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 03:56:50 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IwNpXAPB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 03:56:51 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.429s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:56:51 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] <== connect_volume: return (2847ms) {'type': 'block', 'scsi_wwn': '26434656135376334', 'path': '/dev/sdf'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:56:51 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434656135376334', 'path': '/dev/sdf'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 03:56:51 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T03:54:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-209964559',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-141615707',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1Y2L2l3MWVbNwdnSdeRUxJz0N8le0D37MGjqwWaMwxA7R3Wdx+y5O8T7rTKllDINxi17uE0eTWUeh3EwdhWWGhIv3K2uMZjagCC2gLDhzEp415K3OXZdfZ5QqNTz5yjQ==',key_name='tempest-keypair-336828995',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:54:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='957a9e268fe7460c97fce1e634015214',ramdisk_id='',reservation_id='r-f4s0l7jd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-787129566',owner_user_name='tempest-ServerActionsV293TestJSON-787129566-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:56:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fff2b2e712c1466991b73ead603bcf8f',uuid=2ab80244-d70d-41ce-9b7e-bb9c8a676ad6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "49c54f9c-e72e-4cdf-96d3-7c31d8ed5109", "address": "fa:16:3e:5a:f3:7f", "network": {"id": "ad0d15aa-3eb9-452a-8c1e-f98a235beb89", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-981191229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "957a9e268fe7460c97fce1e634015214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49c54f9c-e7", "ovs_interfaceid": "49c54f9c-e72e-4cdf-96d3-7c31d8ed5109", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 03:56:51 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Converting VIF {"id": "49c54f9c-e72e-4cdf-96d3-7c31d8ed5109", "address": "fa:16:3e:5a:f3:7f", "network": {"id": "ad0d15aa-3eb9-452a-8c1e-f98a235beb89", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-981191229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "957a9e268fe7460c97fce1e634015214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49c54f9c-e7", "ovs_interfaceid": "49c54f9c-e72e-4cdf-96d3-7c31d8ed5109", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:56:51 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5a:f3:7f,bridge_name='br-int',has_traffic_filtering=True,id=49c54f9c-e72e-4cdf-96d3-7c31d8ed5109,network=Network(ad0d15aa-3eb9-452a-8c1e-f98a235beb89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49c54f9c-e7') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:56:51 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] End _get_guest_xml xml=<domain type="kvm">
Nov 16 03:56:51 user nova-compute[103546]:   <uuid>2ab80244-d70d-41ce-9b7e-bb9c8a676ad6</uuid>
Nov 16 03:56:51 user nova-compute[103546]:   <name>instance-00000019</name>
Nov 16 03:56:51 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 03:56:51 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 03:56:51 user nova-compute[103546]:   <metadata>
Nov 16 03:56:51 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 03:56:51 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 03:56:51 user nova-compute[103546]:       <nova:name>tempest-ServerActionsV293TestJSON-server-209964559</nova:name>
Nov 16 03:56:51 user nova-compute[103546]:       <nova:creationTime>2023-11-16 03:56:48</nova:creationTime>
Nov 16 03:56:51 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 03:56:51 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 03:56:51 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 03:56:51 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 03:56:51 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 03:56:51 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 03:56:51 user nova-compute[103546]:       </nova:flavor>
Nov 16 03:56:51 user nova-compute[103546]:       <nova:owner>
Nov 16 03:56:51 user nova-compute[103546]:         <nova:user uuid="fff2b2e712c1466991b73ead603bcf8f">tempest-ServerActionsV293TestJSON-787129566-project-member</nova:user>
Nov 16 03:56:51 user nova-compute[103546]:         <nova:project uuid="957a9e268fe7460c97fce1e634015214">tempest-ServerActionsV293TestJSON-787129566</nova:project>
Nov 16 03:56:51 user nova-compute[103546]:       </nova:owner>
Nov 16 03:56:51 user nova-compute[103546]:       <nova:ports>
Nov 16 03:56:51 user nova-compute[103546]:         <nova:port uuid="49c54f9c-e72e-4cdf-96d3-7c31d8ed5109">
Nov 16 03:56:51 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 16 03:56:51 user nova-compute[103546]:         </nova:port>
Nov 16 03:56:51 user nova-compute[103546]:       </nova:ports>
Nov 16 03:56:51 user nova-compute[103546]:     </nova:instance>
Nov 16 03:56:51 user nova-compute[103546]:   </metadata>
Nov 16 03:56:51 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 03:56:51 user nova-compute[103546]:     <system>
Nov 16 03:56:51 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 03:56:51 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 03:56:51 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 03:56:51 user nova-compute[103546]:       <entry name="serial">2ab80244-d70d-41ce-9b7e-bb9c8a676ad6</entry>
Nov 16 03:56:51 user nova-compute[103546]:       <entry name="uuid">2ab80244-d70d-41ce-9b7e-bb9c8a676ad6</entry>
Nov 16 03:56:51 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 03:56:51 user nova-compute[103546]:     </system>
Nov 16 03:56:51 user nova-compute[103546]:   </sysinfo>
Nov 16 03:56:51 user nova-compute[103546]:   <os>
Nov 16 03:56:51 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 03:56:51 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 03:56:51 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 03:56:51 user nova-compute[103546]:   </os>
Nov 16 03:56:51 user nova-compute[103546]:   <features>
Nov 16 03:56:51 user nova-compute[103546]:     <acpi/>
Nov 16 03:56:51 user nova-compute[103546]:     <apic/>
Nov 16 03:56:51 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 03:56:51 user nova-compute[103546]:   </features>
Nov 16 03:56:51 user nova-compute[103546]:   <clock offset="utc">
Nov 16 03:56:51 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 03:56:51 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 03:56:51 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 03:56:51 user nova-compute[103546]:   </clock>
Nov 16 03:56:51 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 03:56:51 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 03:56:51 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 03:56:51 user nova-compute[103546]:   </cpu>
Nov 16 03:56:51 user nova-compute[103546]:   <devices>
Nov 16 03:56:51 user nova-compute[103546]:     <disk type="block" device="disk">
Nov 16 03:56:51 user nova-compute[103546]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 03:56:51 user nova-compute[103546]:       <source dev="/dev/sdf"/>
Nov 16 03:56:51 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 03:56:51 user nova-compute[103546]:       <serial>5cdf8533-74a7-4737-b4af-2a9ae07490fc</serial>
Nov 16 03:56:51 user nova-compute[103546]:     </disk>
Nov 16 03:56:51 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 03:56:51 user nova-compute[103546]:       <mac address="fa:16:3e:5a:f3:7f"/>
Nov 16 03:56:51 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:56:51 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 03:56:51 user nova-compute[103546]:       <target dev="tap49c54f9c-e7"/>
Nov 16 03:56:51 user nova-compute[103546]:     </interface>
Nov 16 03:56:51 user nova-compute[103546]:     <serial type="pty">
Nov 16 03:56:51 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/2ab80244-d70d-41ce-9b7e-bb9c8a676ad6/console.log" append="off"/>
Nov 16 03:56:51 user nova-compute[103546]:     </serial>
Nov 16 03:56:51 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 03:56:51 user nova-compute[103546]:     <video>
Nov 16 03:56:51 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:56:51 user nova-compute[103546]:     </video>
Nov 16 03:56:51 user nova-compute[103546]:     <rng model="virtio">
Nov 16 03:56:51 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 03:56:51 user nova-compute[103546]:     </rng>
Nov 16 03:56:51 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 03:56:51 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 03:56:51 user nova-compute[103546]:       <stats period="10"/>
Nov 16 03:56:51 user nova-compute[103546]:     </memballoon>
Nov 16 03:56:51 user nova-compute[103546]:   </devices>
Nov 16 03:56:51 user nova-compute[103546]: </domain>
Nov 16 03:56:51 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 03:56:51 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T03:54:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-209964559',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-141615707',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1Y2L2l3MWVbNwdnSdeRUxJz0N8le0D37MGjqwWaMwxA7R3Wdx+y5O8T7rTKllDINxi17uE0eTWUeh3EwdhWWGhIv3K2uMZjagCC2gLDhzEp415K3OXZdfZ5QqNTz5yjQ==',key_name='tempest-keypair-336828995',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:54:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='957a9e268fe7460c97fce1e634015214',ramdisk_id='',reservation_id='r-f4s0l7jd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-787129566',owner_user_name='tempest-ServerActionsV293TestJSON-787129566-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:56:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fff2b2e712c1466991b73ead603bcf8f',uuid=2ab80244-d70d-41ce-9b7e-bb9c8a676ad6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "49c54f9c-e72e-4cdf-96d3-7c31d8ed5109", "address": "fa:16:3e:5a:f3:7f", "network": {"id": "ad0d15aa-3eb9-452a-8c1e-f98a235beb89", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-981191229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "957a9e268fe7460c97fce1e634015214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49c54f9c-e7", "ovs_interfaceid": "49c54f9c-e72e-4cdf-96d3-7c31d8ed5109", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 03:56:51 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Converting VIF {"id": "49c54f9c-e72e-4cdf-96d3-7c31d8ed5109", "address": "fa:16:3e:5a:f3:7f", "network": {"id": "ad0d15aa-3eb9-452a-8c1e-f98a235beb89", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-981191229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "957a9e268fe7460c97fce1e634015214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49c54f9c-e7", "ovs_interfaceid": "49c54f9c-e72e-4cdf-96d3-7c31d8ed5109", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:56:51 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5a:f3:7f,bridge_name='br-int',has_traffic_filtering=True,id=49c54f9c-e72e-4cdf-96d3-7c31d8ed5109,network=Network(ad0d15aa-3eb9-452a-8c1e-f98a235beb89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49c54f9c-e7') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:56:51 user nova-compute[103546]: DEBUG os_vif [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:f3:7f,bridge_name='br-int',has_traffic_filtering=True,id=49c54f9c-e72e-4cdf-96d3-7c31d8ed5109,network=Network(ad0d15aa-3eb9-452a-8c1e-f98a235beb89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49c54f9c-e7') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 03:56:51 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:51 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:56:51 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 03:56:51 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:51 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '362c5c70-c98d-5788-a5e8-8deeae2787d5', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:56:51 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:51 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:56:51 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:51 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:51 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap49c54f9c-e7, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:56:51 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap49c54f9c-e7, col_values=(('qos', UUID('f1324e76-892e-4e91-afab-1f21c3e70037')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:56:51 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap49c54f9c-e7, col_values=(('external_ids', {'iface-id': '49c54f9c-e72e-4cdf-96d3-7c31d8ed5109', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:f3:7f', 'vm-uuid': '2ab80244-d70d-41ce-9b7e-bb9c8a676ad6'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:56:51 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:51 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:56:51 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:51 user nova-compute[103546]: INFO os_vif [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:f3:7f,bridge_name='br-int',has_traffic_filtering=True,id=49c54f9c-e72e-4cdf-96d3-7c31d8ed5109,network=Network(ad0d15aa-3eb9-452a-8c1e-f98a235beb89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49c54f9c-e7')
Nov 16 03:56:51 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:56:51 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] No VIF found with MAC fa:16:3e:5a:f3:7f, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 03:56:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:52 user nova-compute[103546]: DEBUG nova.compute.manager [req-c14c16c2-9e64-42e9-b796-c897d73c8029 req-76329ee9-aaac-4fbf-a324-a702fb127112 service nova] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] Received event network-vif-plugged-75d34b6d-32ab-48bd-aa27-6fbf036ec234 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:56:52 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-c14c16c2-9e64-42e9-b796-c897d73c8029 req-76329ee9-aaac-4fbf-a324-a702fb127112 service nova] Acquiring lock "709be95b-5dbf-4291-b68e-a1e8f077f91e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:56:52 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-c14c16c2-9e64-42e9-b796-c897d73c8029 req-76329ee9-aaac-4fbf-a324-a702fb127112 service nova] Lock "709be95b-5dbf-4291-b68e-a1e8f077f91e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:56:52 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-c14c16c2-9e64-42e9-b796-c897d73c8029 req-76329ee9-aaac-4fbf-a324-a702fb127112 service nova] Lock "709be95b-5dbf-4291-b68e-a1e8f077f91e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:56:52 user nova-compute[103546]: DEBUG nova.compute.manager [req-c14c16c2-9e64-42e9-b796-c897d73c8029 req-76329ee9-aaac-4fbf-a324-a702fb127112 service nova] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] No waiting events found dispatching network-vif-plugged-75d34b6d-32ab-48bd-aa27-6fbf036ec234 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:56:52 user nova-compute[103546]: WARNING nova.compute.manager [req-c14c16c2-9e64-42e9-b796-c897d73c8029 req-76329ee9-aaac-4fbf-a324-a702fb127112 service nova] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] Received unexpected event network-vif-plugged-75d34b6d-32ab-48bd-aa27-6fbf036ec234 for instance with vm_state building and task_state spawning.
Nov 16 03:56:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:53 user nova-compute[103546]: DEBUG nova.compute.manager [req-3c45760c-b028-4131-9dbf-6fc07d66c891 req-2dfc3352-bdd1-4e68-bd2d-c45808c8ce3d service nova] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Received event network-vif-plugged-49c54f9c-e72e-4cdf-96d3-7c31d8ed5109 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:56:53 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3c45760c-b028-4131-9dbf-6fc07d66c891 req-2dfc3352-bdd1-4e68-bd2d-c45808c8ce3d service nova] Acquiring lock "2ab80244-d70d-41ce-9b7e-bb9c8a676ad6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:56:53 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3c45760c-b028-4131-9dbf-6fc07d66c891 req-2dfc3352-bdd1-4e68-bd2d-c45808c8ce3d service nova] Lock "2ab80244-d70d-41ce-9b7e-bb9c8a676ad6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:56:53 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3c45760c-b028-4131-9dbf-6fc07d66c891 req-2dfc3352-bdd1-4e68-bd2d-c45808c8ce3d service nova] Lock "2ab80244-d70d-41ce-9b7e-bb9c8a676ad6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:56:53 user nova-compute[103546]: DEBUG nova.compute.manager [req-3c45760c-b028-4131-9dbf-6fc07d66c891 req-2dfc3352-bdd1-4e68-bd2d-c45808c8ce3d service nova] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] No waiting events found dispatching network-vif-plugged-49c54f9c-e72e-4cdf-96d3-7c31d8ed5109 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:56:53 user nova-compute[103546]: WARNING nova.compute.manager [req-3c45760c-b028-4131-9dbf-6fc07d66c891 req-2dfc3352-bdd1-4e68-bd2d-c45808c8ce3d service nova] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Received unexpected event network-vif-plugged-49c54f9c-e72e-4cdf-96d3-7c31d8ed5109 for instance with vm_state active and task_state rebuild_spawning.
Nov 16 03:56:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:54 user nova-compute[103546]: DEBUG nova.compute.manager [req-17243e54-e2db-460e-a745-e9eec4317384 req-52c6383f-340d-46cf-9bb4-048ddf4dfe6a service nova] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] Received event network-vif-plugged-75d34b6d-32ab-48bd-aa27-6fbf036ec234 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:56:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-17243e54-e2db-460e-a745-e9eec4317384 req-52c6383f-340d-46cf-9bb4-048ddf4dfe6a service nova] Acquiring lock "709be95b-5dbf-4291-b68e-a1e8f077f91e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:56:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-17243e54-e2db-460e-a745-e9eec4317384 req-52c6383f-340d-46cf-9bb4-048ddf4dfe6a service nova] Lock "709be95b-5dbf-4291-b68e-a1e8f077f91e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:56:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-17243e54-e2db-460e-a745-e9eec4317384 req-52c6383f-340d-46cf-9bb4-048ddf4dfe6a service nova] Lock "709be95b-5dbf-4291-b68e-a1e8f077f91e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:56:54 user nova-compute[103546]: DEBUG nova.compute.manager [req-17243e54-e2db-460e-a745-e9eec4317384 req-52c6383f-340d-46cf-9bb4-048ddf4dfe6a service nova] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] No waiting events found dispatching network-vif-plugged-75d34b6d-32ab-48bd-aa27-6fbf036ec234 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:56:54 user nova-compute[103546]: WARNING nova.compute.manager [req-17243e54-e2db-460e-a745-e9eec4317384 req-52c6383f-340d-46cf-9bb4-048ddf4dfe6a service nova] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] Received unexpected event network-vif-plugged-75d34b6d-32ab-48bd-aa27-6fbf036ec234 for instance with vm_state building and task_state spawning.
Nov 16 03:56:55 user nova-compute[103546]: DEBUG nova.compute.manager [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 03:56:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] Guest created on hypervisor {{(pid=103546) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 03:56:55 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] Instance spawned successfully.
Nov 16 03:56:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 03:56:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] Found default for hw_input_bus of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:56:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] Found default for hw_pointer_model of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:56:55 user nova-compute[103546]: INFO nova.compute.manager [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] Took 6.65 seconds to spawn the instance on the hypervisor.
Nov 16 03:56:55 user nova-compute[103546]: DEBUG nova.compute.manager [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 03:56:55 user nova-compute[103546]: INFO nova.compute.manager [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] Took 26.35 seconds to build instance.
Nov 16 03:56:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-5eb7fd3e-f640-4a8e-a954-b16415390bfb tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "709be95b-5dbf-4291-b68e-a1e8f077f91e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.512s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:56:55 user nova-compute[103546]: DEBUG nova.compute.manager [req-e935cf16-57ce-49a9-b693-9432622aa65f req-02be58b6-bc08-480a-add8-df7b001d230f service nova] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Received event network-vif-plugged-49c54f9c-e72e-4cdf-96d3-7c31d8ed5109 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:56:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-e935cf16-57ce-49a9-b693-9432622aa65f req-02be58b6-bc08-480a-add8-df7b001d230f service nova] Acquiring lock "2ab80244-d70d-41ce-9b7e-bb9c8a676ad6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:56:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-e935cf16-57ce-49a9-b693-9432622aa65f req-02be58b6-bc08-480a-add8-df7b001d230f service nova] Lock "2ab80244-d70d-41ce-9b7e-bb9c8a676ad6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:56:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-e935cf16-57ce-49a9-b693-9432622aa65f req-02be58b6-bc08-480a-add8-df7b001d230f service nova] Lock "2ab80244-d70d-41ce-9b7e-bb9c8a676ad6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:56:55 user nova-compute[103546]: DEBUG nova.compute.manager [req-e935cf16-57ce-49a9-b693-9432622aa65f req-02be58b6-bc08-480a-add8-df7b001d230f service nova] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] No waiting events found dispatching network-vif-plugged-49c54f9c-e72e-4cdf-96d3-7c31d8ed5109 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:56:55 user nova-compute[103546]: WARNING nova.compute.manager [req-e935cf16-57ce-49a9-b693-9432622aa65f req-02be58b6-bc08-480a-add8-df7b001d230f service nova] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Received unexpected event network-vif-plugged-49c54f9c-e72e-4cdf-96d3-7c31d8ed5109 for instance with vm_state active and task_state rebuild_spawning.
Nov 16 03:56:55 user nova-compute[103546]: DEBUG nova.compute.manager [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 03:56:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Guest created on hypervisor {{(pid=103546) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 03:56:55 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Instance spawned successfully.
Nov 16 03:56:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 03:56:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Found default for hw_cdrom_bus of ide {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:56:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Found default for hw_disk_bus of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:56:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Found default for hw_input_bus of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:56:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Found default for hw_pointer_model of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:56:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Found default for hw_video_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:56:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Found default for hw_vif_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:56:56 user nova-compute[103546]: DEBUG nova.compute.manager [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 03:56:56 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:56:56 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:56:56 user nova-compute[103546]: DEBUG nova.objects.instance [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Trying to apply a migration context that does not seem to be set for this instance {{(pid=103546) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 16 03:56:56 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a96890ae-0c5a-4d18-8aff-9a8fa36cb970 tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.075s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:56:56 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:56:59 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:00 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:01 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:02 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:04 user nova-compute[103546]: INFO nova.compute.manager [None req-575ce607-7298-4057-a720-f033c3b2c4ec tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Rescuing
Nov 16 03:57:04 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-575ce607-7298-4057-a720-f033c3b2c4ec tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Acquiring lock "refresh_cache-8d229d05-95f1-4997-8539-802ac65cff8b" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:57:04 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-575ce607-7298-4057-a720-f033c3b2c4ec tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Acquired lock "refresh_cache-8d229d05-95f1-4997-8539-802ac65cff8b" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:57:04 user nova-compute[103546]: DEBUG nova.network.neutron [None req-575ce607-7298-4057-a720-f033c3b2c4ec tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 03:57:04 user nova-compute[103546]: DEBUG nova.network.neutron [None req-575ce607-7298-4057-a720-f033c3b2c4ec tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Updating instance_info_cache with network_info: [{"id": "5c802613-81ea-4855-a8ee-d851a4ab2ff5", "address": "fa:16:3e:01:69:11", "network": {"id": "337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-40560053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca049d5674dc4c59814f98478752d73d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c802613-81", "ovs_interfaceid": "5c802613-81ea-4855-a8ee-d851a4ab2ff5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:57:04 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-575ce607-7298-4057-a720-f033c3b2c4ec tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Releasing lock "refresh_cache-8d229d05-95f1-4997-8539-802ac65cff8b" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:57:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:05 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:05 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:05 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:05 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:05 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Instance destroyed successfully.
Nov 16 03:57:05 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-575ce607-7298-4057-a720-f033c3b2c4ec tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Attempting rescue
Nov 16 03:57:05 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-575ce607-7298-4057-a720-f033c3b2c4ec tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=103546) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 16 03:57:05 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-575ce607-7298-4057-a720-f033c3b2c4ec tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Instance directory exists: not creating {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 16 03:57:05 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-575ce607-7298-4057-a720-f033c3b2c4ec tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Creating image(s)
Nov 16 03:57:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-575ce607-7298-4057-a720-f033c3b2c4ec tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Acquiring lock "/opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:57:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-575ce607-7298-4057-a720-f033c3b2c4ec tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "/opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:57:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-575ce607-7298-4057-a720-f033c3b2c4ec tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "/opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:57:05 user nova-compute[103546]: DEBUG nova.objects.instance [None req-575ce607-7298-4057-a720-f033c3b2c4ec tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8d229d05-95f1-4997-8539-802ac65cff8b {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:57:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-575ce607-7298-4057-a720-f033c3b2c4ec tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Acquiring lock "8c9efafb670bfe5842ba1f4ce398924612164af7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:57:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-575ce607-7298-4057-a720-f033c3b2c4ec tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:57:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-575ce607-7298-4057-a720-f033c3b2c4ec tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:57:06 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-575ce607-7298-4057-a720-f033c3b2c4ec tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.199s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:57:06 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-575ce607-7298-4057-a720-f033c3b2c4ec tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.rescue {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:57:06 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-575ce607-7298-4057-a720-f033c3b2c4ec tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.rescue" returned: 0 in 0.061s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:57:06 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-575ce607-7298-4057-a720-f033c3b2c4ec tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:57:06 user nova-compute[103546]: DEBUG nova.objects.instance [None req-575ce607-7298-4057-a720-f033c3b2c4ec tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lazy-loading 'migration_context' on Instance uuid 8d229d05-95f1-4997-8539-802ac65cff8b {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:57:06 user nova-compute[103546]: DEBUG nova.objects.base [None req-575ce607-7298-4057-a720-f033c3b2c4ec tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Object Instance<8d229d05-95f1-4997-8539-802ac65cff8b> lazy-loaded attributes: trusted_certs,migration_context {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 03:57:06 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-575ce607-7298-4057-a720-f033c3b2c4ec tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Created local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 03:57:06 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-575ce607-7298-4057-a720-f033c3b2c4ec tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Start _get_guest_xml network_info=[{"id": "5c802613-81ea-4855-a8ee-d851a4ab2ff5", "address": "fa:16:3e:01:69:11", "network": {"id": "337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-40560053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-40560053-network", "vif_mac": "fa:16:3e:01:69:11"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca049d5674dc4c59814f98478752d73d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c802613-81", "ovs_interfaceid": "5c802613-81ea-4855-a8ee-d851a4ab2ff5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '5c6f539a-01e5-4478-bf8f-a14310b5d7dd', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 03:57:06 user nova-compute[103546]: DEBUG nova.objects.instance [None req-575ce607-7298-4057-a720-f033c3b2c4ec tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lazy-loading 'resources' on Instance uuid 8d229d05-95f1-4997-8539-802ac65cff8b {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:57:06 user nova-compute[103546]: DEBUG nova.objects.base [None req-575ce607-7298-4057-a720-f033c3b2c4ec tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Object Instance<8d229d05-95f1-4997-8539-802ac65cff8b> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 03:57:06 user nova-compute[103546]: DEBUG nova.objects.instance [None req-575ce607-7298-4057-a720-f033c3b2c4ec tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lazy-loading 'numa_topology' on Instance uuid 8d229d05-95f1-4997-8539-802ac65cff8b {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:57:06 user nova-compute[103546]: DEBUG nova.objects.base [None req-575ce607-7298-4057-a720-f033c3b2c4ec tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Object Instance<8d229d05-95f1-4997-8539-802ac65cff8b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 03:57:06 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-575ce607-7298-4057-a720-f033c3b2c4ec tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:57:06 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-575ce607-7298-4057-a720-f033c3b2c4ec tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:57:06 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-575ce607-7298-4057-a720-f033c3b2c4ec tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 03:57:06 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-575ce607-7298-4057-a720-f033c3b2c4ec tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 03:57:06 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-575ce607-7298-4057-a720-f033c3b2c4ec tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 03:57:06 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-575ce607-7298-4057-a720-f033c3b2c4ec tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 03:57:06 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-575ce607-7298-4057-a720-f033c3b2c4ec tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 03:57:06 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-575ce607-7298-4057-a720-f033c3b2c4ec tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 03:57:06 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-575ce607-7298-4057-a720-f033c3b2c4ec tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 03:57:06 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-575ce607-7298-4057-a720-f033c3b2c4ec tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 03:57:06 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-575ce607-7298-4057-a720-f033c3b2c4ec tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 03:57:06 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-575ce607-7298-4057-a720-f033c3b2c4ec tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 03:57:06 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-575ce607-7298-4057-a720-f033c3b2c4ec tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 03:57:06 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-575ce607-7298-4057-a720-f033c3b2c4ec tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 03:57:06 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-575ce607-7298-4057-a720-f033c3b2c4ec tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 03:57:06 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-575ce607-7298-4057-a720-f033c3b2c4ec tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 03:57:06 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-575ce607-7298-4057-a720-f033c3b2c4ec tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 03:57:06 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-575ce607-7298-4057-a720-f033c3b2c4ec tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 03:57:06 user nova-compute[103546]: DEBUG nova.objects.instance [None req-575ce607-7298-4057-a720-f033c3b2c4ec tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8d229d05-95f1-4997-8539-802ac65cff8b {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:57:06 user nova-compute[103546]: DEBUG nova.objects.base [None req-575ce607-7298-4057-a720-f033c3b2c4ec tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Object Instance<8d229d05-95f1-4997-8539-802ac65cff8b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 03:57:06 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-575ce607-7298-4057-a720-f033c3b2c4ec tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:55:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-293131064',display_name='tempest-ServerRescueNegativeTestJSON-server-293131064',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-293131064',id=28,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:55:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ca049d5674dc4c59814f98478752d73d',ramdisk_id='',reservation_id='r-cqeuglk4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1943614153',owner_user_name='tempest-ServerRescueNegativeTestJSON-1943614153-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:55:24Z,user_data=None,user_id='7626749c82fb4b5c81e696e4beeed858',uuid=8d229d05-95f1-4997-8539-802ac65cff8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5c802613-81ea-4855-a8ee-d851a4ab2ff5", "address": "fa:16:3e:01:69:11", "network": {"id": "337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-40560053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-40560053-network", "vif_mac": "fa:16:3e:01:69:11"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca049d5674dc4c59814f98478752d73d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c802613-81", "ovs_interfaceid": "5c802613-81ea-4855-a8ee-d851a4ab2ff5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 03:57:06 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-575ce607-7298-4057-a720-f033c3b2c4ec tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Converting VIF {"id": "5c802613-81ea-4855-a8ee-d851a4ab2ff5", "address": "fa:16:3e:01:69:11", "network": {"id": "337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-40560053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-40560053-network", "vif_mac": "fa:16:3e:01:69:11"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca049d5674dc4c59814f98478752d73d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c802613-81", "ovs_interfaceid": "5c802613-81ea-4855-a8ee-d851a4ab2ff5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:57:06 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-575ce607-7298-4057-a720-f033c3b2c4ec tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:69:11,bridge_name='br-int',has_traffic_filtering=True,id=5c802613-81ea-4855-a8ee-d851a4ab2ff5,network=Network(337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c802613-81') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:57:06 user nova-compute[103546]: DEBUG nova.objects.instance [None req-575ce607-7298-4057-a720-f033c3b2c4ec tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lazy-loading 'pci_devices' on Instance uuid 8d229d05-95f1-4997-8539-802ac65cff8b {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:57:06 user nova-compute[103546]: DEBUG nova.objects.base [None req-575ce607-7298-4057-a720-f033c3b2c4ec tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Object Instance<8d229d05-95f1-4997-8539-802ac65cff8b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 03:57:06 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-575ce607-7298-4057-a720-f033c3b2c4ec tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] End _get_guest_xml xml=<domain type="kvm">
Nov 16 03:57:06 user nova-compute[103546]:   <uuid>8d229d05-95f1-4997-8539-802ac65cff8b</uuid>
Nov 16 03:57:06 user nova-compute[103546]:   <name>instance-0000001c</name>
Nov 16 03:57:06 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 03:57:06 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 03:57:06 user nova-compute[103546]:   <metadata>
Nov 16 03:57:06 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 03:57:06 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 03:57:06 user nova-compute[103546]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-293131064</nova:name>
Nov 16 03:57:06 user nova-compute[103546]:       <nova:creationTime>2023-11-16 03:57:06</nova:creationTime>
Nov 16 03:57:06 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 03:57:06 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 03:57:06 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 03:57:06 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 03:57:06 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 03:57:06 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 03:57:06 user nova-compute[103546]:       </nova:flavor>
Nov 16 03:57:06 user nova-compute[103546]:       <nova:owner>
Nov 16 03:57:06 user nova-compute[103546]:         <nova:user uuid="7626749c82fb4b5c81e696e4beeed858">tempest-ServerRescueNegativeTestJSON-1943614153-project-member</nova:user>
Nov 16 03:57:06 user nova-compute[103546]:         <nova:project uuid="ca049d5674dc4c59814f98478752d73d">tempest-ServerRescueNegativeTestJSON-1943614153</nova:project>
Nov 16 03:57:06 user nova-compute[103546]:       </nova:owner>
Nov 16 03:57:06 user nova-compute[103546]:       <nova:root type="image" uuid="5c6f539a-01e5-4478-bf8f-a14310b5d7dd"/>
Nov 16 03:57:06 user nova-compute[103546]:       <nova:ports>
Nov 16 03:57:06 user nova-compute[103546]:         <nova:port uuid="5c802613-81ea-4855-a8ee-d851a4ab2ff5">
Nov 16 03:57:06 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 16 03:57:06 user nova-compute[103546]:         </nova:port>
Nov 16 03:57:06 user nova-compute[103546]:       </nova:ports>
Nov 16 03:57:06 user nova-compute[103546]:     </nova:instance>
Nov 16 03:57:06 user nova-compute[103546]:   </metadata>
Nov 16 03:57:06 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 03:57:06 user nova-compute[103546]:     <system>
Nov 16 03:57:06 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 03:57:06 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 03:57:06 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 03:57:06 user nova-compute[103546]:       <entry name="serial">8d229d05-95f1-4997-8539-802ac65cff8b</entry>
Nov 16 03:57:06 user nova-compute[103546]:       <entry name="uuid">8d229d05-95f1-4997-8539-802ac65cff8b</entry>
Nov 16 03:57:06 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 03:57:06 user nova-compute[103546]:     </system>
Nov 16 03:57:06 user nova-compute[103546]:   </sysinfo>
Nov 16 03:57:06 user nova-compute[103546]:   <os>
Nov 16 03:57:06 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 03:57:06 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 03:57:06 user nova-compute[103546]:   </os>
Nov 16 03:57:06 user nova-compute[103546]:   <features>
Nov 16 03:57:06 user nova-compute[103546]:     <acpi/>
Nov 16 03:57:06 user nova-compute[103546]:     <apic/>
Nov 16 03:57:06 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 03:57:06 user nova-compute[103546]:   </features>
Nov 16 03:57:06 user nova-compute[103546]:   <clock offset="utc">
Nov 16 03:57:06 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 03:57:06 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 03:57:06 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 03:57:06 user nova-compute[103546]:   </clock>
Nov 16 03:57:06 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 03:57:06 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 03:57:06 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 03:57:06 user nova-compute[103546]:   </cpu>
Nov 16 03:57:06 user nova-compute[103546]:   <devices>
Nov 16 03:57:06 user nova-compute[103546]:     <disk type="file" device="disk">
Nov 16 03:57:06 user nova-compute[103546]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 03:57:06 user nova-compute[103546]:       <source file="/opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.rescue"/>
Nov 16 03:57:06 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 03:57:06 user nova-compute[103546]:     </disk>
Nov 16 03:57:06 user nova-compute[103546]:     <disk type="file" device="disk">
Nov 16 03:57:06 user nova-compute[103546]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 03:57:06 user nova-compute[103546]:       <source file="/opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk"/>
Nov 16 03:57:06 user nova-compute[103546]:       <target dev="vdb" bus="virtio"/>
Nov 16 03:57:06 user nova-compute[103546]:     </disk>
Nov 16 03:57:06 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 03:57:06 user nova-compute[103546]:       <mac address="fa:16:3e:01:69:11"/>
Nov 16 03:57:06 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:57:06 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 03:57:06 user nova-compute[103546]:       <target dev="tap5c802613-81"/>
Nov 16 03:57:06 user nova-compute[103546]:     </interface>
Nov 16 03:57:06 user nova-compute[103546]:     <serial type="pty">
Nov 16 03:57:06 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/console.log" append="off"/>
Nov 16 03:57:06 user nova-compute[103546]:     </serial>
Nov 16 03:57:06 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 03:57:06 user nova-compute[103546]:     <video>
Nov 16 03:57:06 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:57:06 user nova-compute[103546]:     </video>
Nov 16 03:57:06 user nova-compute[103546]:     <rng model="virtio">
Nov 16 03:57:06 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 03:57:06 user nova-compute[103546]:     </rng>
Nov 16 03:57:06 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 03:57:06 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 03:57:06 user nova-compute[103546]:       <stats period="10"/>
Nov 16 03:57:06 user nova-compute[103546]:     </memballoon>
Nov 16 03:57:06 user nova-compute[103546]:   </devices>
Nov 16 03:57:06 user nova-compute[103546]: </domain>
Nov 16 03:57:06 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 03:57:06 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Instance destroyed successfully.
Nov 16 03:57:06 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-575ce607-7298-4057-a720-f033c3b2c4ec tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:57:06 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-575ce607-7298-4057-a720-f033c3b2c4ec tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] No BDM found with device name vdb, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:57:06 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-575ce607-7298-4057-a720-f033c3b2c4ec tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] No VIF found with MAC fa:16:3e:01:69:11, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 03:57:06 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:06 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:08 user nova-compute[103546]: DEBUG nova.compute.manager [req-8dac57bc-75e4-4bb5-96b1-aa39f6458515 req-bb4f05fb-c91a-43ae-bd01-f58a4df76944 service nova] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Received event network-vif-unplugged-5c802613-81ea-4855-a8ee-d851a4ab2ff5 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:57:08 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8dac57bc-75e4-4bb5-96b1-aa39f6458515 req-bb4f05fb-c91a-43ae-bd01-f58a4df76944 service nova] Acquiring lock "8d229d05-95f1-4997-8539-802ac65cff8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:57:08 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8dac57bc-75e4-4bb5-96b1-aa39f6458515 req-bb4f05fb-c91a-43ae-bd01-f58a4df76944 service nova] Lock "8d229d05-95f1-4997-8539-802ac65cff8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:57:08 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8dac57bc-75e4-4bb5-96b1-aa39f6458515 req-bb4f05fb-c91a-43ae-bd01-f58a4df76944 service nova] Lock "8d229d05-95f1-4997-8539-802ac65cff8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:57:08 user nova-compute[103546]: DEBUG nova.compute.manager [req-8dac57bc-75e4-4bb5-96b1-aa39f6458515 req-bb4f05fb-c91a-43ae-bd01-f58a4df76944 service nova] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] No waiting events found dispatching network-vif-unplugged-5c802613-81ea-4855-a8ee-d851a4ab2ff5 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:57:08 user nova-compute[103546]: WARNING nova.compute.manager [req-8dac57bc-75e4-4bb5-96b1-aa39f6458515 req-bb4f05fb-c91a-43ae-bd01-f58a4df76944 service nova] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Received unexpected event network-vif-unplugged-5c802613-81ea-4855-a8ee-d851a4ab2ff5 for instance with vm_state active and task_state rescuing.
Nov 16 03:57:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:10 user nova-compute[103546]: DEBUG nova.compute.manager [None req-575ce607-7298-4057-a720-f033c3b2c4ec tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 03:57:10 user nova-compute[103546]: DEBUG nova.compute.manager [req-3d4a8d54-5029-48d4-85ab-d128ef63c550 req-20667625-51ee-4544-beb9-bf607e284925 service nova] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Received event network-vif-plugged-5c802613-81ea-4855-a8ee-d851a4ab2ff5 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:57:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3d4a8d54-5029-48d4-85ab-d128ef63c550 req-20667625-51ee-4544-beb9-bf607e284925 service nova] Acquiring lock "8d229d05-95f1-4997-8539-802ac65cff8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:57:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3d4a8d54-5029-48d4-85ab-d128ef63c550 req-20667625-51ee-4544-beb9-bf607e284925 service nova] Lock "8d229d05-95f1-4997-8539-802ac65cff8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:57:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3d4a8d54-5029-48d4-85ab-d128ef63c550 req-20667625-51ee-4544-beb9-bf607e284925 service nova] Lock "8d229d05-95f1-4997-8539-802ac65cff8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:57:10 user nova-compute[103546]: DEBUG nova.compute.manager [req-3d4a8d54-5029-48d4-85ab-d128ef63c550 req-20667625-51ee-4544-beb9-bf607e284925 service nova] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] No waiting events found dispatching network-vif-plugged-5c802613-81ea-4855-a8ee-d851a4ab2ff5 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:57:10 user nova-compute[103546]: WARNING nova.compute.manager [req-3d4a8d54-5029-48d4-85ab-d128ef63c550 req-20667625-51ee-4544-beb9-bf607e284925 service nova] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Received unexpected event network-vif-plugged-5c802613-81ea-4855-a8ee-d851a4ab2ff5 for instance with vm_state active and task_state rescuing.
Nov 16 03:57:10 user nova-compute[103546]: DEBUG nova.compute.manager [req-3d4a8d54-5029-48d4-85ab-d128ef63c550 req-20667625-51ee-4544-beb9-bf607e284925 service nova] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Received event network-vif-plugged-5c802613-81ea-4855-a8ee-d851a4ab2ff5 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:57:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3d4a8d54-5029-48d4-85ab-d128ef63c550 req-20667625-51ee-4544-beb9-bf607e284925 service nova] Acquiring lock "8d229d05-95f1-4997-8539-802ac65cff8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:57:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3d4a8d54-5029-48d4-85ab-d128ef63c550 req-20667625-51ee-4544-beb9-bf607e284925 service nova] Lock "8d229d05-95f1-4997-8539-802ac65cff8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:57:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3d4a8d54-5029-48d4-85ab-d128ef63c550 req-20667625-51ee-4544-beb9-bf607e284925 service nova] Lock "8d229d05-95f1-4997-8539-802ac65cff8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:57:10 user nova-compute[103546]: DEBUG nova.compute.manager [req-3d4a8d54-5029-48d4-85ab-d128ef63c550 req-20667625-51ee-4544-beb9-bf607e284925 service nova] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] No waiting events found dispatching network-vif-plugged-5c802613-81ea-4855-a8ee-d851a4ab2ff5 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:57:10 user nova-compute[103546]: WARNING nova.compute.manager [req-3d4a8d54-5029-48d4-85ab-d128ef63c550 req-20667625-51ee-4544-beb9-bf607e284925 service nova] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Received unexpected event network-vif-plugged-5c802613-81ea-4855-a8ee-d851a4ab2ff5 for instance with vm_state active and task_state rescuing.
Nov 16 03:57:10 user nova-compute[103546]: DEBUG nova.compute.manager [req-3d4a8d54-5029-48d4-85ab-d128ef63c550 req-20667625-51ee-4544-beb9-bf607e284925 service nova] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Received event network-vif-plugged-5c802613-81ea-4855-a8ee-d851a4ab2ff5 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:57:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3d4a8d54-5029-48d4-85ab-d128ef63c550 req-20667625-51ee-4544-beb9-bf607e284925 service nova] Acquiring lock "8d229d05-95f1-4997-8539-802ac65cff8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:57:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3d4a8d54-5029-48d4-85ab-d128ef63c550 req-20667625-51ee-4544-beb9-bf607e284925 service nova] Lock "8d229d05-95f1-4997-8539-802ac65cff8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:57:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3d4a8d54-5029-48d4-85ab-d128ef63c550 req-20667625-51ee-4544-beb9-bf607e284925 service nova] Lock "8d229d05-95f1-4997-8539-802ac65cff8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:57:10 user nova-compute[103546]: DEBUG nova.compute.manager [req-3d4a8d54-5029-48d4-85ab-d128ef63c550 req-20667625-51ee-4544-beb9-bf607e284925 service nova] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] No waiting events found dispatching network-vif-plugged-5c802613-81ea-4855-a8ee-d851a4ab2ff5 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:57:10 user nova-compute[103546]: WARNING nova.compute.manager [req-3d4a8d54-5029-48d4-85ab-d128ef63c550 req-20667625-51ee-4544-beb9-bf607e284925 service nova] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Received unexpected event network-vif-plugged-5c802613-81ea-4855-a8ee-d851a4ab2ff5 for instance with vm_state active and task_state rescuing.
Nov 16 03:57:11 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:13 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:57:13 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Cleaning up deleted instances {{(pid=103546) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 03:57:13 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] There are 0 instances to clean {{(pid=103546) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 03:57:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Acquiring lock "66b98917-7551-47a5-94a1-79606cf1467d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:57:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Lock "66b98917-7551-47a5-94a1-79606cf1467d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:57:14 user nova-compute[103546]: DEBUG nova.compute.manager [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Starting instance... {{(pid=103546) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 03:57:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:57:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:57:14 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=103546) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 03:57:14 user nova-compute[103546]: INFO nova.compute.claims [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Claim successful on node user
Nov 16 03:57:14 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:57:14 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:57:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.473s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:57:14 user nova-compute[103546]: DEBUG nova.compute.manager [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Start building networks asynchronously for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 03:57:14 user nova-compute[103546]: DEBUG nova.compute.manager [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Allocating IP information in the background. {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 03:57:14 user nova-compute[103546]: DEBUG nova.network.neutron [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] allocate_for_instance() {{(pid=103546) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 03:57:14 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 03:57:14 user nova-compute[103546]: DEBUG nova.compute.manager [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Start building block device mappings for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 03:57:14 user nova-compute[103546]: DEBUG nova.policy [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7a83510fe87042529b22273d0b26a662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c650c4ec44057973d5d1ab45b7440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103546) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 03:57:14 user nova-compute[103546]: INFO nova.virt.block_device [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Booting with volume 3690ac19-2af3-4701-97ba-2243a390f2af at /dev/vda
Nov 16 03:57:15 user nova-compute[103546]: DEBUG os_brick.utils [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:57:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:57:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:57:15 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e499f2-3734-4ba8-b2ab-34f60acc2186]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af5c39b14ece\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:57:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:57:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:57:15 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[2588827d-037c-4ba9-93e1-a71d79e92ac0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:57:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:57:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:57:15 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[479fc765-aec9-4fc1-9573-bd533fe38d20]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:57:15 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[907297cf-df61-4f36-a15a-9cd0b73d46d4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:57:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Running cmd (subprocess): nvme version {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:57:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] 'nvme version' failed. Not Retrying. {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:57:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.nvmeof [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] nvme not present on system {{(pid=103546) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 03:57:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:57:15 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:57:15 user nova-compute[103546]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 03:57:15 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[823a86c1-a8f8-446e-9446-beb102f84f0a]: (4, '') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:57:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=103546) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 03:57:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 03:57:15 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] LIGHTOS: no hostnqn found. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 03:57:15 user nova-compute[103546]: DEBUG os_brick.utils [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af5c39b14ece', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:57:15 user nova-compute[103546]: DEBUG nova.virt.block_device [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Updating existing volume attachment record: 3c987c99-f10b-4014-a1e3-e5d1b03bdce7 {{(pid=103546) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 03:57:15 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:57:15 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:57:15 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager.update_available_resource {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:57:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:57:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:57:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:57:15 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Auditing locally available compute resources for user (node: user) {{(pid=103546) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 03:57:15 user nova-compute[103546]: DEBUG nova.network.neutron [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Successfully created port: 7df3a25d-d802-44f8-8a98-bb6be3453d3e {{(pid=103546) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 03:57:15 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 03:57:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:57:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:57:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:57:16 user nova-compute[103546]: DEBUG nova.network.neutron [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Successfully updated port: 7df3a25d-d802-44f8-8a98-bb6be3453d3e {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 03:57:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Acquiring lock "refresh_cache-66b98917-7551-47a5-94a1-79606cf1467d" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:57:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Acquired lock "refresh_cache-66b98917-7551-47a5-94a1-79606cf1467d" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:57:16 user nova-compute[103546]: DEBUG nova.network.neutron [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 03:57:16 user nova-compute[103546]: DEBUG nova.compute.manager [req-8f7cff74-3a26-439e-9590-32a77bd19718 req-914d2ac2-de09-4af4-8a79-8801db5d0471 service nova] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Received event network-changed-7df3a25d-d802-44f8-8a98-bb6be3453d3e {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:57:16 user nova-compute[103546]: DEBUG nova.compute.manager [req-8f7cff74-3a26-439e-9590-32a77bd19718 req-914d2ac2-de09-4af4-8a79-8801db5d0471 service nova] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Refreshing instance network info cache due to event network-changed-7df3a25d-d802-44f8-8a98-bb6be3453d3e. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:57:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8f7cff74-3a26-439e-9590-32a77bd19718 req-914d2ac2-de09-4af4-8a79-8801db5d0471 service nova] Acquiring lock "refresh_cache-66b98917-7551-47a5-94a1-79606cf1467d" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:57:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:57:16 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 03:57:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:57:16 user nova-compute[103546]: DEBUG nova.network.neutron [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 03:57:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:57:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:57:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:57:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4065a1b-10a0-4b2a-9088-a703a7c4e064/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:57:16 user nova-compute[103546]: DEBUG nova.network.neutron [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Updating instance_info_cache with network_info: [{"id": "7df3a25d-d802-44f8-8a98-bb6be3453d3e", "address": "fa:16:3e:7c:b1:ba", "network": {"id": "f9df40e7-5801-4e0c-8b8b-6cdb4da22727", "bridge": "br-int", "label": "tempest-TestShelveInstance-1586968346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "164c650c4ec44057973d5d1ab45b7440", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7df3a25d-d8", "ovs_interfaceid": "7df3a25d-d802-44f8-8a98-bb6be3453d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:57:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Releasing lock "refresh_cache-66b98917-7551-47a5-94a1-79606cf1467d" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:57:16 user nova-compute[103546]: DEBUG nova.compute.manager [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Instance network_info: |[{"id": "7df3a25d-d802-44f8-8a98-bb6be3453d3e", "address": "fa:16:3e:7c:b1:ba", "network": {"id": "f9df40e7-5801-4e0c-8b8b-6cdb4da22727", "bridge": "br-int", "label": "tempest-TestShelveInstance-1586968346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "164c650c4ec44057973d5d1ab45b7440", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7df3a25d-d8", "ovs_interfaceid": "7df3a25d-d802-44f8-8a98-bb6be3453d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 03:57:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8f7cff74-3a26-439e-9590-32a77bd19718 req-914d2ac2-de09-4af4-8a79-8801db5d0471 service nova] Acquired lock "refresh_cache-66b98917-7551-47a5-94a1-79606cf1467d" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:57:16 user nova-compute[103546]: DEBUG nova.network.neutron [req-8f7cff74-3a26-439e-9590-32a77bd19718 req-914d2ac2-de09-4af4-8a79-8801db5d0471 service nova] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Refreshing network info cache for port 7df3a25d-d802-44f8-8a98-bb6be3453d3e {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:57:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4065a1b-10a0-4b2a-9088-a703a7c4e064/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:57:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4065a1b-10a0-4b2a-9088-a703a7c4e064/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:57:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4065a1b-10a0-4b2a-9088-a703a7c4e064/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:57:17 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 03:57:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2781221-b5e3-468a-a9f5-436a04285f38/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:57:17 user nova-compute[103546]: DEBUG nova.network.neutron [req-8f7cff74-3a26-439e-9590-32a77bd19718 req-914d2ac2-de09-4af4-8a79-8801db5d0471 service nova] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Updated VIF entry in instance network info cache for port 7df3a25d-d802-44f8-8a98-bb6be3453d3e. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 03:57:17 user nova-compute[103546]: DEBUG nova.network.neutron [req-8f7cff74-3a26-439e-9590-32a77bd19718 req-914d2ac2-de09-4af4-8a79-8801db5d0471 service nova] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Updating instance_info_cache with network_info: [{"id": "7df3a25d-d802-44f8-8a98-bb6be3453d3e", "address": "fa:16:3e:7c:b1:ba", "network": {"id": "f9df40e7-5801-4e0c-8b8b-6cdb4da22727", "bridge": "br-int", "label": "tempest-TestShelveInstance-1586968346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "164c650c4ec44057973d5d1ab45b7440", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7df3a25d-d8", "ovs_interfaceid": "7df3a25d-d802-44f8-8a98-bb6be3453d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:57:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8f7cff74-3a26-439e-9590-32a77bd19718 req-914d2ac2-de09-4af4-8a79-8801db5d0471 service nova] Releasing lock "refresh_cache-66b98917-7551-47a5-94a1-79606cf1467d" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:57:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2781221-b5e3-468a-a9f5-436a04285f38/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:57:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2781221-b5e3-468a-a9f5-436a04285f38/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:57:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2781221-b5e3-468a-a9f5-436a04285f38/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:57:17 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 03:57:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:57:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:57:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:57:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:57:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.rescue --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:57:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:57:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.rescue --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:57:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:57:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:57:18 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:57:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:57:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:57:18 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 03:57:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa7e5468-9dd4-407d-85ec-d45ec76f9e29/disk.rescue --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:57:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa7e5468-9dd4-407d-85ec-d45ec76f9e29/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:57:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa7e5468-9dd4-407d-85ec-d45ec76f9e29/disk.rescue --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:57:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa7e5468-9dd4-407d-85ec-d45ec76f9e29/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:57:19 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:57:19 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:57:19 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Hypervisor/Node resource view: name=user free_ram=7391MB free_disk=25.218425750732422GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=103546) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 03:57:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:57:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:57:19 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 9a89970b-fc61-4419-8ff9-b48013dccf9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:57:19 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 04101512-7333-4581-add3-7af3821e335b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:57:19 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance fa7e5468-9dd4-407d-85ec-d45ec76f9e29 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:57:19 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance f4065a1b-10a0-4b2a-9088-a703a7c4e064 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:57:19 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:57:19 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 9c86c600-6277-4746-934d-c63e95616219 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:57:19 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 246ccf69-847c-4ab2-b709-ad1a85e81eab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:57:19 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 8d229d05-95f1-4997-8539-802ac65cff8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:57:19 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance d2781221-b5e3-468a-a9f5-436a04285f38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:57:19 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 709be95b-5dbf-4291-b68e-a1e8f077f91e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:57:19 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 66b98917-7551-47a5-94a1-79606cf1467d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:57:19 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 03:57:19 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 03:57:19 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Refreshing inventories for resource provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 03:57:19 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Updating ProviderTree inventory for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 03:57:19 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Updating inventory in ProviderTree for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 03:57:20 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Refreshing aggregate associations for resource provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a, aggregates: None {{(pid=103546) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 03:57:20 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Refreshing trait associations for resource provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=103546) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 03:57:20 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:57:20 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:57:20 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Compute_service record updated for user:user {{(pid=103546) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 03:57:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.810s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:57:20 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:57:20 user nova-compute[103546]: DEBUG nova.compute.manager [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Start spawning the instance on the hypervisor. {{(pid=103546) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 03:57:20 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Creating instance directory {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 03:57:20 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Creating image(s)
Nov 16 03:57:20 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Did not create local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 03:57:20 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Ensure instance console log exists: /opt/stack/data/nova/instances/66b98917-7551-47a5-94a1-79606cf1467d/console.log {{(pid=103546) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 03:57:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:57:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:57:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:57:20 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Start _get_guest_xml network_info=[{"id": "7df3a25d-d802-44f8-8a98-bb6be3453d3e", "address": "fa:16:3e:7c:b1:ba", "network": {"id": "f9df40e7-5801-4e0c-8b8b-6cdb4da22727", "bridge": "br-int", "label": "tempest-TestShelveInstance-1586968346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "164c650c4ec44057973d5d1ab45b7440", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7df3a25d-d8", "ovs_interfaceid": "7df3a25d-d802-44f8-8a98-bb6be3453d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZQtTeObl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '66b98917-7551-47a5-94a1-79606cf1467d', 'attached_at': '', 'detached_at': '', 'volume_id': '3690ac19-2af3-4701-97ba-2243a390f2af', 'serial': '3690ac19-2af3-4701-97ba-2243a390f2af'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': '3c987c99-f10b-4014-a1e3-e5d1b03bdce7', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 03:57:21 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:57:21 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:57:21 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZQtTeObl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:57:21 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:57:21 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:57:21 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:57:21 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:57:21 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 03:57:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8b23bf-e8ff-4e0f-9bfa-81ae39dceb8e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 03:57:21 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af -p 172.16.0.220:3260 --interface default --op new {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[93497075-3aa5-4685-8de3-27d68ed6e626]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af] added\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af] added
Nov 16 03:57:21 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[645fdaef-f14f-4d02-91b4-6e59d1b33885]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[598dde8b-bdd0-4c00-b980-443e7a64a381]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZQtTeObl {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZQtTeObl" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc53a4e9-ed17-4333-a0ef-ceb375e08458]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZQtTeObl'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e280cf-d1ca-4d57-9e2c-7b62f4bf1eba]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[403b36f6-055b-4a22-8164-6d3fd65994f5]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:57:21 user nova-compute[103546]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)
Nov 16 03:57:21 user nova-compute[103546]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 (non-flash)
Nov 16 03:57:21 user nova-compute[103546]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283 (non-flash)
Nov 16 03:57:21 user nova-compute[103546]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc (non-flash)
Nov 16 03:57:21 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:57:21 user nova-compute[103546]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)
Nov 16 03:57:21 user nova-compute[103546]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 (non-flash)
Nov 16 03:57:21 user nova-compute[103546]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283 (non-flash)
Nov 16 03:57:21 user nova-compute[103546]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc (non-flash)
Nov 16 03:57:21 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af -p 172.16.0.220:3260 --login {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af -p 172.16.0.220:3260 --login" returned: 0 in 0.104s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1e2f05-a043-4f2a-85ea-da72415b1c5f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af, portal: 172.16.0.220,3260]
Nov 16 03:57:21 user nova-compute[103546]: Login to [iface: default, target: iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af, portal: 172.16.0.220,3260] successful.
Nov 16 03:57:21 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2db8b1-5ce1-4b06-b71f-f1976b6ed273]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[feafa204-a201-466d-9057-dda3384d013e]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:57:21 user nova-compute[103546]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)
Nov 16 03:57:21 user nova-compute[103546]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 (non-flash)
Nov 16 03:57:21 user nova-compute[103546]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283 (non-flash)
Nov 16 03:57:21 user nova-compute[103546]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc (non-flash)
Nov 16 03:57:21 user nova-compute[103546]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af (non-flash)
Nov 16 03:57:21 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:57:21 user nova-compute[103546]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)
Nov 16 03:57:21 user nova-compute[103546]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 (non-flash)
Nov 16 03:57:21 user nova-compute[103546]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283 (non-flash)
Nov 16 03:57:21 user nova-compute[103546]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc (non-flash)
Nov 16 03:57:21 user nova-compute[103546]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af (non-flash)
Nov 16 03:57:21 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] HCTL ('38', '-', '-', 0) found on session 36 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2142d1b-62bd-4457-b7a5-287868025b6b]: (4, ('- - 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Searching for a device in session 36 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZQtTeObl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Starting heal instance info cache {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Rebuilding the list of instances to heal {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Skipping network cache update for instance because it is Building. {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "refresh_cache-9a89970b-fc61-4419-8ff9-b48013dccf9f" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquired lock "refresh_cache-9a89970b-fc61-4419-8ff9-b48013dccf9f" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Forcefully refreshing network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG nova.objects.instance [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lazy-loading 'info_cache' on Instance uuid 9a89970b-fc61-4419-8ff9-b48013dccf9f {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:57:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:22 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Updating instance_info_cache with network_info: [{"id": "5f4e3564-4185-44d2-93f6-2e3803aaf0f8", "address": "fa:16:3e:56:e2:fb", "network": {"id": "29e9620f-313d-4679-89d7-459e7cf75b38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1690634205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72b30a015db444798ee72ff6fd14c69e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f4e3564-41", "ovs_interfaceid": "5f4e3564-4185-44d2-93f6-2e3803aaf0f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:57:22 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Releasing lock "refresh_cache-9a89970b-fc61-4419-8ff9-b48013dccf9f" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:57:22 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Updated the network info_cache for instance {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 03:57:22 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:57:22 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:57:22 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:57:22 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:57:22 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=103546) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 03:57:22 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:57:22 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '23230623732613861', 'path': '/dev/sdg'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:57:22 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23230623732613861', 'path': '/dev/sdg'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 03:57:22 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:57:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1218331939',display_name='tempest-TestShelveInstance-server-1218331939',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1218331939',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJefuleNA9cJ5haFDD+0Ot28lloio76de7VtRTQxzp9Sope/G7fhj4H3KkfSIX4gC5WiTW4ss845RgTAxK6IS7sfMf51A1/Fabu1CWHujElttuESJP/RjYphT+75MUNs3Q==',key_name='tempest-TestShelveInstance-1411640263',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='164c650c4ec44057973d5d1ab45b7440',ramdisk_id='',reservation_id='r-03lh0eut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-2052053009',owner_user_name='tempest-TestShelveInstance-2052053009-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:57:15Z,user_data=None,user_id='7a83510fe87042529b22273d0b26a662',uuid=66b98917-7551-47a5-94a1-79606cf1467d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7df3a25d-d802-44f8-8a98-bb6be3453d3e", "address": "fa:16:3e:7c:b1:ba", "network": {"id": "f9df40e7-5801-4e0c-8b8b-6cdb4da22727", "bridge": "br-int", "label": "tempest-TestShelveInstance-1586968346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "164c650c4ec44057973d5d1ab45b7440", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7df3a25d-d8", "ovs_interfaceid": "7df3a25d-d802-44f8-8a98-bb6be3453d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 03:57:22 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Converting VIF {"id": "7df3a25d-d802-44f8-8a98-bb6be3453d3e", "address": "fa:16:3e:7c:b1:ba", "network": {"id": "f9df40e7-5801-4e0c-8b8b-6cdb4da22727", "bridge": "br-int", "label": "tempest-TestShelveInstance-1586968346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "164c650c4ec44057973d5d1ab45b7440", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7df3a25d-d8", "ovs_interfaceid": "7df3a25d-d802-44f8-8a98-bb6be3453d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:57:22 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:b1:ba,bridge_name='br-int',has_traffic_filtering=True,id=7df3a25d-d802-44f8-8a98-bb6be3453d3e,network=Network(f9df40e7-5801-4e0c-8b8b-6cdb4da22727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7df3a25d-d8') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:57:22 user nova-compute[103546]: DEBUG nova.objects.instance [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Lazy-loading 'pci_devices' on Instance uuid 66b98917-7551-47a5-94a1-79606cf1467d {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:57:22 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] End _get_guest_xml xml=<domain type="kvm">
Nov 16 03:57:22 user nova-compute[103546]:   <uuid>66b98917-7551-47a5-94a1-79606cf1467d</uuid>
Nov 16 03:57:22 user nova-compute[103546]:   <name>instance-0000001f</name>
Nov 16 03:57:22 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 03:57:22 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 03:57:22 user nova-compute[103546]:   <metadata>
Nov 16 03:57:22 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 03:57:22 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 03:57:22 user nova-compute[103546]:       <nova:name>tempest-TestShelveInstance-server-1218331939</nova:name>
Nov 16 03:57:22 user nova-compute[103546]:       <nova:creationTime>2023-11-16 03:57:21</nova:creationTime>
Nov 16 03:57:22 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 03:57:22 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 03:57:22 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 03:57:22 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 03:57:22 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 03:57:22 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 03:57:22 user nova-compute[103546]:       </nova:flavor>
Nov 16 03:57:22 user nova-compute[103546]:       <nova:owner>
Nov 16 03:57:22 user nova-compute[103546]:         <nova:user uuid="7a83510fe87042529b22273d0b26a662">tempest-TestShelveInstance-2052053009-project-member</nova:user>
Nov 16 03:57:22 user nova-compute[103546]:         <nova:project uuid="164c650c4ec44057973d5d1ab45b7440">tempest-TestShelveInstance-2052053009</nova:project>
Nov 16 03:57:22 user nova-compute[103546]:       </nova:owner>
Nov 16 03:57:22 user nova-compute[103546]:       <nova:ports>
Nov 16 03:57:22 user nova-compute[103546]:         <nova:port uuid="7df3a25d-d802-44f8-8a98-bb6be3453d3e">
Nov 16 03:57:22 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 16 03:57:22 user nova-compute[103546]:         </nova:port>
Nov 16 03:57:22 user nova-compute[103546]:       </nova:ports>
Nov 16 03:57:22 user nova-compute[103546]:     </nova:instance>
Nov 16 03:57:22 user nova-compute[103546]:   </metadata>
Nov 16 03:57:22 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 03:57:22 user nova-compute[103546]:     <system>
Nov 16 03:57:22 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 03:57:22 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 03:57:22 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 03:57:22 user nova-compute[103546]:       <entry name="serial">66b98917-7551-47a5-94a1-79606cf1467d</entry>
Nov 16 03:57:22 user nova-compute[103546]:       <entry name="uuid">66b98917-7551-47a5-94a1-79606cf1467d</entry>
Nov 16 03:57:22 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 03:57:22 user nova-compute[103546]:     </system>
Nov 16 03:57:22 user nova-compute[103546]:   </sysinfo>
Nov 16 03:57:22 user nova-compute[103546]:   <os>
Nov 16 03:57:22 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 03:57:22 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 03:57:22 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 03:57:22 user nova-compute[103546]:   </os>
Nov 16 03:57:22 user nova-compute[103546]:   <features>
Nov 16 03:57:22 user nova-compute[103546]:     <acpi/>
Nov 16 03:57:22 user nova-compute[103546]:     <apic/>
Nov 16 03:57:22 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 03:57:22 user nova-compute[103546]:   </features>
Nov 16 03:57:22 user nova-compute[103546]:   <clock offset="utc">
Nov 16 03:57:22 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 03:57:22 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 03:57:22 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 03:57:22 user nova-compute[103546]:   </clock>
Nov 16 03:57:22 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 03:57:22 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 03:57:22 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 03:57:22 user nova-compute[103546]:   </cpu>
Nov 16 03:57:22 user nova-compute[103546]:   <devices>
Nov 16 03:57:22 user nova-compute[103546]:     <disk type="block" device="disk">
Nov 16 03:57:22 user nova-compute[103546]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 03:57:22 user nova-compute[103546]:       <source dev="/dev/sdg"/>
Nov 16 03:57:22 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 03:57:22 user nova-compute[103546]:       <serial>3690ac19-2af3-4701-97ba-2243a390f2af</serial>
Nov 16 03:57:22 user nova-compute[103546]:     </disk>
Nov 16 03:57:22 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 03:57:22 user nova-compute[103546]:       <mac address="fa:16:3e:7c:b1:ba"/>
Nov 16 03:57:22 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:57:22 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 03:57:22 user nova-compute[103546]:       <target dev="tap7df3a25d-d8"/>
Nov 16 03:57:22 user nova-compute[103546]:     </interface>
Nov 16 03:57:22 user nova-compute[103546]:     <serial type="pty">
Nov 16 03:57:22 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/66b98917-7551-47a5-94a1-79606cf1467d/console.log" append="off"/>
Nov 16 03:57:22 user nova-compute[103546]:     </serial>
Nov 16 03:57:22 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 03:57:22 user nova-compute[103546]:     <video>
Nov 16 03:57:22 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:57:22 user nova-compute[103546]:     </video>
Nov 16 03:57:22 user nova-compute[103546]:     <rng model="virtio">
Nov 16 03:57:22 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 03:57:22 user nova-compute[103546]:     </rng>
Nov 16 03:57:22 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 03:57:22 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 03:57:22 user nova-compute[103546]:       <stats period="10"/>
Nov 16 03:57:22 user nova-compute[103546]:     </memballoon>
Nov 16 03:57:22 user nova-compute[103546]:   </devices>
Nov 16 03:57:22 user nova-compute[103546]: </domain>
Nov 16 03:57:22 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 03:57:22 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:57:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1218331939',display_name='tempest-TestShelveInstance-server-1218331939',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1218331939',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJefuleNA9cJ5haFDD+0Ot28lloio76de7VtRTQxzp9Sope/G7fhj4H3KkfSIX4gC5WiTW4ss845RgTAxK6IS7sfMf51A1/Fabu1CWHujElttuESJP/RjYphT+75MUNs3Q==',key_name='tempest-TestShelveInstance-1411640263',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='164c650c4ec44057973d5d1ab45b7440',ramdisk_id='',reservation_id='r-03lh0eut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-2052053009',owner_user_name='tempest-TestShelveInstance-2052053009-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:57:15Z,user_data=None,user_id='7a83510fe87042529b22273d0b26a662',uuid=66b98917-7551-47a5-94a1-79606cf1467d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7df3a25d-d802-44f8-8a98-bb6be3453d3e", "address": "fa:16:3e:7c:b1:ba", "network": {"id": "f9df40e7-5801-4e0c-8b8b-6cdb4da22727", "bridge": "br-int", "label": "tempest-TestShelveInstance-1586968346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "164c650c4ec44057973d5d1ab45b7440", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7df3a25d-d8", "ovs_interfaceid": "7df3a25d-d802-44f8-8a98-bb6be3453d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 03:57:22 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Converting VIF {"id": "7df3a25d-d802-44f8-8a98-bb6be3453d3e", "address": "fa:16:3e:7c:b1:ba", "network": {"id": "f9df40e7-5801-4e0c-8b8b-6cdb4da22727", "bridge": "br-int", "label": "tempest-TestShelveInstance-1586968346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "164c650c4ec44057973d5d1ab45b7440", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7df3a25d-d8", "ovs_interfaceid": "7df3a25d-d802-44f8-8a98-bb6be3453d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:57:22 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:b1:ba,bridge_name='br-int',has_traffic_filtering=True,id=7df3a25d-d802-44f8-8a98-bb6be3453d3e,network=Network(f9df40e7-5801-4e0c-8b8b-6cdb4da22727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7df3a25d-d8') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:57:22 user nova-compute[103546]: DEBUG os_vif [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:b1:ba,bridge_name='br-int',has_traffic_filtering=True,id=7df3a25d-d802-44f8-8a98-bb6be3453d3e,network=Network(f9df40e7-5801-4e0c-8b8b-6cdb4da22727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7df3a25d-d8') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 03:57:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:57:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 03:57:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '105af4d9-f8fb-5aaf-b6d1-f230c76d4fb3', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:57:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:57:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7df3a25d-d8, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:57:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7df3a25d-d8, col_values=(('qos', UUID('ed99590d-d5b2-48b3-9406-66ff247a1b00')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:57:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7df3a25d-d8, col_values=(('external_ids', {'iface-id': '7df3a25d-d802-44f8-8a98-bb6be3453d3e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:b1:ba', 'vm-uuid': '66b98917-7551-47a5-94a1-79606cf1467d'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:57:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:57:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:22 user nova-compute[103546]: INFO os_vif [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:b1:ba,bridge_name='br-int',has_traffic_filtering=True,id=7df3a25d-d802-44f8-8a98-bb6be3453d3e,network=Network(f9df40e7-5801-4e0c-8b8b-6cdb4da22727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7df3a25d-d8')
Nov 16 03:57:22 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:57:22 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] No VIF found with MAC fa:16:3e:7c:b1:ba, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 03:57:23 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:23 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:23 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:24 user nova-compute[103546]: DEBUG nova.compute.manager [req-383b90f2-a846-4752-ac1d-275ba34a113d req-cbb0f7db-1799-4d76-a3fd-4243eaddac5e service nova] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Received event network-vif-plugged-7df3a25d-d802-44f8-8a98-bb6be3453d3e {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:57:24 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-383b90f2-a846-4752-ac1d-275ba34a113d req-cbb0f7db-1799-4d76-a3fd-4243eaddac5e service nova] Acquiring lock "66b98917-7551-47a5-94a1-79606cf1467d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:57:24 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-383b90f2-a846-4752-ac1d-275ba34a113d req-cbb0f7db-1799-4d76-a3fd-4243eaddac5e service nova] Lock "66b98917-7551-47a5-94a1-79606cf1467d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:57:24 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-383b90f2-a846-4752-ac1d-275ba34a113d req-cbb0f7db-1799-4d76-a3fd-4243eaddac5e service nova] Lock "66b98917-7551-47a5-94a1-79606cf1467d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:57:24 user nova-compute[103546]: DEBUG nova.compute.manager [req-383b90f2-a846-4752-ac1d-275ba34a113d req-cbb0f7db-1799-4d76-a3fd-4243eaddac5e service nova] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] No waiting events found dispatching network-vif-plugged-7df3a25d-d802-44f8-8a98-bb6be3453d3e {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:57:24 user nova-compute[103546]: WARNING nova.compute.manager [req-383b90f2-a846-4752-ac1d-275ba34a113d req-cbb0f7db-1799-4d76-a3fd-4243eaddac5e service nova] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Received unexpected event network-vif-plugged-7df3a25d-d802-44f8-8a98-bb6be3453d3e for instance with vm_state building and task_state spawning.
Nov 16 03:57:24 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:24 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:24 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:25 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:57:25 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Cleaning up deleted instances with incomplete migration  {{(pid=103546) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 03:57:26 user nova-compute[103546]: DEBUG nova.compute.manager [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 03:57:26 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Guest created on hypervisor {{(pid=103546) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 03:57:26 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Instance spawned successfully.
Nov 16 03:57:26 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 03:57:26 user nova-compute[103546]: DEBUG nova.compute.manager [req-10b74110-c23f-4cbf-9790-5d36870d429a req-95b48d2e-9036-4c2e-bee8-3488c5227703 service nova] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Received event network-vif-plugged-7df3a25d-d802-44f8-8a98-bb6be3453d3e {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:57:26 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-10b74110-c23f-4cbf-9790-5d36870d429a req-95b48d2e-9036-4c2e-bee8-3488c5227703 service nova] Acquiring lock "66b98917-7551-47a5-94a1-79606cf1467d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:57:26 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-10b74110-c23f-4cbf-9790-5d36870d429a req-95b48d2e-9036-4c2e-bee8-3488c5227703 service nova] Lock "66b98917-7551-47a5-94a1-79606cf1467d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:57:26 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-10b74110-c23f-4cbf-9790-5d36870d429a req-95b48d2e-9036-4c2e-bee8-3488c5227703 service nova] Lock "66b98917-7551-47a5-94a1-79606cf1467d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:57:26 user nova-compute[103546]: DEBUG nova.compute.manager [req-10b74110-c23f-4cbf-9790-5d36870d429a req-95b48d2e-9036-4c2e-bee8-3488c5227703 service nova] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] No waiting events found dispatching network-vif-plugged-7df3a25d-d802-44f8-8a98-bb6be3453d3e {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:57:26 user nova-compute[103546]: WARNING nova.compute.manager [req-10b74110-c23f-4cbf-9790-5d36870d429a req-95b48d2e-9036-4c2e-bee8-3488c5227703 service nova] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Received unexpected event network-vif-plugged-7df3a25d-d802-44f8-8a98-bb6be3453d3e for instance with vm_state building and task_state spawning.
Nov 16 03:57:26 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Found default for hw_cdrom_bus of ide {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:57:26 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Found default for hw_disk_bus of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:57:26 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Found default for hw_input_bus of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:57:26 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Found default for hw_pointer_model of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:57:26 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Found default for hw_video_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:57:26 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Found default for hw_vif_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:57:26 user nova-compute[103546]: INFO nova.compute.manager [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Took 5.39 seconds to spawn the instance on the hypervisor.
Nov 16 03:57:26 user nova-compute[103546]: DEBUG nova.compute.manager [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 03:57:26 user nova-compute[103546]: INFO nova.compute.manager [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Took 12.17 seconds to build instance.
Nov 16 03:57:26 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-afec7253-6193-495b-8243-6acf633cff7c tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Lock "66b98917-7551-47a5-94a1-79606cf1467d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.271s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:57:27 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:28 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:31 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Acquiring lock "ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:57:31 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:57:31 user nova-compute[103546]: INFO nova.compute.manager [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Unshelving
Nov 16 03:57:31 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:57:31 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:57:31 user nova-compute[103546]: DEBUG nova.objects.instance [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lazy-loading 'pci_requests' on Instance uuid ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:57:31 user nova-compute[103546]: DEBUG nova.objects.instance [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lazy-loading 'numa_topology' on Instance uuid ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:57:31 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=103546) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 03:57:31 user nova-compute[103546]: INFO nova.compute.claims [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Claim successful on node user
Nov 16 03:57:31 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:57:31 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:57:31 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.699s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:57:31 user nova-compute[103546]: INFO nova.network.neutron [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Updating port 757f4202-bbf9-42cf-8ccc-7e970b892f1f with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 16 03:57:32 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:32 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Acquiring lock "refresh_cache-ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:57:32 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Acquired lock "refresh_cache-ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:57:32 user nova-compute[103546]: DEBUG nova.network.neutron [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 03:57:32 user nova-compute[103546]: DEBUG nova.compute.manager [req-c172af6c-dff4-406e-a567-35785d667ef2 req-a449e9ca-24ef-491a-90c6-795f1530103d service nova] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Received event network-changed-757f4202-bbf9-42cf-8ccc-7e970b892f1f {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:57:32 user nova-compute[103546]: DEBUG nova.compute.manager [req-c172af6c-dff4-406e-a567-35785d667ef2 req-a449e9ca-24ef-491a-90c6-795f1530103d service nova] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Refreshing instance network info cache due to event network-changed-757f4202-bbf9-42cf-8ccc-7e970b892f1f. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:57:32 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-c172af6c-dff4-406e-a567-35785d667ef2 req-a449e9ca-24ef-491a-90c6-795f1530103d service nova] Acquiring lock "refresh_cache-ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:57:33 user nova-compute[103546]: DEBUG nova.network.neutron [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Updating instance_info_cache with network_info: [{"id": "757f4202-bbf9-42cf-8ccc-7e970b892f1f", "address": "fa:16:3e:db:d6:71", "network": {"id": "b2fca984-f1e9-4c86-a3a5-b8d5b9950555", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-172535633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63722fdf17e4408299de8c215c133812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap757f4202-bb", "ovs_interfaceid": "757f4202-bbf9-42cf-8ccc-7e970b892f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:57:33 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Releasing lock "refresh_cache-ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:57:33 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Creating instance directory {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 03:57:33 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Creating image(s)
Nov 16 03:57:33 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Acquiring lock "/opt/stack/data/nova/instances/ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:57:33 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "/opt/stack/data/nova/instances/ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:57:33 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "/opt/stack/data/nova/instances/ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:57:33 user nova-compute[103546]: DEBUG nova.objects.instance [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lazy-loading 'trusted_certs' on Instance uuid ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:57:33 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-c172af6c-dff4-406e-a567-35785d667ef2 req-a449e9ca-24ef-491a-90c6-795f1530103d service nova] Acquired lock "refresh_cache-ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:57:33 user nova-compute[103546]: DEBUG nova.network.neutron [req-c172af6c-dff4-406e-a567-35785d667ef2 req-a449e9ca-24ef-491a-90c6-795f1530103d service nova] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Refreshing network info cache for port 757f4202-bbf9-42cf-8ccc-7e970b892f1f {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:57:33 user nova-compute[103546]: DEBUG nova.objects.base [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Object Instance<ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 03:57:33 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Acquiring lock "86fe3eebd87582e7733a5bbce163201dc262c3e2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:57:33 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "86fe3eebd87582e7733a5bbce163201dc262c3e2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:57:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86fe3eebd87582e7733a5bbce163201dc262c3e2.part --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:57:34 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86fe3eebd87582e7733a5bbce163201dc262c3e2.part --force-share --output=json" returned: 0 in 0.236s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:57:34 user nova-compute[103546]: DEBUG nova.virt.images [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] a10cd2a1-7c3b-44fd-a21c-316f8df9774b was qcow2, converting to raw {{(pid=103546) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 03:57:34 user nova-compute[103546]: DEBUG nova.privsep.utils [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=103546) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 03:57:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/86fe3eebd87582e7733a5bbce163201dc262c3e2.part /opt/stack/data/nova/instances/_base/86fe3eebd87582e7733a5bbce163201dc262c3e2.converted {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:57:34 user nova-compute[103546]: DEBUG nova.network.neutron [req-c172af6c-dff4-406e-a567-35785d667ef2 req-a449e9ca-24ef-491a-90c6-795f1530103d service nova] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Updated VIF entry in instance network info cache for port 757f4202-bbf9-42cf-8ccc-7e970b892f1f. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 03:57:34 user nova-compute[103546]: DEBUG nova.network.neutron [req-c172af6c-dff4-406e-a567-35785d667ef2 req-a449e9ca-24ef-491a-90c6-795f1530103d service nova] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Updating instance_info_cache with network_info: [{"id": "757f4202-bbf9-42cf-8ccc-7e970b892f1f", "address": "fa:16:3e:db:d6:71", "network": {"id": "b2fca984-f1e9-4c86-a3a5-b8d5b9950555", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-172535633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63722fdf17e4408299de8c215c133812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap757f4202-bb", "ovs_interfaceid": "757f4202-bbf9-42cf-8ccc-7e970b892f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:57:34 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-c172af6c-dff4-406e-a567-35785d667ef2 req-a449e9ca-24ef-491a-90c6-795f1530103d service nova] Releasing lock "refresh_cache-ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:57:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/86fe3eebd87582e7733a5bbce163201dc262c3e2.part /opt/stack/data/nova/instances/_base/86fe3eebd87582e7733a5bbce163201dc262c3e2.converted" returned: 0 in 0.936s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:57:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86fe3eebd87582e7733a5bbce163201dc262c3e2.converted --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:57:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86fe3eebd87582e7733a5bbce163201dc262c3e2.converted --force-share --output=json" returned: 0 in 0.236s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:57:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "86fe3eebd87582e7733a5bbce163201dc262c3e2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.489s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:57:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86fe3eebd87582e7733a5bbce163201dc262c3e2 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:57:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86fe3eebd87582e7733a5bbce163201dc262c3e2 --force-share --output=json" returned: 0 in 0.175s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:57:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Acquiring lock "86fe3eebd87582e7733a5bbce163201dc262c3e2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:57:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "86fe3eebd87582e7733a5bbce163201dc262c3e2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:57:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86fe3eebd87582e7733a5bbce163201dc262c3e2 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:57:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86fe3eebd87582e7733a5bbce163201dc262c3e2 --force-share --output=json" returned: 0 in 0.190s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:57:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/86fe3eebd87582e7733a5bbce163201dc262c3e2,backing_fmt=raw /opt/stack/data/nova/instances/ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c/disk 1073741824 {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:57:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/86fe3eebd87582e7733a5bbce163201dc262c3e2,backing_fmt=raw /opt/stack/data/nova/instances/ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c/disk 1073741824" returned: 0 in 0.047s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:57:36 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "86fe3eebd87582e7733a5bbce163201dc262c3e2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:57:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86fe3eebd87582e7733a5bbce163201dc262c3e2 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:57:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86fe3eebd87582e7733a5bbce163201dc262c3e2 --force-share --output=json" returned: 0 in 0.166s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:57:36 user nova-compute[103546]: DEBUG nova.objects.instance [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lazy-loading 'migration_context' on Instance uuid ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:57:36 user nova-compute[103546]: DEBUG nova.objects.base [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Object Instance<ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 03:57:36 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Rebasing disk image.
Nov 16 03:57:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:57:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.193s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:57:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 -F raw /opt/stack/data/nova/instances/ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c/disk {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:57:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:38 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 -F raw /opt/stack/data/nova/instances/ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c/disk" returned: 0 in 2.785s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:57:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Created local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 03:57:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Ensure instance console log exists: /opt/stack/data/nova/instances/ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c/console.log {{(pid=103546) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 03:57:39 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:57:39 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:57:39 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:57:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Start _get_guest_xml network_info=[{"id": "757f4202-bbf9-42cf-8ccc-7e970b892f1f", "address": "fa:16:3e:db:d6:71", "network": {"id": "b2fca984-f1e9-4c86-a3a5-b8d5b9950555", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-172535633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63722fdf17e4408299de8c215c133812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap757f4202-bb", "ovs_interfaceid": "757f4202-bbf9-42cf-8ccc-7e970b892f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='ba211b8ce023804ed144724107e8240d',container_format='bare',created_at=2023-11-16T03:55:38Z,direct_url=<?>,disk_format='qcow2',id=a10cd2a1-7c3b-44fd-a21c-316f8df9774b,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-131803665-shelved',owner='63722fdf17e4408299de8c215c133812',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-16T03:55:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '5c6f539a-01e5-4478-bf8f-a14310b5d7dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 03:57:39 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:57:39 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:57:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 03:57:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 03:57:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 03:57:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 03:57:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 03:57:39 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='ba211b8ce023804ed144724107e8240d',container_format='bare',created_at=2023-11-16T03:55:38Z,direct_url=<?>,disk_format='qcow2',id=a10cd2a1-7c3b-44fd-a21c-316f8df9774b,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-131803665-shelved',owner='63722fdf17e4408299de8c215c133812',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-16T03:55:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 03:57:39 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 03:57:39 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 03:57:39 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 03:57:39 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 03:57:39 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 03:57:39 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 03:57:39 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 03:57:39 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 03:57:39 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 03:57:39 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 03:57:39 user nova-compute[103546]: DEBUG nova.objects.instance [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lazy-loading 'vcpu_model' on Instance uuid ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:57:39 user nova-compute[103546]: DEBUG nova.objects.base [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Object Instance<ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 03:57:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T03:53:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-131803665',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-131803665',id=22,image_ref='a10cd2a1-7c3b-44fd-a21c-316f8df9774b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1198627758',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:53:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='63722fdf17e4408299de8c215c133812',ramdisk_id='',reservation_id='r-gew0pxlb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1382373405',owner_user_name='tempest-AttachVolumeShelveTestJSON-1382373405-project-member',shelved_at='2023-11-16T03:55:42.538464',shelved_host='user',shelved_image_id='a10cd2a1-7c3b-44fd-a21c-316f8df9774b'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:57:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21d4e9052a614968bda331f028920ca7',uuid=ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "757f4202-bbf9-42cf-8ccc-7e970b892f1f", "address": "fa:16:3e:db:d6:71", "network": {"id": "b2fca984-f1e9-4c86-a3a5-b8d5b9950555", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-172535633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63722fdf17e4408299de8c215c133812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap757f4202-bb", "ovs_interfaceid": "757f4202-bbf9-42cf-8ccc-7e970b892f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 03:57:39 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Converting VIF {"id": "757f4202-bbf9-42cf-8ccc-7e970b892f1f", "address": "fa:16:3e:db:d6:71", "network": {"id": "b2fca984-f1e9-4c86-a3a5-b8d5b9950555", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-172535633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63722fdf17e4408299de8c215c133812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap757f4202-bb", "ovs_interfaceid": "757f4202-bbf9-42cf-8ccc-7e970b892f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:57:39 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:d6:71,bridge_name='br-int',has_traffic_filtering=True,id=757f4202-bbf9-42cf-8ccc-7e970b892f1f,network=Network(b2fca984-f1e9-4c86-a3a5-b8d5b9950555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap757f4202-bb') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:57:39 user nova-compute[103546]: DEBUG nova.objects.instance [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lazy-loading 'pci_devices' on Instance uuid ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:57:39 user nova-compute[103546]: DEBUG nova.objects.base [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Object Instance<ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 03:57:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] End _get_guest_xml xml=<domain type="kvm">
Nov 16 03:57:39 user nova-compute[103546]:   <uuid>ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c</uuid>
Nov 16 03:57:39 user nova-compute[103546]:   <name>instance-00000016</name>
Nov 16 03:57:39 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 03:57:39 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 03:57:39 user nova-compute[103546]:   <metadata>
Nov 16 03:57:39 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 03:57:39 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 03:57:39 user nova-compute[103546]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-131803665</nova:name>
Nov 16 03:57:39 user nova-compute[103546]:       <nova:creationTime>2023-11-16 03:57:39</nova:creationTime>
Nov 16 03:57:39 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 03:57:39 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 03:57:39 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 03:57:39 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 03:57:39 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 03:57:39 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 03:57:39 user nova-compute[103546]:       </nova:flavor>
Nov 16 03:57:39 user nova-compute[103546]:       <nova:owner>
Nov 16 03:57:39 user nova-compute[103546]:         <nova:user uuid="21d4e9052a614968bda331f028920ca7">tempest-AttachVolumeShelveTestJSON-1382373405-project-member</nova:user>
Nov 16 03:57:39 user nova-compute[103546]:         <nova:project uuid="63722fdf17e4408299de8c215c133812">tempest-AttachVolumeShelveTestJSON-1382373405</nova:project>
Nov 16 03:57:39 user nova-compute[103546]:       </nova:owner>
Nov 16 03:57:39 user nova-compute[103546]:       <nova:root type="image" uuid="a10cd2a1-7c3b-44fd-a21c-316f8df9774b"/>
Nov 16 03:57:39 user nova-compute[103546]:       <nova:ports>
Nov 16 03:57:39 user nova-compute[103546]:         <nova:port uuid="757f4202-bbf9-42cf-8ccc-7e970b892f1f">
Nov 16 03:57:39 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 16 03:57:39 user nova-compute[103546]:         </nova:port>
Nov 16 03:57:39 user nova-compute[103546]:       </nova:ports>
Nov 16 03:57:39 user nova-compute[103546]:     </nova:instance>
Nov 16 03:57:39 user nova-compute[103546]:   </metadata>
Nov 16 03:57:39 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 03:57:39 user nova-compute[103546]:     <system>
Nov 16 03:57:39 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 03:57:39 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 03:57:39 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 03:57:39 user nova-compute[103546]:       <entry name="serial">ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c</entry>
Nov 16 03:57:39 user nova-compute[103546]:       <entry name="uuid">ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c</entry>
Nov 16 03:57:39 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 03:57:39 user nova-compute[103546]:     </system>
Nov 16 03:57:39 user nova-compute[103546]:   </sysinfo>
Nov 16 03:57:39 user nova-compute[103546]:   <os>
Nov 16 03:57:39 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 03:57:39 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 03:57:39 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 03:57:39 user nova-compute[103546]:   </os>
Nov 16 03:57:39 user nova-compute[103546]:   <features>
Nov 16 03:57:39 user nova-compute[103546]:     <acpi/>
Nov 16 03:57:39 user nova-compute[103546]:     <apic/>
Nov 16 03:57:39 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 03:57:39 user nova-compute[103546]:   </features>
Nov 16 03:57:39 user nova-compute[103546]:   <clock offset="utc">
Nov 16 03:57:39 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 03:57:39 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 03:57:39 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 03:57:39 user nova-compute[103546]:   </clock>
Nov 16 03:57:39 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 03:57:39 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 03:57:39 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 03:57:39 user nova-compute[103546]:   </cpu>
Nov 16 03:57:39 user nova-compute[103546]:   <devices>
Nov 16 03:57:39 user nova-compute[103546]:     <disk type="file" device="disk">
Nov 16 03:57:39 user nova-compute[103546]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 03:57:39 user nova-compute[103546]:       <source file="/opt/stack/data/nova/instances/ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c/disk"/>
Nov 16 03:57:39 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 03:57:39 user nova-compute[103546]:     </disk>
Nov 16 03:57:39 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 03:57:39 user nova-compute[103546]:       <mac address="fa:16:3e:db:d6:71"/>
Nov 16 03:57:39 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:57:39 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 03:57:39 user nova-compute[103546]:       <target dev="tap757f4202-bb"/>
Nov 16 03:57:39 user nova-compute[103546]:     </interface>
Nov 16 03:57:39 user nova-compute[103546]:     <serial type="pty">
Nov 16 03:57:39 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c/console.log" append="off"/>
Nov 16 03:57:39 user nova-compute[103546]:     </serial>
Nov 16 03:57:39 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 03:57:39 user nova-compute[103546]:     <video>
Nov 16 03:57:39 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:57:39 user nova-compute[103546]:     </video>
Nov 16 03:57:39 user nova-compute[103546]:     <rng model="virtio">
Nov 16 03:57:39 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 03:57:39 user nova-compute[103546]:     </rng>
Nov 16 03:57:39 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 03:57:39 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 03:57:39 user nova-compute[103546]:       <stats period="10"/>
Nov 16 03:57:39 user nova-compute[103546]:     </memballoon>
Nov 16 03:57:39 user nova-compute[103546]:   </devices>
Nov 16 03:57:39 user nova-compute[103546]: </domain>
Nov 16 03:57:39 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 03:57:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T03:53:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-131803665',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-131803665',id=22,image_ref='a10cd2a1-7c3b-44fd-a21c-316f8df9774b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1198627758',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:53:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='63722fdf17e4408299de8c215c133812',ramdisk_id='',reservation_id='r-gew0pxlb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1382373405',owner_user_name='tempest-AttachVolumeShelveTestJSON-1382373405-project-member',shelved_at='2023-11-16T03:55:42.538464',shelved_host='user',shelved_image_id='a10cd2a1-7c3b-44fd-a21c-316f8df9774b'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:57:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21d4e9052a614968bda331f028920ca7',uuid=ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "757f4202-bbf9-42cf-8ccc-7e970b892f1f", "address": "fa:16:3e:db:d6:71", "network": {"id": "b2fca984-f1e9-4c86-a3a5-b8d5b9950555", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-172535633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63722fdf17e4408299de8c215c133812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap757f4202-bb", "ovs_interfaceid": "757f4202-bbf9-42cf-8ccc-7e970b892f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 03:57:39 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Converting VIF {"id": "757f4202-bbf9-42cf-8ccc-7e970b892f1f", "address": "fa:16:3e:db:d6:71", "network": {"id": "b2fca984-f1e9-4c86-a3a5-b8d5b9950555", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-172535633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63722fdf17e4408299de8c215c133812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap757f4202-bb", "ovs_interfaceid": "757f4202-bbf9-42cf-8ccc-7e970b892f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:57:39 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:d6:71,bridge_name='br-int',has_traffic_filtering=True,id=757f4202-bbf9-42cf-8ccc-7e970b892f1f,network=Network(b2fca984-f1e9-4c86-a3a5-b8d5b9950555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap757f4202-bb') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:57:39 user nova-compute[103546]: DEBUG os_vif [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:d6:71,bridge_name='br-int',has_traffic_filtering=True,id=757f4202-bbf9-42cf-8ccc-7e970b892f1f,network=Network(b2fca984-f1e9-4c86-a3a5-b8d5b9950555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap757f4202-bb') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 03:57:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:57:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 03:57:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6e307f88-ebfc-5131-b177-53f94cc6cd37', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:57:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap757f4202-bb, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:57:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap757f4202-bb, col_values=(('qos', UUID('17899e45-2a79-4d08-aeeb-4a8344d05ad1')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:57:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap757f4202-bb, col_values=(('external_ids', {'iface-id': '757f4202-bbf9-42cf-8ccc-7e970b892f1f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:d6:71', 'vm-uuid': 'ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:57:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:57:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:39 user nova-compute[103546]: INFO os_vif [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:d6:71,bridge_name='br-int',has_traffic_filtering=True,id=757f4202-bbf9-42cf-8ccc-7e970b892f1f,network=Network(b2fca984-f1e9-4c86-a3a5-b8d5b9950555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap757f4202-bb')
Nov 16 03:57:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:57:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] No VIF found with MAC fa:16:3e:db:d6:71, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 03:57:40 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:40 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:40 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:40 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:40 user nova-compute[103546]: DEBUG nova.compute.manager [req-df9354d9-e634-41c3-9dbb-9e9ddfae3cee req-e1806658-f899-4211-a967-7114ed086690 service nova] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Received event network-vif-plugged-757f4202-bbf9-42cf-8ccc-7e970b892f1f {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:57:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-df9354d9-e634-41c3-9dbb-9e9ddfae3cee req-e1806658-f899-4211-a967-7114ed086690 service nova] Acquiring lock "ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:57:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-df9354d9-e634-41c3-9dbb-9e9ddfae3cee req-e1806658-f899-4211-a967-7114ed086690 service nova] Lock "ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:57:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-df9354d9-e634-41c3-9dbb-9e9ddfae3cee req-e1806658-f899-4211-a967-7114ed086690 service nova] Lock "ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:57:40 user nova-compute[103546]: DEBUG nova.compute.manager [req-df9354d9-e634-41c3-9dbb-9e9ddfae3cee req-e1806658-f899-4211-a967-7114ed086690 service nova] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] No waiting events found dispatching network-vif-plugged-757f4202-bbf9-42cf-8ccc-7e970b892f1f {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:57:40 user nova-compute[103546]: WARNING nova.compute.manager [req-df9354d9-e634-41c3-9dbb-9e9ddfae3cee req-e1806658-f899-4211-a967-7114ed086690 service nova] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Received unexpected event network-vif-plugged-757f4202-bbf9-42cf-8ccc-7e970b892f1f for instance with vm_state shelved_offloaded and task_state spawning.
Nov 16 03:57:41 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:41 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:41 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:41 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:42 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:42 user nova-compute[103546]: DEBUG nova.compute.manager [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 03:57:42 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Guest created on hypervisor {{(pid=103546) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 03:57:43 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Instance spawned successfully.
Nov 16 03:57:43 user nova-compute[103546]: DEBUG nova.compute.manager [req-1fc9147c-2d65-4d27-9467-cdf2bebc2131 req-b54e3814-f909-4dc4-b095-6dad45e5f19b service nova] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Received event network-vif-plugged-757f4202-bbf9-42cf-8ccc-7e970b892f1f {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:57:43 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-1fc9147c-2d65-4d27-9467-cdf2bebc2131 req-b54e3814-f909-4dc4-b095-6dad45e5f19b service nova] Acquiring lock "ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:57:43 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-1fc9147c-2d65-4d27-9467-cdf2bebc2131 req-b54e3814-f909-4dc4-b095-6dad45e5f19b service nova] Lock "ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:57:43 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-1fc9147c-2d65-4d27-9467-cdf2bebc2131 req-b54e3814-f909-4dc4-b095-6dad45e5f19b service nova] Lock "ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:57:43 user nova-compute[103546]: DEBUG nova.compute.manager [req-1fc9147c-2d65-4d27-9467-cdf2bebc2131 req-b54e3814-f909-4dc4-b095-6dad45e5f19b service nova] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] No waiting events found dispatching network-vif-plugged-757f4202-bbf9-42cf-8ccc-7e970b892f1f {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:57:43 user nova-compute[103546]: WARNING nova.compute.manager [req-1fc9147c-2d65-4d27-9467-cdf2bebc2131 req-b54e3814-f909-4dc4-b095-6dad45e5f19b service nova] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Received unexpected event network-vif-plugged-757f4202-bbf9-42cf-8ccc-7e970b892f1f for instance with vm_state shelved_offloaded and task_state spawning.
Nov 16 03:57:43 user nova-compute[103546]: DEBUG nova.compute.manager [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 03:57:43 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-15614494-6232-4c33-8c52-eaed76b32789 tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.323s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:57:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:43 user nova-compute[103546]: INFO nova.compute.manager [None req-9ae98d10-a2ce-4d6b-87d6-cb8327c782d1 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Unrescuing
Nov 16 03:57:43 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-9ae98d10-a2ce-4d6b-87d6-cb8327c782d1 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Acquiring lock "refresh_cache-fa7e5468-9dd4-407d-85ec-d45ec76f9e29" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:57:43 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-9ae98d10-a2ce-4d6b-87d6-cb8327c782d1 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Acquired lock "refresh_cache-fa7e5468-9dd4-407d-85ec-d45ec76f9e29" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:57:43 user nova-compute[103546]: DEBUG nova.network.neutron [None req-9ae98d10-a2ce-4d6b-87d6-cb8327c782d1 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 03:57:44 user nova-compute[103546]: DEBUG nova.network.neutron [None req-9ae98d10-a2ce-4d6b-87d6-cb8327c782d1 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Updating instance_info_cache with network_info: [{"id": "764b22e9-e899-4d39-8bc7-903ff8a7c3f6", "address": "fa:16:3e:77:63:89", "network": {"id": "fdbb2d2c-9a54-4517-b33a-cf27ce7570b1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79661471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2a38a5eb514ce8a7569c8322657eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap764b22e9-e8", "ovs_interfaceid": "764b22e9-e899-4d39-8bc7-903ff8a7c3f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:57:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-9ae98d10-a2ce-4d6b-87d6-cb8327c782d1 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Releasing lock "refresh_cache-fa7e5468-9dd4-407d-85ec-d45ec76f9e29" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:57:44 user nova-compute[103546]: DEBUG nova.objects.instance [None req-9ae98d10-a2ce-4d6b-87d6-cb8327c782d1 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lazy-loading 'flavor' on Instance uuid fa7e5468-9dd4-407d-85ec-d45ec76f9e29 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:57:44 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:44 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:44 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:44 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:44 user nova-compute[103546]: DEBUG nova.compute.manager [req-78d8571e-dc83-4421-a951-eb6b750a46ab req-c1cd6763-e162-4a4c-bc32-d7a70c3750de service nova] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Received event network-vif-unplugged-764b22e9-e899-4d39-8bc7-903ff8a7c3f6 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:57:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-78d8571e-dc83-4421-a951-eb6b750a46ab req-c1cd6763-e162-4a4c-bc32-d7a70c3750de service nova] Acquiring lock "fa7e5468-9dd4-407d-85ec-d45ec76f9e29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:57:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-78d8571e-dc83-4421-a951-eb6b750a46ab req-c1cd6763-e162-4a4c-bc32-d7a70c3750de service nova] Lock "fa7e5468-9dd4-407d-85ec-d45ec76f9e29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:57:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-78d8571e-dc83-4421-a951-eb6b750a46ab req-c1cd6763-e162-4a4c-bc32-d7a70c3750de service nova] Lock "fa7e5468-9dd4-407d-85ec-d45ec76f9e29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:57:44 user nova-compute[103546]: DEBUG nova.compute.manager [req-78d8571e-dc83-4421-a951-eb6b750a46ab req-c1cd6763-e162-4a4c-bc32-d7a70c3750de service nova] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] No waiting events found dispatching network-vif-unplugged-764b22e9-e899-4d39-8bc7-903ff8a7c3f6 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:57:44 user nova-compute[103546]: WARNING nova.compute.manager [req-78d8571e-dc83-4421-a951-eb6b750a46ab req-c1cd6763-e162-4a4c-bc32-d7a70c3750de service nova] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Received unexpected event network-vif-unplugged-764b22e9-e899-4d39-8bc7-903ff8a7c3f6 for instance with vm_state rescued and task_state unrescuing.
Nov 16 03:57:44 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:44 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:45 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Instance destroyed successfully.
Nov 16 03:57:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:46 user nova-compute[103546]: DEBUG nova.compute.manager [req-72042a8d-e764-4a6d-9d1a-dd069e78e280 req-4e6fd374-76b3-408c-8646-e39da880a944 service nova] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Received event network-vif-plugged-764b22e9-e899-4d39-8bc7-903ff8a7c3f6 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:57:46 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-72042a8d-e764-4a6d-9d1a-dd069e78e280 req-4e6fd374-76b3-408c-8646-e39da880a944 service nova] Acquiring lock "fa7e5468-9dd4-407d-85ec-d45ec76f9e29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:57:46 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-72042a8d-e764-4a6d-9d1a-dd069e78e280 req-4e6fd374-76b3-408c-8646-e39da880a944 service nova] Lock "fa7e5468-9dd4-407d-85ec-d45ec76f9e29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:57:46 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-72042a8d-e764-4a6d-9d1a-dd069e78e280 req-4e6fd374-76b3-408c-8646-e39da880a944 service nova] Lock "fa7e5468-9dd4-407d-85ec-d45ec76f9e29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:57:46 user nova-compute[103546]: DEBUG nova.compute.manager [req-72042a8d-e764-4a6d-9d1a-dd069e78e280 req-4e6fd374-76b3-408c-8646-e39da880a944 service nova] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] No waiting events found dispatching network-vif-plugged-764b22e9-e899-4d39-8bc7-903ff8a7c3f6 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:57:46 user nova-compute[103546]: WARNING nova.compute.manager [req-72042a8d-e764-4a6d-9d1a-dd069e78e280 req-4e6fd374-76b3-408c-8646-e39da880a944 service nova] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Received unexpected event network-vif-plugged-764b22e9-e899-4d39-8bc7-903ff8a7c3f6 for instance with vm_state rescued and task_state unrescuing.
Nov 16 03:57:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:48 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:48 user nova-compute[103546]: DEBUG nova.compute.manager [req-63890d23-a93d-433c-8a0c-75311f61ce1d req-e087b79a-76d4-42f3-ae1f-943f26af1acb service nova] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Received event network-vif-plugged-764b22e9-e899-4d39-8bc7-903ff8a7c3f6 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:57:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-63890d23-a93d-433c-8a0c-75311f61ce1d req-e087b79a-76d4-42f3-ae1f-943f26af1acb service nova] Acquiring lock "fa7e5468-9dd4-407d-85ec-d45ec76f9e29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:57:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-63890d23-a93d-433c-8a0c-75311f61ce1d req-e087b79a-76d4-42f3-ae1f-943f26af1acb service nova] Lock "fa7e5468-9dd4-407d-85ec-d45ec76f9e29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:57:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-63890d23-a93d-433c-8a0c-75311f61ce1d req-e087b79a-76d4-42f3-ae1f-943f26af1acb service nova] Lock "fa7e5468-9dd4-407d-85ec-d45ec76f9e29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:57:48 user nova-compute[103546]: DEBUG nova.compute.manager [req-63890d23-a93d-433c-8a0c-75311f61ce1d req-e087b79a-76d4-42f3-ae1f-943f26af1acb service nova] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] No waiting events found dispatching network-vif-plugged-764b22e9-e899-4d39-8bc7-903ff8a7c3f6 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:57:48 user nova-compute[103546]: WARNING nova.compute.manager [req-63890d23-a93d-433c-8a0c-75311f61ce1d req-e087b79a-76d4-42f3-ae1f-943f26af1acb service nova] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Received unexpected event network-vif-plugged-764b22e9-e899-4d39-8bc7-903ff8a7c3f6 for instance with vm_state rescued and task_state unrescuing.
Nov 16 03:57:48 user nova-compute[103546]: DEBUG nova.compute.manager [req-63890d23-a93d-433c-8a0c-75311f61ce1d req-e087b79a-76d4-42f3-ae1f-943f26af1acb service nova] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Received event network-vif-plugged-764b22e9-e899-4d39-8bc7-903ff8a7c3f6 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:57:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-63890d23-a93d-433c-8a0c-75311f61ce1d req-e087b79a-76d4-42f3-ae1f-943f26af1acb service nova] Acquiring lock "fa7e5468-9dd4-407d-85ec-d45ec76f9e29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:57:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-63890d23-a93d-433c-8a0c-75311f61ce1d req-e087b79a-76d4-42f3-ae1f-943f26af1acb service nova] Lock "fa7e5468-9dd4-407d-85ec-d45ec76f9e29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:57:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-63890d23-a93d-433c-8a0c-75311f61ce1d req-e087b79a-76d4-42f3-ae1f-943f26af1acb service nova] Lock "fa7e5468-9dd4-407d-85ec-d45ec76f9e29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:57:48 user nova-compute[103546]: DEBUG nova.compute.manager [req-63890d23-a93d-433c-8a0c-75311f61ce1d req-e087b79a-76d4-42f3-ae1f-943f26af1acb service nova] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] No waiting events found dispatching network-vif-plugged-764b22e9-e899-4d39-8bc7-903ff8a7c3f6 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:57:48 user nova-compute[103546]: WARNING nova.compute.manager [req-63890d23-a93d-433c-8a0c-75311f61ce1d req-e087b79a-76d4-42f3-ae1f-943f26af1acb service nova] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Received unexpected event network-vif-plugged-764b22e9-e899-4d39-8bc7-903ff8a7c3f6 for instance with vm_state rescued and task_state unrescuing.
Nov 16 03:57:48 user nova-compute[103546]: DEBUG nova.compute.manager [None req-9ae98d10-a2ce-4d6b-87d6-cb8327c782d1 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 03:57:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:51 user nova-compute[103546]: DEBUG nova.compute.manager [req-2836078a-609d-404b-8aaf-594a60b2dec7 req-e03b815f-e5c8-4317-87db-d0086700736f service nova] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Received event network-changed-eb9c9c0a-9b82-4cdf-8500-4ee860f7af29 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:57:51 user nova-compute[103546]: DEBUG nova.compute.manager [req-2836078a-609d-404b-8aaf-594a60b2dec7 req-e03b815f-e5c8-4317-87db-d0086700736f service nova] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Refreshing instance network info cache due to event network-changed-eb9c9c0a-9b82-4cdf-8500-4ee860f7af29. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:57:51 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-2836078a-609d-404b-8aaf-594a60b2dec7 req-e03b815f-e5c8-4317-87db-d0086700736f service nova] Acquiring lock "refresh_cache-d2781221-b5e3-468a-a9f5-436a04285f38" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:57:51 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-2836078a-609d-404b-8aaf-594a60b2dec7 req-e03b815f-e5c8-4317-87db-d0086700736f service nova] Acquired lock "refresh_cache-d2781221-b5e3-468a-a9f5-436a04285f38" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:57:51 user nova-compute[103546]: DEBUG nova.network.neutron [req-2836078a-609d-404b-8aaf-594a60b2dec7 req-e03b815f-e5c8-4317-87db-d0086700736f service nova] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Refreshing network info cache for port eb9c9c0a-9b82-4cdf-8500-4ee860f7af29 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:57:52 user nova-compute[103546]: DEBUG nova.network.neutron [req-2836078a-609d-404b-8aaf-594a60b2dec7 req-e03b815f-e5c8-4317-87db-d0086700736f service nova] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Updated VIF entry in instance network info cache for port eb9c9c0a-9b82-4cdf-8500-4ee860f7af29. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 03:57:52 user nova-compute[103546]: DEBUG nova.network.neutron [req-2836078a-609d-404b-8aaf-594a60b2dec7 req-e03b815f-e5c8-4317-87db-d0086700736f service nova] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Updating instance_info_cache with network_info: [{"id": "eb9c9c0a-9b82-4cdf-8500-4ee860f7af29", "address": "fa:16:3e:28:2f:a8", "network": {"id": "6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038318316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e30b7ac9515458aa8a6eb1a34cc543a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb9c9c0a-9b", "ovs_interfaceid": "eb9c9c0a-9b82-4cdf-8500-4ee860f7af29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:57:52 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-2836078a-609d-404b-8aaf-594a60b2dec7 req-e03b815f-e5c8-4317-87db-d0086700736f service nova] Releasing lock "refresh_cache-d2781221-b5e3-468a-a9f5-436a04285f38" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:57:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-74fa6d57-1a77-4060-8352-5e9acad90c1d tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Acquiring lock "d2781221-b5e3-468a-a9f5-436a04285f38" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:57:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-74fa6d57-1a77-4060-8352-5e9acad90c1d tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "d2781221-b5e3-468a-a9f5-436a04285f38" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:57:54 user nova-compute[103546]: DEBUG nova.objects.instance [None req-74fa6d57-1a77-4060-8352-5e9acad90c1d tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lazy-loading 'flavor' on Instance uuid d2781221-b5e3-468a-a9f5-436a04285f38 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:57:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-74fa6d57-1a77-4060-8352-5e9acad90c1d tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "d2781221-b5e3-468a-a9f5-436a04285f38" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:57:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-74fa6d57-1a77-4060-8352-5e9acad90c1d tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Acquiring lock "d2781221-b5e3-468a-a9f5-436a04285f38" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:57:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-74fa6d57-1a77-4060-8352-5e9acad90c1d tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "d2781221-b5e3-468a-a9f5-436a04285f38" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:57:54 user nova-compute[103546]: INFO nova.compute.manager [None req-74fa6d57-1a77-4060-8352-5e9acad90c1d tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Attaching volume 2eb2ddb2-cce9-416f-b15c-58dd8afa3e17 to /dev/vdb
Nov 16 03:57:55 user nova-compute[103546]: DEBUG os_brick.utils [None req-74fa6d57-1a77-4060-8352-5e9acad90c1d tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:57:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:57:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:57:55 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa8374c-9bb4-434c-ad08-bdf8e4ad7016]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af5c39b14ece\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:57:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:57:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:57:55 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[7377acb0-a944-448a-9acf-fe591a0c42c1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:57:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:57:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:57:55 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4afdb9c-4cfe-4ee1-a917-44e29cb501c7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:57:55 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d996192d-05b5-4981-9736-f23414ae1358]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:57:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-74fa6d57-1a77-4060-8352-5e9acad90c1d tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Running cmd (subprocess): nvme version {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:57:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-74fa6d57-1a77-4060-8352-5e9acad90c1d tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] 'nvme version' failed. Not Retrying. {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:57:55 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.nvmeof [None req-74fa6d57-1a77-4060-8352-5e9acad90c1d tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] nvme not present on system {{(pid=103546) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 03:57:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:57:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 03:57:55 user nova-compute[103546]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 03:57:55 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e5966e-9f65-46cf-9a1e-8a3071825743]: (4, '') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:57:55 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-74fa6d57-1a77-4060-8352-5e9acad90c1d tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=103546) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 03:57:55 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-74fa6d57-1a77-4060-8352-5e9acad90c1d tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 03:57:55 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-74fa6d57-1a77-4060-8352-5e9acad90c1d tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] LIGHTOS: no hostnqn found. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 03:57:55 user nova-compute[103546]: DEBUG os_brick.utils [None req-74fa6d57-1a77-4060-8352-5e9acad90c1d tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af5c39b14ece', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:57:55 user nova-compute[103546]: DEBUG nova.virt.block_device [None req-74fa6d57-1a77-4060-8352-5e9acad90c1d tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Updating existing volume attachment record: affa8f10-def1-4a4c-aca9-e4f4a99d5be6 {{(pid=103546) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 03:57:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:57:59 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:58:00 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74fa6d57-1a77-4060-8352-5e9acad90c1d tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 03:58:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fa6d57-1a77-4060-8352-5e9acad90c1d tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zsxKYaUl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:58:00 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-74fa6d57-1a77-4060-8352-5e9acad90c1d tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:58:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-74fa6d57-1a77-4060-8352-5e9acad90c1d tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:58:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-74fa6d57-1a77-4060-8352-5e9acad90c1d tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:58:00 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-74fa6d57-1a77-4060-8352-5e9acad90c1d tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:58:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-74fa6d57-1a77-4060-8352-5e9acad90c1d tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:58:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-74fa6d57-1a77-4060-8352-5e9acad90c1d tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:58:00 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-74fa6d57-1a77-4060-8352-5e9acad90c1d tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 03:58:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17 -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:58:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:58:00 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4e4d61-c771-4f7e-a09a-2a812e5056af]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:58:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fa6d57-1a77-4060-8352-5e9acad90c1d tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 03:58:00 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:58:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17 -p 172.16.0.220:3260 --interface default --op new {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:58:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:58:00 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ac93f1-1f27-486f-abf6-cd461ec87a17]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17] added\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:58:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fa6d57-1a77-4060-8352-5e9acad90c1d tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17] added
Nov 16 03:58:00 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:58:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:58:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.036s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:58:00 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[558e156e-f80f-4efd-a463-21e28800ecd4]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:58:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fa6d57-1a77-4060-8352-5e9acad90c1d tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:58:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:58:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:58:00 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a8e03b-d8c7-47ab-bf3c-8d0ef494bdbe]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:58:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fa6d57-1a77-4060-8352-5e9acad90c1d tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:58:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zsxKYaUl {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:58:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zsxKYaUl" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:58:00 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb42ccd0-6280-4244-ab1c-9adabb63d329]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:58:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fa6d57-1a77-4060-8352-5e9acad90c1d tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zsxKYaUl'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:58:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:58:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:58:00 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fba06bb-69fe-496a-a05c-da507c237989]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:58:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fa6d57-1a77-4060-8352-5e9acad90c1d tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:58:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:58:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:58:00 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a011f6-0aef-431b-aae4-622669a2baaf]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:58:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fa6d57-1a77-4060-8352-5e9acad90c1d tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:58:00 user nova-compute[103546]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)
Nov 16 03:58:00 user nova-compute[103546]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 (non-flash)
Nov 16 03:58:00 user nova-compute[103546]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283 (non-flash)
Nov 16 03:58:00 user nova-compute[103546]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc (non-flash)
Nov 16 03:58:00 user nova-compute[103546]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af (non-flash)
Nov 16 03:58:00 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:58:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fa6d57-1a77-4060-8352-5e9acad90c1d tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:58:00 user nova-compute[103546]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)
Nov 16 03:58:00 user nova-compute[103546]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 (non-flash)
Nov 16 03:58:00 user nova-compute[103546]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283 (non-flash)
Nov 16 03:58:00 user nova-compute[103546]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc (non-flash)
Nov 16 03:58:00 user nova-compute[103546]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af (non-flash)
Nov 16 03:58:00 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:58:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17 -p 172.16.0.220:3260 --login {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:58:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:58:00 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e871a478-bcfb-4ea7-98f6-003561faaad4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:58:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fa6d57-1a77-4060-8352-5e9acad90c1d tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17, portal: 172.16.0.220,3260]
Nov 16 03:58:00 user nova-compute[103546]: Login to [iface: default, target: iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17, portal: 172.16.0.220,3260] successful.
Nov 16 03:58:00 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:58:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:58:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:58:00 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da33a41-9bde-4502-815a-dd0f25072262]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:58:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fa6d57-1a77-4060-8352-5e9acad90c1d tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:58:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:58:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:58:00 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[81271f33-bb5f-4721-981d-8e49dc6f59b3]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:58:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fa6d57-1a77-4060-8352-5e9acad90c1d tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:58:00 user nova-compute[103546]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)
Nov 16 03:58:00 user nova-compute[103546]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 (non-flash)
Nov 16 03:58:00 user nova-compute[103546]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283 (non-flash)
Nov 16 03:58:00 user nova-compute[103546]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc (non-flash)
Nov 16 03:58:00 user nova-compute[103546]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af (non-flash)
Nov 16 03:58:00 user nova-compute[103546]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17 (non-flash)
Nov 16 03:58:00 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:58:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fa6d57-1a77-4060-8352-5e9acad90c1d tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:58:00 user nova-compute[103546]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)
Nov 16 03:58:00 user nova-compute[103546]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 (non-flash)
Nov 16 03:58:00 user nova-compute[103546]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283 (non-flash)
Nov 16 03:58:00 user nova-compute[103546]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc (non-flash)
Nov 16 03:58:00 user nova-compute[103546]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af (non-flash)
Nov 16 03:58:00 user nova-compute[103546]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17 (non-flash)
Nov 16 03:58:00 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:58:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-74fa6d57-1a77-4060-8352-5e9acad90c1d tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:58:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fa6d57-1a77-4060-8352-5e9acad90c1d tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 03:58:00 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-74fa6d57-1a77-4060-8352-5e9acad90c1d tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] HCTL ('39', '-', '-', 0) found on session 37 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 03:58:00 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-74fa6d57-1a77-4060-8352-5e9acad90c1d tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 03:58:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:58:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:58:00 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5558183e-e091-4388-b71e-42a61ae6b096]: (4, ('- - 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:58:00 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-74fa6d57-1a77-4060-8352-5e9acad90c1d tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Searching for a device in session 37 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 03:58:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fa6d57-1a77-4060-8352-5e9acad90c1d tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zsxKYaUl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 03:58:01 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-74fa6d57-1a77-4060-8352-5e9acad90c1d tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:58:01 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-74fa6d57-1a77-4060-8352-5e9acad90c1d tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '23765353061626666', 'path': '/dev/sdh'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:58:01 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74fa6d57-1a77-4060-8352-5e9acad90c1d tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765353061626666', 'path': '/dev/sdh'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 03:58:01 user nova-compute[103546]: DEBUG nova.objects.instance [None req-74fa6d57-1a77-4060-8352-5e9acad90c1d tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lazy-loading 'flavor' on Instance uuid d2781221-b5e3-468a-a9f5-436a04285f38 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:58:01 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-74fa6d57-1a77-4060-8352-5e9acad90c1d tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 03:58:01 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 03:58:01 user nova-compute[103546]:   <source dev="/dev/sdh"/>
Nov 16 03:58:01 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 03:58:01 user nova-compute[103546]:   <serial>2eb2ddb2-cce9-416f-b15c-58dd8afa3e17</serial>
Nov 16 03:58:01 user nova-compute[103546]: </disk>
Nov 16 03:58:01 user nova-compute[103546]:  {{(pid=103546) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 03:58:02 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-74fa6d57-1a77-4060-8352-5e9acad90c1d tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:58:02 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-74fa6d57-1a77-4060-8352-5e9acad90c1d tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] No BDM found with device name vdb, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:58:02 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-74fa6d57-1a77-4060-8352-5e9acad90c1d tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] No VIF found with MAC fa:16:3e:28:2f:a8, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 03:58:02 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-74fa6d57-1a77-4060-8352-5e9acad90c1d tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "d2781221-b5e3-468a-a9f5-436a04285f38" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.563s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:58:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:58:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:58:06 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Acquiring lock "8e6fddce-7650-4bf9-8c63-3d6db6ff4726" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:58:06 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "8e6fddce-7650-4bf9-8c63-3d6db6ff4726" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:58:06 user nova-compute[103546]: DEBUG nova.compute.manager [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] Starting instance... {{(pid=103546) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 03:58:06 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:58:06 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:58:06 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=103546) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 03:58:06 user nova-compute[103546]: INFO nova.compute.claims [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] Claim successful on node user
Nov 16 03:58:06 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:58:06 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:58:06 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.551s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:58:06 user nova-compute[103546]: DEBUG nova.compute.manager [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] Start building networks asynchronously for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 03:58:07 user nova-compute[103546]: DEBUG nova.compute.manager [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] Allocating IP information in the background. {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 03:58:07 user nova-compute[103546]: DEBUG nova.network.neutron [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] allocate_for_instance() {{(pid=103546) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 03:58:07 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 03:58:07 user nova-compute[103546]: DEBUG nova.compute.manager [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] Start building block device mappings for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 03:58:07 user nova-compute[103546]: DEBUG nova.policy [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9d186163bddc48319b97f186f7c65e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e30b7ac9515458aa8a6eb1a34cc543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103546) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 03:58:07 user nova-compute[103546]: DEBUG nova.compute.manager [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] Start spawning the instance on the hypervisor. {{(pid=103546) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 03:58:07 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] Creating instance directory {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 03:58:07 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] Creating image(s)
Nov 16 03:58:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Acquiring lock "/opt/stack/data/nova/instances/8e6fddce-7650-4bf9-8c63-3d6db6ff4726/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:58:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "/opt/stack/data/nova/instances/8e6fddce-7650-4bf9-8c63-3d6db6ff4726/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:58:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "/opt/stack/data/nova/instances/8e6fddce-7650-4bf9-8c63-3d6db6ff4726/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:58:07 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:58:07 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.186s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:58:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Acquiring lock "8c9efafb670bfe5842ba1f4ce398924612164af7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:58:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:58:07 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:58:07 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.175s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:58:07 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/8e6fddce-7650-4bf9-8c63-3d6db6ff4726/disk 1073741824 {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:58:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-60fb6df6-1260-4549-9462-a26c1becad6a tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Acquiring lock "2ab80244-d70d-41ce-9b7e-bb9c8a676ad6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:58:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-60fb6df6-1260-4549-9462-a26c1becad6a tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Lock "2ab80244-d70d-41ce-9b7e-bb9c8a676ad6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.004s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:58:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-60fb6df6-1260-4549-9462-a26c1becad6a tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Acquiring lock "2ab80244-d70d-41ce-9b7e-bb9c8a676ad6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:58:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-60fb6df6-1260-4549-9462-a26c1becad6a tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Lock "2ab80244-d70d-41ce-9b7e-bb9c8a676ad6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:58:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-60fb6df6-1260-4549-9462-a26c1becad6a tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Lock "2ab80244-d70d-41ce-9b7e-bb9c8a676ad6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:58:07 user nova-compute[103546]: INFO nova.compute.manager [None req-60fb6df6-1260-4549-9462-a26c1becad6a tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Terminating instance
Nov 16 03:58:07 user nova-compute[103546]: DEBUG nova.compute.manager [None req-60fb6df6-1260-4549-9462-a26c1becad6a tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Start destroying the instance on the hypervisor. {{(pid=103546) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 03:58:07 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/8e6fddce-7650-4bf9-8c63-3d6db6ff4726/disk 1073741824" returned: 0 in 0.060s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:58:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:58:07 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:58:07 user nova-compute[103546]: DEBUG nova.network.neutron [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] Successfully created port: c9253207-134c-459d-becb-ba6b70ccd346 {{(pid=103546) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 03:58:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:58:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:58:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:58:07 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.177s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:58:07 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8e6fddce-7650-4bf9-8c63-3d6db6ff4726/disk. size=1073741824 {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 03:58:07 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6fddce-7650-4bf9-8c63-3d6db6ff4726/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:58:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:58:07 user nova-compute[103546]: DEBUG nova.compute.manager [req-3aa5d84e-226d-4567-a7a3-851ede370f88 req-a26a1500-4d03-47e0-af56-c45fdbc9bc89 service nova] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Received event network-vif-unplugged-49c54f9c-e72e-4cdf-96d3-7c31d8ed5109 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:58:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3aa5d84e-226d-4567-a7a3-851ede370f88 req-a26a1500-4d03-47e0-af56-c45fdbc9bc89 service nova] Acquiring lock "2ab80244-d70d-41ce-9b7e-bb9c8a676ad6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:58:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3aa5d84e-226d-4567-a7a3-851ede370f88 req-a26a1500-4d03-47e0-af56-c45fdbc9bc89 service nova] Lock "2ab80244-d70d-41ce-9b7e-bb9c8a676ad6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:58:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3aa5d84e-226d-4567-a7a3-851ede370f88 req-a26a1500-4d03-47e0-af56-c45fdbc9bc89 service nova] Lock "2ab80244-d70d-41ce-9b7e-bb9c8a676ad6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:58:07 user nova-compute[103546]: DEBUG nova.compute.manager [req-3aa5d84e-226d-4567-a7a3-851ede370f88 req-a26a1500-4d03-47e0-af56-c45fdbc9bc89 service nova] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] No waiting events found dispatching network-vif-unplugged-49c54f9c-e72e-4cdf-96d3-7c31d8ed5109 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:58:07 user nova-compute[103546]: DEBUG nova.compute.manager [req-3aa5d84e-226d-4567-a7a3-851ede370f88 req-a26a1500-4d03-47e0-af56-c45fdbc9bc89 service nova] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Received event network-vif-unplugged-49c54f9c-e72e-4cdf-96d3-7c31d8ed5109 for instance with task_state deleting. {{(pid=103546) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6fddce-7650-4bf9-8c63-3d6db6ff4726/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Cannot resize image /opt/stack/data/nova/instances/8e6fddce-7650-4bf9-8c63-3d6db6ff4726/disk to a smaller size. {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] Created local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] Ensure instance console log exists: /opt/stack/data/nova/instances/8e6fddce-7650-4bf9-8c63-3d6db6ff4726/console.log {{(pid=103546) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG nova.network.neutron [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] Successfully updated port: c9253207-134c-459d-becb-ba6b70ccd346 {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Acquiring lock "refresh_cache-8e6fddce-7650-4bf9-8c63-3d6db6ff4726" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Acquired lock "refresh_cache-8e6fddce-7650-4bf9-8c63-3d6db6ff4726" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG nova.network.neutron [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG nova.compute.manager [req-827cf65a-dc4f-4662-a7f5-710656eb1e9f req-366605c8-29e4-49d6-9a27-41bf9af2b067 service nova] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] Received event network-changed-c9253207-134c-459d-becb-ba6b70ccd346 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG nova.compute.manager [req-827cf65a-dc4f-4662-a7f5-710656eb1e9f req-366605c8-29e4-49d6-9a27-41bf9af2b067 service nova] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] Refreshing instance network info cache due to event network-changed-c9253207-134c-459d-becb-ba6b70ccd346. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-827cf65a-dc4f-4662-a7f5-710656eb1e9f req-366605c8-29e4-49d6-9a27-41bf9af2b067 service nova] Acquiring lock "refresh_cache-8e6fddce-7650-4bf9-8c63-3d6db6ff4726" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:58:08 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Instance destroyed successfully.
Nov 16 03:58:08 user nova-compute[103546]: DEBUG nova.objects.instance [None req-60fb6df6-1260-4549-9462-a26c1becad6a tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Lazy-loading 'resources' on Instance uuid 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-60fb6df6-1260-4549-9462-a26c1becad6a tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T03:54:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-209964559',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-141615707',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1Y2L2l3MWVbNwdnSdeRUxJz0N8le0D37MGjqwWaMwxA7R3Wdx+y5O8T7rTKllDINxi17uE0eTWUeh3EwdhWWGhIv3K2uMZjagCC2gLDhzEp415K3OXZdfZ5QqNTz5yjQ==',key_name='tempest-keypair-336828995',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:56:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='957a9e268fe7460c97fce1e634015214',ramdisk_id='',reservation_id='r-f4s0l7jd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-787129566',owner_user_name='tempest-ServerActionsV293TestJSON-787129566-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T03:56:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fff2b2e712c1466991b73ead603bcf8f',uuid=2ab80244-d70d-41ce-9b7e-bb9c8a676ad6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "49c54f9c-e72e-4cdf-96d3-7c31d8ed5109", "address": "fa:16:3e:5a:f3:7f", "network": {"id": "ad0d15aa-3eb9-452a-8c1e-f98a235beb89", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-981191229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "957a9e268fe7460c97fce1e634015214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49c54f9c-e7", "ovs_interfaceid": "49c54f9c-e72e-4cdf-96d3-7c31d8ed5109", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-60fb6df6-1260-4549-9462-a26c1becad6a tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Converting VIF {"id": "49c54f9c-e72e-4cdf-96d3-7c31d8ed5109", "address": "fa:16:3e:5a:f3:7f", "network": {"id": "ad0d15aa-3eb9-452a-8c1e-f98a235beb89", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-981191229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "957a9e268fe7460c97fce1e634015214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49c54f9c-e7", "ovs_interfaceid": "49c54f9c-e72e-4cdf-96d3-7c31d8ed5109", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-60fb6df6-1260-4549-9462-a26c1becad6a tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5a:f3:7f,bridge_name='br-int',has_traffic_filtering=True,id=49c54f9c-e72e-4cdf-96d3-7c31d8ed5109,network=Network(ad0d15aa-3eb9-452a-8c1e-f98a235beb89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49c54f9c-e7') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG os_vif [None req-60fb6df6-1260-4549-9462-a26c1becad6a tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:f3:7f,bridge_name='br-int',has_traffic_filtering=True,id=49c54f9c-e72e-4cdf-96d3-7c31d8ed5109,network=Network(ad0d15aa-3eb9-452a-8c1e-f98a235beb89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49c54f9c-e7') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap49c54f9c-e7, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f1324e76-892e-4e91-afab-1f21c3e70037) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:58:08 user nova-compute[103546]: INFO os_vif [None req-60fb6df6-1260-4549-9462-a26c1becad6a tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:f3:7f,bridge_name='br-int',has_traffic_filtering=True,id=49c54f9c-e72e-4cdf-96d3-7c31d8ed5109,network=Network(ad0d15aa-3eb9-452a-8c1e-f98a235beb89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49c54f9c-e7')
Nov 16 03:58:08 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60fb6df6-1260-4549-9462-a26c1becad6a tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-60fb6df6-1260-4549-9462-a26c1becad6a tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IwNpXAPB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:58:08 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-60fb6df6-1260-4549-9462-a26c1becad6a tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:58:08 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-60fb6df6-1260-4549-9462-a26c1becad6a tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-60fb6df6-1260-4549-9462-a26c1becad6a tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b785b54-b560-43c0-b36f-6e4d826ccb31]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-60fb6df6-1260-4549-9462-a26c1becad6a tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 03:58:08 user nova-compute[103546]: No targets found.
Nov 16 03:58:08 user nova-compute[103546]: iSNS:
Nov 16 03:58:08 user nova-compute[103546]: No targets found.
Nov 16 03:58:08 user nova-compute[103546]: STATIC:
Nov 16 03:58:08 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229
Nov 16 03:58:08 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:58:08 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:58:08 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283
Nov 16 03:58:08 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:58:08 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:58:08 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4
Nov 16 03:58:08 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:58:08 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:58:08 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc
Nov 16 03:58:08 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:58:08 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:58:08 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925
Nov 16 03:58:08 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:58:08 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:58:08 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af
Nov 16 03:58:08 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:58:08 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:58:08 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17
Nov 16 03:58:08 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:58:08 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:58:08 user nova-compute[103546]: FIRMWARE:
Nov 16 03:58:08 user nova-compute[103546]: No targets found.
Nov 16 03:58:08 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-60fb6df6-1260-4549-9462-a26c1becad6a tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 03:58:08 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 03:58:08 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-60fb6df6-1260-4549-9462-a26c1becad6a tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[902847fb-39a4-464d-ab0e-13a5c1524811]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e416b7-e25a-4b21-8a18-a8a24cf35553]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-60fb6df6-1260-4549-9462-a26c1becad6a tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:58:08 user nova-compute[103546]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)
Nov 16 03:58:08 user nova-compute[103546]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 (non-flash)
Nov 16 03:58:08 user nova-compute[103546]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283 (non-flash)
Nov 16 03:58:08 user nova-compute[103546]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc (non-flash)
Nov 16 03:58:08 user nova-compute[103546]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af (non-flash)
Nov 16 03:58:08 user nova-compute[103546]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17 (non-flash)
Nov 16 03:58:08 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-60fb6df6-1260-4549-9462-a26c1becad6a tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:58:08 user nova-compute[103546]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)
Nov 16 03:58:08 user nova-compute[103546]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 (non-flash)
Nov 16 03:58:08 user nova-compute[103546]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283 (non-flash)
Nov 16 03:58:08 user nova-compute[103546]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc (non-flash)
Nov 16 03:58:08 user nova-compute[103546]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af (non-flash)
Nov 16 03:58:08 user nova-compute[103546]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17 (non-flash)
Nov 16 03:58:08 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-60fb6df6-1260-4549-9462-a26c1becad6a tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60cc291c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc'): ({'sdf'}, set())}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-60fb6df6-1260-4549-9462-a26c1becad6a tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Removing single pathed devices sdf {{(pid=103546) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f639fd83-5e9a-4292-a9d6-1e1770841a2f]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.024s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d809f2f-3bf2-4b99-982d-e5a2936f36e4]: (4, ('ok\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-60fb6df6-1260-4549-9462-a26c1becad6a tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Flushing IO for device /dev/sdf {{(pid=103546) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[df39b376-8261-464f-aba3-70c3b4807206]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-60fb6df6-1260-4549-9462-a26c1becad6a tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=103546) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.053s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[86064bf6-02aa-41b7-9ea0-cd4fd62795a5]: (4, ('1', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-60fb6df6-1260-4549-9462-a26c1becad6a tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-60fb6df6-1260-4549-9462-a26c1becad6a tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] SCSI volumes sdf have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-60fb6df6-1260-4549-9462-a26c1becad6a tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc')] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2facd27-d0c8-4a3f-82e6-e9bcd947f014]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-60fb6df6-1260-4549-9462-a26c1becad6a tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc -p 172.16.0.220:3260 --logout {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG nova.network.neutron [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd452215-5719-458e-915d-a3768d43e2bc]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-60fb6df6-1260-4549-9462-a26c1becad6a tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc, portal: 172.16.0.220,3260]
Nov 16 03:58:08 user nova-compute[103546]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc, portal: 172.16.0.220,3260] successful.
Nov 16 03:58:08 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc -p 172.16.0.220:3260 --op delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cdf8533-74a7-4737-b4af-2a9ae07490fc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00ec4f7-5a91-4f3e-a5fe-862978727b1e]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-60fb6df6-1260-4549-9462-a26c1becad6a tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-60fb6df6-1260-4549-9462-a26c1becad6a tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.390s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-60fb6df6-1260-4549-9462-a26c1becad6a tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] <== disconnect_volume: return (391ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60fb6df6-1260-4549-9462-a26c1becad6a tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 03:58:08 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-60fb6df6-1260-4549-9462-a26c1becad6a tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Deleting instance files /opt/stack/data/nova/instances/2ab80244-d70d-41ce-9b7e-bb9c8a676ad6_del
Nov 16 03:58:08 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-60fb6df6-1260-4549-9462-a26c1becad6a tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Deletion of /opt/stack/data/nova/instances/2ab80244-d70d-41ce-9b7e-bb9c8a676ad6_del complete
Nov 16 03:58:08 user nova-compute[103546]: INFO nova.compute.manager [None req-60fb6df6-1260-4549-9462-a26c1becad6a tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Took 1.32 seconds to destroy the instance on the hypervisor.
Nov 16 03:58:08 user nova-compute[103546]: DEBUG oslo.service.loopingcall [None req-60fb6df6-1260-4549-9462-a26c1becad6a tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=103546) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG nova.compute.manager [-] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Deallocating network for instance {{(pid=103546) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 03:58:08 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] deallocate_for_instance() {{(pid=103546) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 03:58:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:58:09 user nova-compute[103546]: DEBUG nova.network.neutron [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] Updating instance_info_cache with network_info: [{"id": "c9253207-134c-459d-becb-ba6b70ccd346", "address": "fa:16:3e:a5:f8:87", "network": {"id": "6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038318316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e30b7ac9515458aa8a6eb1a34cc543a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9253207-13", "ovs_interfaceid": "c9253207-134c-459d-becb-ba6b70ccd346", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:58:09 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Releasing lock "refresh_cache-8e6fddce-7650-4bf9-8c63-3d6db6ff4726" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:58:09 user nova-compute[103546]: DEBUG nova.compute.manager [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] Instance network_info: |[{"id": "c9253207-134c-459d-becb-ba6b70ccd346", "address": "fa:16:3e:a5:f8:87", "network": {"id": "6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038318316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e30b7ac9515458aa8a6eb1a34cc543a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9253207-13", "ovs_interfaceid": "c9253207-134c-459d-becb-ba6b70ccd346", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 03:58:09 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-827cf65a-dc4f-4662-a7f5-710656eb1e9f req-366605c8-29e4-49d6-9a27-41bf9af2b067 service nova] Acquired lock "refresh_cache-8e6fddce-7650-4bf9-8c63-3d6db6ff4726" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:58:09 user nova-compute[103546]: DEBUG nova.network.neutron [req-827cf65a-dc4f-4662-a7f5-710656eb1e9f req-366605c8-29e4-49d6-9a27-41bf9af2b067 service nova] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] Refreshing network info cache for port c9253207-134c-459d-becb-ba6b70ccd346 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:58:09 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] Start _get_guest_xml network_info=[{"id": "c9253207-134c-459d-becb-ba6b70ccd346", "address": "fa:16:3e:a5:f8:87", "network": {"id": "6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038318316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e30b7ac9515458aa8a6eb1a34cc543a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9253207-13", "ovs_interfaceid": "c9253207-134c-459d-becb-ba6b70ccd346", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '5c6f539a-01e5-4478-bf8f-a14310b5d7dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 03:58:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:58:09 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:58:09 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:58:09 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 03:58:09 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 03:58:09 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 03:58:09 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 03:58:09 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 03:58:09 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 03:58:09 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 03:58:09 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 03:58:09 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 03:58:09 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 03:58:09 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 03:58:09 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 03:58:09 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 03:58:09 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 03:58:09 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 03:58:09 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 03:58:09 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:58:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-543146264',display_name='tempest-AttachVolumeNegativeTest-server-543146264',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-543146264',id=32,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjY//FeSMjnHH8p2HhPRIAaGvy65QA1urCliLX+NI7R540IP9DKTRI0PBWuy8kW9PO9nBXnEBUa1HmgqwjXN82NZQ+J1RoLdFH/k1BGb9oavm0R+vlaapGz8aGaQFI9Tg==',key_name='tempest-keypair-1808058804',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8e30b7ac9515458aa8a6eb1a34cc543a',ramdisk_id='',reservation_id='r-nuzon9nm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-64216432',owner_user_name='tempest-AttachVolumeNegativeTest-64216432-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:58:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d186163bddc48319b97f186f7c65e80',uuid=8e6fddce-7650-4bf9-8c63-3d6db6ff4726,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9253207-134c-459d-becb-ba6b70ccd346", "address": "fa:16:3e:a5:f8:87", "network": {"id": "6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038318316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e30b7ac9515458aa8a6eb1a34cc543a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9253207-13", "ovs_interfaceid": "c9253207-134c-459d-becb-ba6b70ccd346", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 03:58:09 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Converting VIF {"id": "c9253207-134c-459d-becb-ba6b70ccd346", "address": "fa:16:3e:a5:f8:87", "network": {"id": "6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038318316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e30b7ac9515458aa8a6eb1a34cc543a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9253207-13", "ovs_interfaceid": "c9253207-134c-459d-becb-ba6b70ccd346", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:58:09 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:f8:87,bridge_name='br-int',has_traffic_filtering=True,id=c9253207-134c-459d-becb-ba6b70ccd346,network=Network(6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9253207-13') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:58:09 user nova-compute[103546]: DEBUG nova.objects.instance [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lazy-loading 'pci_devices' on Instance uuid 8e6fddce-7650-4bf9-8c63-3d6db6ff4726 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:58:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:58:09 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] End _get_guest_xml xml=<domain type="kvm">
Nov 16 03:58:09 user nova-compute[103546]:   <uuid>8e6fddce-7650-4bf9-8c63-3d6db6ff4726</uuid>
Nov 16 03:58:09 user nova-compute[103546]:   <name>instance-00000020</name>
Nov 16 03:58:09 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 03:58:09 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 03:58:09 user nova-compute[103546]:   <metadata>
Nov 16 03:58:09 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 03:58:09 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 03:58:09 user nova-compute[103546]:       <nova:name>tempest-AttachVolumeNegativeTest-server-543146264</nova:name>
Nov 16 03:58:09 user nova-compute[103546]:       <nova:creationTime>2023-11-16 03:58:09</nova:creationTime>
Nov 16 03:58:09 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 03:58:09 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 03:58:09 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 03:58:09 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 03:58:09 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 03:58:09 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 03:58:09 user nova-compute[103546]:       </nova:flavor>
Nov 16 03:58:09 user nova-compute[103546]:       <nova:owner>
Nov 16 03:58:09 user nova-compute[103546]:         <nova:user uuid="9d186163bddc48319b97f186f7c65e80">tempest-AttachVolumeNegativeTest-64216432-project-member</nova:user>
Nov 16 03:58:09 user nova-compute[103546]:         <nova:project uuid="8e30b7ac9515458aa8a6eb1a34cc543a">tempest-AttachVolumeNegativeTest-64216432</nova:project>
Nov 16 03:58:09 user nova-compute[103546]:       </nova:owner>
Nov 16 03:58:09 user nova-compute[103546]:       <nova:root type="image" uuid="5c6f539a-01e5-4478-bf8f-a14310b5d7dd"/>
Nov 16 03:58:09 user nova-compute[103546]:       <nova:ports>
Nov 16 03:58:09 user nova-compute[103546]:         <nova:port uuid="c9253207-134c-459d-becb-ba6b70ccd346">
Nov 16 03:58:09 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 16 03:58:09 user nova-compute[103546]:         </nova:port>
Nov 16 03:58:09 user nova-compute[103546]:       </nova:ports>
Nov 16 03:58:09 user nova-compute[103546]:     </nova:instance>
Nov 16 03:58:09 user nova-compute[103546]:   </metadata>
Nov 16 03:58:09 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 03:58:09 user nova-compute[103546]:     <system>
Nov 16 03:58:09 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 03:58:09 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 03:58:09 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 03:58:09 user nova-compute[103546]:       <entry name="serial">8e6fddce-7650-4bf9-8c63-3d6db6ff4726</entry>
Nov 16 03:58:09 user nova-compute[103546]:       <entry name="uuid">8e6fddce-7650-4bf9-8c63-3d6db6ff4726</entry>
Nov 16 03:58:09 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 03:58:09 user nova-compute[103546]:     </system>
Nov 16 03:58:09 user nova-compute[103546]:   </sysinfo>
Nov 16 03:58:09 user nova-compute[103546]:   <os>
Nov 16 03:58:09 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 03:58:09 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 03:58:09 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 03:58:09 user nova-compute[103546]:   </os>
Nov 16 03:58:09 user nova-compute[103546]:   <features>
Nov 16 03:58:09 user nova-compute[103546]:     <acpi/>
Nov 16 03:58:09 user nova-compute[103546]:     <apic/>
Nov 16 03:58:09 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 03:58:09 user nova-compute[103546]:   </features>
Nov 16 03:58:09 user nova-compute[103546]:   <clock offset="utc">
Nov 16 03:58:09 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 03:58:09 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 03:58:09 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 03:58:09 user nova-compute[103546]:   </clock>
Nov 16 03:58:09 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 03:58:09 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 03:58:09 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 03:58:09 user nova-compute[103546]:   </cpu>
Nov 16 03:58:09 user nova-compute[103546]:   <devices>
Nov 16 03:58:09 user nova-compute[103546]:     <disk type="file" device="disk">
Nov 16 03:58:09 user nova-compute[103546]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 03:58:09 user nova-compute[103546]:       <source file="/opt/stack/data/nova/instances/8e6fddce-7650-4bf9-8c63-3d6db6ff4726/disk"/>
Nov 16 03:58:09 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 03:58:09 user nova-compute[103546]:     </disk>
Nov 16 03:58:09 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 03:58:09 user nova-compute[103546]:       <mac address="fa:16:3e:a5:f8:87"/>
Nov 16 03:58:09 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:58:09 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 03:58:09 user nova-compute[103546]:       <target dev="tapc9253207-13"/>
Nov 16 03:58:09 user nova-compute[103546]:     </interface>
Nov 16 03:58:09 user nova-compute[103546]:     <serial type="pty">
Nov 16 03:58:09 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/8e6fddce-7650-4bf9-8c63-3d6db6ff4726/console.log" append="off"/>
Nov 16 03:58:09 user nova-compute[103546]:     </serial>
Nov 16 03:58:09 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 03:58:09 user nova-compute[103546]:     <video>
Nov 16 03:58:09 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:58:09 user nova-compute[103546]:     </video>
Nov 16 03:58:09 user nova-compute[103546]:     <rng model="virtio">
Nov 16 03:58:09 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 03:58:09 user nova-compute[103546]:     </rng>
Nov 16 03:58:09 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 03:58:09 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 03:58:09 user nova-compute[103546]:       <stats period="10"/>
Nov 16 03:58:09 user nova-compute[103546]:     </memballoon>
Nov 16 03:58:09 user nova-compute[103546]:   </devices>
Nov 16 03:58:09 user nova-compute[103546]: </domain>
Nov 16 03:58:09 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 03:58:09 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:58:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-543146264',display_name='tempest-AttachVolumeNegativeTest-server-543146264',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-543146264',id=32,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjY//FeSMjnHH8p2HhPRIAaGvy65QA1urCliLX+NI7R540IP9DKTRI0PBWuy8kW9PO9nBXnEBUa1HmgqwjXN82NZQ+J1RoLdFH/k1BGb9oavm0R+vlaapGz8aGaQFI9Tg==',key_name='tempest-keypair-1808058804',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8e30b7ac9515458aa8a6eb1a34cc543a',ramdisk_id='',reservation_id='r-nuzon9nm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-64216432',owner_user_name='tempest-AttachVolumeNegativeTest-64216432-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:58:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d186163bddc48319b97f186f7c65e80',uuid=8e6fddce-7650-4bf9-8c63-3d6db6ff4726,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9253207-134c-459d-becb-ba6b70ccd346", "address": "fa:16:3e:a5:f8:87", "network": {"id": "6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038318316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e30b7ac9515458aa8a6eb1a34cc543a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9253207-13", "ovs_interfaceid": "c9253207-134c-459d-becb-ba6b70ccd346", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 03:58:09 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Converting VIF {"id": "c9253207-134c-459d-becb-ba6b70ccd346", "address": "fa:16:3e:a5:f8:87", "network": {"id": "6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038318316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e30b7ac9515458aa8a6eb1a34cc543a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9253207-13", "ovs_interfaceid": "c9253207-134c-459d-becb-ba6b70ccd346", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:58:09 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:f8:87,bridge_name='br-int',has_traffic_filtering=True,id=c9253207-134c-459d-becb-ba6b70ccd346,network=Network(6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9253207-13') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:58:09 user nova-compute[103546]: DEBUG os_vif [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:f8:87,bridge_name='br-int',has_traffic_filtering=True,id=c9253207-134c-459d-becb-ba6b70ccd346,network=Network(6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9253207-13') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 03:58:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:58:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:58:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 03:58:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:58:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '73e59af5-9bd5-56fe-8eec-d04ac63b5c0f', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:58:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:58:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:58:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:58:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:58:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc9253207-13, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:58:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc9253207-13, col_values=(('qos', UUID('07c1cf1d-ba44-458e-ac1d-380a6a4a32ec')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:58:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc9253207-13, col_values=(('external_ids', {'iface-id': 'c9253207-134c-459d-becb-ba6b70ccd346', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:f8:87', 'vm-uuid': '8e6fddce-7650-4bf9-8c63-3d6db6ff4726'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:58:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:58:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:58:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:58:09 user nova-compute[103546]: INFO os_vif [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:f8:87,bridge_name='br-int',has_traffic_filtering=True,id=c9253207-134c-459d-becb-ba6b70ccd346,network=Network(6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9253207-13')
Nov 16 03:58:09 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:58:09 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] No VIF found with MAC fa:16:3e:a5:f8:87, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 03:58:09 user nova-compute[103546]: DEBUG nova.network.neutron [req-827cf65a-dc4f-4662-a7f5-710656eb1e9f req-366605c8-29e4-49d6-9a27-41bf9af2b067 service nova] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] Updated VIF entry in instance network info cache for port c9253207-134c-459d-becb-ba6b70ccd346. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 03:58:09 user nova-compute[103546]: DEBUG nova.network.neutron [req-827cf65a-dc4f-4662-a7f5-710656eb1e9f req-366605c8-29e4-49d6-9a27-41bf9af2b067 service nova] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] Updating instance_info_cache with network_info: [{"id": "c9253207-134c-459d-becb-ba6b70ccd346", "address": "fa:16:3e:a5:f8:87", "network": {"id": "6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038318316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e30b7ac9515458aa8a6eb1a34cc543a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9253207-13", "ovs_interfaceid": "c9253207-134c-459d-becb-ba6b70ccd346", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:58:09 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-827cf65a-dc4f-4662-a7f5-710656eb1e9f req-366605c8-29e4-49d6-9a27-41bf9af2b067 service nova] Releasing lock "refresh_cache-8e6fddce-7650-4bf9-8c63-3d6db6ff4726" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:58:09 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:58:09 user nova-compute[103546]: INFO nova.compute.manager [-] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Took 0.72 seconds to deallocate network for instance.
Nov 16 03:58:09 user nova-compute[103546]: DEBUG nova.compute.manager [req-77d536a2-b5c0-4306-ab01-1a8375acecd5 req-5d48a71a-8a27-4832-8366-a9e3b786cdb1 service nova] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Received event network-vif-deleted-49c54f9c-e72e-4cdf-96d3-7c31d8ed5109 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:58:10 user nova-compute[103546]: DEBUG nova.compute.manager [req-423e9396-a9a2-4526-9406-36491e527e4b req-9325a818-b2c1-4de0-b1c9-b6e3504e985f service nova] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Received event network-vif-plugged-49c54f9c-e72e-4cdf-96d3-7c31d8ed5109 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:58:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-423e9396-a9a2-4526-9406-36491e527e4b req-9325a818-b2c1-4de0-b1c9-b6e3504e985f service nova] Acquiring lock "2ab80244-d70d-41ce-9b7e-bb9c8a676ad6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:58:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-423e9396-a9a2-4526-9406-36491e527e4b req-9325a818-b2c1-4de0-b1c9-b6e3504e985f service nova] Lock "2ab80244-d70d-41ce-9b7e-bb9c8a676ad6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:58:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-423e9396-a9a2-4526-9406-36491e527e4b req-9325a818-b2c1-4de0-b1c9-b6e3504e985f service nova] Lock "2ab80244-d70d-41ce-9b7e-bb9c8a676ad6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:58:10 user nova-compute[103546]: DEBUG nova.compute.manager [req-423e9396-a9a2-4526-9406-36491e527e4b req-9325a818-b2c1-4de0-b1c9-b6e3504e985f service nova] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] No waiting events found dispatching network-vif-plugged-49c54f9c-e72e-4cdf-96d3-7c31d8ed5109 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:58:10 user nova-compute[103546]: WARNING nova.compute.manager [req-423e9396-a9a2-4526-9406-36491e527e4b req-9325a818-b2c1-4de0-b1c9-b6e3504e985f service nova] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Received unexpected event network-vif-plugged-49c54f9c-e72e-4cdf-96d3-7c31d8ed5109 for instance with vm_state active and task_state deleting.
Nov 16 03:58:10 user nova-compute[103546]: INFO nova.compute.manager [None req-60fb6df6-1260-4549-9462-a26c1becad6a tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Took 0.76 seconds to detach 1 volumes for instance.
Nov 16 03:58:10 user nova-compute[103546]: DEBUG nova.compute.manager [None req-60fb6df6-1260-4549-9462-a26c1becad6a tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] [instance: 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6] Deleting volume: 5cdf8533-74a7-4737-b4af-2a9ae07490fc {{(pid=103546) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 16 03:58:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-60fb6df6-1260-4549-9462-a26c1becad6a tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:58:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-60fb6df6-1260-4549-9462-a26c1becad6a tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:58:10 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:58:10 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:58:10 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:58:10 user nova-compute[103546]: DEBUG nova.compute.manager [req-e8ecd6eb-6a5e-4993-ad25-602810f4f929 req-827a29c5-d19c-401d-ba89-404fcd1e405e service nova] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] Received event network-vif-plugged-c9253207-134c-459d-becb-ba6b70ccd346 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:58:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-e8ecd6eb-6a5e-4993-ad25-602810f4f929 req-827a29c5-d19c-401d-ba89-404fcd1e405e service nova] Acquiring lock "8e6fddce-7650-4bf9-8c63-3d6db6ff4726-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:58:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-e8ecd6eb-6a5e-4993-ad25-602810f4f929 req-827a29c5-d19c-401d-ba89-404fcd1e405e service nova] Lock "8e6fddce-7650-4bf9-8c63-3d6db6ff4726-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:58:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-e8ecd6eb-6a5e-4993-ad25-602810f4f929 req-827a29c5-d19c-401d-ba89-404fcd1e405e service nova] Lock "8e6fddce-7650-4bf9-8c63-3d6db6ff4726-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:58:10 user nova-compute[103546]: DEBUG nova.compute.manager [req-e8ecd6eb-6a5e-4993-ad25-602810f4f929 req-827a29c5-d19c-401d-ba89-404fcd1e405e service nova] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] No waiting events found dispatching network-vif-plugged-c9253207-134c-459d-becb-ba6b70ccd346 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:58:10 user nova-compute[103546]: WARNING nova.compute.manager [req-e8ecd6eb-6a5e-4993-ad25-602810f4f929 req-827a29c5-d19c-401d-ba89-404fcd1e405e service nova] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] Received unexpected event network-vif-plugged-c9253207-134c-459d-becb-ba6b70ccd346 for instance with vm_state building and task_state spawning.
Nov 16 03:58:10 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:58:10 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:58:10 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-60fb6df6-1260-4549-9462-a26c1becad6a tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:58:11 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-60fb6df6-1260-4549-9462-a26c1becad6a tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:58:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-60fb6df6-1260-4549-9462-a26c1becad6a tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.452s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:58:11 user nova-compute[103546]: INFO nova.scheduler.client.report [None req-60fb6df6-1260-4549-9462-a26c1becad6a tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Deleted allocations for instance 2ab80244-d70d-41ce-9b7e-bb9c8a676ad6
Nov 16 03:58:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-60fb6df6-1260-4549-9462-a26c1becad6a tempest-ServerActionsV293TestJSON-787129566 tempest-ServerActionsV293TestJSON-787129566-project-member] Lock "2ab80244-d70d-41ce-9b7e-bb9c8a676ad6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.519s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:58:12 user nova-compute[103546]: DEBUG nova.compute.manager [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 03:58:12 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] Guest created on hypervisor {{(pid=103546) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 03:58:12 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] Instance spawned successfully.
Nov 16 03:58:12 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 03:58:12 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] Found default for hw_cdrom_bus of ide {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:58:12 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] Found default for hw_disk_bus of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:58:12 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] Found default for hw_input_bus of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:58:12 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] Found default for hw_pointer_model of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:58:12 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] Found default for hw_video_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:58:12 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] Found default for hw_vif_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:58:12 user nova-compute[103546]: DEBUG nova.compute.manager [req-1967bd37-bd62-4819-9960-39dc59674b6b req-a1682641-ce17-4ce5-a83c-45a4368d1c7f service nova] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] Received event network-vif-plugged-c9253207-134c-459d-becb-ba6b70ccd346 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:58:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-1967bd37-bd62-4819-9960-39dc59674b6b req-a1682641-ce17-4ce5-a83c-45a4368d1c7f service nova] Acquiring lock "8e6fddce-7650-4bf9-8c63-3d6db6ff4726-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:58:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-1967bd37-bd62-4819-9960-39dc59674b6b req-a1682641-ce17-4ce5-a83c-45a4368d1c7f service nova] Lock "8e6fddce-7650-4bf9-8c63-3d6db6ff4726-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:58:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-1967bd37-bd62-4819-9960-39dc59674b6b req-a1682641-ce17-4ce5-a83c-45a4368d1c7f service nova] Lock "8e6fddce-7650-4bf9-8c63-3d6db6ff4726-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:58:12 user nova-compute[103546]: DEBUG nova.compute.manager [req-1967bd37-bd62-4819-9960-39dc59674b6b req-a1682641-ce17-4ce5-a83c-45a4368d1c7f service nova] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] No waiting events found dispatching network-vif-plugged-c9253207-134c-459d-becb-ba6b70ccd346 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:58:12 user nova-compute[103546]: WARNING nova.compute.manager [req-1967bd37-bd62-4819-9960-39dc59674b6b req-a1682641-ce17-4ce5-a83c-45a4368d1c7f service nova] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] Received unexpected event network-vif-plugged-c9253207-134c-459d-becb-ba6b70ccd346 for instance with vm_state building and task_state spawning.
Nov 16 03:58:12 user nova-compute[103546]: INFO nova.compute.manager [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] Took 5.73 seconds to spawn the instance on the hypervisor.
Nov 16 03:58:12 user nova-compute[103546]: DEBUG nova.compute.manager [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 03:58:13 user nova-compute[103546]: INFO nova.compute.manager [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] Took 6.68 seconds to build instance.
Nov 16 03:58:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d480948e-e07c-4fc6-84b5-c8dbd174d0ea tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "8e6fddce-7650-4bf9-8c63-3d6db6ff4726" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.808s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:58:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:58:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:58:14 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:58:16 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:58:16 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:58:16 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager.update_available_resource {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:58:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:58:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:58:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:58:16 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Auditing locally available compute resources for user (node: user) {{(pid=103546) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 03:58:16 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 03:58:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:58:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:58:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:58:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:58:17 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 03:58:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:58:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:58:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:58:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:58:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:58:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:58:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:58:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:58:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4065a1b-10a0-4b2a-9088-a703a7c4e064/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:58:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4065a1b-10a0-4b2a-9088-a703a7c4e064/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:58:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4065a1b-10a0-4b2a-9088-a703a7c4e064/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:58:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4065a1b-10a0-4b2a-9088-a703a7c4e064/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:58:18 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 03:58:18 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 03:58:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:58:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:58:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:58:18 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:58:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:58:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2781221-b5e3-468a-a9f5-436a04285f38/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:58:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2781221-b5e3-468a-a9f5-436a04285f38/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:58:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2781221-b5e3-468a-a9f5-436a04285f38/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:58:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2781221-b5e3-468a-a9f5-436a04285f38/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:58:19 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 03:58:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6fddce-7650-4bf9-8c63-3d6db6ff4726/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:58:19 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:58:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6fddce-7650-4bf9-8c63-3d6db6ff4726/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:58:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6fddce-7650-4bf9-8c63-3d6db6ff4726/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:58:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6fddce-7650-4bf9-8c63-3d6db6ff4726/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:58:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.rescue --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:58:19 user nova-compute[103546]: DEBUG nova.compute.manager [req-1d877e3d-423b-4d5f-a8b7-b36d55b231cb req-7ab28884-389c-4e85-b205-72a7cc1ee4bc service nova] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] Received event network-changed-75d34b6d-32ab-48bd-aa27-6fbf036ec234 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:58:19 user nova-compute[103546]: DEBUG nova.compute.manager [req-1d877e3d-423b-4d5f-a8b7-b36d55b231cb req-7ab28884-389c-4e85-b205-72a7cc1ee4bc service nova] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] Refreshing instance network info cache due to event network-changed-75d34b6d-32ab-48bd-aa27-6fbf036ec234. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:58:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-1d877e3d-423b-4d5f-a8b7-b36d55b231cb req-7ab28884-389c-4e85-b205-72a7cc1ee4bc service nova] Acquiring lock "refresh_cache-709be95b-5dbf-4291-b68e-a1e8f077f91e" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:58:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-1d877e3d-423b-4d5f-a8b7-b36d55b231cb req-7ab28884-389c-4e85-b205-72a7cc1ee4bc service nova] Acquired lock "refresh_cache-709be95b-5dbf-4291-b68e-a1e8f077f91e" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:58:19 user nova-compute[103546]: DEBUG nova.network.neutron [req-1d877e3d-423b-4d5f-a8b7-b36d55b231cb req-7ab28884-389c-4e85-b205-72a7cc1ee4bc service nova] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] Refreshing network info cache for port 75d34b6d-32ab-48bd-aa27-6fbf036ec234 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:58:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:58:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.rescue --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:58:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:58:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:58:20 user nova-compute[103546]: DEBUG nova.network.neutron [req-1d877e3d-423b-4d5f-a8b7-b36d55b231cb req-7ab28884-389c-4e85-b205-72a7cc1ee4bc service nova] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] Updated VIF entry in instance network info cache for port 75d34b6d-32ab-48bd-aa27-6fbf036ec234. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 03:58:20 user nova-compute[103546]: DEBUG nova.network.neutron [req-1d877e3d-423b-4d5f-a8b7-b36d55b231cb req-7ab28884-389c-4e85-b205-72a7cc1ee4bc service nova] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] Updating instance_info_cache with network_info: [{"id": "75d34b6d-32ab-48bd-aa27-6fbf036ec234", "address": "fa:16:3e:6a:08:16", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75d34b6d-32", "ovs_interfaceid": "75d34b6d-32ab-48bd-aa27-6fbf036ec234", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:58:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:58:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:58:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-1d877e3d-423b-4d5f-a8b7-b36d55b231cb req-7ab28884-389c-4e85-b205-72a7cc1ee4bc service nova] Releasing lock "refresh_cache-709be95b-5dbf-4291-b68e-a1e8f077f91e" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:58:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-98083212-7b2e-4097-a7e4-ffffc353deca tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquiring lock "709be95b-5dbf-4291-b68e-a1e8f077f91e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:58:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-98083212-7b2e-4097-a7e4-ffffc353deca tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "709be95b-5dbf-4291-b68e-a1e8f077f91e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:58:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-98083212-7b2e-4097-a7e4-ffffc353deca tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquiring lock "709be95b-5dbf-4291-b68e-a1e8f077f91e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:58:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-98083212-7b2e-4097-a7e4-ffffc353deca tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "709be95b-5dbf-4291-b68e-a1e8f077f91e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:58:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-98083212-7b2e-4097-a7e4-ffffc353deca tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "709be95b-5dbf-4291-b68e-a1e8f077f91e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:58:20 user nova-compute[103546]: INFO nova.compute.manager [None req-98083212-7b2e-4097-a7e4-ffffc353deca tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] Terminating instance
Nov 16 03:58:20 user nova-compute[103546]: DEBUG nova.compute.manager [None req-98083212-7b2e-4097-a7e4-ffffc353deca tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] Start destroying the instance on the hypervisor. {{(pid=103546) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 03:58:20 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:58:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:58:20 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:58:20 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 03:58:20 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:58:20 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:58:20 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:58:20 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Hypervisor/Node resource view: name=user free_ram=7418MB free_disk=25.179115295410156GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=103546) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 03:58:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:58:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:58:20 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] Instance destroyed successfully.
Nov 16 03:58:20 user nova-compute[103546]: DEBUG nova.objects.instance [None req-98083212-7b2e-4097-a7e4-ffffc353deca tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lazy-loading 'resources' on Instance uuid 709be95b-5dbf-4291-b68e-a1e8f077f91e {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:58:20 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-98083212-7b2e-4097-a7e4-ffffc353deca tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:56:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-263568704',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-263568704',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-263568704',id=30,image_ref='e3a926cc-8023-44a2-84b7-d8211f0d8e26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJvQIzvXYHIpYfXfhd4U/osksmky+SFNQRPgvulHfz4FLBtDTFZIQDNMsPOpw0IHXC+c0NClsUnhpcAcH1s4l3q/6fZ5PsXOlgk6oCnbIjRFpNkJl/DeDGVS9pLYi8TG7Q==',key_name='tempest-keypair-1901490093',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:56:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='40ce50192a9743b59a9430163dd6a51c',ramdisk_id='',reservation_id='r-jp00s4ms',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1283031547',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1283031547-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1283031547',owner_user_name='tempest-TestVolumeBootPattern-1283031547-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T03:56:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ab77040a7b9846d28dc08852d678d1ed',uuid=709be95b-5dbf-4291-b68e-a1e8f077f91e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "75d34b6d-32ab-48bd-aa27-6fbf036ec234", "address": "fa:16:3e:6a:08:16", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75d34b6d-32", "ovs_interfaceid": "75d34b6d-32ab-48bd-aa27-6fbf036ec234", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 03:58:20 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-98083212-7b2e-4097-a7e4-ffffc353deca tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Converting VIF {"id": "75d34b6d-32ab-48bd-aa27-6fbf036ec234", "address": "fa:16:3e:6a:08:16", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75d34b6d-32", "ovs_interfaceid": "75d34b6d-32ab-48bd-aa27-6fbf036ec234", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:58:20 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-98083212-7b2e-4097-a7e4-ffffc353deca tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:08:16,bridge_name='br-int',has_traffic_filtering=True,id=75d34b6d-32ab-48bd-aa27-6fbf036ec234,network=Network(a13f532d-a30d-4c06-83fe-760bcffae183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75d34b6d-32') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:58:20 user nova-compute[103546]: DEBUG os_vif [None req-98083212-7b2e-4097-a7e4-ffffc353deca tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:08:16,bridge_name='br-int',has_traffic_filtering=True,id=75d34b6d-32ab-48bd-aa27-6fbf036ec234,network=Network(a13f532d-a30d-4c06-83fe-760bcffae183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75d34b6d-32') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 03:58:20 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:58:20 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap75d34b6d-32, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:58:20 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:58:20 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:58:20 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:58:20 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9a2249df-2faa-4198-9c8c-2a265a048a5e) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:58:20 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:58:20 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:58:20 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:58:20 user nova-compute[103546]: INFO os_vif [None req-98083212-7b2e-4097-a7e4-ffffc353deca tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:08:16,bridge_name='br-int',has_traffic_filtering=True,id=75d34b6d-32ab-48bd-aa27-6fbf036ec234,network=Network(a13f532d-a30d-4c06-83fe-760bcffae183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75d34b6d-32')
Nov 16 03:58:20 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98083212-7b2e-4097-a7e4-ffffc353deca tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 03:58:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-98083212-7b2e-4097-a7e4-ffffc353deca tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oqCvjOeu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:58:20 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-98083212-7b2e-4097-a7e4-ffffc353deca tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:58:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-98083212-7b2e-4097-a7e4-ffffc353deca tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:58:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-98083212-7b2e-4097-a7e4-ffffc353deca tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:58:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:58:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:58:20 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15ee544-9b76-44f7-b1dd-189ac381d58c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:58:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-98083212-7b2e-4097-a7e4-ffffc353deca tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 03:58:20 user nova-compute[103546]: No targets found.
Nov 16 03:58:20 user nova-compute[103546]: iSNS:
Nov 16 03:58:20 user nova-compute[103546]: No targets found.
Nov 16 03:58:20 user nova-compute[103546]: STATIC:
Nov 16 03:58:20 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229
Nov 16 03:58:20 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:58:20 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:58:20 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283
Nov 16 03:58:20 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:58:20 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:58:20 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4
Nov 16 03:58:20 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:58:20 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:58:20 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925
Nov 16 03:58:20 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:58:20 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:58:20 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af
Nov 16 03:58:20 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:58:20 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:58:20 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17
Nov 16 03:58:20 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:58:20 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:58:20 user nova-compute[103546]: FIRMWARE:
Nov 16 03:58:20 user nova-compute[103546]: No targets found.
Nov 16 03:58:20 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:58:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-98083212-7b2e-4097-a7e4-ffffc353deca tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 03:58:20 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 03:58:20 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 03:58:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-98083212-7b2e-4097-a7e4-ffffc353deca tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 03:58:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:58:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:58:20 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba05d784-3a2d-425e-97f1-c19ac7815357]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:58:20 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 9a89970b-fc61-4419-8ff9-b48013dccf9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:58:20 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 04101512-7333-4581-add3-7af3821e335b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:58:20 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance fa7e5468-9dd4-407d-85ec-d45ec76f9e29 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:58:20 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance f4065a1b-10a0-4b2a-9088-a703a7c4e064 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:58:20 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 9c86c600-6277-4746-934d-c63e95616219 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:58:20 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 246ccf69-847c-4ab2-b709-ad1a85e81eab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:58:20 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 8d229d05-95f1-4997-8539-802ac65cff8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:58:20 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance d2781221-b5e3-468a-a9f5-436a04285f38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:58:20 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 709be95b-5dbf-4291-b68e-a1e8f077f91e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:58:20 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 66b98917-7551-47a5-94a1-79606cf1467d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:58:20 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:58:20 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 8e6fddce-7650-4bf9-8c63-3d6db6ff4726 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:58:20 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 03:58:20 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 03:58:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:58:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:58:21 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc6d548-a9cc-4606-815b-348cf7165375]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:58:21 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-98083212-7b2e-4097-a7e4-ffffc353deca tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:58:21 user nova-compute[103546]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)
Nov 16 03:58:21 user nova-compute[103546]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 (non-flash)
Nov 16 03:58:21 user nova-compute[103546]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283 (non-flash)
Nov 16 03:58:21 user nova-compute[103546]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af (non-flash)
Nov 16 03:58:21 user nova-compute[103546]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17 (non-flash)
Nov 16 03:58:21 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:58:21 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-98083212-7b2e-4097-a7e4-ffffc353deca tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:58:21 user nova-compute[103546]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)
Nov 16 03:58:21 user nova-compute[103546]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 (non-flash)
Nov 16 03:58:21 user nova-compute[103546]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283 (non-flash)
Nov 16 03:58:21 user nova-compute[103546]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af (non-flash)
Nov 16 03:58:21 user nova-compute[103546]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17 (non-flash)
Nov 16 03:58:21 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:58:21 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-98083212-7b2e-4097-a7e4-ffffc353deca tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60cc2915a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283'): ({'sdc'}, set())}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 03:58:21 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-98083212-7b2e-4097-a7e4-ffffc353deca tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Removing single pathed devices sdc {{(pid=103546) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 03:58:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:58:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:58:21 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6248e59-1f6c-42db-80e1-22783c6af9ef]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:58:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:58:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:58:21 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e10befc-1acc-4643-a829-3d5e13cd15c6]: (4, ('ok\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:58:21 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-98083212-7b2e-4097-a7e4-ffffc353deca tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Flushing IO for device /dev/sdc {{(pid=103546) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 03:58:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:58:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:58:21 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1698b6-ef7a-47d2-88fb-0092cab02154]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:58:21 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-98083212-7b2e-4097-a7e4-ffffc353deca tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=103546) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 03:58:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:58:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:58:21 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3375724-1b08-4f4a-9d31-c1a33d99ec9d]: (4, ('1', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:58:21 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-98083212-7b2e-4097-a7e4-ffffc353deca tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 03:58:21 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-98083212-7b2e-4097-a7e4-ffffc353deca tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] SCSI volumes sdc have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 03:58:21 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-98083212-7b2e-4097-a7e4-ffffc353deca tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283')] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 03:58:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:58:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:58:21 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f93ea20-637a-40ed-9e9d-e4912d6ae100]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:58:21 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-98083212-7b2e-4097-a7e4-ffffc353deca tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:58:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283 -p 172.16.0.220:3260 --logout {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:58:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:58:21 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9a5f9f-6bd6-4242-a68f-321dc2be1a74]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:58:21 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-98083212-7b2e-4097-a7e4-ffffc353deca tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283, portal: 172.16.0.220,3260]
Nov 16 03:58:21 user nova-compute[103546]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283, portal: 172.16.0.220,3260] successful.
Nov 16 03:58:21 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:58:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283 -p 172.16.0.220:3260 --op delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:58:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28aeb543-e70b-479e-b1c9-65fb682c9283 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:58:21 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ebf57e6-0002-43b3-9237-4536acfb8c55]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:58:21 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-98083212-7b2e-4097-a7e4-ffffc353deca tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:58:21 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-98083212-7b2e-4097-a7e4-ffffc353deca tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:58:21 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-98083212-7b2e-4097-a7e4-ffffc353deca tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] <== disconnect_volume: return (389ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:58:21 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98083212-7b2e-4097-a7e4-ffffc353deca tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 03:58:21 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-98083212-7b2e-4097-a7e4-ffffc353deca tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] Deleting instance files /opt/stack/data/nova/instances/709be95b-5dbf-4291-b68e-a1e8f077f91e_del
Nov 16 03:58:21 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-98083212-7b2e-4097-a7e4-ffffc353deca tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] Deletion of /opt/stack/data/nova/instances/709be95b-5dbf-4291-b68e-a1e8f077f91e_del complete
Nov 16 03:58:21 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:58:21 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:58:21 user nova-compute[103546]: INFO nova.compute.manager [None req-98083212-7b2e-4097-a7e4-ffffc353deca tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] Took 1.26 seconds to destroy the instance on the hypervisor.
Nov 16 03:58:21 user nova-compute[103546]: DEBUG oslo.service.loopingcall [None req-98083212-7b2e-4097-a7e4-ffffc353deca tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=103546) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 03:58:21 user nova-compute[103546]: DEBUG nova.compute.manager [-] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] Deallocating network for instance {{(pid=103546) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 03:58:21 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] deallocate_for_instance() {{(pid=103546) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 03:58:21 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Compute_service record updated for user:user {{(pid=103546) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 03:58:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.566s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:58:21 user nova-compute[103546]: DEBUG nova.compute.manager [req-69fe0604-b30c-4f19-85be-f59b70054d18 req-33a5053e-18a4-4947-a0eb-e39dcfa7269f service nova] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] Received event network-vif-unplugged-75d34b6d-32ab-48bd-aa27-6fbf036ec234 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:58:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-69fe0604-b30c-4f19-85be-f59b70054d18 req-33a5053e-18a4-4947-a0eb-e39dcfa7269f service nova] Acquiring lock "709be95b-5dbf-4291-b68e-a1e8f077f91e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:58:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-69fe0604-b30c-4f19-85be-f59b70054d18 req-33a5053e-18a4-4947-a0eb-e39dcfa7269f service nova] Lock "709be95b-5dbf-4291-b68e-a1e8f077f91e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:58:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-69fe0604-b30c-4f19-85be-f59b70054d18 req-33a5053e-18a4-4947-a0eb-e39dcfa7269f service nova] Lock "709be95b-5dbf-4291-b68e-a1e8f077f91e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:58:21 user nova-compute[103546]: DEBUG nova.compute.manager [req-69fe0604-b30c-4f19-85be-f59b70054d18 req-33a5053e-18a4-4947-a0eb-e39dcfa7269f service nova] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] No waiting events found dispatching network-vif-unplugged-75d34b6d-32ab-48bd-aa27-6fbf036ec234 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:58:21 user nova-compute[103546]: DEBUG nova.compute.manager [req-69fe0604-b30c-4f19-85be-f59b70054d18 req-33a5053e-18a4-4947-a0eb-e39dcfa7269f service nova] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] Received event network-vif-unplugged-75d34b6d-32ab-48bd-aa27-6fbf036ec234 for instance with task_state deleting. {{(pid=103546) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 03:58:21 user nova-compute[103546]: DEBUG nova.compute.manager [req-69fe0604-b30c-4f19-85be-f59b70054d18 req-33a5053e-18a4-4947-a0eb-e39dcfa7269f service nova] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] Received event network-vif-plugged-75d34b6d-32ab-48bd-aa27-6fbf036ec234 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:58:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-69fe0604-b30c-4f19-85be-f59b70054d18 req-33a5053e-18a4-4947-a0eb-e39dcfa7269f service nova] Acquiring lock "709be95b-5dbf-4291-b68e-a1e8f077f91e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:58:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-69fe0604-b30c-4f19-85be-f59b70054d18 req-33a5053e-18a4-4947-a0eb-e39dcfa7269f service nova] Lock "709be95b-5dbf-4291-b68e-a1e8f077f91e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:58:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-69fe0604-b30c-4f19-85be-f59b70054d18 req-33a5053e-18a4-4947-a0eb-e39dcfa7269f service nova] Lock "709be95b-5dbf-4291-b68e-a1e8f077f91e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:58:21 user nova-compute[103546]: DEBUG nova.compute.manager [req-69fe0604-b30c-4f19-85be-f59b70054d18 req-33a5053e-18a4-4947-a0eb-e39dcfa7269f service nova] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] No waiting events found dispatching network-vif-plugged-75d34b6d-32ab-48bd-aa27-6fbf036ec234 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:58:21 user nova-compute[103546]: WARNING nova.compute.manager [req-69fe0604-b30c-4f19-85be-f59b70054d18 req-33a5053e-18a4-4947-a0eb-e39dcfa7269f service nova] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] Received unexpected event network-vif-plugged-75d34b6d-32ab-48bd-aa27-6fbf036ec234 for instance with vm_state active and task_state deleting.
Nov 16 03:58:21 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:58:21 user nova-compute[103546]: INFO nova.compute.manager [-] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] Took 0.61 seconds to deallocate network for instance.
Nov 16 03:58:22 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:58:22 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:58:22 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Starting heal instance info cache {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 03:58:22 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "refresh_cache-04101512-7333-4581-add3-7af3821e335b" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:58:22 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquired lock "refresh_cache-04101512-7333-4581-add3-7af3821e335b" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:58:22 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 04101512-7333-4581-add3-7af3821e335b] Forcefully refreshing network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 03:58:22 user nova-compute[103546]: INFO nova.compute.manager [None req-98083212-7b2e-4097-a7e4-ffffc353deca tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] Took 0.73 seconds to detach 1 volumes for instance.
Nov 16 03:58:22 user nova-compute[103546]: DEBUG nova.compute.manager [None req-98083212-7b2e-4097-a7e4-ffffc353deca tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] Deleting volume: 28aeb543-e70b-479e-b1c9-65fb682c9283 {{(pid=103546) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 16 03:58:22 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 04101512-7333-4581-add3-7af3821e335b] Updating instance_info_cache with network_info: [{"id": "20bc48cc-9db0-49c8-8dd5-246c685c6884", "address": "fa:16:3e:a5:d9:dc", "network": {"id": "fdbb2d2c-9a54-4517-b33a-cf27ce7570b1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79661471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2a38a5eb514ce8a7569c8322657eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20bc48cc-9d", "ovs_interfaceid": "20bc48cc-9db0-49c8-8dd5-246c685c6884", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:58:22 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-98083212-7b2e-4097-a7e4-ffffc353deca tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:58:22 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-98083212-7b2e-4097-a7e4-ffffc353deca tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:58:22 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Releasing lock "refresh_cache-04101512-7333-4581-add3-7af3821e335b" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:58:22 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 04101512-7333-4581-add3-7af3821e335b] Updated the network info_cache for instance {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 03:58:22 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:58:22 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:58:22 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:58:22 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:58:22 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=103546) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 03:58:23 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-98083212-7b2e-4097-a7e4-ffffc353deca tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:58:23 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-98083212-7b2e-4097-a7e4-ffffc353deca tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:58:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-98083212-7b2e-4097-a7e4-ffffc353deca tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.376s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:58:23 user nova-compute[103546]: INFO nova.scheduler.client.report [None req-98083212-7b2e-4097-a7e4-ffffc353deca tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Deleted allocations for instance 709be95b-5dbf-4291-b68e-a1e8f077f91e
Nov 16 03:58:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-98083212-7b2e-4097-a7e4-ffffc353deca tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "709be95b-5dbf-4291-b68e-a1e8f077f91e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.279s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:58:23 user nova-compute[103546]: DEBUG nova.compute.manager [req-88e97002-6b2f-40be-a05f-e71105156a7e req-9bb96a48-edee-41a9-8bc8-4f5b022f1ead service nova] [instance: 709be95b-5dbf-4291-b68e-a1e8f077f91e] Received event network-vif-deleted-75d34b6d-32ab-48bd-aa27-6fbf036ec234 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:58:23 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:58:25 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:58:28 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:58:30 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:58:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:58:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:58:38 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:58:40 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:58:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:58:45 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:58:50 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:58:55 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:58:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:00 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:00 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:05 user nova-compute[103546]: DEBUG nova.compute.manager [req-4b5b5079-b800-4b9f-885c-5c2e933bff6b req-4f9d1b3b-3b8a-4903-bcc3-c8e69a5d8256 service nova] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Received event network-changed-7df3a25d-d802-44f8-8a98-bb6be3453d3e {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:59:05 user nova-compute[103546]: DEBUG nova.compute.manager [req-4b5b5079-b800-4b9f-885c-5c2e933bff6b req-4f9d1b3b-3b8a-4903-bcc3-c8e69a5d8256 service nova] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Refreshing instance network info cache due to event network-changed-7df3a25d-d802-44f8-8a98-bb6be3453d3e. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:59:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-4b5b5079-b800-4b9f-885c-5c2e933bff6b req-4f9d1b3b-3b8a-4903-bcc3-c8e69a5d8256 service nova] Acquiring lock "refresh_cache-66b98917-7551-47a5-94a1-79606cf1467d" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:59:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-4b5b5079-b800-4b9f-885c-5c2e933bff6b req-4f9d1b3b-3b8a-4903-bcc3-c8e69a5d8256 service nova] Acquired lock "refresh_cache-66b98917-7551-47a5-94a1-79606cf1467d" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:59:05 user nova-compute[103546]: DEBUG nova.network.neutron [req-4b5b5079-b800-4b9f-885c-5c2e933bff6b req-4f9d1b3b-3b8a-4903-bcc3-c8e69a5d8256 service nova] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Refreshing network info cache for port 7df3a25d-d802-44f8-8a98-bb6be3453d3e {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:59:05 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:59:05 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:05 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=103546) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 03:59:05 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 03:59:05 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 03:59:05 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:06 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:06 user nova-compute[103546]: DEBUG nova.network.neutron [req-4b5b5079-b800-4b9f-885c-5c2e933bff6b req-4f9d1b3b-3b8a-4903-bcc3-c8e69a5d8256 service nova] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Updated VIF entry in instance network info cache for port 7df3a25d-d802-44f8-8a98-bb6be3453d3e. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 03:59:06 user nova-compute[103546]: DEBUG nova.network.neutron [req-4b5b5079-b800-4b9f-885c-5c2e933bff6b req-4f9d1b3b-3b8a-4903-bcc3-c8e69a5d8256 service nova] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Updating instance_info_cache with network_info: [{"id": "7df3a25d-d802-44f8-8a98-bb6be3453d3e", "address": "fa:16:3e:7c:b1:ba", "network": {"id": "f9df40e7-5801-4e0c-8b8b-6cdb4da22727", "bridge": "br-int", "label": "tempest-TestShelveInstance-1586968346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "164c650c4ec44057973d5d1ab45b7440", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7df3a25d-d8", "ovs_interfaceid": "7df3a25d-d802-44f8-8a98-bb6be3453d3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:59:06 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-4b5b5079-b800-4b9f-885c-5c2e933bff6b req-4f9d1b3b-3b8a-4903-bcc3-c8e69a5d8256 service nova] Releasing lock "refresh_cache-66b98917-7551-47a5-94a1-79606cf1467d" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:59:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0893fb3d-5b99-48f2-8c32-a194a1f5f420 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Acquiring lock "66b98917-7551-47a5-94a1-79606cf1467d" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:59:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0893fb3d-5b99-48f2-8c32-a194a1f5f420 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Lock "66b98917-7551-47a5-94a1-79606cf1467d" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:59:07 user nova-compute[103546]: INFO nova.compute.manager [None req-0893fb3d-5b99-48f2-8c32-a194a1f5f420 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Shelve offloading
Nov 16 03:59:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:08 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Instance destroyed successfully.
Nov 16 03:59:08 user nova-compute[103546]: DEBUG nova.compute.manager [None req-0893fb3d-5b99-48f2-8c32-a194a1f5f420 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 03:59:08 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0893fb3d-5b99-48f2-8c32-a194a1f5f420 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Acquiring lock "refresh_cache-66b98917-7551-47a5-94a1-79606cf1467d" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:59:08 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0893fb3d-5b99-48f2-8c32-a194a1f5f420 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Acquired lock "refresh_cache-66b98917-7551-47a5-94a1-79606cf1467d" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:59:08 user nova-compute[103546]: DEBUG nova.network.neutron [None req-0893fb3d-5b99-48f2-8c32-a194a1f5f420 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 03:59:08 user nova-compute[103546]: DEBUG nova.network.neutron [None req-0893fb3d-5b99-48f2-8c32-a194a1f5f420 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Updating instance_info_cache with network_info: [{"id": "7df3a25d-d802-44f8-8a98-bb6be3453d3e", "address": "fa:16:3e:7c:b1:ba", "network": {"id": "f9df40e7-5801-4e0c-8b8b-6cdb4da22727", "bridge": "br-int", "label": "tempest-TestShelveInstance-1586968346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "164c650c4ec44057973d5d1ab45b7440", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7df3a25d-d8", "ovs_interfaceid": "7df3a25d-d802-44f8-8a98-bb6be3453d3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:59:08 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0893fb3d-5b99-48f2-8c32-a194a1f5f420 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Releasing lock "refresh_cache-66b98917-7551-47a5-94a1-79606cf1467d" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:59:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:09 user nova-compute[103546]: DEBUG nova.compute.manager [req-08de6f0e-37b9-43d1-8eed-a8b439d3d0bd req-ab41d547-633f-40e7-b72e-a3dd563ad25d service nova] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Received event network-vif-unplugged-7df3a25d-d802-44f8-8a98-bb6be3453d3e {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:59:09 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-08de6f0e-37b9-43d1-8eed-a8b439d3d0bd req-ab41d547-633f-40e7-b72e-a3dd563ad25d service nova] Acquiring lock "66b98917-7551-47a5-94a1-79606cf1467d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:59:09 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-08de6f0e-37b9-43d1-8eed-a8b439d3d0bd req-ab41d547-633f-40e7-b72e-a3dd563ad25d service nova] Lock "66b98917-7551-47a5-94a1-79606cf1467d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:59:09 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-08de6f0e-37b9-43d1-8eed-a8b439d3d0bd req-ab41d547-633f-40e7-b72e-a3dd563ad25d service nova] Lock "66b98917-7551-47a5-94a1-79606cf1467d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:59:09 user nova-compute[103546]: DEBUG nova.compute.manager [req-08de6f0e-37b9-43d1-8eed-a8b439d3d0bd req-ab41d547-633f-40e7-b72e-a3dd563ad25d service nova] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] No waiting events found dispatching network-vif-unplugged-7df3a25d-d802-44f8-8a98-bb6be3453d3e {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:59:09 user nova-compute[103546]: WARNING nova.compute.manager [req-08de6f0e-37b9-43d1-8eed-a8b439d3d0bd req-ab41d547-633f-40e7-b72e-a3dd563ad25d service nova] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Received unexpected event network-vif-unplugged-7df3a25d-d802-44f8-8a98-bb6be3453d3e for instance with vm_state active and task_state shelving.
Nov 16 03:59:09 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Instance destroyed successfully.
Nov 16 03:59:09 user nova-compute[103546]: DEBUG nova.objects.instance [None req-0893fb3d-5b99-48f2-8c32-a194a1f5f420 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Lazy-loading 'resources' on Instance uuid 66b98917-7551-47a5-94a1-79606cf1467d {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:59:09 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-0893fb3d-5b99-48f2-8c32-a194a1f5f420 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:57:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1218331939',display_name='tempest-TestShelveInstance-server-1218331939',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1218331939',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJefuleNA9cJ5haFDD+0Ot28lloio76de7VtRTQxzp9Sope/G7fhj4H3KkfSIX4gC5WiTW4ss845RgTAxK6IS7sfMf51A1/Fabu1CWHujElttuESJP/RjYphT+75MUNs3Q==',key_name='tempest-TestShelveInstance-1411640263',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:57:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='164c650c4ec44057973d5d1ab45b7440',ramdisk_id='',reservation_id='r-03lh0eut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2052053009',owner_user_name='tempest-TestShelveInstance-2052053009-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T03:57:26Z,user_data=None,user_id='7a83510fe87042529b22273d0b26a662',uuid=66b98917-7551-47a5-94a1-79606cf1467d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7df3a25d-d802-44f8-8a98-bb6be3453d3e", "address": "fa:16:3e:7c:b1:ba", "network": {"id": "f9df40e7-5801-4e0c-8b8b-6cdb4da22727", "bridge": "br-int", "label": "tempest-TestShelveInstance-1586968346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "164c650c4ec44057973d5d1ab45b7440", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7df3a25d-d8", "ovs_interfaceid": "7df3a25d-d802-44f8-8a98-bb6be3453d3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 03:59:09 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-0893fb3d-5b99-48f2-8c32-a194a1f5f420 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Converting VIF {"id": "7df3a25d-d802-44f8-8a98-bb6be3453d3e", "address": "fa:16:3e:7c:b1:ba", "network": {"id": "f9df40e7-5801-4e0c-8b8b-6cdb4da22727", "bridge": "br-int", "label": "tempest-TestShelveInstance-1586968346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "164c650c4ec44057973d5d1ab45b7440", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7df3a25d-d8", "ovs_interfaceid": "7df3a25d-d802-44f8-8a98-bb6be3453d3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:59:09 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-0893fb3d-5b99-48f2-8c32-a194a1f5f420 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:b1:ba,bridge_name='br-int',has_traffic_filtering=True,id=7df3a25d-d802-44f8-8a98-bb6be3453d3e,network=Network(f9df40e7-5801-4e0c-8b8b-6cdb4da22727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7df3a25d-d8') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:59:09 user nova-compute[103546]: DEBUG os_vif [None req-0893fb3d-5b99-48f2-8c32-a194a1f5f420 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:b1:ba,bridge_name='br-int',has_traffic_filtering=True,id=7df3a25d-d802-44f8-8a98-bb6be3453d3e,network=Network(f9df40e7-5801-4e0c-8b8b-6cdb4da22727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7df3a25d-d8') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 03:59:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7df3a25d-d8, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:59:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ed99590d-d5b2-48b3-9406-66ff247a1b00) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:59:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:09 user nova-compute[103546]: INFO os_vif [None req-0893fb3d-5b99-48f2-8c32-a194a1f5f420 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:b1:ba,bridge_name='br-int',has_traffic_filtering=True,id=7df3a25d-d802-44f8-8a98-bb6be3453d3e,network=Network(f9df40e7-5801-4e0c-8b8b-6cdb4da22727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7df3a25d-d8')
Nov 16 03:59:09 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0893fb3d-5b99-48f2-8c32-a194a1f5f420 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 03:59:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-0893fb3d-5b99-48f2-8c32-a194a1f5f420 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZQtTeObl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:59:09 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-0893fb3d-5b99-48f2-8c32-a194a1f5f420 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:59:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-0893fb3d-5b99-48f2-8c32-a194a1f5f420 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:59:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-0893fb3d-5b99-48f2-8c32-a194a1f5f420 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:59:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:59:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:59:09 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8532fe-1dea-4575-8e81-0daa998b2a01]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:59:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-0893fb3d-5b99-48f2-8c32-a194a1f5f420 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 03:59:09 user nova-compute[103546]: No targets found.
Nov 16 03:59:09 user nova-compute[103546]: iSNS:
Nov 16 03:59:09 user nova-compute[103546]: No targets found.
Nov 16 03:59:09 user nova-compute[103546]: STATIC:
Nov 16 03:59:09 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229
Nov 16 03:59:09 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:59:09 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:59:09 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4
Nov 16 03:59:09 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:59:09 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:59:09 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925
Nov 16 03:59:09 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:59:09 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:59:09 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af
Nov 16 03:59:09 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:59:09 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:59:09 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17
Nov 16 03:59:09 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:59:09 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:59:09 user nova-compute[103546]: FIRMWARE:
Nov 16 03:59:09 user nova-compute[103546]: No targets found.
Nov 16 03:59:09 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:59:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-0893fb3d-5b99-48f2-8c32-a194a1f5f420 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 03:59:09 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 03:59:09 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 03:59:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-0893fb3d-5b99-48f2-8c32-a194a1f5f420 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 03:59:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:59:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:59:09 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6877b9-b145-4efd-aa8b-c0393da7b784]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:59:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:59:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:59:09 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a78dc9-9ec0-4db3-8188-1fa496b4c037]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:59:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-0893fb3d-5b99-48f2-8c32-a194a1f5f420 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:59:09 user nova-compute[103546]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)
Nov 16 03:59:09 user nova-compute[103546]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 (non-flash)
Nov 16 03:59:09 user nova-compute[103546]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af (non-flash)
Nov 16 03:59:09 user nova-compute[103546]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17 (non-flash)
Nov 16 03:59:09 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:59:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-0893fb3d-5b99-48f2-8c32-a194a1f5f420 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:59:09 user nova-compute[103546]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)
Nov 16 03:59:09 user nova-compute[103546]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 (non-flash)
Nov 16 03:59:09 user nova-compute[103546]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af (non-flash)
Nov 16 03:59:09 user nova-compute[103546]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17 (non-flash)
Nov 16 03:59:09 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:59:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-0893fb3d-5b99-48f2-8c32-a194a1f5f420 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60c4169510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af'): ({'sdg'}, set())}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 03:59:09 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-0893fb3d-5b99-48f2-8c32-a194a1f5f420 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Removing single pathed devices sdg {{(pid=103546) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 03:59:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:59:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:59:09 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b234d3c4-bfde-4911-a8ec-cd6d24ef1312]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:59:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:59:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:59:09 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[922997dc-f290-443f-b00e-8630cbf6b43c]: (4, ('ok\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:59:09 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-0893fb3d-5b99-48f2-8c32-a194a1f5f420 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Flushing IO for device /dev/sdg {{(pid=103546) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 03:59:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:59:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:59:09 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2b05d4-db29-40e3-93c9-a4af1d36bcbf]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:59:09 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-0893fb3d-5b99-48f2-8c32-a194a1f5f420 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=103546) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 03:59:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:59:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.040s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:59:09 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[325ebbe3-2998-43b3-80b7-1be0b02b25ee]: (4, ('1', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:59:09 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-0893fb3d-5b99-48f2-8c32-a194a1f5f420 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 03:59:09 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-0893fb3d-5b99-48f2-8c32-a194a1f5f420 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] SCSI volumes sdg have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 03:59:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-0893fb3d-5b99-48f2-8c32-a194a1f5f420 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af')] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 03:59:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:59:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:59:09 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c79e54-a320-4222-8799-21d14602ad6c]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:59:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-0893fb3d-5b99-48f2-8c32-a194a1f5f420 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:59:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af -p 172.16.0.220:3260 --logout {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:59:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:59:09 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e7657e-c23f-462f-9380-16c2f3716014]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:59:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-0893fb3d-5b99-48f2-8c32-a194a1f5f420 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af, portal: 172.16.0.220,3260]
Nov 16 03:59:09 user nova-compute[103546]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af, portal: 172.16.0.220,3260] successful.
Nov 16 03:59:09 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:59:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af -p 172.16.0.220:3260 --op delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:59:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:59:10 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf854b5-8180-4a32-acf4-812736674612]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:59:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-0893fb3d-5b99-48f2-8c32-a194a1f5f420 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:59:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-0893fb3d-5b99-48f2-8c32-a194a1f5f420 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:59:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-0893fb3d-5b99-48f2-8c32-a194a1f5f420 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] <== disconnect_volume: return (299ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:59:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0893fb3d-5b99-48f2-8c32-a194a1f5f420 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 03:59:10 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-0893fb3d-5b99-48f2-8c32-a194a1f5f420 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Deleting instance files /opt/stack/data/nova/instances/66b98917-7551-47a5-94a1-79606cf1467d_del
Nov 16 03:59:10 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-0893fb3d-5b99-48f2-8c32-a194a1f5f420 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Deletion of /opt/stack/data/nova/instances/66b98917-7551-47a5-94a1-79606cf1467d_del complete
Nov 16 03:59:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-2352ac0f-8e72-4705-94b6-950dedb74cd4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Acquiring lock "f4065a1b-10a0-4b2a-9088-a703a7c4e064" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:59:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-2352ac0f-8e72-4705-94b6-950dedb74cd4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "f4065a1b-10a0-4b2a-9088-a703a7c4e064" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:59:10 user nova-compute[103546]: INFO nova.compute.manager [None req-2352ac0f-8e72-4705-94b6-950dedb74cd4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Detaching volume 80738ad2-a7e0-4996-bda9-07784deca229
Nov 16 03:59:11 user nova-compute[103546]: INFO nova.virt.block_device [None req-2352ac0f-8e72-4705-94b6-950dedb74cd4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Attempting to driver detach volume 80738ad2-a7e0-4996-bda9-07784deca229 from mountpoint /dev/vdb
Nov 16 03:59:11 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-2352ac0f-8e72-4705-94b6-950dedb74cd4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Attempting to detach device vdb from instance f4065a1b-10a0-4b2a-9088-a703a7c4e064 from the persistent domain config. {{(pid=103546) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 03:59:11 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-2352ac0f-8e72-4705-94b6-950dedb74cd4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 03:59:11 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 03:59:11 user nova-compute[103546]:   <source dev="/dev/sde"/>
Nov 16 03:59:11 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 03:59:11 user nova-compute[103546]:   <serial>80738ad2-a7e0-4996-bda9-07784deca229</serial>
Nov 16 03:59:11 user nova-compute[103546]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 03:59:11 user nova-compute[103546]: </disk>
Nov 16 03:59:11 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 03:59:11 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-2352ac0f-8e72-4705-94b6-950dedb74cd4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Successfully detached device vdb from instance f4065a1b-10a0-4b2a-9088-a703a7c4e064 from the persistent domain config.
Nov 16 03:59:11 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-2352ac0f-8e72-4705-94b6-950dedb74cd4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f4065a1b-10a0-4b2a-9088-a703a7c4e064 from the live domain config. {{(pid=103546) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 03:59:11 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-2352ac0f-8e72-4705-94b6-950dedb74cd4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 03:59:11 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 03:59:11 user nova-compute[103546]:   <source dev="/dev/sde"/>
Nov 16 03:59:11 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 03:59:11 user nova-compute[103546]:   <serial>80738ad2-a7e0-4996-bda9-07784deca229</serial>
Nov 16 03:59:11 user nova-compute[103546]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 03:59:11 user nova-compute[103546]: </disk>
Nov 16 03:59:11 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 03:59:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Acquiring lock "b0a480de-e99b-4b54-bd81-36c216442137" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:59:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "b0a480de-e99b-4b54-bd81-36c216442137" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:59:11 user nova-compute[103546]: DEBUG nova.compute.manager [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Starting instance... {{(pid=103546) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 03:59:11 user nova-compute[103546]: INFO nova.scheduler.client.report [None req-0893fb3d-5b99-48f2-8c32-a194a1f5f420 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Deleted allocations for instance 66b98917-7551-47a5-94a1-79606cf1467d
Nov 16 03:59:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0893fb3d-5b99-48f2-8c32-a194a1f5f420 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:59:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0893fb3d-5b99-48f2-8c32-a194a1f5f420 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:59:11 user nova-compute[103546]: DEBUG nova.objects.instance [None req-0893fb3d-5b99-48f2-8c32-a194a1f5f420 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Lazy-loading 'numa_topology' on Instance uuid 66b98917-7551-47a5-94a1-79606cf1467d {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:59:11 user nova-compute[103546]: DEBUG nova.objects.base [None req-0893fb3d-5b99-48f2-8c32-a194a1f5f420 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Object Instance<66b98917-7551-47a5-94a1-79606cf1467d> lazy-loaded attributes: resources,numa_topology {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 03:59:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:59:11 user nova-compute[103546]: DEBUG nova.compute.manager [req-b123254d-058d-491d-acb3-14e515ffe74d req-f7fc78d9-7789-4866-97e3-2431f2d7a959 service nova] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Received event network-changed-7df3a25d-d802-44f8-8a98-bb6be3453d3e {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:59:11 user nova-compute[103546]: DEBUG nova.compute.manager [req-b123254d-058d-491d-acb3-14e515ffe74d req-f7fc78d9-7789-4866-97e3-2431f2d7a959 service nova] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Refreshing instance network info cache due to event network-changed-7df3a25d-d802-44f8-8a98-bb6be3453d3e. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:59:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-b123254d-058d-491d-acb3-14e515ffe74d req-f7fc78d9-7789-4866-97e3-2431f2d7a959 service nova] Acquiring lock "refresh_cache-66b98917-7551-47a5-94a1-79606cf1467d" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:59:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-b123254d-058d-491d-acb3-14e515ffe74d req-f7fc78d9-7789-4866-97e3-2431f2d7a959 service nova] Acquired lock "refresh_cache-66b98917-7551-47a5-94a1-79606cf1467d" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:59:11 user nova-compute[103546]: DEBUG nova.network.neutron [req-b123254d-058d-491d-acb3-14e515ffe74d req-f7fc78d9-7789-4866-97e3-2431f2d7a959 service nova] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Refreshing network info cache for port 7df3a25d-d802-44f8-8a98-bb6be3453d3e {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:59:11 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-2352ac0f-8e72-4705-94b6-950dedb74cd4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f4065a1b-10a0-4b2a-9088-a703a7c4e064 {{(pid=103546) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 03:59:11 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-0893fb3d-5b99-48f2-8c32-a194a1f5f420 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:59:11 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-0893fb3d-5b99-48f2-8c32-a194a1f5f420 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:59:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0893fb3d-5b99-48f2-8c32-a194a1f5f420 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.589s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:59:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.515s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:59:11 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=103546) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 03:59:11 user nova-compute[103546]: INFO nova.compute.claims [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Claim successful on node user
Nov 16 03:59:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0893fb3d-5b99-48f2-8c32-a194a1f5f420 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Lock "66b98917-7551-47a5-94a1-79606cf1467d" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.393s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:59:12 user nova-compute[103546]: DEBUG nova.network.neutron [req-b123254d-058d-491d-acb3-14e515ffe74d req-f7fc78d9-7789-4866-97e3-2431f2d7a959 service nova] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Updated VIF entry in instance network info cache for port 7df3a25d-d802-44f8-8a98-bb6be3453d3e. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 03:59:12 user nova-compute[103546]: DEBUG nova.network.neutron [req-b123254d-058d-491d-acb3-14e515ffe74d req-f7fc78d9-7789-4866-97e3-2431f2d7a959 service nova] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Updating instance_info_cache with network_info: [{"id": "7df3a25d-d802-44f8-8a98-bb6be3453d3e", "address": "fa:16:3e:7c:b1:ba", "network": {"id": "f9df40e7-5801-4e0c-8b8b-6cdb4da22727", "bridge": null, "label": "tempest-TestShelveInstance-1586968346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "164c650c4ec44057973d5d1ab45b7440", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap7df3a25d-d8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:59:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-b123254d-058d-491d-acb3-14e515ffe74d req-f7fc78d9-7789-4866-97e3-2431f2d7a959 service nova] Releasing lock "refresh_cache-66b98917-7551-47a5-94a1-79606cf1467d" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:59:12 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:59:12 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:59:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.452s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:59:12 user nova-compute[103546]: DEBUG nova.compute.manager [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Start building networks asynchronously for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 03:59:12 user nova-compute[103546]: DEBUG nova.compute.manager [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Allocating IP information in the background. {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 03:59:12 user nova-compute[103546]: DEBUG nova.network.neutron [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] allocate_for_instance() {{(pid=103546) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 03:59:12 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 03:59:12 user nova-compute[103546]: DEBUG nova.compute.manager [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Start building block device mappings for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 03:59:12 user nova-compute[103546]: DEBUG nova.policy [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '005ffc068a19494bb5a436fc4a07aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f33e7eff7954fcc895f66982d7d45c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103546) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 03:59:12 user nova-compute[103546]: DEBUG nova.compute.manager [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Start spawning the instance on the hypervisor. {{(pid=103546) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 03:59:12 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Creating instance directory {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 03:59:12 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Creating image(s)
Nov 16 03:59:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Acquiring lock "/opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:59:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "/opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:59:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "/opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:59:12 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:59:12 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.285s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:59:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Acquiring lock "8c9efafb670bfe5842ba1f4ce398924612164af7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:59:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:59:12 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:59:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-85961072-eb9f-4c02-8888-fe4bcc6641a3 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquiring lock "9c86c600-6277-4746-934d-c63e95616219" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:59:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-85961072-eb9f-4c02-8888-fe4bcc6641a3 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "9c86c600-6277-4746-934d-c63e95616219" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:59:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-85961072-eb9f-4c02-8888-fe4bcc6641a3 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquiring lock "9c86c600-6277-4746-934d-c63e95616219-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:59:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-85961072-eb9f-4c02-8888-fe4bcc6641a3 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "9c86c600-6277-4746-934d-c63e95616219-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:59:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-85961072-eb9f-4c02-8888-fe4bcc6641a3 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "9c86c600-6277-4746-934d-c63e95616219-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:59:12 user nova-compute[103546]: INFO nova.compute.manager [None req-85961072-eb9f-4c02-8888-fe4bcc6641a3 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9c86c600-6277-4746-934d-c63e95616219] Terminating instance
Nov 16 03:59:12 user nova-compute[103546]: DEBUG nova.compute.manager [None req-85961072-eb9f-4c02-8888-fe4bcc6641a3 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9c86c600-6277-4746-934d-c63e95616219] Start destroying the instance on the hypervisor. {{(pid=103546) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 03:59:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:12 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.187s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:59:12 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk 1073741824 {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:59:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:12 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk 1073741824" returned: 0 in 0.060s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:59:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:59:12 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG nova.network.neutron [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Successfully created port: 804319c6-55cb-4f30-908c-71817934fb45 {{(pid=103546) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.177s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk. size=1073741824 {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Cannot resize image /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk to a smaller size. {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Created local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Ensure instance console log exists: /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/console.log {{(pid=103546) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:59:13 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 9c86c600-6277-4746-934d-c63e95616219] Instance destroyed successfully.
Nov 16 03:59:13 user nova-compute[103546]: DEBUG nova.objects.instance [None req-85961072-eb9f-4c02-8888-fe4bcc6641a3 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lazy-loading 'resources' on Instance uuid 9c86c600-6277-4746-934d-c63e95616219 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-85961072-eb9f-4c02-8888-fe4bcc6641a3 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:54:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1526373307',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1526373307',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1526373307',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7nUqVdJvmnH7LQDMxVUr6ehgNHY3jQVGbY7JqwBiU54q4wNBiglmli+abZPfIvdkEzE97CKjHGu7VBVKB6tBg6LQ9oTiV027MnLn1e/iQR5tl6HZe1WbiOwCpAjpiaWg==',key_name='tempest-keypair-1140930886',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:54:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='40ce50192a9743b59a9430163dd6a51c',ramdisk_id='',reservation_id='r-s100j9bi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1283031547',owner_user_name='tempest-TestVolumeBootPattern-1283031547-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T03:54:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ab77040a7b9846d28dc08852d678d1ed',uuid=9c86c600-6277-4746-934d-c63e95616219,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5d9f9a33-9288-41e9-9965-d9f2c768f57a", "address": "fa:16:3e:ca:8d:04", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d9f9a33-92", "ovs_interfaceid": "5d9f9a33-9288-41e9-9965-d9f2c768f57a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-85961072-eb9f-4c02-8888-fe4bcc6641a3 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Converting VIF {"id": "5d9f9a33-9288-41e9-9965-d9f2c768f57a", "address": "fa:16:3e:ca:8d:04", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d9f9a33-92", "ovs_interfaceid": "5d9f9a33-9288-41e9-9965-d9f2c768f57a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-85961072-eb9f-4c02-8888-fe4bcc6641a3 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ca:8d:04,bridge_name='br-int',has_traffic_filtering=True,id=5d9f9a33-9288-41e9-9965-d9f2c768f57a,network=Network(a13f532d-a30d-4c06-83fe-760bcffae183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d9f9a33-92') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG os_vif [None req-85961072-eb9f-4c02-8888-fe4bcc6641a3 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:8d:04,bridge_name='br-int',has_traffic_filtering=True,id=5d9f9a33-9288-41e9-9965-d9f2c768f57a,network=Network(a13f532d-a30d-4c06-83fe-760bcffae183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d9f9a33-92') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5d9f9a33-92, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ed686a11-f69d-4a9c-8d5d-17c6c69af68d) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:13 user nova-compute[103546]: INFO os_vif [None req-85961072-eb9f-4c02-8888-fe4bcc6641a3 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:8d:04,bridge_name='br-int',has_traffic_filtering=True,id=5d9f9a33-9288-41e9-9965-d9f2c768f57a,network=Network(a13f532d-a30d-4c06-83fe-760bcffae183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d9f9a33-92')
Nov 16 03:59:13 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85961072-eb9f-4c02-8888-fe4bcc6641a3 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9c86c600-6277-4746-934d-c63e95616219] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-85961072-eb9f-4c02-8888-fe4bcc6641a3 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tfPpUYJD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:59:13 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-85961072-eb9f-4c02-8888-fe4bcc6641a3 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:59:13 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-85961072-eb9f-4c02-8888-fe4bcc6641a3 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-85961072-eb9f-4c02-8888-fe4bcc6641a3 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7783882-c1ec-43a3-9f65-f1c28208d428]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-85961072-eb9f-4c02-8888-fe4bcc6641a3 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 03:59:13 user nova-compute[103546]: No targets found.
Nov 16 03:59:13 user nova-compute[103546]: iSNS:
Nov 16 03:59:13 user nova-compute[103546]: No targets found.
Nov 16 03:59:13 user nova-compute[103546]: STATIC:
Nov 16 03:59:13 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229
Nov 16 03:59:13 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:59:13 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:59:13 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4
Nov 16 03:59:13 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:59:13 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:59:13 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925
Nov 16 03:59:13 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:59:13 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:59:13 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17
Nov 16 03:59:13 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:59:13 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:59:13 user nova-compute[103546]: FIRMWARE:
Nov 16 03:59:13 user nova-compute[103546]: No targets found.
Nov 16 03:59:13 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-85961072-eb9f-4c02-8888-fe4bcc6641a3 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 03:59:13 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 03:59:13 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-85961072-eb9f-4c02-8888-fe4bcc6641a3 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG nova.network.neutron [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Successfully updated port: 804319c6-55cb-4f30-908c-71817934fb45 {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e653b354-4923-49d5-9627-674ae0f06c1c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Acquiring lock "refresh_cache-b0a480de-e99b-4b54-bd81-36c216442137" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Acquired lock "refresh_cache-b0a480de-e99b-4b54-bd81-36c216442137" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG nova.network.neutron [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7fd8d4-a0ef-4493-98de-c3221e492f29]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG nova.compute.manager [req-340570ce-c1cc-487f-81e1-5885e75c2d61 req-ecc24bf5-3489-49df-895c-fc7948a8e4e1 service nova] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Received event network-changed-804319c6-55cb-4f30-908c-71817934fb45 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG nova.compute.manager [req-340570ce-c1cc-487f-81e1-5885e75c2d61 req-ecc24bf5-3489-49df-895c-fc7948a8e4e1 service nova] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Refreshing instance network info cache due to event network-changed-804319c6-55cb-4f30-908c-71817934fb45. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-340570ce-c1cc-487f-81e1-5885e75c2d61 req-ecc24bf5-3489-49df-895c-fc7948a8e4e1 service nova] Acquiring lock "refresh_cache-b0a480de-e99b-4b54-bd81-36c216442137" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-85961072-eb9f-4c02-8888-fe4bcc6641a3 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:59:13 user nova-compute[103546]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)
Nov 16 03:59:13 user nova-compute[103546]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 (non-flash)
Nov 16 03:59:13 user nova-compute[103546]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17 (non-flash)
Nov 16 03:59:13 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-85961072-eb9f-4c02-8888-fe4bcc6641a3 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:59:13 user nova-compute[103546]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 (non-flash)
Nov 16 03:59:13 user nova-compute[103546]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 (non-flash)
Nov 16 03:59:13 user nova-compute[103546]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17 (non-flash)
Nov 16 03:59:13 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-85961072-eb9f-4c02-8888-fe4bcc6641a3 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60c40eeb00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925'): ({'sdd'}, set())}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-85961072-eb9f-4c02-8888-fe4bcc6641a3 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Removing single pathed devices sdd {{(pid=103546) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7124b6-58b6-4730-8fef-81b75cd9463f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG nova.network.neutron [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c480d6-106e-4e18-bcce-1407aa082fdf]: (4, ('ok\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-85961072-eb9f-4c02-8888-fe4bcc6641a3 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Flushing IO for device /dev/sdd {{(pid=103546) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[846a3878-8e76-486f-81be-86d3d0076f8c]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-85961072-eb9f-4c02-8888-fe4bcc6641a3 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=103546) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[defefa8b-f3a8-48a2-b63b-92b76de6e1e7]: (4, ('1', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-85961072-eb9f-4c02-8888-fe4bcc6641a3 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-85961072-eb9f-4c02-8888-fe4bcc6641a3 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] SCSI volumes sdd have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-85961072-eb9f-4c02-8888-fe4bcc6641a3 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925')] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ace93d-5761-42df-afef-93e1089d3f7f]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-85961072-eb9f-4c02-8888-fe4bcc6641a3 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 -p 172.16.0.220:3260 --logout {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[552ffdaa-fefd-43e9-b337-ec1d4d4b945d]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-85961072-eb9f-4c02-8888-fe4bcc6641a3 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925, portal: 172.16.0.220,3260]
Nov 16 03:59:13 user nova-compute[103546]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925, portal: 172.16.0.220,3260] successful.
Nov 16 03:59:13 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 -p 172.16.0.220:3260 --op delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e06dd4b-d05c-4a7d-84a2-5801598f2925 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[312fbb89-bfaf-4bd4-a00f-4a9c5aaa067d]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-85961072-eb9f-4c02-8888-fe4bcc6641a3 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-85961072-eb9f-4c02-8888-fe4bcc6641a3 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-85961072-eb9f-4c02-8888-fe4bcc6641a3 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] <== disconnect_volume: return (343ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:59:13 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85961072-eb9f-4c02-8888-fe4bcc6641a3 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9c86c600-6277-4746-934d-c63e95616219] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 03:59:13 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-85961072-eb9f-4c02-8888-fe4bcc6641a3 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9c86c600-6277-4746-934d-c63e95616219] Deleting instance files /opt/stack/data/nova/instances/9c86c600-6277-4746-934d-c63e95616219_del
Nov 16 03:59:13 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-85961072-eb9f-4c02-8888-fe4bcc6641a3 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9c86c600-6277-4746-934d-c63e95616219] Deletion of /opt/stack/data/nova/instances/9c86c600-6277-4746-934d-c63e95616219_del complete
Nov 16 03:59:13 user nova-compute[103546]: DEBUG nova.network.neutron [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Updating instance_info_cache with network_info: [{"id": "804319c6-55cb-4f30-908c-71817934fb45", "address": "fa:16:3e:d5:4f:3e", "network": {"id": "23baa589-ae15-4a44-8991-d6fe8569dc8a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-464431710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f33e7eff7954fcc895f66982d7d45c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804319c6-55", "ovs_interfaceid": "804319c6-55cb-4f30-908c-71817934fb45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:59:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Releasing lock "refresh_cache-b0a480de-e99b-4b54-bd81-36c216442137" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:59:14 user nova-compute[103546]: DEBUG nova.compute.manager [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Instance network_info: |[{"id": "804319c6-55cb-4f30-908c-71817934fb45", "address": "fa:16:3e:d5:4f:3e", "network": {"id": "23baa589-ae15-4a44-8991-d6fe8569dc8a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-464431710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f33e7eff7954fcc895f66982d7d45c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804319c6-55", "ovs_interfaceid": "804319c6-55cb-4f30-908c-71817934fb45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 03:59:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-340570ce-c1cc-487f-81e1-5885e75c2d61 req-ecc24bf5-3489-49df-895c-fc7948a8e4e1 service nova] Acquired lock "refresh_cache-b0a480de-e99b-4b54-bd81-36c216442137" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:59:14 user nova-compute[103546]: DEBUG nova.network.neutron [req-340570ce-c1cc-487f-81e1-5885e75c2d61 req-ecc24bf5-3489-49df-895c-fc7948a8e4e1 service nova] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Refreshing network info cache for port 804319c6-55cb-4f30-908c-71817934fb45 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:59:14 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Start _get_guest_xml network_info=[{"id": "804319c6-55cb-4f30-908c-71817934fb45", "address": "fa:16:3e:d5:4f:3e", "network": {"id": "23baa589-ae15-4a44-8991-d6fe8569dc8a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-464431710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f33e7eff7954fcc895f66982d7d45c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804319c6-55", "ovs_interfaceid": "804319c6-55cb-4f30-908c-71817934fb45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '5c6f539a-01e5-4478-bf8f-a14310b5d7dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 03:59:14 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:59:14 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:59:14 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 03:59:14 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 03:59:14 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 03:59:14 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 03:59:14 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 03:59:14 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 03:59:14 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 03:59:14 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 03:59:14 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 03:59:14 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 03:59:14 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 03:59:14 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 03:59:14 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 03:59:14 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 03:59:14 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 03:59:14 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 03:59:14 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:59:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1194569156',display_name='tempest-AttachVolumeTestJSON-server-1194569156',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1194569156',id=33,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGulyvMv6DBB41Qe8XWF63e9B3iBHOwlSkAryW1iz72Aw6HfFs0cTFUdIe1uTx/ceIRIbAXp8f4Mb3WAscOyquzQNMRUlWLf10PNP0Nn0ZjiELMrAE3x8QFH1PXFWQSd/w==',key_name='tempest-keypair-309978137',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f33e7eff7954fcc895f66982d7d45c8',ramdisk_id='',reservation_id='r-sa4b0m91',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1584447380',owner_user_name='tempest-AttachVolumeTestJSON-1584447380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:59:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='005ffc068a19494bb5a436fc4a07aaa1',uuid=b0a480de-e99b-4b54-bd81-36c216442137,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "804319c6-55cb-4f30-908c-71817934fb45", "address": "fa:16:3e:d5:4f:3e", "network": {"id": "23baa589-ae15-4a44-8991-d6fe8569dc8a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-464431710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f33e7eff7954fcc895f66982d7d45c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804319c6-55", "ovs_interfaceid": "804319c6-55cb-4f30-908c-71817934fb45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 03:59:14 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Converting VIF {"id": "804319c6-55cb-4f30-908c-71817934fb45", "address": "fa:16:3e:d5:4f:3e", "network": {"id": "23baa589-ae15-4a44-8991-d6fe8569dc8a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-464431710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f33e7eff7954fcc895f66982d7d45c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804319c6-55", "ovs_interfaceid": "804319c6-55cb-4f30-908c-71817934fb45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:59:14 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:4f:3e,bridge_name='br-int',has_traffic_filtering=True,id=804319c6-55cb-4f30-908c-71817934fb45,network=Network(23baa589-ae15-4a44-8991-d6fe8569dc8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap804319c6-55') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:59:14 user nova-compute[103546]: DEBUG nova.objects.instance [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lazy-loading 'pci_devices' on Instance uuid b0a480de-e99b-4b54-bd81-36c216442137 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:59:14 user nova-compute[103546]: INFO nova.compute.manager [None req-85961072-eb9f-4c02-8888-fe4bcc6641a3 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9c86c600-6277-4746-934d-c63e95616219] Took 1.27 seconds to destroy the instance on the hypervisor.
Nov 16 03:59:14 user nova-compute[103546]: DEBUG oslo.service.loopingcall [None req-85961072-eb9f-4c02-8888-fe4bcc6641a3 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=103546) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 03:59:14 user nova-compute[103546]: DEBUG nova.compute.manager [-] [instance: 9c86c600-6277-4746-934d-c63e95616219] Deallocating network for instance {{(pid=103546) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 03:59:14 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 9c86c600-6277-4746-934d-c63e95616219] deallocate_for_instance() {{(pid=103546) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 03:59:14 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] End _get_guest_xml xml=<domain type="kvm">
Nov 16 03:59:14 user nova-compute[103546]:   <uuid>b0a480de-e99b-4b54-bd81-36c216442137</uuid>
Nov 16 03:59:14 user nova-compute[103546]:   <name>instance-00000021</name>
Nov 16 03:59:14 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 03:59:14 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 03:59:14 user nova-compute[103546]:   <metadata>
Nov 16 03:59:14 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 03:59:14 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 03:59:14 user nova-compute[103546]:       <nova:name>tempest-AttachVolumeTestJSON-server-1194569156</nova:name>
Nov 16 03:59:14 user nova-compute[103546]:       <nova:creationTime>2023-11-16 03:59:14</nova:creationTime>
Nov 16 03:59:14 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 03:59:14 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 03:59:14 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 03:59:14 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 03:59:14 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 03:59:14 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 03:59:14 user nova-compute[103546]:       </nova:flavor>
Nov 16 03:59:14 user nova-compute[103546]:       <nova:owner>
Nov 16 03:59:14 user nova-compute[103546]:         <nova:user uuid="005ffc068a19494bb5a436fc4a07aaa1">tempest-AttachVolumeTestJSON-1584447380-project-member</nova:user>
Nov 16 03:59:14 user nova-compute[103546]:         <nova:project uuid="5f33e7eff7954fcc895f66982d7d45c8">tempest-AttachVolumeTestJSON-1584447380</nova:project>
Nov 16 03:59:14 user nova-compute[103546]:       </nova:owner>
Nov 16 03:59:14 user nova-compute[103546]:       <nova:root type="image" uuid="5c6f539a-01e5-4478-bf8f-a14310b5d7dd"/>
Nov 16 03:59:14 user nova-compute[103546]:       <nova:ports>
Nov 16 03:59:14 user nova-compute[103546]:         <nova:port uuid="804319c6-55cb-4f30-908c-71817934fb45">
Nov 16 03:59:14 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 16 03:59:14 user nova-compute[103546]:         </nova:port>
Nov 16 03:59:14 user nova-compute[103546]:       </nova:ports>
Nov 16 03:59:14 user nova-compute[103546]:     </nova:instance>
Nov 16 03:59:14 user nova-compute[103546]:   </metadata>
Nov 16 03:59:14 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 03:59:14 user nova-compute[103546]:     <system>
Nov 16 03:59:14 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 03:59:14 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 03:59:14 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 03:59:14 user nova-compute[103546]:       <entry name="serial">b0a480de-e99b-4b54-bd81-36c216442137</entry>
Nov 16 03:59:14 user nova-compute[103546]:       <entry name="uuid">b0a480de-e99b-4b54-bd81-36c216442137</entry>
Nov 16 03:59:14 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 03:59:14 user nova-compute[103546]:     </system>
Nov 16 03:59:14 user nova-compute[103546]:   </sysinfo>
Nov 16 03:59:14 user nova-compute[103546]:   <os>
Nov 16 03:59:14 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 03:59:14 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 03:59:14 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 03:59:14 user nova-compute[103546]:   </os>
Nov 16 03:59:14 user nova-compute[103546]:   <features>
Nov 16 03:59:14 user nova-compute[103546]:     <acpi/>
Nov 16 03:59:14 user nova-compute[103546]:     <apic/>
Nov 16 03:59:14 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 03:59:14 user nova-compute[103546]:   </features>
Nov 16 03:59:14 user nova-compute[103546]:   <clock offset="utc">
Nov 16 03:59:14 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 03:59:14 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 03:59:14 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 03:59:14 user nova-compute[103546]:   </clock>
Nov 16 03:59:14 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 03:59:14 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 03:59:14 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 03:59:14 user nova-compute[103546]:   </cpu>
Nov 16 03:59:14 user nova-compute[103546]:   <devices>
Nov 16 03:59:14 user nova-compute[103546]:     <disk type="file" device="disk">
Nov 16 03:59:14 user nova-compute[103546]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 03:59:14 user nova-compute[103546]:       <source file="/opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk"/>
Nov 16 03:59:14 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 03:59:14 user nova-compute[103546]:     </disk>
Nov 16 03:59:14 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 03:59:14 user nova-compute[103546]:       <mac address="fa:16:3e:d5:4f:3e"/>
Nov 16 03:59:14 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:59:14 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 03:59:14 user nova-compute[103546]:       <target dev="tap804319c6-55"/>
Nov 16 03:59:14 user nova-compute[103546]:     </interface>
Nov 16 03:59:14 user nova-compute[103546]:     <serial type="pty">
Nov 16 03:59:14 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/console.log" append="off"/>
Nov 16 03:59:14 user nova-compute[103546]:     </serial>
Nov 16 03:59:14 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 03:59:14 user nova-compute[103546]:     <video>
Nov 16 03:59:14 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:59:14 user nova-compute[103546]:     </video>
Nov 16 03:59:14 user nova-compute[103546]:     <rng model="virtio">
Nov 16 03:59:14 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 03:59:14 user nova-compute[103546]:     </rng>
Nov 16 03:59:14 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 03:59:14 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 03:59:14 user nova-compute[103546]:       <stats period="10"/>
Nov 16 03:59:14 user nova-compute[103546]:     </memballoon>
Nov 16 03:59:14 user nova-compute[103546]:   </devices>
Nov 16 03:59:14 user nova-compute[103546]: </domain>
Nov 16 03:59:14 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 03:59:14 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:59:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1194569156',display_name='tempest-AttachVolumeTestJSON-server-1194569156',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1194569156',id=33,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGulyvMv6DBB41Qe8XWF63e9B3iBHOwlSkAryW1iz72Aw6HfFs0cTFUdIe1uTx/ceIRIbAXp8f4Mb3WAscOyquzQNMRUlWLf10PNP0Nn0ZjiELMrAE3x8QFH1PXFWQSd/w==',key_name='tempest-keypair-309978137',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f33e7eff7954fcc895f66982d7d45c8',ramdisk_id='',reservation_id='r-sa4b0m91',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1584447380',owner_user_name='tempest-AttachVolumeTestJSON-1584447380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:59:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='005ffc068a19494bb5a436fc4a07aaa1',uuid=b0a480de-e99b-4b54-bd81-36c216442137,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "804319c6-55cb-4f30-908c-71817934fb45", "address": "fa:16:3e:d5:4f:3e", "network": {"id": "23baa589-ae15-4a44-8991-d6fe8569dc8a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-464431710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f33e7eff7954fcc895f66982d7d45c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804319c6-55", "ovs_interfaceid": "804319c6-55cb-4f30-908c-71817934fb45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 03:59:14 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Converting VIF {"id": "804319c6-55cb-4f30-908c-71817934fb45", "address": "fa:16:3e:d5:4f:3e", "network": {"id": "23baa589-ae15-4a44-8991-d6fe8569dc8a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-464431710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f33e7eff7954fcc895f66982d7d45c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804319c6-55", "ovs_interfaceid": "804319c6-55cb-4f30-908c-71817934fb45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:59:14 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:4f:3e,bridge_name='br-int',has_traffic_filtering=True,id=804319c6-55cb-4f30-908c-71817934fb45,network=Network(23baa589-ae15-4a44-8991-d6fe8569dc8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap804319c6-55') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:59:14 user nova-compute[103546]: DEBUG os_vif [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:4f:3e,bridge_name='br-int',has_traffic_filtering=True,id=804319c6-55cb-4f30-908c-71817934fb45,network=Network(23baa589-ae15-4a44-8991-d6fe8569dc8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap804319c6-55') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 03:59:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:59:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 03:59:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '48de04b5-06ba-556b-8a0c-fe984b5b9f91', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:59:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap804319c6-55, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:59:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap804319c6-55, col_values=(('qos', UUID('f67fb2ff-e871-42ab-aae0-eaffb2cec538')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:59:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap804319c6-55, col_values=(('external_ids', {'iface-id': '804319c6-55cb-4f30-908c-71817934fb45', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:4f:3e', 'vm-uuid': 'b0a480de-e99b-4b54-bd81-36c216442137'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:59:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:59:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:14 user nova-compute[103546]: INFO os_vif [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:4f:3e,bridge_name='br-int',has_traffic_filtering=True,id=804319c6-55cb-4f30-908c-71817934fb45,network=Network(23baa589-ae15-4a44-8991-d6fe8569dc8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap804319c6-55')
Nov 16 03:59:14 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:59:14 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] No VIF found with MAC fa:16:3e:d5:4f:3e, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 03:59:14 user nova-compute[103546]: DEBUG nova.network.neutron [req-340570ce-c1cc-487f-81e1-5885e75c2d61 req-ecc24bf5-3489-49df-895c-fc7948a8e4e1 service nova] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Updated VIF entry in instance network info cache for port 804319c6-55cb-4f30-908c-71817934fb45. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 03:59:14 user nova-compute[103546]: DEBUG nova.network.neutron [req-340570ce-c1cc-487f-81e1-5885e75c2d61 req-ecc24bf5-3489-49df-895c-fc7948a8e4e1 service nova] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Updating instance_info_cache with network_info: [{"id": "804319c6-55cb-4f30-908c-71817934fb45", "address": "fa:16:3e:d5:4f:3e", "network": {"id": "23baa589-ae15-4a44-8991-d6fe8569dc8a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-464431710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f33e7eff7954fcc895f66982d7d45c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804319c6-55", "ovs_interfaceid": "804319c6-55cb-4f30-908c-71817934fb45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:59:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-340570ce-c1cc-487f-81e1-5885e75c2d61 req-ecc24bf5-3489-49df-895c-fc7948a8e4e1 service nova] Releasing lock "refresh_cache-b0a480de-e99b-4b54-bd81-36c216442137" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:59:14 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 9c86c600-6277-4746-934d-c63e95616219] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:59:14 user nova-compute[103546]: INFO nova.compute.manager [-] [instance: 9c86c600-6277-4746-934d-c63e95616219] Took 0.82 seconds to deallocate network for instance.
Nov 16 03:59:14 user nova-compute[103546]: DEBUG nova.compute.manager [req-039be0cc-3915-421c-9e36-ef0be5542c41 req-73f0865d-c118-4ffd-87e6-c5c540241213 service nova] [instance: 9c86c600-6277-4746-934d-c63e95616219] Received event network-vif-deleted-5d9f9a33-9288-41e9-9965-d9f2c768f57a {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:59:15 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:15 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:15 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:15 user nova-compute[103546]: INFO nova.compute.manager [None req-85961072-eb9f-4c02-8888-fe4bcc6641a3 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9c86c600-6277-4746-934d-c63e95616219] Took 0.74 seconds to detach 1 volumes for instance.
Nov 16 03:59:15 user nova-compute[103546]: DEBUG nova.compute.manager [None req-85961072-eb9f-4c02-8888-fe4bcc6641a3 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9c86c600-6277-4746-934d-c63e95616219] Deleting volume: 0e06dd4b-d05c-4a7d-84a2-5801598f2925 {{(pid=103546) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 16 03:59:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-85961072-eb9f-4c02-8888-fe4bcc6641a3 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:59:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-85961072-eb9f-4c02-8888-fe4bcc6641a3 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:59:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:16 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-85961072-eb9f-4c02-8888-fe4bcc6641a3 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:59:16 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-85961072-eb9f-4c02-8888-fe4bcc6641a3 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:59:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-85961072-eb9f-4c02-8888-fe4bcc6641a3 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.418s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:59:16 user nova-compute[103546]: INFO nova.scheduler.client.report [None req-85961072-eb9f-4c02-8888-fe4bcc6641a3 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Deleted allocations for instance 9c86c600-6277-4746-934d-c63e95616219
Nov 16 03:59:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-85961072-eb9f-4c02-8888-fe4bcc6641a3 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "9c86c600-6277-4746-934d-c63e95616219" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.521s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:59:16 user nova-compute[103546]: DEBUG nova.compute.manager [req-3fc3db56-bde8-47cb-84bf-5b1825a29756 req-e7a4a780-592a-4ff3-884a-5a17d8efd82b service nova] [instance: 9c86c600-6277-4746-934d-c63e95616219] Received event network-vif-plugged-5d9f9a33-9288-41e9-9965-d9f2c768f57a {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:59:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3fc3db56-bde8-47cb-84bf-5b1825a29756 req-e7a4a780-592a-4ff3-884a-5a17d8efd82b service nova] Acquiring lock "9c86c600-6277-4746-934d-c63e95616219-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:59:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3fc3db56-bde8-47cb-84bf-5b1825a29756 req-e7a4a780-592a-4ff3-884a-5a17d8efd82b service nova] Lock "9c86c600-6277-4746-934d-c63e95616219-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:59:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3fc3db56-bde8-47cb-84bf-5b1825a29756 req-e7a4a780-592a-4ff3-884a-5a17d8efd82b service nova] Lock "9c86c600-6277-4746-934d-c63e95616219-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:59:16 user nova-compute[103546]: DEBUG nova.compute.manager [req-3fc3db56-bde8-47cb-84bf-5b1825a29756 req-e7a4a780-592a-4ff3-884a-5a17d8efd82b service nova] [instance: 9c86c600-6277-4746-934d-c63e95616219] No waiting events found dispatching network-vif-plugged-5d9f9a33-9288-41e9-9965-d9f2c768f57a {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:59:16 user nova-compute[103546]: WARNING nova.compute.manager [req-3fc3db56-bde8-47cb-84bf-5b1825a29756 req-e7a4a780-592a-4ff3-884a-5a17d8efd82b service nova] [instance: 9c86c600-6277-4746-934d-c63e95616219] Received unexpected event network-vif-plugged-5d9f9a33-9288-41e9-9965-d9f2c768f57a for instance with vm_state deleted and task_state None.
Nov 16 03:59:16 user nova-compute[103546]: DEBUG nova.compute.manager [req-cbece225-aa8f-4555-b2ee-b62486c31dff req-c43f7b8b-a396-47ff-b494-34892f95d653 service nova] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Received event network-vif-plugged-804319c6-55cb-4f30-908c-71817934fb45 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:59:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-cbece225-aa8f-4555-b2ee-b62486c31dff req-c43f7b8b-a396-47ff-b494-34892f95d653 service nova] Acquiring lock "b0a480de-e99b-4b54-bd81-36c216442137-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:59:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-cbece225-aa8f-4555-b2ee-b62486c31dff req-c43f7b8b-a396-47ff-b494-34892f95d653 service nova] Lock "b0a480de-e99b-4b54-bd81-36c216442137-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:59:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-cbece225-aa8f-4555-b2ee-b62486c31dff req-c43f7b8b-a396-47ff-b494-34892f95d653 service nova] Lock "b0a480de-e99b-4b54-bd81-36c216442137-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:59:16 user nova-compute[103546]: DEBUG nova.compute.manager [req-cbece225-aa8f-4555-b2ee-b62486c31dff req-c43f7b8b-a396-47ff-b494-34892f95d653 service nova] [instance: b0a480de-e99b-4b54-bd81-36c216442137] No waiting events found dispatching network-vif-plugged-804319c6-55cb-4f30-908c-71817934fb45 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:59:16 user nova-compute[103546]: WARNING nova.compute.manager [req-cbece225-aa8f-4555-b2ee-b62486c31dff req-c43f7b8b-a396-47ff-b494-34892f95d653 service nova] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Received unexpected event network-vif-plugged-804319c6-55cb-4f30-908c-71817934fb45 for instance with vm_state building and task_state spawning.
Nov 16 03:59:16 user nova-compute[103546]: DEBUG nova.compute.manager [req-cbece225-aa8f-4555-b2ee-b62486c31dff req-c43f7b8b-a396-47ff-b494-34892f95d653 service nova] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Received event network-vif-plugged-804319c6-55cb-4f30-908c-71817934fb45 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:59:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-cbece225-aa8f-4555-b2ee-b62486c31dff req-c43f7b8b-a396-47ff-b494-34892f95d653 service nova] Acquiring lock "b0a480de-e99b-4b54-bd81-36c216442137-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:59:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-cbece225-aa8f-4555-b2ee-b62486c31dff req-c43f7b8b-a396-47ff-b494-34892f95d653 service nova] Lock "b0a480de-e99b-4b54-bd81-36c216442137-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:59:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-cbece225-aa8f-4555-b2ee-b62486c31dff req-c43f7b8b-a396-47ff-b494-34892f95d653 service nova] Lock "b0a480de-e99b-4b54-bd81-36c216442137-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:59:16 user nova-compute[103546]: DEBUG nova.compute.manager [req-cbece225-aa8f-4555-b2ee-b62486c31dff req-c43f7b8b-a396-47ff-b494-34892f95d653 service nova] [instance: b0a480de-e99b-4b54-bd81-36c216442137] No waiting events found dispatching network-vif-plugged-804319c6-55cb-4f30-908c-71817934fb45 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:59:16 user nova-compute[103546]: WARNING nova.compute.manager [req-cbece225-aa8f-4555-b2ee-b62486c31dff req-c43f7b8b-a396-47ff-b494-34892f95d653 service nova] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Received unexpected event network-vif-plugged-804319c6-55cb-4f30-908c-71817934fb45 for instance with vm_state building and task_state spawning.
Nov 16 03:59:17 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:59:17 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:59:17 user nova-compute[103546]: DEBUG nova.compute.manager [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 03:59:17 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Guest created on hypervisor {{(pid=103546) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 03:59:17 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Instance spawned successfully.
Nov 16 03:59:17 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 03:59:17 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Found default for hw_cdrom_bus of ide {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:59:17 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Found default for hw_disk_bus of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:59:17 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Found default for hw_input_bus of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:59:17 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Found default for hw_pointer_model of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:59:17 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Found default for hw_video_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:59:17 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Found default for hw_vif_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:59:17 user nova-compute[103546]: INFO nova.compute.manager [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Took 5.46 seconds to spawn the instance on the hypervisor.
Nov 16 03:59:17 user nova-compute[103546]: DEBUG nova.compute.manager [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 03:59:17 user nova-compute[103546]: INFO nova.compute.manager [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Took 6.77 seconds to build instance.
Nov 16 03:59:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-304d8240-3962-4c5b-841c-9c9fff6dc2a8 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "b0a480de-e99b-4b54-bd81-36c216442137" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.894s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:59:18 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:18 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:59:18 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=103546) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 03:59:18 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager.update_available_resource {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:59:18 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:59:18 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:59:18 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:59:18 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Auditing locally available compute resources for user (node: user) {{(pid=103546) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 03:59:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:59:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:59:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:59:19 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:59:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:59:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:59:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:59:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:59:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:59:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:59:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:59:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:59:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4065a1b-10a0-4b2a-9088-a703a7c4e064/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:59:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4065a1b-10a0-4b2a-9088-a703a7c4e064/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:59:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4065a1b-10a0-4b2a-9088-a703a7c4e064/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:59:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4065a1b-10a0-4b2a-9088-a703a7c4e064/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:59:20 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 03:59:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:59:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:59:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:59:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:59:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2781221-b5e3-468a-a9f5-436a04285f38/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:59:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2781221-b5e3-468a-a9f5-436a04285f38/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:59:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2781221-b5e3-468a-a9f5-436a04285f38/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:59:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2781221-b5e3-468a-a9f5-436a04285f38/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:59:21 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 03:59:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6fddce-7650-4bf9-8c63-3d6db6ff4726/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:59:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-2457375e-9ce6-4df6-bb8a-644edc8566da tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Acquiring lock "ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:59:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-2457375e-9ce6-4df6-bb8a-644edc8566da tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:59:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-2457375e-9ce6-4df6-bb8a-644edc8566da tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Acquiring lock "ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:59:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-2457375e-9ce6-4df6-bb8a-644edc8566da tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:59:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-2457375e-9ce6-4df6-bb8a-644edc8566da tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:59:21 user nova-compute[103546]: INFO nova.compute.manager [None req-2457375e-9ce6-4df6-bb8a-644edc8566da tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Terminating instance
Nov 16 03:59:21 user nova-compute[103546]: DEBUG nova.compute.manager [None req-2457375e-9ce6-4df6-bb8a-644edc8566da tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Start destroying the instance on the hypervisor. {{(pid=103546) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 03:59:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6fddce-7650-4bf9-8c63-3d6db6ff4726/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:59:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6fddce-7650-4bf9-8c63-3d6db6ff4726/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:59:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6fddce-7650-4bf9-8c63-3d6db6ff4726/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:59:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.rescue --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:59:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:21 user nova-compute[103546]: DEBUG nova.compute.manager [req-055ba35d-6ae7-4be9-8631-d862e77ac63b req-2f46d305-882d-49f7-ac96-d2070215f4c3 service nova] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Received event network-vif-unplugged-757f4202-bbf9-42cf-8ccc-7e970b892f1f {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:59:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-055ba35d-6ae7-4be9-8631-d862e77ac63b req-2f46d305-882d-49f7-ac96-d2070215f4c3 service nova] Acquiring lock "ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:59:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-055ba35d-6ae7-4be9-8631-d862e77ac63b req-2f46d305-882d-49f7-ac96-d2070215f4c3 service nova] Lock "ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:59:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-055ba35d-6ae7-4be9-8631-d862e77ac63b req-2f46d305-882d-49f7-ac96-d2070215f4c3 service nova] Lock "ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:59:21 user nova-compute[103546]: DEBUG nova.compute.manager [req-055ba35d-6ae7-4be9-8631-d862e77ac63b req-2f46d305-882d-49f7-ac96-d2070215f4c3 service nova] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] No waiting events found dispatching network-vif-unplugged-757f4202-bbf9-42cf-8ccc-7e970b892f1f {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:59:21 user nova-compute[103546]: DEBUG nova.compute.manager [req-055ba35d-6ae7-4be9-8631-d862e77ac63b req-2f46d305-882d-49f7-ac96-d2070215f4c3 service nova] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Received event network-vif-unplugged-757f4202-bbf9-42cf-8ccc-7e970b892f1f for instance with task_state deleting. {{(pid=103546) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 03:59:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:59:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.rescue --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:59:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:59:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:59:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:59:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:59:22 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Instance destroyed successfully.
Nov 16 03:59:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:22 user nova-compute[103546]: DEBUG nova.objects.instance [None req-2457375e-9ce6-4df6-bb8a-644edc8566da tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lazy-loading 'resources' on Instance uuid ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:59:22 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-2457375e-9ce6-4df6-bb8a-644edc8566da tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T03:53:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-131803665',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-131803665',id=22,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCpMkDeLog7bvOvwKkIjqfS8179Rp5Wy/oiCfL7hNx4ACLwn8Ka5bKgRH8IHZl2m0/RN2qLs1wVx1qnT5sRNlnObDaB0h+OIqSDqvVheIpq1rj9KpUcFGrgypySriGKxIw==',key_name='tempest-keypair-1198627758',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:57:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='63722fdf17e4408299de8c215c133812',ramdisk_id='',reservation_id='r-gew0pxlb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1382373405',owner_user_name='tempest-AttachVolumeShelveTestJSON-1382373405-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T03:57:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21d4e9052a614968bda331f028920ca7',uuid=ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "757f4202-bbf9-42cf-8ccc-7e970b892f1f", "address": "fa:16:3e:db:d6:71", "network": {"id": "b2fca984-f1e9-4c86-a3a5-b8d5b9950555", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-172535633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63722fdf17e4408299de8c215c133812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap757f4202-bb", "ovs_interfaceid": "757f4202-bbf9-42cf-8ccc-7e970b892f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 03:59:22 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-2457375e-9ce6-4df6-bb8a-644edc8566da tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Converting VIF {"id": "757f4202-bbf9-42cf-8ccc-7e970b892f1f", "address": "fa:16:3e:db:d6:71", "network": {"id": "b2fca984-f1e9-4c86-a3a5-b8d5b9950555", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-172535633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63722fdf17e4408299de8c215c133812", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap757f4202-bb", "ovs_interfaceid": "757f4202-bbf9-42cf-8ccc-7e970b892f1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:59:22 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-2457375e-9ce6-4df6-bb8a-644edc8566da tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:d6:71,bridge_name='br-int',has_traffic_filtering=True,id=757f4202-bbf9-42cf-8ccc-7e970b892f1f,network=Network(b2fca984-f1e9-4c86-a3a5-b8d5b9950555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap757f4202-bb') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:59:22 user nova-compute[103546]: DEBUG os_vif [None req-2457375e-9ce6-4df6-bb8a-644edc8566da tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:d6:71,bridge_name='br-int',has_traffic_filtering=True,id=757f4202-bbf9-42cf-8ccc-7e970b892f1f,network=Network(b2fca984-f1e9-4c86-a3a5-b8d5b9950555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap757f4202-bb') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 03:59:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap757f4202-bb, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:59:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:59:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=17899e45-2a79-4d08-aeeb-4a8344d05ad1) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:59:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:59:22 user nova-compute[103546]: INFO os_vif [None req-2457375e-9ce6-4df6-bb8a-644edc8566da tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:d6:71,bridge_name='br-int',has_traffic_filtering=True,id=757f4202-bbf9-42cf-8ccc-7e970b892f1f,network=Network(b2fca984-f1e9-4c86-a3a5-b8d5b9950555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap757f4202-bb')
Nov 16 03:59:22 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-2457375e-9ce6-4df6-bb8a-644edc8566da tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Deleting instance files /opt/stack/data/nova/instances/ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c_del
Nov 16 03:59:22 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-2457375e-9ce6-4df6-bb8a-644edc8566da tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Deletion of /opt/stack/data/nova/instances/ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c_del complete
Nov 16 03:59:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:59:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:59:22 user nova-compute[103546]: INFO nova.compute.manager [None req-2457375e-9ce6-4df6-bb8a-644edc8566da tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Took 1.13 seconds to destroy the instance on the hypervisor.
Nov 16 03:59:22 user nova-compute[103546]: DEBUG oslo.service.loopingcall [None req-2457375e-9ce6-4df6-bb8a-644edc8566da tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=103546) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 03:59:22 user nova-compute[103546]: DEBUG nova.compute.manager [-] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Deallocating network for instance {{(pid=103546) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 03:59:22 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] deallocate_for_instance() {{(pid=103546) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 03:59:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:59:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:59:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:59:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:23 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:23 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:59:23 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:59:23 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Hypervisor/Node resource view: name=user free_ram=7759MB free_disk=25.140003204345703GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=103546) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 03:59:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:59:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:59:23 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:59:23 user nova-compute[103546]: INFO nova.compute.manager [-] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Took 0.91 seconds to deallocate network for instance.
Nov 16 03:59:23 user nova-compute[103546]: DEBUG nova.compute.manager [req-b4b39804-b119-46ce-ad77-9cd533348441 req-69c0b5a7-c73e-41c2-a2b7-fa4ecca787be service nova] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Received event network-vif-deleted-757f4202-bbf9-42cf-8ccc-7e970b892f1f {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:59:23 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 9a89970b-fc61-4419-8ff9-b48013dccf9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:59:23 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 04101512-7333-4581-add3-7af3821e335b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:59:23 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance fa7e5468-9dd4-407d-85ec-d45ec76f9e29 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:59:23 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance f4065a1b-10a0-4b2a-9088-a703a7c4e064 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:59:23 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 246ccf69-847c-4ab2-b709-ad1a85e81eab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:59:23 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 8d229d05-95f1-4997-8539-802ac65cff8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:59:23 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance d2781221-b5e3-468a-a9f5-436a04285f38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:59:23 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:59:23 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 8e6fddce-7650-4bf9-8c63-3d6db6ff4726 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:59:23 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance b0a480de-e99b-4b54-bd81-36c216442137 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 03:59:23 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 03:59:23 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 03:59:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-2457375e-9ce6-4df6-bb8a-644edc8566da tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:59:23 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:23 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:59:23 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:59:23 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Compute_service record updated for user:user {{(pid=103546) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 03:59:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.452s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:59:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-2457375e-9ce6-4df6-bb8a-644edc8566da tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.302s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:59:23 user nova-compute[103546]: DEBUG nova.compute.manager [req-47b21708-7866-4de0-89f6-8063d8bebda1 req-ea6bec9b-3097-406a-81b3-6338b3ea52b3 service nova] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Received event network-vif-plugged-757f4202-bbf9-42cf-8ccc-7e970b892f1f {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:59:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-47b21708-7866-4de0-89f6-8063d8bebda1 req-ea6bec9b-3097-406a-81b3-6338b3ea52b3 service nova] Acquiring lock "ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:59:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-47b21708-7866-4de0-89f6-8063d8bebda1 req-ea6bec9b-3097-406a-81b3-6338b3ea52b3 service nova] Lock "ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:59:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-47b21708-7866-4de0-89f6-8063d8bebda1 req-ea6bec9b-3097-406a-81b3-6338b3ea52b3 service nova] Lock "ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:59:23 user nova-compute[103546]: DEBUG nova.compute.manager [req-47b21708-7866-4de0-89f6-8063d8bebda1 req-ea6bec9b-3097-406a-81b3-6338b3ea52b3 service nova] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] No waiting events found dispatching network-vif-plugged-757f4202-bbf9-42cf-8ccc-7e970b892f1f {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:59:23 user nova-compute[103546]: WARNING nova.compute.manager [req-47b21708-7866-4de0-89f6-8063d8bebda1 req-ea6bec9b-3097-406a-81b3-6338b3ea52b3 service nova] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Received unexpected event network-vif-plugged-757f4202-bbf9-42cf-8ccc-7e970b892f1f for instance with vm_state deleted and task_state None.
Nov 16 03:59:23 user nova-compute[103546]: DEBUG nova.compute.manager [req-47b21708-7866-4de0-89f6-8063d8bebda1 req-ea6bec9b-3097-406a-81b3-6338b3ea52b3 service nova] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Received event network-vif-plugged-757f4202-bbf9-42cf-8ccc-7e970b892f1f {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:59:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-47b21708-7866-4de0-89f6-8063d8bebda1 req-ea6bec9b-3097-406a-81b3-6338b3ea52b3 service nova] Acquiring lock "ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:59:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-47b21708-7866-4de0-89f6-8063d8bebda1 req-ea6bec9b-3097-406a-81b3-6338b3ea52b3 service nova] Lock "ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:59:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-47b21708-7866-4de0-89f6-8063d8bebda1 req-ea6bec9b-3097-406a-81b3-6338b3ea52b3 service nova] Lock "ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:59:23 user nova-compute[103546]: DEBUG nova.compute.manager [req-47b21708-7866-4de0-89f6-8063d8bebda1 req-ea6bec9b-3097-406a-81b3-6338b3ea52b3 service nova] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] No waiting events found dispatching network-vif-plugged-757f4202-bbf9-42cf-8ccc-7e970b892f1f {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:59:23 user nova-compute[103546]: WARNING nova.compute.manager [req-47b21708-7866-4de0-89f6-8063d8bebda1 req-ea6bec9b-3097-406a-81b3-6338b3ea52b3 service nova] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Received unexpected event network-vif-plugged-757f4202-bbf9-42cf-8ccc-7e970b892f1f for instance with vm_state deleted and task_state None.
Nov 16 03:59:23 user nova-compute[103546]: DEBUG nova.compute.manager [req-47b21708-7866-4de0-89f6-8063d8bebda1 req-ea6bec9b-3097-406a-81b3-6338b3ea52b3 service nova] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Received event network-vif-plugged-757f4202-bbf9-42cf-8ccc-7e970b892f1f {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:59:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-47b21708-7866-4de0-89f6-8063d8bebda1 req-ea6bec9b-3097-406a-81b3-6338b3ea52b3 service nova] Acquiring lock "ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:59:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-47b21708-7866-4de0-89f6-8063d8bebda1 req-ea6bec9b-3097-406a-81b3-6338b3ea52b3 service nova] Lock "ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:59:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-47b21708-7866-4de0-89f6-8063d8bebda1 req-ea6bec9b-3097-406a-81b3-6338b3ea52b3 service nova] Lock "ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:59:23 user nova-compute[103546]: DEBUG nova.compute.manager [req-47b21708-7866-4de0-89f6-8063d8bebda1 req-ea6bec9b-3097-406a-81b3-6338b3ea52b3 service nova] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] No waiting events found dispatching network-vif-plugged-757f4202-bbf9-42cf-8ccc-7e970b892f1f {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:59:23 user nova-compute[103546]: WARNING nova.compute.manager [req-47b21708-7866-4de0-89f6-8063d8bebda1 req-ea6bec9b-3097-406a-81b3-6338b3ea52b3 service nova] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Received unexpected event network-vif-plugged-757f4202-bbf9-42cf-8ccc-7e970b892f1f for instance with vm_state deleted and task_state None.
Nov 16 03:59:23 user nova-compute[103546]: DEBUG nova.compute.manager [req-47b21708-7866-4de0-89f6-8063d8bebda1 req-ea6bec9b-3097-406a-81b3-6338b3ea52b3 service nova] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Received event network-vif-unplugged-757f4202-bbf9-42cf-8ccc-7e970b892f1f {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:59:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-47b21708-7866-4de0-89f6-8063d8bebda1 req-ea6bec9b-3097-406a-81b3-6338b3ea52b3 service nova] Acquiring lock "ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:59:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-47b21708-7866-4de0-89f6-8063d8bebda1 req-ea6bec9b-3097-406a-81b3-6338b3ea52b3 service nova] Lock "ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:59:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-47b21708-7866-4de0-89f6-8063d8bebda1 req-ea6bec9b-3097-406a-81b3-6338b3ea52b3 service nova] Lock "ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:59:23 user nova-compute[103546]: DEBUG nova.compute.manager [req-47b21708-7866-4de0-89f6-8063d8bebda1 req-ea6bec9b-3097-406a-81b3-6338b3ea52b3 service nova] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] No waiting events found dispatching network-vif-unplugged-757f4202-bbf9-42cf-8ccc-7e970b892f1f {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:59:23 user nova-compute[103546]: WARNING nova.compute.manager [req-47b21708-7866-4de0-89f6-8063d8bebda1 req-ea6bec9b-3097-406a-81b3-6338b3ea52b3 service nova] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Received unexpected event network-vif-unplugged-757f4202-bbf9-42cf-8ccc-7e970b892f1f for instance with vm_state deleted and task_state None.
Nov 16 03:59:23 user nova-compute[103546]: DEBUG nova.compute.manager [req-47b21708-7866-4de0-89f6-8063d8bebda1 req-ea6bec9b-3097-406a-81b3-6338b3ea52b3 service nova] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Received event network-vif-plugged-757f4202-bbf9-42cf-8ccc-7e970b892f1f {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:59:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-47b21708-7866-4de0-89f6-8063d8bebda1 req-ea6bec9b-3097-406a-81b3-6338b3ea52b3 service nova] Acquiring lock "ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:59:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-47b21708-7866-4de0-89f6-8063d8bebda1 req-ea6bec9b-3097-406a-81b3-6338b3ea52b3 service nova] Lock "ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:59:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-47b21708-7866-4de0-89f6-8063d8bebda1 req-ea6bec9b-3097-406a-81b3-6338b3ea52b3 service nova] Lock "ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:59:23 user nova-compute[103546]: DEBUG nova.compute.manager [req-47b21708-7866-4de0-89f6-8063d8bebda1 req-ea6bec9b-3097-406a-81b3-6338b3ea52b3 service nova] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] No waiting events found dispatching network-vif-plugged-757f4202-bbf9-42cf-8ccc-7e970b892f1f {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:59:23 user nova-compute[103546]: WARNING nova.compute.manager [req-47b21708-7866-4de0-89f6-8063d8bebda1 req-ea6bec9b-3097-406a-81b3-6338b3ea52b3 service nova] [instance: ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c] Received unexpected event network-vif-plugged-757f4202-bbf9-42cf-8ccc-7e970b892f1f for instance with vm_state deleted and task_state None.
Nov 16 03:59:24 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-2457375e-9ce6-4df6-bb8a-644edc8566da tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:59:24 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-2457375e-9ce6-4df6-bb8a-644edc8566da tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:59:24 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-2457375e-9ce6-4df6-bb8a-644edc8566da tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.326s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:59:24 user nova-compute[103546]: INFO nova.scheduler.client.report [None req-2457375e-9ce6-4df6-bb8a-644edc8566da tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Deleted allocations for instance ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c
Nov 16 03:59:24 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-2457375e-9ce6-4df6-bb8a-644edc8566da tempest-AttachVolumeShelveTestJSON-1382373405 tempest-AttachVolumeShelveTestJSON-1382373405-project-member] Lock "ddcc1978-6cc2-45cb-bc64-2068bbeb3f9c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.869s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:59:24 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:59:24 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:59:24 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Starting heal instance info cache {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 03:59:24 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "refresh_cache-fa7e5468-9dd4-407d-85ec-d45ec76f9e29" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:59:24 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquired lock "refresh_cache-fa7e5468-9dd4-407d-85ec-d45ec76f9e29" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:59:24 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Forcefully refreshing network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 03:59:25 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Updating instance_info_cache with network_info: [{"id": "764b22e9-e899-4d39-8bc7-903ff8a7c3f6", "address": "fa:16:3e:77:63:89", "network": {"id": "fdbb2d2c-9a54-4517-b33a-cf27ce7570b1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79661471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2a38a5eb514ce8a7569c8322657eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap764b22e9-e8", "ovs_interfaceid": "764b22e9-e899-4d39-8bc7-903ff8a7c3f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:59:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Releasing lock "refresh_cache-fa7e5468-9dd4-407d-85ec-d45ec76f9e29" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:59:25 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Updated the network info_cache for instance {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 03:59:25 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:59:25 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:59:25 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 03:59:27 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:31 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-2352ac0f-8e72-4705-94b6-950dedb74cd4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f4065a1b-10a0-4b2a-9088-a703a7c4e064 is timed out.
Nov 16 03:59:31 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-2352ac0f-8e72-4705-94b6-950dedb74cd4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Successfully detached device vdb from instance f4065a1b-10a0-4b2a-9088-a703a7c4e064 from the live domain config.
Nov 16 03:59:31 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2352ac0f-8e72-4705-94b6-950dedb74cd4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 03:59:31 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-2352ac0f-8e72-4705-94b6-950dedb74cd4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GxzRICWM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 03:59:31 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-2352ac0f-8e72-4705-94b6-950dedb74cd4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 03:59:31 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-2352ac0f-8e72-4705-94b6-950dedb74cd4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 03:59:31 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-2352ac0f-8e72-4705-94b6-950dedb74cd4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 03:59:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:59:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:59:31 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e003b0bb-bdce-4c94-aacd-5d1a33ccf76f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:59:31 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-2352ac0f-8e72-4705-94b6-950dedb74cd4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 03:59:31 user nova-compute[103546]: No targets found.
Nov 16 03:59:31 user nova-compute[103546]: iSNS:
Nov 16 03:59:31 user nova-compute[103546]: No targets found.
Nov 16 03:59:31 user nova-compute[103546]: STATIC:
Nov 16 03:59:31 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229
Nov 16 03:59:31 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:59:31 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:59:31 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4
Nov 16 03:59:31 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:59:31 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:59:31 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17
Nov 16 03:59:31 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 03:59:31 user nova-compute[103546]:                 Iface Name: default
Nov 16 03:59:31 user nova-compute[103546]: FIRMWARE:
Nov 16 03:59:31 user nova-compute[103546]: No targets found.
Nov 16 03:59:31 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:59:31 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-2352ac0f-8e72-4705-94b6-950dedb74cd4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 03:59:31 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 03:59:31 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 03:59:31 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-2352ac0f-8e72-4705-94b6-950dedb74cd4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 03:59:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:59:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:59:31 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6e213e-ce21-4274-a649-00bcb9fdb0d9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:59:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:59:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:59:31 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3d8fb3-bca4-45fe-9bce-fbbfd95658db]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:59:31 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-2352ac0f-8e72-4705-94b6-950dedb74cd4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:59:31 user nova-compute[103546]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 (non-flash)
Nov 16 03:59:31 user nova-compute[103546]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17 (non-flash)
Nov 16 03:59:31 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 03:59:31 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-2352ac0f-8e72-4705-94b6-950dedb74cd4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 03:59:31 user nova-compute[103546]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 (non-flash)
Nov 16 03:59:31 user nova-compute[103546]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17 (non-flash)
Nov 16 03:59:31 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 03:59:31 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-2352ac0f-8e72-4705-94b6-950dedb74cd4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60ac54fb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229'): ({'sde'}, set())}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 03:59:31 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-2352ac0f-8e72-4705-94b6-950dedb74cd4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Removing single pathed devices sde {{(pid=103546) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 03:59:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:59:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:59:31 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b90656-11cc-458f-8100-29251b8af3cb]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:59:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:59:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:59:31 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e58e9c-7882-4ea4-bbf6-57a4a036d939]: (4, ('ok\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:59:31 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-2352ac0f-8e72-4705-94b6-950dedb74cd4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Flushing IO for device /dev/sde {{(pid=103546) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 03:59:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:59:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:59:31 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[efad0088-b89a-464b-affa-a6b83ce9f5ac]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:59:31 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-2352ac0f-8e72-4705-94b6-950dedb74cd4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=103546) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 03:59:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:59:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:59:31 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[619cc038-dac2-4689-855e-57ee9c86c39a]: (4, ('1', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:59:31 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-2352ac0f-8e72-4705-94b6-950dedb74cd4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 03:59:31 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-2352ac0f-8e72-4705-94b6-950dedb74cd4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] SCSI volumes sde have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 03:59:31 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-2352ac0f-8e72-4705-94b6-950dedb74cd4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229')] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 03:59:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:59:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:59:31 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbbf1d7-1698-4642-a38f-5b067d37d777]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:59:31 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-2352ac0f-8e72-4705-94b6-950dedb74cd4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:59:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 -p 172.16.0.220:3260 --logout {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:59:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:59:31 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6020b4a-16d3-4e7d-bfc6-94c63b1aafed]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:59:31 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-2352ac0f-8e72-4705-94b6-950dedb74cd4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229, portal: 172.16.0.220,3260]
Nov 16 03:59:31 user nova-compute[103546]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229, portal: 172.16.0.220,3260] successful.
Nov 16 03:59:31 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:59:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 -p 172.16.0.220:3260 --op delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:59:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80738ad2-a7e0-4996-bda9-07784deca229 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:59:31 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[161faa3d-88c8-4ef0-975d-dd5337de3e13]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 03:59:31 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-2352ac0f-8e72-4705-94b6-950dedb74cd4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 03:59:31 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-2352ac0f-8e72-4705-94b6-950dedb74cd4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 03:59:31 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-2352ac0f-8e72-4705-94b6-950dedb74cd4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] <== disconnect_volume: return (313ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 03:59:31 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2352ac0f-8e72-4705-94b6-950dedb74cd4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 03:59:32 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:32 user nova-compute[103546]: DEBUG nova.objects.instance [None req-2352ac0f-8e72-4705-94b6-950dedb74cd4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lazy-loading 'flavor' on Instance uuid f4065a1b-10a0-4b2a-9088-a703a7c4e064 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:59:32 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-2352ac0f-8e72-4705-94b6-950dedb74cd4 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "f4065a1b-10a0-4b2a-9088-a703a7c4e064" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.818s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:59:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Acquiring lock "38f7c407-3373-43ba-ac92-7eb0a43a7093" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:59:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "38f7c407-3373-43ba-ac92-7eb0a43a7093" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:59:35 user nova-compute[103546]: DEBUG nova.compute.manager [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Starting instance... {{(pid=103546) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 03:59:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:59:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:59:35 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=103546) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 03:59:35 user nova-compute[103546]: INFO nova.compute.claims [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Claim successful on node user
Nov 16 03:59:35 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:59:35 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:59:36 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.442s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:59:36 user nova-compute[103546]: DEBUG nova.compute.manager [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Start building networks asynchronously for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 03:59:36 user nova-compute[103546]: DEBUG nova.compute.manager [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Allocating IP information in the background. {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 03:59:36 user nova-compute[103546]: DEBUG nova.network.neutron [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] allocate_for_instance() {{(pid=103546) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 03:59:36 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 03:59:36 user nova-compute[103546]: DEBUG nova.compute.manager [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Start building block device mappings for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 03:59:36 user nova-compute[103546]: DEBUG nova.policy [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e1176a2817ef428ea81e2fb18299a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2a38a5eb514ce8a7569c8322657eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103546) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 03:59:36 user nova-compute[103546]: DEBUG nova.compute.manager [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Start spawning the instance on the hypervisor. {{(pid=103546) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 03:59:36 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Creating instance directory {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 03:59:36 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Creating image(s)
Nov 16 03:59:36 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Acquiring lock "/opt/stack/data/nova/instances/38f7c407-3373-43ba-ac92-7eb0a43a7093/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:59:36 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "/opt/stack/data/nova/instances/38f7c407-3373-43ba-ac92-7eb0a43a7093/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:59:36 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "/opt/stack/data/nova/instances/38f7c407-3373-43ba-ac92-7eb0a43a7093/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:59:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:59:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.179s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:59:36 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Acquiring lock "8c9efafb670bfe5842ba1f4ce398924612164af7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:59:36 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:59:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:59:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.180s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:59:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/38f7c407-3373-43ba-ac92-7eb0a43a7093/disk 1073741824 {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:59:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/38f7c407-3373-43ba-ac92-7eb0a43a7093/disk 1073741824" returned: 0 in 0.053s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:59:36 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:59:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:59:36 user nova-compute[103546]: DEBUG nova.network.neutron [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Successfully created port: 25f18a73-4153-41e2-a4e9-f5ce77367363 {{(pid=103546) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 03:59:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.182s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:59:36 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Checking if we can resize image /opt/stack/data/nova/instances/38f7c407-3373-43ba-ac92-7eb0a43a7093/disk. size=1073741824 {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 03:59:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f7c407-3373-43ba-ac92-7eb0a43a7093/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f7c407-3373-43ba-ac92-7eb0a43a7093/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Cannot resize image /opt/stack/data/nova/instances/38f7c407-3373-43ba-ac92-7eb0a43a7093/disk to a smaller size. {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Created local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Ensure instance console log exists: /opt/stack/data/nova/instances/38f7c407-3373-43ba-ac92-7eb0a43a7093/console.log {{(pid=103546) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG nova.network.neutron [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Successfully updated port: 25f18a73-4153-41e2-a4e9-f5ce77367363 {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Acquiring lock "refresh_cache-38f7c407-3373-43ba-ac92-7eb0a43a7093" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Acquired lock "refresh_cache-38f7c407-3373-43ba-ac92-7eb0a43a7093" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG nova.network.neutron [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG nova.compute.manager [req-f682b097-3360-44f3-80b7-3da6cbc05635 req-154ce2c4-3f93-45db-b055-3293e25e9874 service nova] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Received event network-changed-25f18a73-4153-41e2-a4e9-f5ce77367363 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG nova.compute.manager [req-f682b097-3360-44f3-80b7-3da6cbc05635 req-154ce2c4-3f93-45db-b055-3293e25e9874 service nova] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Refreshing instance network info cache due to event network-changed-25f18a73-4153-41e2-a4e9-f5ce77367363. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-f682b097-3360-44f3-80b7-3da6cbc05635 req-154ce2c4-3f93-45db-b055-3293e25e9874 service nova] Acquiring lock "refresh_cache-38f7c407-3373-43ba-ac92-7eb0a43a7093" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG nova.network.neutron [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG nova.network.neutron [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Updating instance_info_cache with network_info: [{"id": "25f18a73-4153-41e2-a4e9-f5ce77367363", "address": "fa:16:3e:34:b9:ff", "network": {"id": "fdbb2d2c-9a54-4517-b33a-cf27ce7570b1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79661471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2a38a5eb514ce8a7569c8322657eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f18a73-41", "ovs_interfaceid": "25f18a73-4153-41e2-a4e9-f5ce77367363", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Releasing lock "refresh_cache-38f7c407-3373-43ba-ac92-7eb0a43a7093" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG nova.compute.manager [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Instance network_info: |[{"id": "25f18a73-4153-41e2-a4e9-f5ce77367363", "address": "fa:16:3e:34:b9:ff", "network": {"id": "fdbb2d2c-9a54-4517-b33a-cf27ce7570b1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79661471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2a38a5eb514ce8a7569c8322657eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f18a73-41", "ovs_interfaceid": "25f18a73-4153-41e2-a4e9-f5ce77367363", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-f682b097-3360-44f3-80b7-3da6cbc05635 req-154ce2c4-3f93-45db-b055-3293e25e9874 service nova] Acquired lock "refresh_cache-38f7c407-3373-43ba-ac92-7eb0a43a7093" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG nova.network.neutron [req-f682b097-3360-44f3-80b7-3da6cbc05635 req-154ce2c4-3f93-45db-b055-3293e25e9874 service nova] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Refreshing network info cache for port 25f18a73-4153-41e2-a4e9-f5ce77367363 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Start _get_guest_xml network_info=[{"id": "25f18a73-4153-41e2-a4e9-f5ce77367363", "address": "fa:16:3e:34:b9:ff", "network": {"id": "fdbb2d2c-9a54-4517-b33a-cf27ce7570b1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79661471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2a38a5eb514ce8a7569c8322657eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f18a73-41", "ovs_interfaceid": "25f18a73-4153-41e2-a4e9-f5ce77367363", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '5c6f539a-01e5-4478-bf8f-a14310b5d7dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 03:59:37 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:59:37 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:59:37 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:59:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1175423654',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1175423654',id=34,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f2a38a5eb514ce8a7569c8322657eac',ramdisk_id='',reservation_id='r-q94f02i7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1634874924',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:59:36Z,user_data=None,user_id='e1176a2817ef428ea81e2fb18299a306',uuid=38f7c407-3373-43ba-ac92-7eb0a43a7093,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25f18a73-4153-41e2-a4e9-f5ce77367363", "address": "fa:16:3e:34:b9:ff", "network": {"id": "fdbb2d2c-9a54-4517-b33a-cf27ce7570b1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79661471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2a38a5eb514ce8a7569c8322657eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f18a73-41", "ovs_interfaceid": "25f18a73-4153-41e2-a4e9-f5ce77367363", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Converting VIF {"id": "25f18a73-4153-41e2-a4e9-f5ce77367363", "address": "fa:16:3e:34:b9:ff", "network": {"id": "fdbb2d2c-9a54-4517-b33a-cf27ce7570b1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79661471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2a38a5eb514ce8a7569c8322657eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f18a73-41", "ovs_interfaceid": "25f18a73-4153-41e2-a4e9-f5ce77367363", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:b9:ff,bridge_name='br-int',has_traffic_filtering=True,id=25f18a73-4153-41e2-a4e9-f5ce77367363,network=Network(fdbb2d2c-9a54-4517-b33a-cf27ce7570b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25f18a73-41') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG nova.objects.instance [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lazy-loading 'pci_devices' on Instance uuid 38f7c407-3373-43ba-ac92-7eb0a43a7093 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] End _get_guest_xml xml=<domain type="kvm">
Nov 16 03:59:37 user nova-compute[103546]:   <uuid>38f7c407-3373-43ba-ac92-7eb0a43a7093</uuid>
Nov 16 03:59:37 user nova-compute[103546]:   <name>instance-00000022</name>
Nov 16 03:59:37 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 03:59:37 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 03:59:37 user nova-compute[103546]:   <metadata>
Nov 16 03:59:37 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 03:59:37 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 03:59:37 user nova-compute[103546]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1175423654</nova:name>
Nov 16 03:59:37 user nova-compute[103546]:       <nova:creationTime>2023-11-16 03:59:37</nova:creationTime>
Nov 16 03:59:37 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 03:59:37 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 03:59:37 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 03:59:37 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 03:59:37 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 03:59:37 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 03:59:37 user nova-compute[103546]:       </nova:flavor>
Nov 16 03:59:37 user nova-compute[103546]:       <nova:owner>
Nov 16 03:59:37 user nova-compute[103546]:         <nova:user uuid="e1176a2817ef428ea81e2fb18299a306">tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member</nova:user>
Nov 16 03:59:37 user nova-compute[103546]:         <nova:project uuid="6f2a38a5eb514ce8a7569c8322657eac">tempest-ServerBootFromVolumeStableRescueTest-1634874924</nova:project>
Nov 16 03:59:37 user nova-compute[103546]:       </nova:owner>
Nov 16 03:59:37 user nova-compute[103546]:       <nova:root type="image" uuid="5c6f539a-01e5-4478-bf8f-a14310b5d7dd"/>
Nov 16 03:59:37 user nova-compute[103546]:       <nova:ports>
Nov 16 03:59:37 user nova-compute[103546]:         <nova:port uuid="25f18a73-4153-41e2-a4e9-f5ce77367363">
Nov 16 03:59:37 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 03:59:37 user nova-compute[103546]:         </nova:port>
Nov 16 03:59:37 user nova-compute[103546]:       </nova:ports>
Nov 16 03:59:37 user nova-compute[103546]:     </nova:instance>
Nov 16 03:59:37 user nova-compute[103546]:   </metadata>
Nov 16 03:59:37 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 03:59:37 user nova-compute[103546]:     <system>
Nov 16 03:59:37 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 03:59:37 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 03:59:37 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 03:59:37 user nova-compute[103546]:       <entry name="serial">38f7c407-3373-43ba-ac92-7eb0a43a7093</entry>
Nov 16 03:59:37 user nova-compute[103546]:       <entry name="uuid">38f7c407-3373-43ba-ac92-7eb0a43a7093</entry>
Nov 16 03:59:37 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 03:59:37 user nova-compute[103546]:     </system>
Nov 16 03:59:37 user nova-compute[103546]:   </sysinfo>
Nov 16 03:59:37 user nova-compute[103546]:   <os>
Nov 16 03:59:37 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 03:59:37 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 03:59:37 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 03:59:37 user nova-compute[103546]:   </os>
Nov 16 03:59:37 user nova-compute[103546]:   <features>
Nov 16 03:59:37 user nova-compute[103546]:     <acpi/>
Nov 16 03:59:37 user nova-compute[103546]:     <apic/>
Nov 16 03:59:37 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 03:59:37 user nova-compute[103546]:   </features>
Nov 16 03:59:37 user nova-compute[103546]:   <clock offset="utc">
Nov 16 03:59:37 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 03:59:37 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 03:59:37 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 03:59:37 user nova-compute[103546]:   </clock>
Nov 16 03:59:37 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 03:59:37 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 03:59:37 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 03:59:37 user nova-compute[103546]:   </cpu>
Nov 16 03:59:37 user nova-compute[103546]:   <devices>
Nov 16 03:59:37 user nova-compute[103546]:     <disk type="file" device="disk">
Nov 16 03:59:37 user nova-compute[103546]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 03:59:37 user nova-compute[103546]:       <source file="/opt/stack/data/nova/instances/38f7c407-3373-43ba-ac92-7eb0a43a7093/disk"/>
Nov 16 03:59:37 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 03:59:37 user nova-compute[103546]:     </disk>
Nov 16 03:59:37 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 03:59:37 user nova-compute[103546]:       <mac address="fa:16:3e:34:b9:ff"/>
Nov 16 03:59:37 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:59:37 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 03:59:37 user nova-compute[103546]:       <target dev="tap25f18a73-41"/>
Nov 16 03:59:37 user nova-compute[103546]:     </interface>
Nov 16 03:59:37 user nova-compute[103546]:     <serial type="pty">
Nov 16 03:59:37 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/38f7c407-3373-43ba-ac92-7eb0a43a7093/console.log" append="off"/>
Nov 16 03:59:37 user nova-compute[103546]:     </serial>
Nov 16 03:59:37 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 03:59:37 user nova-compute[103546]:     <video>
Nov 16 03:59:37 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:59:37 user nova-compute[103546]:     </video>
Nov 16 03:59:37 user nova-compute[103546]:     <rng model="virtio">
Nov 16 03:59:37 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 03:59:37 user nova-compute[103546]:     </rng>
Nov 16 03:59:37 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 03:59:37 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 03:59:37 user nova-compute[103546]:       <stats period="10"/>
Nov 16 03:59:37 user nova-compute[103546]:     </memballoon>
Nov 16 03:59:37 user nova-compute[103546]:   </devices>
Nov 16 03:59:37 user nova-compute[103546]: </domain>
Nov 16 03:59:37 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:59:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1175423654',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1175423654',id=34,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f2a38a5eb514ce8a7569c8322657eac',ramdisk_id='',reservation_id='r-q94f02i7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1634874924',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:59:36Z,user_data=None,user_id='e1176a2817ef428ea81e2fb18299a306',uuid=38f7c407-3373-43ba-ac92-7eb0a43a7093,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25f18a73-4153-41e2-a4e9-f5ce77367363", "address": "fa:16:3e:34:b9:ff", "network": {"id": "fdbb2d2c-9a54-4517-b33a-cf27ce7570b1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79661471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2a38a5eb514ce8a7569c8322657eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f18a73-41", "ovs_interfaceid": "25f18a73-4153-41e2-a4e9-f5ce77367363", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Converting VIF {"id": "25f18a73-4153-41e2-a4e9-f5ce77367363", "address": "fa:16:3e:34:b9:ff", "network": {"id": "fdbb2d2c-9a54-4517-b33a-cf27ce7570b1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79661471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2a38a5eb514ce8a7569c8322657eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f18a73-41", "ovs_interfaceid": "25f18a73-4153-41e2-a4e9-f5ce77367363", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:b9:ff,bridge_name='br-int',has_traffic_filtering=True,id=25f18a73-4153-41e2-a4e9-f5ce77367363,network=Network(fdbb2d2c-9a54-4517-b33a-cf27ce7570b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25f18a73-41') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG os_vif [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:b9:ff,bridge_name='br-int',has_traffic_filtering=True,id=25f18a73-4153-41e2-a4e9-f5ce77367363,network=Network(fdbb2d2c-9a54-4517-b33a-cf27ce7570b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25f18a73-41') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f1f8f871-7a82-5a9d-8608-1c03a0531351', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap25f18a73-41, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap25f18a73-41, col_values=(('qos', UUID('0d6f2075-d8eb-4096-98f6-ee2a31425e4c')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap25f18a73-41, col_values=(('external_ids', {'iface-id': '25f18a73-4153-41e2-a4e9-f5ce77367363', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:b9:ff', 'vm-uuid': '38f7c407-3373-43ba-ac92-7eb0a43a7093'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:37 user nova-compute[103546]: INFO os_vif [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:b9:ff,bridge_name='br-int',has_traffic_filtering=True,id=25f18a73-4153-41e2-a4e9-f5ce77367363,network=Network(fdbb2d2c-9a54-4517-b33a-cf27ce7570b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25f18a73-41')
Nov 16 03:59:37 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] No VIF found with MAC fa:16:3e:34:b9:ff, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG nova.network.neutron [req-f682b097-3360-44f3-80b7-3da6cbc05635 req-154ce2c4-3f93-45db-b055-3293e25e9874 service nova] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Updated VIF entry in instance network info cache for port 25f18a73-4153-41e2-a4e9-f5ce77367363. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG nova.network.neutron [req-f682b097-3360-44f3-80b7-3da6cbc05635 req-154ce2c4-3f93-45db-b055-3293e25e9874 service nova] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Updating instance_info_cache with network_info: [{"id": "25f18a73-4153-41e2-a4e9-f5ce77367363", "address": "fa:16:3e:34:b9:ff", "network": {"id": "fdbb2d2c-9a54-4517-b33a-cf27ce7570b1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79661471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2a38a5eb514ce8a7569c8322657eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f18a73-41", "ovs_interfaceid": "25f18a73-4153-41e2-a4e9-f5ce77367363", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:59:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-f682b097-3360-44f3-80b7-3da6cbc05635 req-154ce2c4-3f93-45db-b055-3293e25e9874 service nova] Releasing lock "refresh_cache-38f7c407-3373-43ba-ac92-7eb0a43a7093" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:59:38 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:38 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:39 user nova-compute[103546]: DEBUG nova.compute.manager [req-8a6c61e8-ff4e-4fef-b4ed-6aa5f4357044 req-a0d6fb23-59a5-4faf-8148-e7bcefab7c2e service nova] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Received event network-vif-plugged-25f18a73-4153-41e2-a4e9-f5ce77367363 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:59:39 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8a6c61e8-ff4e-4fef-b4ed-6aa5f4357044 req-a0d6fb23-59a5-4faf-8148-e7bcefab7c2e service nova] Acquiring lock "38f7c407-3373-43ba-ac92-7eb0a43a7093-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:59:39 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8a6c61e8-ff4e-4fef-b4ed-6aa5f4357044 req-a0d6fb23-59a5-4faf-8148-e7bcefab7c2e service nova] Lock "38f7c407-3373-43ba-ac92-7eb0a43a7093-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:59:39 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8a6c61e8-ff4e-4fef-b4ed-6aa5f4357044 req-a0d6fb23-59a5-4faf-8148-e7bcefab7c2e service nova] Lock "38f7c407-3373-43ba-ac92-7eb0a43a7093-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:59:39 user nova-compute[103546]: DEBUG nova.compute.manager [req-8a6c61e8-ff4e-4fef-b4ed-6aa5f4357044 req-a0d6fb23-59a5-4faf-8148-e7bcefab7c2e service nova] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] No waiting events found dispatching network-vif-plugged-25f18a73-4153-41e2-a4e9-f5ce77367363 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:59:39 user nova-compute[103546]: WARNING nova.compute.manager [req-8a6c61e8-ff4e-4fef-b4ed-6aa5f4357044 req-a0d6fb23-59a5-4faf-8148-e7bcefab7c2e service nova] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Received unexpected event network-vif-plugged-25f18a73-4153-41e2-a4e9-f5ce77367363 for instance with vm_state building and task_state spawning.
Nov 16 03:59:41 user nova-compute[103546]: DEBUG nova.compute.manager [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 03:59:41 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Guest created on hypervisor {{(pid=103546) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 03:59:41 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Instance spawned successfully.
Nov 16 03:59:41 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 03:59:41 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Found default for hw_cdrom_bus of ide {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:59:41 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Found default for hw_disk_bus of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:59:41 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Found default for hw_input_bus of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:59:41 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Found default for hw_pointer_model of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:59:41 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Found default for hw_video_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:59:41 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Found default for hw_vif_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 03:59:41 user nova-compute[103546]: INFO nova.compute.manager [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Took 5.01 seconds to spawn the instance on the hypervisor.
Nov 16 03:59:41 user nova-compute[103546]: DEBUG nova.compute.manager [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 03:59:41 user nova-compute[103546]: DEBUG nova.compute.manager [req-6ec4bd61-04ae-47c6-91dc-d804aaa9f297 req-59c121b5-bb65-43c4-b214-04b83b402762 service nova] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Received event network-vif-plugged-25f18a73-4153-41e2-a4e9-f5ce77367363 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:59:41 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6ec4bd61-04ae-47c6-91dc-d804aaa9f297 req-59c121b5-bb65-43c4-b214-04b83b402762 service nova] Acquiring lock "38f7c407-3373-43ba-ac92-7eb0a43a7093-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:59:41 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6ec4bd61-04ae-47c6-91dc-d804aaa9f297 req-59c121b5-bb65-43c4-b214-04b83b402762 service nova] Lock "38f7c407-3373-43ba-ac92-7eb0a43a7093-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:59:41 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6ec4bd61-04ae-47c6-91dc-d804aaa9f297 req-59c121b5-bb65-43c4-b214-04b83b402762 service nova] Lock "38f7c407-3373-43ba-ac92-7eb0a43a7093-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:59:41 user nova-compute[103546]: DEBUG nova.compute.manager [req-6ec4bd61-04ae-47c6-91dc-d804aaa9f297 req-59c121b5-bb65-43c4-b214-04b83b402762 service nova] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] No waiting events found dispatching network-vif-plugged-25f18a73-4153-41e2-a4e9-f5ce77367363 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:59:41 user nova-compute[103546]: WARNING nova.compute.manager [req-6ec4bd61-04ae-47c6-91dc-d804aaa9f297 req-59c121b5-bb65-43c4-b214-04b83b402762 service nova] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Received unexpected event network-vif-plugged-25f18a73-4153-41e2-a4e9-f5ce77367363 for instance with vm_state building and task_state spawning.
Nov 16 03:59:41 user nova-compute[103546]: INFO nova.compute.manager [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Took 5.82 seconds to build instance.
Nov 16 03:59:41 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-757be745-1778-42cd-ae4b-64c97b5daafe tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "38f7c407-3373-43ba-ac92-7eb0a43a7093" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.920s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:59:42 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:48 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:56 user nova-compute[103546]: INFO nova.compute.manager [None req-1581a45a-79b9-485c-9c40-2c4556ffa3f6 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Rescuing
Nov 16 03:59:56 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1581a45a-79b9-485c-9c40-2c4556ffa3f6 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Acquiring lock "refresh_cache-246ccf69-847c-4ab2-b709-ad1a85e81eab" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:59:56 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1581a45a-79b9-485c-9c40-2c4556ffa3f6 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Acquired lock "refresh_cache-246ccf69-847c-4ab2-b709-ad1a85e81eab" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:59:56 user nova-compute[103546]: DEBUG nova.network.neutron [None req-1581a45a-79b9-485c-9c40-2c4556ffa3f6 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 03:59:57 user nova-compute[103546]: DEBUG nova.network.neutron [None req-1581a45a-79b9-485c-9c40-2c4556ffa3f6 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Updating instance_info_cache with network_info: [{"id": "84add44b-0c93-4ebc-b45d-2f30d63d900f", "address": "fa:16:3e:13:18:5f", "network": {"id": "337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-40560053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca049d5674dc4c59814f98478752d73d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84add44b-0c", "ovs_interfaceid": "84add44b-0c93-4ebc-b45d-2f30d63d900f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:59:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1581a45a-79b9-485c-9c40-2c4556ffa3f6 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Releasing lock "refresh_cache-246ccf69-847c-4ab2-b709-ad1a85e81eab" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:59:57 user nova-compute[103546]: DEBUG nova.compute.manager [req-85795782-ec86-4c84-b5d6-01e17fb147dd req-51863d93-e6be-4b87-b64a-3729f9e84029 service nova] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] Received event network-changed-c9253207-134c-459d-becb-ba6b70ccd346 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:59:57 user nova-compute[103546]: DEBUG nova.compute.manager [req-85795782-ec86-4c84-b5d6-01e17fb147dd req-51863d93-e6be-4b87-b64a-3729f9e84029 service nova] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] Refreshing instance network info cache due to event network-changed-c9253207-134c-459d-becb-ba6b70ccd346. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 03:59:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-85795782-ec86-4c84-b5d6-01e17fb147dd req-51863d93-e6be-4b87-b64a-3729f9e84029 service nova] Acquiring lock "refresh_cache-8e6fddce-7650-4bf9-8c63-3d6db6ff4726" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 03:59:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-85795782-ec86-4c84-b5d6-01e17fb147dd req-51863d93-e6be-4b87-b64a-3729f9e84029 service nova] Acquired lock "refresh_cache-8e6fddce-7650-4bf9-8c63-3d6db6ff4726" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 03:59:57 user nova-compute[103546]: DEBUG nova.network.neutron [req-85795782-ec86-4c84-b5d6-01e17fb147dd req-51863d93-e6be-4b87-b64a-3729f9e84029 service nova] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] Refreshing network info cache for port c9253207-134c-459d-becb-ba6b70ccd346 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 03:59:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:57 user nova-compute[103546]: DEBUG nova.compute.manager [req-5367eb67-e5ce-43fb-a7f6-533aa021f65f req-84e4bfa3-ad52-4c4d-87ed-6d9ec7b4adfd service nova] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Received event network-vif-unplugged-84add44b-0c93-4ebc-b45d-2f30d63d900f {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:59:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-5367eb67-e5ce-43fb-a7f6-533aa021f65f req-84e4bfa3-ad52-4c4d-87ed-6d9ec7b4adfd service nova] Acquiring lock "246ccf69-847c-4ab2-b709-ad1a85e81eab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:59:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-5367eb67-e5ce-43fb-a7f6-533aa021f65f req-84e4bfa3-ad52-4c4d-87ed-6d9ec7b4adfd service nova] Lock "246ccf69-847c-4ab2-b709-ad1a85e81eab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:59:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-5367eb67-e5ce-43fb-a7f6-533aa021f65f req-84e4bfa3-ad52-4c4d-87ed-6d9ec7b4adfd service nova] Lock "246ccf69-847c-4ab2-b709-ad1a85e81eab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:59:57 user nova-compute[103546]: DEBUG nova.compute.manager [req-5367eb67-e5ce-43fb-a7f6-533aa021f65f req-84e4bfa3-ad52-4c4d-87ed-6d9ec7b4adfd service nova] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] No waiting events found dispatching network-vif-unplugged-84add44b-0c93-4ebc-b45d-2f30d63d900f {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:59:57 user nova-compute[103546]: WARNING nova.compute.manager [req-5367eb67-e5ce-43fb-a7f6-533aa021f65f req-84e4bfa3-ad52-4c4d-87ed-6d9ec7b4adfd service nova] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Received unexpected event network-vif-unplugged-84add44b-0c93-4ebc-b45d-2f30d63d900f for instance with vm_state active and task_state rescuing.
Nov 16 03:59:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-aa5e2d3c-b4b9-4415-85d9-3313aaa50f22 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Acquiring lock "8e6fddce-7650-4bf9-8c63-3d6db6ff4726" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:59:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-aa5e2d3c-b4b9-4415-85d9-3313aaa50f22 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "8e6fddce-7650-4bf9-8c63-3d6db6ff4726" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:59:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-aa5e2d3c-b4b9-4415-85d9-3313aaa50f22 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Acquiring lock "8e6fddce-7650-4bf9-8c63-3d6db6ff4726-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:59:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-aa5e2d3c-b4b9-4415-85d9-3313aaa50f22 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "8e6fddce-7650-4bf9-8c63-3d6db6ff4726-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:59:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-aa5e2d3c-b4b9-4415-85d9-3313aaa50f22 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "8e6fddce-7650-4bf9-8c63-3d6db6ff4726-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:59:57 user nova-compute[103546]: INFO nova.compute.manager [None req-aa5e2d3c-b4b9-4415-85d9-3313aaa50f22 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] Terminating instance
Nov 16 03:59:57 user nova-compute[103546]: DEBUG nova.compute.manager [None req-aa5e2d3c-b4b9-4415-85d9-3313aaa50f22 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] Start destroying the instance on the hypervisor. {{(pid=103546) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 03:59:57 user nova-compute[103546]: DEBUG nova.network.neutron [req-85795782-ec86-4c84-b5d6-01e17fb147dd req-51863d93-e6be-4b87-b64a-3729f9e84029 service nova] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] Updated VIF entry in instance network info cache for port c9253207-134c-459d-becb-ba6b70ccd346. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 03:59:57 user nova-compute[103546]: DEBUG nova.network.neutron [req-85795782-ec86-4c84-b5d6-01e17fb147dd req-51863d93-e6be-4b87-b64a-3729f9e84029 service nova] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] Updating instance_info_cache with network_info: [{"id": "c9253207-134c-459d-becb-ba6b70ccd346", "address": "fa:16:3e:a5:f8:87", "network": {"id": "6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038318316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e30b7ac9515458aa8a6eb1a34cc543a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9253207-13", "ovs_interfaceid": "c9253207-134c-459d-becb-ba6b70ccd346", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:59:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-85795782-ec86-4c84-b5d6-01e17fb147dd req-51863d93-e6be-4b87-b64a-3729f9e84029 service nova] Releasing lock "refresh_cache-8e6fddce-7650-4bf9-8c63-3d6db6ff4726" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 03:59:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:57 user nova-compute[103546]: DEBUG nova.compute.manager [req-728cc2f2-8e32-4872-8630-e46e00e1fc60 req-5199ab0e-0f56-4bc0-b535-a7db0aea37c5 service nova] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] Received event network-vif-unplugged-c9253207-134c-459d-becb-ba6b70ccd346 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:59:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-728cc2f2-8e32-4872-8630-e46e00e1fc60 req-5199ab0e-0f56-4bc0-b535-a7db0aea37c5 service nova] Acquiring lock "8e6fddce-7650-4bf9-8c63-3d6db6ff4726-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:59:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-728cc2f2-8e32-4872-8630-e46e00e1fc60 req-5199ab0e-0f56-4bc0-b535-a7db0aea37c5 service nova] Lock "8e6fddce-7650-4bf9-8c63-3d6db6ff4726-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:59:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-728cc2f2-8e32-4872-8630-e46e00e1fc60 req-5199ab0e-0f56-4bc0-b535-a7db0aea37c5 service nova] Lock "8e6fddce-7650-4bf9-8c63-3d6db6ff4726-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:59:57 user nova-compute[103546]: DEBUG nova.compute.manager [req-728cc2f2-8e32-4872-8630-e46e00e1fc60 req-5199ab0e-0f56-4bc0-b535-a7db0aea37c5 service nova] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] No waiting events found dispatching network-vif-unplugged-c9253207-134c-459d-becb-ba6b70ccd346 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:59:57 user nova-compute[103546]: DEBUG nova.compute.manager [req-728cc2f2-8e32-4872-8630-e46e00e1fc60 req-5199ab0e-0f56-4bc0-b535-a7db0aea37c5 service nova] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] Received event network-vif-unplugged-c9253207-134c-459d-becb-ba6b70ccd346 for instance with task_state deleting. {{(pid=103546) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 03:59:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:57 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Instance destroyed successfully.
Nov 16 03:59:57 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-1581a45a-79b9-485c-9c40-2c4556ffa3f6 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Attempting rescue
Nov 16 03:59:57 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1581a45a-79b9-485c-9c40-2c4556ffa3f6 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=103546) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 16 03:59:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:57 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1581a45a-79b9-485c-9c40-2c4556ffa3f6 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Instance directory exists: not creating {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 16 03:59:57 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-1581a45a-79b9-485c-9c40-2c4556ffa3f6 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Creating image(s)
Nov 16 03:59:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1581a45a-79b9-485c-9c40-2c4556ffa3f6 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Acquiring lock "/opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:59:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1581a45a-79b9-485c-9c40-2c4556ffa3f6 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "/opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:59:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1581a45a-79b9-485c-9c40-2c4556ffa3f6 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "/opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:59:57 user nova-compute[103546]: DEBUG nova.objects.instance [None req-1581a45a-79b9-485c-9c40-2c4556ffa3f6 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lazy-loading 'trusted_certs' on Instance uuid 246ccf69-847c-4ab2-b709-ad1a85e81eab {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:59:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1581a45a-79b9-485c-9c40-2c4556ffa3f6 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Acquiring lock "8c9efafb670bfe5842ba1f4ce398924612164af7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:59:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1581a45a-79b9-485c-9c40-2c4556ffa3f6 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:59:57 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-1581a45a-79b9-485c-9c40-2c4556ffa3f6 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:59:58 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-1581a45a-79b9-485c-9c40-2c4556ffa3f6 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.217s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:59:58 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-1581a45a-79b9-485c-9c40-2c4556ffa3f6 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk.rescue {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 03:59:58 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-1581a45a-79b9-485c-9c40-2c4556ffa3f6 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk.rescue" returned: 0 in 0.052s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 03:59:58 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1581a45a-79b9-485c-9c40-2c4556ffa3f6 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:59:58 user nova-compute[103546]: DEBUG nova.objects.instance [None req-1581a45a-79b9-485c-9c40-2c4556ffa3f6 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lazy-loading 'migration_context' on Instance uuid 246ccf69-847c-4ab2-b709-ad1a85e81eab {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:59:58 user nova-compute[103546]: DEBUG nova.objects.base [None req-1581a45a-79b9-485c-9c40-2c4556ffa3f6 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Object Instance<246ccf69-847c-4ab2-b709-ad1a85e81eab> lazy-loaded attributes: trusted_certs,migration_context {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 03:59:58 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1581a45a-79b9-485c-9c40-2c4556ffa3f6 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Created local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 03:59:58 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1581a45a-79b9-485c-9c40-2c4556ffa3f6 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Start _get_guest_xml network_info=[{"id": "84add44b-0c93-4ebc-b45d-2f30d63d900f", "address": "fa:16:3e:13:18:5f", "network": {"id": "337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-40560053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-40560053-network", "vif_mac": "fa:16:3e:13:18:5f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca049d5674dc4c59814f98478752d73d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84add44b-0c", "ovs_interfaceid": "84add44b-0c93-4ebc-b45d-2f30d63d900f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '5c6f539a-01e5-4478-bf8f-a14310b5d7dd', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 03:59:58 user nova-compute[103546]: DEBUG nova.objects.instance [None req-1581a45a-79b9-485c-9c40-2c4556ffa3f6 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lazy-loading 'resources' on Instance uuid 246ccf69-847c-4ab2-b709-ad1a85e81eab {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:59:58 user nova-compute[103546]: DEBUG nova.objects.base [None req-1581a45a-79b9-485c-9c40-2c4556ffa3f6 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Object Instance<246ccf69-847c-4ab2-b709-ad1a85e81eab> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 03:59:58 user nova-compute[103546]: DEBUG nova.objects.instance [None req-1581a45a-79b9-485c-9c40-2c4556ffa3f6 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lazy-loading 'numa_topology' on Instance uuid 246ccf69-847c-4ab2-b709-ad1a85e81eab {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:59:58 user nova-compute[103546]: DEBUG nova.objects.base [None req-1581a45a-79b9-485c-9c40-2c4556ffa3f6 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Object Instance<246ccf69-847c-4ab2-b709-ad1a85e81eab> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 03:59:58 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-1581a45a-79b9-485c-9c40-2c4556ffa3f6 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:59:58 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-1581a45a-79b9-485c-9c40-2c4556ffa3f6 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 03:59:58 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-1581a45a-79b9-485c-9c40-2c4556ffa3f6 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 03:59:58 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-1581a45a-79b9-485c-9c40-2c4556ffa3f6 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 03:59:58 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-1581a45a-79b9-485c-9c40-2c4556ffa3f6 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 03:59:58 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-1581a45a-79b9-485c-9c40-2c4556ffa3f6 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 03:59:58 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1581a45a-79b9-485c-9c40-2c4556ffa3f6 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 03:59:58 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-1581a45a-79b9-485c-9c40-2c4556ffa3f6 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 03:59:58 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-1581a45a-79b9-485c-9c40-2c4556ffa3f6 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 03:59:58 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-1581a45a-79b9-485c-9c40-2c4556ffa3f6 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 03:59:58 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-1581a45a-79b9-485c-9c40-2c4556ffa3f6 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 03:59:58 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-1581a45a-79b9-485c-9c40-2c4556ffa3f6 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 03:59:58 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-1581a45a-79b9-485c-9c40-2c4556ffa3f6 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 03:59:58 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-1581a45a-79b9-485c-9c40-2c4556ffa3f6 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 03:59:58 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-1581a45a-79b9-485c-9c40-2c4556ffa3f6 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 03:59:58 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-1581a45a-79b9-485c-9c40-2c4556ffa3f6 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 03:59:58 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-1581a45a-79b9-485c-9c40-2c4556ffa3f6 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 03:59:58 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-1581a45a-79b9-485c-9c40-2c4556ffa3f6 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 03:59:58 user nova-compute[103546]: DEBUG nova.objects.instance [None req-1581a45a-79b9-485c-9c40-2c4556ffa3f6 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lazy-loading 'vcpu_model' on Instance uuid 246ccf69-847c-4ab2-b709-ad1a85e81eab {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:59:58 user nova-compute[103546]: DEBUG nova.objects.base [None req-1581a45a-79b9-485c-9c40-2c4556ffa3f6 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Object Instance<246ccf69-847c-4ab2-b709-ad1a85e81eab> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 03:59:58 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-1581a45a-79b9-485c-9c40-2c4556ffa3f6 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:55:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2068912145',display_name='tempest-ServerRescueNegativeTestJSON-server-2068912145',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2068912145',id=27,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:55:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ca049d5674dc4c59814f98478752d73d',ramdisk_id='',reservation_id='r-rkqsk0gl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1943614153',owner_user_name='tempest-ServerRescueNegativeTestJSON-1943614153-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T03:55:20Z,user_data=None,user_id='7626749c82fb4b5c81e696e4beeed858',uuid=246ccf69-847c-4ab2-b709-ad1a85e81eab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84add44b-0c93-4ebc-b45d-2f30d63d900f", "address": "fa:16:3e:13:18:5f", "network": {"id": "337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-40560053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-40560053-network", "vif_mac": "fa:16:3e:13:18:5f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca049d5674dc4c59814f98478752d73d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84add44b-0c", "ovs_interfaceid": "84add44b-0c93-4ebc-b45d-2f30d63d900f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 03:59:58 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-1581a45a-79b9-485c-9c40-2c4556ffa3f6 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Converting VIF {"id": "84add44b-0c93-4ebc-b45d-2f30d63d900f", "address": "fa:16:3e:13:18:5f", "network": {"id": "337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-40560053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-40560053-network", "vif_mac": "fa:16:3e:13:18:5f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca049d5674dc4c59814f98478752d73d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84add44b-0c", "ovs_interfaceid": "84add44b-0c93-4ebc-b45d-2f30d63d900f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:59:58 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-1581a45a-79b9-485c-9c40-2c4556ffa3f6 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:18:5f,bridge_name='br-int',has_traffic_filtering=True,id=84add44b-0c93-4ebc-b45d-2f30d63d900f,network=Network(337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84add44b-0c') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:59:58 user nova-compute[103546]: DEBUG nova.objects.instance [None req-1581a45a-79b9-485c-9c40-2c4556ffa3f6 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lazy-loading 'pci_devices' on Instance uuid 246ccf69-847c-4ab2-b709-ad1a85e81eab {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:59:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:58 user nova-compute[103546]: DEBUG nova.objects.base [None req-1581a45a-79b9-485c-9c40-2c4556ffa3f6 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Object Instance<246ccf69-847c-4ab2-b709-ad1a85e81eab> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 03:59:58 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1581a45a-79b9-485c-9c40-2c4556ffa3f6 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] End _get_guest_xml xml=<domain type="kvm">
Nov 16 03:59:58 user nova-compute[103546]:   <uuid>246ccf69-847c-4ab2-b709-ad1a85e81eab</uuid>
Nov 16 03:59:58 user nova-compute[103546]:   <name>instance-0000001b</name>
Nov 16 03:59:58 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 03:59:58 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 03:59:58 user nova-compute[103546]:   <metadata>
Nov 16 03:59:58 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 03:59:58 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 03:59:58 user nova-compute[103546]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2068912145</nova:name>
Nov 16 03:59:58 user nova-compute[103546]:       <nova:creationTime>2023-11-16 03:59:58</nova:creationTime>
Nov 16 03:59:58 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 03:59:58 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 03:59:58 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 03:59:58 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 03:59:58 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 03:59:58 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 03:59:58 user nova-compute[103546]:       </nova:flavor>
Nov 16 03:59:58 user nova-compute[103546]:       <nova:owner>
Nov 16 03:59:58 user nova-compute[103546]:         <nova:user uuid="7626749c82fb4b5c81e696e4beeed858">tempest-ServerRescueNegativeTestJSON-1943614153-project-member</nova:user>
Nov 16 03:59:58 user nova-compute[103546]:         <nova:project uuid="ca049d5674dc4c59814f98478752d73d">tempest-ServerRescueNegativeTestJSON-1943614153</nova:project>
Nov 16 03:59:58 user nova-compute[103546]:       </nova:owner>
Nov 16 03:59:58 user nova-compute[103546]:       <nova:root type="image" uuid="5c6f539a-01e5-4478-bf8f-a14310b5d7dd"/>
Nov 16 03:59:58 user nova-compute[103546]:       <nova:ports>
Nov 16 03:59:58 user nova-compute[103546]:         <nova:port uuid="84add44b-0c93-4ebc-b45d-2f30d63d900f">
Nov 16 03:59:58 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 16 03:59:58 user nova-compute[103546]:         </nova:port>
Nov 16 03:59:58 user nova-compute[103546]:       </nova:ports>
Nov 16 03:59:58 user nova-compute[103546]:     </nova:instance>
Nov 16 03:59:58 user nova-compute[103546]:   </metadata>
Nov 16 03:59:58 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 03:59:58 user nova-compute[103546]:     <system>
Nov 16 03:59:58 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 03:59:58 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 03:59:58 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 03:59:58 user nova-compute[103546]:       <entry name="serial">246ccf69-847c-4ab2-b709-ad1a85e81eab</entry>
Nov 16 03:59:58 user nova-compute[103546]:       <entry name="uuid">246ccf69-847c-4ab2-b709-ad1a85e81eab</entry>
Nov 16 03:59:58 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 03:59:58 user nova-compute[103546]:     </system>
Nov 16 03:59:58 user nova-compute[103546]:   </sysinfo>
Nov 16 03:59:58 user nova-compute[103546]:   <os>
Nov 16 03:59:58 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 03:59:58 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 03:59:58 user nova-compute[103546]:   </os>
Nov 16 03:59:58 user nova-compute[103546]:   <features>
Nov 16 03:59:58 user nova-compute[103546]:     <acpi/>
Nov 16 03:59:58 user nova-compute[103546]:     <apic/>
Nov 16 03:59:58 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 03:59:58 user nova-compute[103546]:   </features>
Nov 16 03:59:58 user nova-compute[103546]:   <clock offset="utc">
Nov 16 03:59:58 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 03:59:58 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 03:59:58 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 03:59:58 user nova-compute[103546]:   </clock>
Nov 16 03:59:58 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 03:59:58 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 03:59:58 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 03:59:58 user nova-compute[103546]:   </cpu>
Nov 16 03:59:58 user nova-compute[103546]:   <devices>
Nov 16 03:59:58 user nova-compute[103546]:     <disk type="file" device="disk">
Nov 16 03:59:58 user nova-compute[103546]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 03:59:58 user nova-compute[103546]:       <source file="/opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk.rescue"/>
Nov 16 03:59:58 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 03:59:58 user nova-compute[103546]:     </disk>
Nov 16 03:59:58 user nova-compute[103546]:     <disk type="file" device="disk">
Nov 16 03:59:58 user nova-compute[103546]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 03:59:58 user nova-compute[103546]:       <source file="/opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk"/>
Nov 16 03:59:58 user nova-compute[103546]:       <target dev="vdb" bus="virtio"/>
Nov 16 03:59:58 user nova-compute[103546]:     </disk>
Nov 16 03:59:58 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 03:59:58 user nova-compute[103546]:       <mac address="fa:16:3e:13:18:5f"/>
Nov 16 03:59:58 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:59:58 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 03:59:58 user nova-compute[103546]:       <target dev="tap84add44b-0c"/>
Nov 16 03:59:58 user nova-compute[103546]:     </interface>
Nov 16 03:59:58 user nova-compute[103546]:     <serial type="pty">
Nov 16 03:59:58 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/console.log" append="off"/>
Nov 16 03:59:58 user nova-compute[103546]:     </serial>
Nov 16 03:59:58 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 03:59:58 user nova-compute[103546]:     <video>
Nov 16 03:59:58 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 03:59:58 user nova-compute[103546]:     </video>
Nov 16 03:59:58 user nova-compute[103546]:     <rng model="virtio">
Nov 16 03:59:58 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 03:59:58 user nova-compute[103546]:     </rng>
Nov 16 03:59:58 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 03:59:58 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 03:59:58 user nova-compute[103546]:       <stats period="10"/>
Nov 16 03:59:58 user nova-compute[103546]:     </memballoon>
Nov 16 03:59:58 user nova-compute[103546]:   </devices>
Nov 16 03:59:58 user nova-compute[103546]: </domain>
Nov 16 03:59:58 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 03:59:58 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] Instance destroyed successfully.
Nov 16 03:59:58 user nova-compute[103546]: DEBUG nova.objects.instance [None req-aa5e2d3c-b4b9-4415-85d9-3313aaa50f22 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lazy-loading 'resources' on Instance uuid 8e6fddce-7650-4bf9-8c63-3d6db6ff4726 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 03:59:58 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Instance destroyed successfully.
Nov 16 03:59:58 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-aa5e2d3c-b4b9-4415-85d9-3313aaa50f22 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:58:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-543146264',display_name='tempest-AttachVolumeNegativeTest-server-543146264',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-543146264',id=32,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjY//FeSMjnHH8p2HhPRIAaGvy65QA1urCliLX+NI7R540IP9DKTRI0PBWuy8kW9PO9nBXnEBUa1HmgqwjXN82NZQ+J1RoLdFH/k1BGb9oavm0R+vlaapGz8aGaQFI9Tg==',key_name='tempest-keypair-1808058804',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:58:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8e30b7ac9515458aa8a6eb1a34cc543a',ramdisk_id='',reservation_id='r-nuzon9nm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-64216432',owner_user_name='tempest-AttachVolumeNegativeTest-64216432-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T03:58:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d186163bddc48319b97f186f7c65e80',uuid=8e6fddce-7650-4bf9-8c63-3d6db6ff4726,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9253207-134c-459d-becb-ba6b70ccd346", "address": "fa:16:3e:a5:f8:87", "network": {"id": "6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038318316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e30b7ac9515458aa8a6eb1a34cc543a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9253207-13", "ovs_interfaceid": "c9253207-134c-459d-becb-ba6b70ccd346", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 03:59:58 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-aa5e2d3c-b4b9-4415-85d9-3313aaa50f22 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Converting VIF {"id": "c9253207-134c-459d-becb-ba6b70ccd346", "address": "fa:16:3e:a5:f8:87", "network": {"id": "6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038318316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e30b7ac9515458aa8a6eb1a34cc543a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9253207-13", "ovs_interfaceid": "c9253207-134c-459d-becb-ba6b70ccd346", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 03:59:58 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-aa5e2d3c-b4b9-4415-85d9-3313aaa50f22 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:f8:87,bridge_name='br-int',has_traffic_filtering=True,id=c9253207-134c-459d-becb-ba6b70ccd346,network=Network(6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9253207-13') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 03:59:58 user nova-compute[103546]: DEBUG os_vif [None req-aa5e2d3c-b4b9-4415-85d9-3313aaa50f22 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:f8:87,bridge_name='br-int',has_traffic_filtering=True,id=c9253207-134c-459d-becb-ba6b70ccd346,network=Network(6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9253207-13') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 03:59:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc9253207-13, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:59:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:59:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=07c1cf1d-ba44-458e-ac1d-380a6a4a32ec) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 03:59:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 03:59:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:58 user nova-compute[103546]: INFO os_vif [None req-aa5e2d3c-b4b9-4415-85d9-3313aaa50f22 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:f8:87,bridge_name='br-int',has_traffic_filtering=True,id=c9253207-134c-459d-becb-ba6b70ccd346,network=Network(6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9253207-13')
Nov 16 03:59:58 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-aa5e2d3c-b4b9-4415-85d9-3313aaa50f22 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] Deleting instance files /opt/stack/data/nova/instances/8e6fddce-7650-4bf9-8c63-3d6db6ff4726_del
Nov 16 03:59:58 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-aa5e2d3c-b4b9-4415-85d9-3313aaa50f22 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] Deletion of /opt/stack/data/nova/instances/8e6fddce-7650-4bf9-8c63-3d6db6ff4726_del complete
Nov 16 03:59:58 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1581a45a-79b9-485c-9c40-2c4556ffa3f6 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:59:58 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1581a45a-79b9-485c-9c40-2c4556ffa3f6 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] No BDM found with device name vdb, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 03:59:58 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1581a45a-79b9-485c-9c40-2c4556ffa3f6 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] No VIF found with MAC fa:16:3e:13:18:5f, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 03:59:58 user nova-compute[103546]: INFO nova.compute.manager [None req-aa5e2d3c-b4b9-4415-85d9-3313aaa50f22 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 16 03:59:58 user nova-compute[103546]: DEBUG oslo.service.loopingcall [None req-aa5e2d3c-b4b9-4415-85d9-3313aaa50f22 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=103546) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 03:59:58 user nova-compute[103546]: DEBUG nova.compute.manager [-] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] Deallocating network for instance {{(pid=103546) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 03:59:58 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] deallocate_for_instance() {{(pid=103546) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 03:59:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:59 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 03:59:59 user nova-compute[103546]: INFO nova.compute.manager [-] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] Took 0.76 seconds to deallocate network for instance.
Nov 16 03:59:59 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-aa5e2d3c-b4b9-4415-85d9-3313aaa50f22 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:59:59 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-aa5e2d3c-b4b9-4415-85d9-3313aaa50f22 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:59:59 user nova-compute[103546]: DEBUG nova.compute.manager [req-5fe32d67-68a1-4c6a-8c9d-e7f28fc13367 req-3d6d2e44-93f6-4d60-9fe7-f81a752116c4 service nova] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Received event network-vif-plugged-84add44b-0c93-4ebc-b45d-2f30d63d900f {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 03:59:59 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-5fe32d67-68a1-4c6a-8c9d-e7f28fc13367 req-3d6d2e44-93f6-4d60-9fe7-f81a752116c4 service nova] Acquiring lock "246ccf69-847c-4ab2-b709-ad1a85e81eab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 03:59:59 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-5fe32d67-68a1-4c6a-8c9d-e7f28fc13367 req-3d6d2e44-93f6-4d60-9fe7-f81a752116c4 service nova] Lock "246ccf69-847c-4ab2-b709-ad1a85e81eab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 03:59:59 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-5fe32d67-68a1-4c6a-8c9d-e7f28fc13367 req-3d6d2e44-93f6-4d60-9fe7-f81a752116c4 service nova] Lock "246ccf69-847c-4ab2-b709-ad1a85e81eab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:59:59 user nova-compute[103546]: DEBUG nova.compute.manager [req-5fe32d67-68a1-4c6a-8c9d-e7f28fc13367 req-3d6d2e44-93f6-4d60-9fe7-f81a752116c4 service nova] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] No waiting events found dispatching network-vif-plugged-84add44b-0c93-4ebc-b45d-2f30d63d900f {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 03:59:59 user nova-compute[103546]: WARNING nova.compute.manager [req-5fe32d67-68a1-4c6a-8c9d-e7f28fc13367 req-3d6d2e44-93f6-4d60-9fe7-f81a752116c4 service nova] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Received unexpected event network-vif-plugged-84add44b-0c93-4ebc-b45d-2f30d63d900f for instance with vm_state active and task_state rescuing.
Nov 16 03:59:59 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-aa5e2d3c-b4b9-4415-85d9-3313aaa50f22 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 03:59:59 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-aa5e2d3c-b4b9-4415-85d9-3313aaa50f22 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 03:59:59 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-aa5e2d3c-b4b9-4415-85d9-3313aaa50f22 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.337s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:59:59 user nova-compute[103546]: INFO nova.scheduler.client.report [None req-aa5e2d3c-b4b9-4415-85d9-3313aaa50f22 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Deleted allocations for instance 8e6fddce-7650-4bf9-8c63-3d6db6ff4726
Nov 16 03:59:59 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:59 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:59 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:59 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:59 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-aa5e2d3c-b4b9-4415-85d9-3313aaa50f22 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "8e6fddce-7650-4bf9-8c63-3d6db6ff4726" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.265s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 03:59:59 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 03:59:59 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:00:00 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:00:00 user nova-compute[103546]: DEBUG nova.compute.manager [req-80a089e2-4706-4bd9-87a4-b8d7a7216dcf req-b15a5bc1-7372-4e7d-975f-633cf7f88fbb service nova] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] Received event network-vif-plugged-c9253207-134c-459d-becb-ba6b70ccd346 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:00:00 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-80a089e2-4706-4bd9-87a4-b8d7a7216dcf req-b15a5bc1-7372-4e7d-975f-633cf7f88fbb service nova] Acquiring lock "8e6fddce-7650-4bf9-8c63-3d6db6ff4726-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:00:00 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-80a089e2-4706-4bd9-87a4-b8d7a7216dcf req-b15a5bc1-7372-4e7d-975f-633cf7f88fbb service nova] Lock "8e6fddce-7650-4bf9-8c63-3d6db6ff4726-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:00:00 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-80a089e2-4706-4bd9-87a4-b8d7a7216dcf req-b15a5bc1-7372-4e7d-975f-633cf7f88fbb service nova] Lock "8e6fddce-7650-4bf9-8c63-3d6db6ff4726-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:00:00 user nova-compute[103546]: DEBUG nova.compute.manager [req-80a089e2-4706-4bd9-87a4-b8d7a7216dcf req-b15a5bc1-7372-4e7d-975f-633cf7f88fbb service nova] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] No waiting events found dispatching network-vif-plugged-c9253207-134c-459d-becb-ba6b70ccd346 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:00:00 user nova-compute[103546]: WARNING nova.compute.manager [req-80a089e2-4706-4bd9-87a4-b8d7a7216dcf req-b15a5bc1-7372-4e7d-975f-633cf7f88fbb service nova] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] Received unexpected event network-vif-plugged-c9253207-134c-459d-becb-ba6b70ccd346 for instance with vm_state deleted and task_state None.
Nov 16 04:00:00 user nova-compute[103546]: DEBUG nova.compute.manager [req-80a089e2-4706-4bd9-87a4-b8d7a7216dcf req-b15a5bc1-7372-4e7d-975f-633cf7f88fbb service nova] [instance: 8e6fddce-7650-4bf9-8c63-3d6db6ff4726] Received event network-vif-deleted-c9253207-134c-459d-becb-ba6b70ccd346 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:00:01 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4e1aa08d-031c-400b-a239-3f663137253e tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Acquiring lock "f4065a1b-10a0-4b2a-9088-a703a7c4e064" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:00:01 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4e1aa08d-031c-400b-a239-3f663137253e tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "f4065a1b-10a0-4b2a-9088-a703a7c4e064" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:00:01 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4e1aa08d-031c-400b-a239-3f663137253e tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Acquiring lock "f4065a1b-10a0-4b2a-9088-a703a7c4e064-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:00:01 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4e1aa08d-031c-400b-a239-3f663137253e tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "f4065a1b-10a0-4b2a-9088-a703a7c4e064-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:00:01 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4e1aa08d-031c-400b-a239-3f663137253e tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "f4065a1b-10a0-4b2a-9088-a703a7c4e064-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:00:01 user nova-compute[103546]: INFO nova.compute.manager [None req-4e1aa08d-031c-400b-a239-3f663137253e tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Terminating instance
Nov 16 04:00:01 user nova-compute[103546]: DEBUG nova.compute.manager [None req-4e1aa08d-031c-400b-a239-3f663137253e tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Start destroying the instance on the hypervisor. {{(pid=103546) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 04:00:01 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:00:01 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:00:01 user nova-compute[103546]: DEBUG nova.compute.manager [req-37497b49-460a-40fc-8501-2542f84b70cb req-0fa77551-6280-4def-b9df-631f58e20704 service nova] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Received event network-vif-plugged-84add44b-0c93-4ebc-b45d-2f30d63d900f {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:00:01 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-37497b49-460a-40fc-8501-2542f84b70cb req-0fa77551-6280-4def-b9df-631f58e20704 service nova] Acquiring lock "246ccf69-847c-4ab2-b709-ad1a85e81eab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:00:01 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-37497b49-460a-40fc-8501-2542f84b70cb req-0fa77551-6280-4def-b9df-631f58e20704 service nova] Lock "246ccf69-847c-4ab2-b709-ad1a85e81eab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:00:01 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-37497b49-460a-40fc-8501-2542f84b70cb req-0fa77551-6280-4def-b9df-631f58e20704 service nova] Lock "246ccf69-847c-4ab2-b709-ad1a85e81eab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:00:01 user nova-compute[103546]: DEBUG nova.compute.manager [req-37497b49-460a-40fc-8501-2542f84b70cb req-0fa77551-6280-4def-b9df-631f58e20704 service nova] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] No waiting events found dispatching network-vif-plugged-84add44b-0c93-4ebc-b45d-2f30d63d900f {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:00:01 user nova-compute[103546]: WARNING nova.compute.manager [req-37497b49-460a-40fc-8501-2542f84b70cb req-0fa77551-6280-4def-b9df-631f58e20704 service nova] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Received unexpected event network-vif-plugged-84add44b-0c93-4ebc-b45d-2f30d63d900f for instance with vm_state active and task_state rescuing.
Nov 16 04:00:01 user nova-compute[103546]: DEBUG nova.compute.manager [req-37497b49-460a-40fc-8501-2542f84b70cb req-0fa77551-6280-4def-b9df-631f58e20704 service nova] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Received event network-vif-plugged-84add44b-0c93-4ebc-b45d-2f30d63d900f {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:00:01 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-37497b49-460a-40fc-8501-2542f84b70cb req-0fa77551-6280-4def-b9df-631f58e20704 service nova] Acquiring lock "246ccf69-847c-4ab2-b709-ad1a85e81eab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:00:01 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-37497b49-460a-40fc-8501-2542f84b70cb req-0fa77551-6280-4def-b9df-631f58e20704 service nova] Lock "246ccf69-847c-4ab2-b709-ad1a85e81eab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:00:01 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-37497b49-460a-40fc-8501-2542f84b70cb req-0fa77551-6280-4def-b9df-631f58e20704 service nova] Lock "246ccf69-847c-4ab2-b709-ad1a85e81eab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:00:01 user nova-compute[103546]: DEBUG nova.compute.manager [req-37497b49-460a-40fc-8501-2542f84b70cb req-0fa77551-6280-4def-b9df-631f58e20704 service nova] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] No waiting events found dispatching network-vif-plugged-84add44b-0c93-4ebc-b45d-2f30d63d900f {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:00:01 user nova-compute[103546]: WARNING nova.compute.manager [req-37497b49-460a-40fc-8501-2542f84b70cb req-0fa77551-6280-4def-b9df-631f58e20704 service nova] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Received unexpected event network-vif-plugged-84add44b-0c93-4ebc-b45d-2f30d63d900f for instance with vm_state active and task_state rescuing.
Nov 16 04:00:01 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:00:01 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:00:01 user nova-compute[103546]: DEBUG nova.compute.manager [None req-1581a45a-79b9-485c-9c40-2c4556ffa3f6 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 04:00:02 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Instance destroyed successfully.
Nov 16 04:00:02 user nova-compute[103546]: DEBUG nova.objects.instance [None req-4e1aa08d-031c-400b-a239-3f663137253e tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lazy-loading 'resources' on Instance uuid f4065a1b-10a0-4b2a-9088-a703a7c4e064 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:00:02 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-4e1aa08d-031c-400b-a239-3f663137253e tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T03:54:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1025315495',display_name='tempest-ServerActionsTestOtherA-server-266370165',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1025315495',id=24,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPsowU+DxXGj+EwRCt8oPsJDiFFQ1t3et4Wt5bZ1kwjAb+70RLl9mpMNr3QanWoL9YswsQhH0dcFmnUwAGlTlrni8Jn0NM/Wnv7EVtjYYBmh+ct83CyqQ55pikSB2BGp8A==',key_name='tempest-keypair-185377902',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:56:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72b30a015db444798ee72ff6fd14c69e',ramdisk_id='',reservation_id='r-dcagc0xa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1488667220',owner_user_name='tempest-ServerActionsTestOtherA-1488667220-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T03:56:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e471c69657c745bbbdfc82307a49946f',uuid=f4065a1b-10a0-4b2a-9088-a703a7c4e064,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7471b1be-a897-4ef9-8dbe-8c6962cfbd31", "address": "fa:16:3e:64:f3:d9", "network": {"id": "29e9620f-313d-4679-89d7-459e7cf75b38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1690634205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72b30a015db444798ee72ff6fd14c69e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7471b1be-a8", "ovs_interfaceid": "7471b1be-a897-4ef9-8dbe-8c6962cfbd31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 04:00:02 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-4e1aa08d-031c-400b-a239-3f663137253e tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Converting VIF {"id": "7471b1be-a897-4ef9-8dbe-8c6962cfbd31", "address": "fa:16:3e:64:f3:d9", "network": {"id": "29e9620f-313d-4679-89d7-459e7cf75b38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1690634205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72b30a015db444798ee72ff6fd14c69e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7471b1be-a8", "ovs_interfaceid": "7471b1be-a897-4ef9-8dbe-8c6962cfbd31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:00:02 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-4e1aa08d-031c-400b-a239-3f663137253e tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:64:f3:d9,bridge_name='br-int',has_traffic_filtering=True,id=7471b1be-a897-4ef9-8dbe-8c6962cfbd31,network=Network(29e9620f-313d-4679-89d7-459e7cf75b38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7471b1be-a8') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:00:02 user nova-compute[103546]: DEBUG os_vif [None req-4e1aa08d-031c-400b-a239-3f663137253e tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:f3:d9,bridge_name='br-int',has_traffic_filtering=True,id=7471b1be-a897-4ef9-8dbe-8c6962cfbd31,network=Network(29e9620f-313d-4679-89d7-459e7cf75b38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7471b1be-a8') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 04:00:02 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:00:02 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7471b1be-a8, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:00:02 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:00:02 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:00:02 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:00:02 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=42a03687-e21a-4c77-8a0c-dbda56047f5a) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:00:02 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:00:02 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:00:02 user nova-compute[103546]: INFO os_vif [None req-4e1aa08d-031c-400b-a239-3f663137253e tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:f3:d9,bridge_name='br-int',has_traffic_filtering=True,id=7471b1be-a897-4ef9-8dbe-8c6962cfbd31,network=Network(29e9620f-313d-4679-89d7-459e7cf75b38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7471b1be-a8')
Nov 16 04:00:02 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-4e1aa08d-031c-400b-a239-3f663137253e tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Deleting instance files /opt/stack/data/nova/instances/f4065a1b-10a0-4b2a-9088-a703a7c4e064_del
Nov 16 04:00:02 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-4e1aa08d-031c-400b-a239-3f663137253e tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Deletion of /opt/stack/data/nova/instances/f4065a1b-10a0-4b2a-9088-a703a7c4e064_del complete
Nov 16 04:00:02 user nova-compute[103546]: INFO nova.compute.manager [None req-4e1aa08d-031c-400b-a239-3f663137253e tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 16 04:00:02 user nova-compute[103546]: DEBUG oslo.service.loopingcall [None req-4e1aa08d-031c-400b-a239-3f663137253e tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=103546) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 04:00:02 user nova-compute[103546]: DEBUG nova.compute.manager [-] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Deallocating network for instance {{(pid=103546) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 04:00:02 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] deallocate_for_instance() {{(pid=103546) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 04:00:02 user nova-compute[103546]: DEBUG nova.compute.manager [req-808531ec-d99a-4283-9518-f4f35c68dfaa req-4ffa37a9-8c6a-471e-b20b-91b64a6e4422 service nova] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Received event network-vif-unplugged-7471b1be-a897-4ef9-8dbe-8c6962cfbd31 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:00:02 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-808531ec-d99a-4283-9518-f4f35c68dfaa req-4ffa37a9-8c6a-471e-b20b-91b64a6e4422 service nova] Acquiring lock "f4065a1b-10a0-4b2a-9088-a703a7c4e064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:00:02 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-808531ec-d99a-4283-9518-f4f35c68dfaa req-4ffa37a9-8c6a-471e-b20b-91b64a6e4422 service nova] Lock "f4065a1b-10a0-4b2a-9088-a703a7c4e064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:00:02 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-808531ec-d99a-4283-9518-f4f35c68dfaa req-4ffa37a9-8c6a-471e-b20b-91b64a6e4422 service nova] Lock "f4065a1b-10a0-4b2a-9088-a703a7c4e064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:00:02 user nova-compute[103546]: DEBUG nova.compute.manager [req-808531ec-d99a-4283-9518-f4f35c68dfaa req-4ffa37a9-8c6a-471e-b20b-91b64a6e4422 service nova] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] No waiting events found dispatching network-vif-unplugged-7471b1be-a897-4ef9-8dbe-8c6962cfbd31 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:00:02 user nova-compute[103546]: DEBUG nova.compute.manager [req-808531ec-d99a-4283-9518-f4f35c68dfaa req-4ffa37a9-8c6a-471e-b20b-91b64a6e4422 service nova] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Received event network-vif-unplugged-7471b1be-a897-4ef9-8dbe-8c6962cfbd31 for instance with task_state deleting. {{(pid=103546) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 04:00:02 user nova-compute[103546]: DEBUG nova.compute.manager [req-808531ec-d99a-4283-9518-f4f35c68dfaa req-4ffa37a9-8c6a-471e-b20b-91b64a6e4422 service nova] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Received event network-vif-plugged-7471b1be-a897-4ef9-8dbe-8c6962cfbd31 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:00:02 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-808531ec-d99a-4283-9518-f4f35c68dfaa req-4ffa37a9-8c6a-471e-b20b-91b64a6e4422 service nova] Acquiring lock "f4065a1b-10a0-4b2a-9088-a703a7c4e064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:00:02 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-808531ec-d99a-4283-9518-f4f35c68dfaa req-4ffa37a9-8c6a-471e-b20b-91b64a6e4422 service nova] Lock "f4065a1b-10a0-4b2a-9088-a703a7c4e064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:00:02 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-808531ec-d99a-4283-9518-f4f35c68dfaa req-4ffa37a9-8c6a-471e-b20b-91b64a6e4422 service nova] Lock "f4065a1b-10a0-4b2a-9088-a703a7c4e064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:00:02 user nova-compute[103546]: DEBUG nova.compute.manager [req-808531ec-d99a-4283-9518-f4f35c68dfaa req-4ffa37a9-8c6a-471e-b20b-91b64a6e4422 service nova] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] No waiting events found dispatching network-vif-plugged-7471b1be-a897-4ef9-8dbe-8c6962cfbd31 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:00:02 user nova-compute[103546]: WARNING nova.compute.manager [req-808531ec-d99a-4283-9518-f4f35c68dfaa req-4ffa37a9-8c6a-471e-b20b-91b64a6e4422 service nova] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Received unexpected event network-vif-plugged-7471b1be-a897-4ef9-8dbe-8c6962cfbd31 for instance with vm_state active and task_state deleting.
Nov 16 04:00:02 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:00:02 user nova-compute[103546]: INFO nova.compute.manager [-] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Took 0.72 seconds to deallocate network for instance.
Nov 16 04:00:02 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4e1aa08d-031c-400b-a239-3f663137253e tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:00:02 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4e1aa08d-031c-400b-a239-3f663137253e tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:00:03 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-4e1aa08d-031c-400b-a239-3f663137253e tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:00:03 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-4e1aa08d-031c-400b-a239-3f663137253e tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:00:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4e1aa08d-031c-400b-a239-3f663137253e tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.327s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:00:03 user nova-compute[103546]: INFO nova.scheduler.client.report [None req-4e1aa08d-031c-400b-a239-3f663137253e tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Deleted allocations for instance f4065a1b-10a0-4b2a-9088-a703a7c4e064
Nov 16 04:00:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4e1aa08d-031c-400b-a239-3f663137253e tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "f4065a1b-10a0-4b2a-9088-a703a7c4e064" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.142s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:00:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:00:04 user nova-compute[103546]: DEBUG nova.compute.manager [req-76ba5fb5-925b-4e84-8835-775e55141014 req-2d84dd75-6b96-4b87-a16b-23516d56a4c8 service nova] [instance: f4065a1b-10a0-4b2a-9088-a703a7c4e064] Received event network-vif-deleted-7471b1be-a897-4ef9-8dbe-8c6962cfbd31 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:00:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:00:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:00:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquiring lock "e5b2903b-053a-4671-af52-aa08e0b220b8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:00:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "e5b2903b-053a-4671-af52-aa08e0b220b8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:00:11 user nova-compute[103546]: DEBUG nova.compute.manager [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Starting instance... {{(pid=103546) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 04:00:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:00:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:00:11 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=103546) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 04:00:11 user nova-compute[103546]: INFO nova.compute.claims [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Claim successful on node user
Nov 16 04:00:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:00:12 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:00:12 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:00:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.404s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:00:12 user nova-compute[103546]: DEBUG nova.compute.manager [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Start building networks asynchronously for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 04:00:12 user nova-compute[103546]: DEBUG nova.compute.manager [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Allocating IP information in the background. {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 04:00:12 user nova-compute[103546]: DEBUG nova.network.neutron [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] allocate_for_instance() {{(pid=103546) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 04:00:12 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 04:00:12 user nova-compute[103546]: DEBUG nova.compute.manager [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Start building block device mappings for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 04:00:12 user nova-compute[103546]: DEBUG nova.policy [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ab77040a7b9846d28dc08852d678d1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ce50192a9743b59a9430163dd6a51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103546) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 04:00:12 user nova-compute[103546]: INFO nova.virt.block_device [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Booting with volume 6dd96488-81c4-484b-ada5-812f7adb960e at /dev/vda
Nov 16 04:00:12 user nova-compute[103546]: DEBUG os_brick.utils [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:00:12 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:00:12 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:00:12 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[643d24bf-bbdd-45bc-ad2c-89d03342c2cb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af5c39b14ece\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:00:12 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:00:12 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:00:12 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[900822c2-bdb4-48f5-8324-a4927bc54f56]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:00:12 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:00:12 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:00:12 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8388d1-619b-48ef-a326-af2b7a38dedf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:00:12 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c468310-178c-4300-b93b-11fb588b7db4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:00:12 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Running cmd (subprocess): nvme version {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:00:12 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] 'nvme version' failed. Not Retrying. {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 04:00:12 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] nvme not present on system {{(pid=103546) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 04:00:12 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:00:12 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 04:00:12 user nova-compute[103546]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 04:00:12 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1b95cc-8d45-4614-a11b-de04ea9e34b6]: (4, '') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:00:12 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=103546) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 04:00:12 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 04:00:12 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] LIGHTOS: no hostnqn found. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 04:00:12 user nova-compute[103546]: DEBUG os_brick.utils [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af5c39b14ece', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:00:12 user nova-compute[103546]: DEBUG nova.virt.block_device [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Updating existing volume attachment record: 6c39ce45-653b-48cc-96c0-e49235d4c27e {{(pid=103546) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 04:00:13 user nova-compute[103546]: DEBUG nova.network.neutron [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Successfully created port: 9ab0370c-4cd8-49c4-9c20-c566d0db69cf {{(pid=103546) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 04:00:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:00:13 user nova-compute[103546]: DEBUG nova.network.neutron [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Successfully updated port: 9ab0370c-4cd8-49c4-9c20-c566d0db69cf {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 04:00:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquiring lock "refresh_cache-e5b2903b-053a-4671-af52-aa08e0b220b8" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:00:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquired lock "refresh_cache-e5b2903b-053a-4671-af52-aa08e0b220b8" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:00:13 user nova-compute[103546]: DEBUG nova.network.neutron [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 04:00:13 user nova-compute[103546]: DEBUG nova.compute.manager [req-9a047fe6-7b92-4cff-b213-5b4a9d6f14ab req-e411c882-bd9d-460c-b8bf-a07a12dc78ab service nova] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Received event network-changed-9ab0370c-4cd8-49c4-9c20-c566d0db69cf {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:00:13 user nova-compute[103546]: DEBUG nova.compute.manager [req-9a047fe6-7b92-4cff-b213-5b4a9d6f14ab req-e411c882-bd9d-460c-b8bf-a07a12dc78ab service nova] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Refreshing instance network info cache due to event network-changed-9ab0370c-4cd8-49c4-9c20-c566d0db69cf. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 04:00:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-9a047fe6-7b92-4cff-b213-5b4a9d6f14ab req-e411c882-bd9d-460c-b8bf-a07a12dc78ab service nova] Acquiring lock "refresh_cache-e5b2903b-053a-4671-af52-aa08e0b220b8" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:00:13 user nova-compute[103546]: DEBUG nova.network.neutron [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 04:00:14 user nova-compute[103546]: DEBUG nova.network.neutron [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Updating instance_info_cache with network_info: [{"id": "9ab0370c-4cd8-49c4-9c20-c566d0db69cf", "address": "fa:16:3e:0b:51:11", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ab0370c-4c", "ovs_interfaceid": "9ab0370c-4cd8-49c4-9c20-c566d0db69cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:00:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Releasing lock "refresh_cache-e5b2903b-053a-4671-af52-aa08e0b220b8" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:00:14 user nova-compute[103546]: DEBUG nova.compute.manager [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Instance network_info: |[{"id": "9ab0370c-4cd8-49c4-9c20-c566d0db69cf", "address": "fa:16:3e:0b:51:11", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ab0370c-4c", "ovs_interfaceid": "9ab0370c-4cd8-49c4-9c20-c566d0db69cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 04:00:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-9a047fe6-7b92-4cff-b213-5b4a9d6f14ab req-e411c882-bd9d-460c-b8bf-a07a12dc78ab service nova] Acquired lock "refresh_cache-e5b2903b-053a-4671-af52-aa08e0b220b8" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:00:14 user nova-compute[103546]: DEBUG nova.network.neutron [req-9a047fe6-7b92-4cff-b213-5b4a9d6f14ab req-e411c882-bd9d-460c-b8bf-a07a12dc78ab service nova] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Refreshing network info cache for port 9ab0370c-4cd8-49c4-9c20-c566d0db69cf {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 04:00:14 user nova-compute[103546]: DEBUG nova.network.neutron [req-9a047fe6-7b92-4cff-b213-5b4a9d6f14ab req-e411c882-bd9d-460c-b8bf-a07a12dc78ab service nova] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Updated VIF entry in instance network info cache for port 9ab0370c-4cd8-49c4-9c20-c566d0db69cf. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 04:00:14 user nova-compute[103546]: DEBUG nova.network.neutron [req-9a047fe6-7b92-4cff-b213-5b4a9d6f14ab req-e411c882-bd9d-460c-b8bf-a07a12dc78ab service nova] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Updating instance_info_cache with network_info: [{"id": "9ab0370c-4cd8-49c4-9c20-c566d0db69cf", "address": "fa:16:3e:0b:51:11", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ab0370c-4c", "ovs_interfaceid": "9ab0370c-4cd8-49c4-9c20-c566d0db69cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:00:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-9a047fe6-7b92-4cff-b213-5b4a9d6f14ab req-e411c882-bd9d-460c-b8bf-a07a12dc78ab service nova] Releasing lock "refresh_cache-e5b2903b-053a-4671-af52-aa08e0b220b8" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:00:17 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:00:17 user nova-compute[103546]: DEBUG nova.compute.manager [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Start spawning the instance on the hypervisor. {{(pid=103546) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 04:00:17 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Creating instance directory {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 04:00:17 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Creating image(s)
Nov 16 04:00:17 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Did not create local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 04:00:17 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Ensure instance console log exists: /opt/stack/data/nova/instances/e5b2903b-053a-4671-af52-aa08e0b220b8/console.log {{(pid=103546) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 04:00:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:00:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:00:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:00:17 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Start _get_guest_xml network_info=[{"id": "9ab0370c-4cd8-49c4-9c20-c566d0db69cf", "address": "fa:16:3e:0b:51:11", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ab0370c-4c", "ovs_interfaceid": "9ab0370c-4cd8-49c4-9c20-c566d0db69cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QwVdAeaX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e5b2903b-053a-4671-af52-aa08e0b220b8', 'attached_at': '', 'detached_at': '', 'volume_id': '6dd96488-81c4-484b-ada5-812f7adb960e', 'serial': '6dd96488-81c4-484b-ada5-812f7adb960e'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': '6c39ce45-653b-48cc-96c0-e49235d4c27e', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 04:00:17 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:00:17 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:00:17 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 04:00:17 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 04:00:17 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 04:00:17 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 04:00:17 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 04:00:17 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 04:00:17 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 04:00:17 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 04:00:17 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 04:00:17 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 04:00:17 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 04:00:17 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 04:00:17 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 04:00:17 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 04:00:17 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 04:00:17 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 04:00:17 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 04:00:17 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QwVdAeaX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:00:17 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:00:17 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:00:17 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:00:17 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:00:17 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:00:17 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:00:17 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 04:00:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:00:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:00:17 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37db4dd-467f-431f-b7cd-0bb926e93298]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:00:17 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 04:00:17 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:00:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e -p 172.16.0.220:3260 --interface default --op new {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:00:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:00:17 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[71bcf1f8-7012-4eb1-938f-c8279ba30049]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e] added\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:00:17 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e] added
Nov 16 04:00:17 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:00:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:00:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:00:17 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[811e3e5a-6bba-4480-bbd4-d3999b1aeed3]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:00:17 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:00:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:00:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:00:17 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef4e81a-5394-4112-8250-8072f9bdd497]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:00:17 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:00:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QwVdAeaX {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:00:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QwVdAeaX" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:00:17 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[679bdc48-24ef-4b61-aefb-e5e751cdbf71]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:00:17 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QwVdAeaX'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:00:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:00:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:00:17 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63682b5-127c-4299-9d5c-2bbe7790bc79]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:00:17 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:00:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:00:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:00:17 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[302a4a36-1875-47cc-a905-a17a821ed9da]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:00:17 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:00:17 user nova-compute[103546]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17 (non-flash)
Nov 16 04:00:17 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:00:17 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:00:17 user nova-compute[103546]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17 (non-flash)
Nov 16 04:00:17 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:00:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e -p 172.16.0.220:3260 --login {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:00:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:00:17 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a30a97-bfbd-4681-a585-e4422f84b650]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:00:17 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e, portal: 172.16.0.220,3260]
Nov 16 04:00:17 user nova-compute[103546]: Login to [iface: default, target: iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e, portal: 172.16.0.220,3260] successful.
Nov 16 04:00:17 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:00:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:00:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:00:17 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5799efe2-ac36-4137-847a-6a60e664dd78]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:00:18 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:00:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:00:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:00:18 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e83f626-2db3-487b-ac02-4d2c7a28a6fc]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:00:18 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:00:18 user nova-compute[103546]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17 (non-flash)
Nov 16 04:00:18 user nova-compute[103546]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:00:18 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:00:18 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:00:18 user nova-compute[103546]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17 (non-flash)
Nov 16 04:00:18 user nova-compute[103546]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:00:18 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:00:18 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:00:18 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 04:00:18 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] HCTL ('34', '-', '-', 0) found on session 38 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 04:00:18 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 04:00:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:00:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:00:18 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f58dd19-5ba6-4fc7-a453-0ee0d2bae82f]: (4, ('- - 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:00:18 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 04:00:18 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QwVdAeaX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 04:00:18 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:00:18 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:00:18 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:00:18 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:00:18 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=103546) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 04:00:19 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:00:19 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23836303834323539', 'path': '/dev/sdc'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:00:19 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836303834323539', 'path': '/dev/sdc'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 04:00:19 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:00:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1328575671',display_name='tempest-TestVolumeBootPattern-server-1328575671',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1328575671',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAUuzWuYKsux0jTpLPt6gxhC1FaUy3kEUyYKr8BxuO29MPaSGm/xG+Qeyua0CAfOtv/fD3rdnfc1wGAbEANqJwnqI370L1woOSlI3nH8Q8Ypdr+d2TMfVLtiA9YGdx0zEg==',key_name='tempest-TestVolumeBootPattern-1153098015',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40ce50192a9743b59a9430163dd6a51c',ramdisk_id='',reservation_id='r-wsv36jze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1283031547',owner_user_name='tempest-TestVolumeBootPattern-1283031547-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T04:00:12Z,user_data=None,user_id='ab77040a7b9846d28dc08852d678d1ed',uuid=e5b2903b-053a-4671-af52-aa08e0b220b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ab0370c-4cd8-49c4-9c20-c566d0db69cf", "address": "fa:16:3e:0b:51:11", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ab0370c-4c", "ovs_interfaceid": "9ab0370c-4cd8-49c4-9c20-c566d0db69cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 04:00:19 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Converting VIF {"id": "9ab0370c-4cd8-49c4-9c20-c566d0db69cf", "address": "fa:16:3e:0b:51:11", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ab0370c-4c", "ovs_interfaceid": "9ab0370c-4cd8-49c4-9c20-c566d0db69cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:00:19 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:51:11,bridge_name='br-int',has_traffic_filtering=True,id=9ab0370c-4cd8-49c4-9c20-c566d0db69cf,network=Network(a13f532d-a30d-4c06-83fe-760bcffae183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ab0370c-4c') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:00:19 user nova-compute[103546]: DEBUG nova.objects.instance [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lazy-loading 'pci_devices' on Instance uuid e5b2903b-053a-4671-af52-aa08e0b220b8 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:00:19 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] End _get_guest_xml xml=<domain type="kvm">
Nov 16 04:00:19 user nova-compute[103546]:   <uuid>e5b2903b-053a-4671-af52-aa08e0b220b8</uuid>
Nov 16 04:00:19 user nova-compute[103546]:   <name>instance-00000023</name>
Nov 16 04:00:19 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 04:00:19 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 04:00:19 user nova-compute[103546]:   <metadata>
Nov 16 04:00:19 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 04:00:19 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 04:00:19 user nova-compute[103546]:       <nova:name>tempest-TestVolumeBootPattern-server-1328575671</nova:name>
Nov 16 04:00:19 user nova-compute[103546]:       <nova:creationTime>2023-11-16 04:00:17</nova:creationTime>
Nov 16 04:00:19 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 04:00:19 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 04:00:19 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 04:00:19 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 04:00:19 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 04:00:19 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 04:00:19 user nova-compute[103546]:       </nova:flavor>
Nov 16 04:00:19 user nova-compute[103546]:       <nova:owner>
Nov 16 04:00:19 user nova-compute[103546]:         <nova:user uuid="ab77040a7b9846d28dc08852d678d1ed">tempest-TestVolumeBootPattern-1283031547-project-member</nova:user>
Nov 16 04:00:19 user nova-compute[103546]:         <nova:project uuid="40ce50192a9743b59a9430163dd6a51c">tempest-TestVolumeBootPattern-1283031547</nova:project>
Nov 16 04:00:19 user nova-compute[103546]:       </nova:owner>
Nov 16 04:00:19 user nova-compute[103546]:       <nova:ports>
Nov 16 04:00:19 user nova-compute[103546]:         <nova:port uuid="9ab0370c-4cd8-49c4-9c20-c566d0db69cf">
Nov 16 04:00:19 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 16 04:00:19 user nova-compute[103546]:         </nova:port>
Nov 16 04:00:19 user nova-compute[103546]:       </nova:ports>
Nov 16 04:00:19 user nova-compute[103546]:     </nova:instance>
Nov 16 04:00:19 user nova-compute[103546]:   </metadata>
Nov 16 04:00:19 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 04:00:19 user nova-compute[103546]:     <system>
Nov 16 04:00:19 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 04:00:19 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 04:00:19 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 04:00:19 user nova-compute[103546]:       <entry name="serial">e5b2903b-053a-4671-af52-aa08e0b220b8</entry>
Nov 16 04:00:19 user nova-compute[103546]:       <entry name="uuid">e5b2903b-053a-4671-af52-aa08e0b220b8</entry>
Nov 16 04:00:19 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 04:00:19 user nova-compute[103546]:     </system>
Nov 16 04:00:19 user nova-compute[103546]:   </sysinfo>
Nov 16 04:00:19 user nova-compute[103546]:   <os>
Nov 16 04:00:19 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 04:00:19 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 04:00:19 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 04:00:19 user nova-compute[103546]:   </os>
Nov 16 04:00:19 user nova-compute[103546]:   <features>
Nov 16 04:00:19 user nova-compute[103546]:     <acpi/>
Nov 16 04:00:19 user nova-compute[103546]:     <apic/>
Nov 16 04:00:19 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 04:00:19 user nova-compute[103546]:   </features>
Nov 16 04:00:19 user nova-compute[103546]:   <clock offset="utc">
Nov 16 04:00:19 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 04:00:19 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 04:00:19 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 04:00:19 user nova-compute[103546]:   </clock>
Nov 16 04:00:19 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 04:00:19 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 04:00:19 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 04:00:19 user nova-compute[103546]:   </cpu>
Nov 16 04:00:19 user nova-compute[103546]:   <devices>
Nov 16 04:00:19 user nova-compute[103546]:     <disk type="block" device="disk">
Nov 16 04:00:19 user nova-compute[103546]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:00:19 user nova-compute[103546]:       <source dev="/dev/sdc"/>
Nov 16 04:00:19 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 04:00:19 user nova-compute[103546]:       <serial>6dd96488-81c4-484b-ada5-812f7adb960e</serial>
Nov 16 04:00:19 user nova-compute[103546]:     </disk>
Nov 16 04:00:19 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 04:00:19 user nova-compute[103546]:       <mac address="fa:16:3e:0b:51:11"/>
Nov 16 04:00:19 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 04:00:19 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 04:00:19 user nova-compute[103546]:       <target dev="tap9ab0370c-4c"/>
Nov 16 04:00:19 user nova-compute[103546]:     </interface>
Nov 16 04:00:19 user nova-compute[103546]:     <serial type="pty">
Nov 16 04:00:19 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/e5b2903b-053a-4671-af52-aa08e0b220b8/console.log" append="off"/>
Nov 16 04:00:19 user nova-compute[103546]:     </serial>
Nov 16 04:00:19 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 04:00:19 user nova-compute[103546]:     <video>
Nov 16 04:00:19 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 04:00:19 user nova-compute[103546]:     </video>
Nov 16 04:00:19 user nova-compute[103546]:     <rng model="virtio">
Nov 16 04:00:19 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 04:00:19 user nova-compute[103546]:     </rng>
Nov 16 04:00:19 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 04:00:19 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 04:00:19 user nova-compute[103546]:       <stats period="10"/>
Nov 16 04:00:19 user nova-compute[103546]:     </memballoon>
Nov 16 04:00:19 user nova-compute[103546]:   </devices>
Nov 16 04:00:19 user nova-compute[103546]: </domain>
Nov 16 04:00:19 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 04:00:19 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:00:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1328575671',display_name='tempest-TestVolumeBootPattern-server-1328575671',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1328575671',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAUuzWuYKsux0jTpLPt6gxhC1FaUy3kEUyYKr8BxuO29MPaSGm/xG+Qeyua0CAfOtv/fD3rdnfc1wGAbEANqJwnqI370L1woOSlI3nH8Q8Ypdr+d2TMfVLtiA9YGdx0zEg==',key_name='tempest-TestVolumeBootPattern-1153098015',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40ce50192a9743b59a9430163dd6a51c',ramdisk_id='',reservation_id='r-wsv36jze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1283031547',owner_user_name='tempest-TestVolumeBootPattern-1283031547-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T04:00:12Z,user_data=None,user_id='ab77040a7b9846d28dc08852d678d1ed',uuid=e5b2903b-053a-4671-af52-aa08e0b220b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ab0370c-4cd8-49c4-9c20-c566d0db69cf", "address": "fa:16:3e:0b:51:11", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ab0370c-4c", "ovs_interfaceid": "9ab0370c-4cd8-49c4-9c20-c566d0db69cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 04:00:19 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Converting VIF {"id": "9ab0370c-4cd8-49c4-9c20-c566d0db69cf", "address": "fa:16:3e:0b:51:11", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ab0370c-4c", "ovs_interfaceid": "9ab0370c-4cd8-49c4-9c20-c566d0db69cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:00:19 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:51:11,bridge_name='br-int',has_traffic_filtering=True,id=9ab0370c-4cd8-49c4-9c20-c566d0db69cf,network=Network(a13f532d-a30d-4c06-83fe-760bcffae183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ab0370c-4c') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:00:19 user nova-compute[103546]: DEBUG os_vif [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:51:11,bridge_name='br-int',has_traffic_filtering=True,id=9ab0370c-4cd8-49c4-9c20-c566d0db69cf,network=Network(a13f532d-a30d-4c06-83fe-760bcffae183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ab0370c-4c') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 04:00:19 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:00:19 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:00:19 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 04:00:19 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:00:19 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '52f96676-0452-514f-8b45-6469a41956f7', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:00:19 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:00:19 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:00:19 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:00:19 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9ab0370c-4c, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:00:19 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9ab0370c-4c, col_values=(('qos', UUID('1e92c751-75e3-4028-9460-56ad882376aa')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:00:19 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9ab0370c-4c, col_values=(('external_ids', {'iface-id': '9ab0370c-4cd8-49c4-9c20-c566d0db69cf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:51:11', 'vm-uuid': 'e5b2903b-053a-4671-af52-aa08e0b220b8'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:00:19 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:00:19 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:00:19 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:00:19 user nova-compute[103546]: INFO os_vif [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:51:11,bridge_name='br-int',has_traffic_filtering=True,id=9ab0370c-4cd8-49c4-9c20-c566d0db69cf,network=Network(a13f532d-a30d-4c06-83fe-760bcffae183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ab0370c-4c')
Nov 16 04:00:19 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:00:19 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] No VIF found with MAC fa:16:3e:0b:51:11, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 04:00:19 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:00:19 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:00:19 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:00:19 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager.update_available_resource {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:00:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:00:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:00:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:00:19 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Auditing locally available compute resources for user (node: user) {{(pid=103546) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 04:00:20 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:00:20 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:00:20 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:00:20 user nova-compute[103546]: DEBUG nova.compute.manager [req-db23a141-2052-489a-a679-12aada968ae8 req-abd8dc43-8aa1-4ff7-8316-615cd0c73eb9 service nova] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Received event network-vif-plugged-9ab0370c-4cd8-49c4-9c20-c566d0db69cf {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:00:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-db23a141-2052-489a-a679-12aada968ae8 req-abd8dc43-8aa1-4ff7-8316-615cd0c73eb9 service nova] Acquiring lock "e5b2903b-053a-4671-af52-aa08e0b220b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:00:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-db23a141-2052-489a-a679-12aada968ae8 req-abd8dc43-8aa1-4ff7-8316-615cd0c73eb9 service nova] Lock "e5b2903b-053a-4671-af52-aa08e0b220b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:00:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-db23a141-2052-489a-a679-12aada968ae8 req-abd8dc43-8aa1-4ff7-8316-615cd0c73eb9 service nova] Lock "e5b2903b-053a-4671-af52-aa08e0b220b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:00:20 user nova-compute[103546]: DEBUG nova.compute.manager [req-db23a141-2052-489a-a679-12aada968ae8 req-abd8dc43-8aa1-4ff7-8316-615cd0c73eb9 service nova] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] No waiting events found dispatching network-vif-plugged-9ab0370c-4cd8-49c4-9c20-c566d0db69cf {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:00:20 user nova-compute[103546]: WARNING nova.compute.manager [req-db23a141-2052-489a-a679-12aada968ae8 req-abd8dc43-8aa1-4ff7-8316-615cd0c73eb9 service nova] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Received unexpected event network-vif-plugged-9ab0370c-4cd8-49c4-9c20-c566d0db69cf for instance with vm_state building and task_state spawning.
Nov 16 04:00:20 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 04:00:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk.rescue --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:00:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:00:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:00:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:00:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk.rescue --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:00:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:00:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:00:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:00:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:00:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:00:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f7c407-3373-43ba-ac92-7eb0a43a7093/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:00:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f7c407-3373-43ba-ac92-7eb0a43a7093/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:00:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f7c407-3373-43ba-ac92-7eb0a43a7093/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:00:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f7c407-3373-43ba-ac92-7eb0a43a7093/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:00:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:00:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:00:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:00:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:00:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:00:22 user nova-compute[103546]: DEBUG nova.compute.manager [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 04:00:22 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Guest created on hypervisor {{(pid=103546) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 04:00:22 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Instance spawned successfully.
Nov 16 04:00:22 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 04:00:22 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Found default for hw_cdrom_bus of ide {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:00:22 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Found default for hw_disk_bus of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:00:22 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Found default for hw_input_bus of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:00:22 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Found default for hw_pointer_model of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:00:22 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Found default for hw_video_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:00:22 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Found default for hw_vif_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:00:22 user nova-compute[103546]: INFO nova.compute.manager [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Took 5.02 seconds to spawn the instance on the hypervisor.
Nov 16 04:00:22 user nova-compute[103546]: DEBUG nova.compute.manager [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 04:00:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:00:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:00:22 user nova-compute[103546]: DEBUG nova.compute.manager [req-0ab8852e-a6e2-413d-8887-786176194ce8 req-d3dfdfdb-7e20-407a-b861-a1927581dfd9 service nova] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Received event network-vif-plugged-9ab0370c-4cd8-49c4-9c20-c566d0db69cf {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:00:22 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-0ab8852e-a6e2-413d-8887-786176194ce8 req-d3dfdfdb-7e20-407a-b861-a1927581dfd9 service nova] Acquiring lock "e5b2903b-053a-4671-af52-aa08e0b220b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:00:22 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-0ab8852e-a6e2-413d-8887-786176194ce8 req-d3dfdfdb-7e20-407a-b861-a1927581dfd9 service nova] Lock "e5b2903b-053a-4671-af52-aa08e0b220b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:00:22 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-0ab8852e-a6e2-413d-8887-786176194ce8 req-d3dfdfdb-7e20-407a-b861-a1927581dfd9 service nova] Lock "e5b2903b-053a-4671-af52-aa08e0b220b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:00:22 user nova-compute[103546]: DEBUG nova.compute.manager [req-0ab8852e-a6e2-413d-8887-786176194ce8 req-d3dfdfdb-7e20-407a-b861-a1927581dfd9 service nova] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] No waiting events found dispatching network-vif-plugged-9ab0370c-4cd8-49c4-9c20-c566d0db69cf {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:00:22 user nova-compute[103546]: WARNING nova.compute.manager [req-0ab8852e-a6e2-413d-8887-786176194ce8 req-d3dfdfdb-7e20-407a-b861-a1927581dfd9 service nova] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Received unexpected event network-vif-plugged-9ab0370c-4cd8-49c4-9c20-c566d0db69cf for instance with vm_state building and task_state spawning.
Nov 16 04:00:22 user nova-compute[103546]: INFO nova.compute.manager [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Took 11.15 seconds to build instance.
Nov 16 04:00:22 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a8d53bb9-aa71-4ec2-a6ed-ba8edf8022c9 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "e5b2903b-053a-4671-af52-aa08e0b220b8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.264s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:00:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:00:22 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 04:00:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2781221-b5e3-468a-a9f5-436a04285f38/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:00:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2781221-b5e3-468a-a9f5-436a04285f38/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:00:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2781221-b5e3-468a-a9f5-436a04285f38/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:00:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2781221-b5e3-468a-a9f5-436a04285f38/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:00:23 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 04:00:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.rescue --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:00:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:00:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.rescue --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:00:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:00:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:00:23 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:00:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:00:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:00:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:00:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:00:24 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:00:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:00:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:00:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:00:24 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:00:24 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:00:24 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Hypervisor/Node resource view: name=user free_ram=7844MB free_disk=25.163646697998047GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=103546) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 04:00:24 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:00:24 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:00:25 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 9a89970b-fc61-4419-8ff9-b48013dccf9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:00:25 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 04101512-7333-4581-add3-7af3821e335b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:00:25 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance fa7e5468-9dd4-407d-85ec-d45ec76f9e29 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:00:25 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 246ccf69-847c-4ab2-b709-ad1a85e81eab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:00:25 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 8d229d05-95f1-4997-8539-802ac65cff8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:00:25 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance d2781221-b5e3-468a-a9f5-436a04285f38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:00:25 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance b0a480de-e99b-4b54-bd81-36c216442137 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:00:25 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 38f7c407-3373-43ba-ac92-7eb0a43a7093 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:00:25 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance e5b2903b-053a-4671-af52-aa08e0b220b8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:00:25 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 04:00:25 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 04:00:25 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:00:25 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:00:25 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Compute_service record updated for user:user {{(pid=103546) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 04:00:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.499s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:00:27 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:00:27 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Starting heal instance info cache {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 04:00:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "refresh_cache-246ccf69-847c-4ab2-b709-ad1a85e81eab" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:00:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquired lock "refresh_cache-246ccf69-847c-4ab2-b709-ad1a85e81eab" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:00:27 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Forcefully refreshing network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 04:00:27 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Updating instance_info_cache with network_info: [{"id": "84add44b-0c93-4ebc-b45d-2f30d63d900f", "address": "fa:16:3e:13:18:5f", "network": {"id": "337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-40560053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca049d5674dc4c59814f98478752d73d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84add44b-0c", "ovs_interfaceid": "84add44b-0c93-4ebc-b45d-2f30d63d900f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:00:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Releasing lock "refresh_cache-246ccf69-847c-4ab2-b709-ad1a85e81eab" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:00:27 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Updated the network info_cache for instance {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 04:00:27 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:00:27 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:00:27 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:00:28 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:00:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:00:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:00:34 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:00:38 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:00:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:00:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:00:44 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:00:48 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:00:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e1dba307-2fc4-4776-9660-ec8140a4b93c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Acquiring lock "d2781221-b5e3-468a-a9f5-436a04285f38" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:00:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e1dba307-2fc4-4776-9660-ec8140a4b93c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "d2781221-b5e3-468a-a9f5-436a04285f38" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:00:48 user nova-compute[103546]: INFO nova.compute.manager [None req-e1dba307-2fc4-4776-9660-ec8140a4b93c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Detaching volume 2eb2ddb2-cce9-416f-b15c-58dd8afa3e17
Nov 16 04:00:48 user nova-compute[103546]: INFO nova.virt.block_device [None req-e1dba307-2fc4-4776-9660-ec8140a4b93c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Attempting to driver detach volume 2eb2ddb2-cce9-416f-b15c-58dd8afa3e17 from mountpoint /dev/vdb
Nov 16 04:00:48 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-e1dba307-2fc4-4776-9660-ec8140a4b93c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Attempting to detach device vdb from instance d2781221-b5e3-468a-a9f5-436a04285f38 from the persistent domain config. {{(pid=103546) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 04:00:48 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-e1dba307-2fc4-4776-9660-ec8140a4b93c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 04:00:48 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:00:48 user nova-compute[103546]:   <source dev="/dev/sdh"/>
Nov 16 04:00:48 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 04:00:48 user nova-compute[103546]:   <serial>2eb2ddb2-cce9-416f-b15c-58dd8afa3e17</serial>
Nov 16 04:00:48 user nova-compute[103546]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 04:00:48 user nova-compute[103546]: </disk>
Nov 16 04:00:48 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 04:00:48 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-e1dba307-2fc4-4776-9660-ec8140a4b93c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Successfully detached device vdb from instance d2781221-b5e3-468a-a9f5-436a04285f38 from the persistent domain config.
Nov 16 04:00:48 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-e1dba307-2fc4-4776-9660-ec8140a4b93c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d2781221-b5e3-468a-a9f5-436a04285f38 from the live domain config. {{(pid=103546) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 04:00:48 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-e1dba307-2fc4-4776-9660-ec8140a4b93c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 04:00:48 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:00:48 user nova-compute[103546]:   <source dev="/dev/sdh"/>
Nov 16 04:00:48 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 04:00:48 user nova-compute[103546]:   <serial>2eb2ddb2-cce9-416f-b15c-58dd8afa3e17</serial>
Nov 16 04:00:48 user nova-compute[103546]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 04:00:48 user nova-compute[103546]: </disk>
Nov 16 04:00:48 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 04:00:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:00:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-e1dba307-2fc4-4776-9660-ec8140a4b93c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d2781221-b5e3-468a-a9f5-436a04285f38 {{(pid=103546) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 04:00:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:00:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:00:58 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Acquiring lock "66b98917-7551-47a5-94a1-79606cf1467d" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:00:58 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Lock "66b98917-7551-47a5-94a1-79606cf1467d" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:00:58 user nova-compute[103546]: INFO nova.compute.manager [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Unshelving
Nov 16 04:00:59 user nova-compute[103546]: INFO nova.virt.block_device [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Booting with volume 3690ac19-2af3-4701-97ba-2243a390f2af at /dev/vda
Nov 16 04:00:59 user nova-compute[103546]: DEBUG os_brick.utils [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:00:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:00:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:00:59 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ed1e66-85ee-4803-ba43-932172d17d4f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af5c39b14ece\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:00:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:00:59 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:00:59 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:00:59 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=103546) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 04:00:59 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:00:59 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:00:59 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:00:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:00:59 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[81500e91-aafb-4ef0-8567-636ed4bfe42e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:00:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:00:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:00:59 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd0e3bb-e696-4c38-9d29-4dfeb3c85dda]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:00:59 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb22c10-15c1-4aa8-8d73-193542b6405e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:00:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Running cmd (subprocess): nvme version {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:00:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] 'nvme version' failed. Not Retrying. {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 04:00:59 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] nvme not present on system {{(pid=103546) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 04:00:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:00:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 04:00:59 user nova-compute[103546]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 04:00:59 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f930b43-30e5-4aeb-a3e1-1c8f5f3046ef]: (4, '') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:00:59 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=103546) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 04:00:59 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 04:00:59 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] LIGHTOS: no hostnqn found. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 04:00:59 user nova-compute[103546]: DEBUG os_brick.utils [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af5c39b14ece', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:00:59 user nova-compute[103546]: DEBUG nova.virt.block_device [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Updating existing volume attachment record: 92cb9207-1f5a-443d-9b17-9758094c6956 {{(pid=103546) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 04:01:01 user nova-compute[103546]: DEBUG nova.compute.manager [req-a73e8694-f525-48fe-a051-446865aac4c4 req-a65e47fc-9141-4cc8-960c-498bf9d89814 service nova] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Received event network-changed-804319c6-55cb-4f30-908c-71817934fb45 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:01:01 user nova-compute[103546]: DEBUG nova.compute.manager [req-a73e8694-f525-48fe-a051-446865aac4c4 req-a65e47fc-9141-4cc8-960c-498bf9d89814 service nova] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Refreshing instance network info cache due to event network-changed-804319c6-55cb-4f30-908c-71817934fb45. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 04:01:01 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a73e8694-f525-48fe-a051-446865aac4c4 req-a65e47fc-9141-4cc8-960c-498bf9d89814 service nova] Acquiring lock "refresh_cache-b0a480de-e99b-4b54-bd81-36c216442137" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:01:01 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a73e8694-f525-48fe-a051-446865aac4c4 req-a65e47fc-9141-4cc8-960c-498bf9d89814 service nova] Acquired lock "refresh_cache-b0a480de-e99b-4b54-bd81-36c216442137" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:01:01 user nova-compute[103546]: DEBUG nova.network.neutron [req-a73e8694-f525-48fe-a051-446865aac4c4 req-a65e47fc-9141-4cc8-960c-498bf9d89814 service nova] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Refreshing network info cache for port 804319c6-55cb-4f30-908c-71817934fb45 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 04:01:02 user nova-compute[103546]: DEBUG nova.network.neutron [req-a73e8694-f525-48fe-a051-446865aac4c4 req-a65e47fc-9141-4cc8-960c-498bf9d89814 service nova] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Updated VIF entry in instance network info cache for port 804319c6-55cb-4f30-908c-71817934fb45. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 04:01:02 user nova-compute[103546]: DEBUG nova.network.neutron [req-a73e8694-f525-48fe-a051-446865aac4c4 req-a65e47fc-9141-4cc8-960c-498bf9d89814 service nova] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Updating instance_info_cache with network_info: [{"id": "804319c6-55cb-4f30-908c-71817934fb45", "address": "fa:16:3e:d5:4f:3e", "network": {"id": "23baa589-ae15-4a44-8991-d6fe8569dc8a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-464431710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f33e7eff7954fcc895f66982d7d45c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804319c6-55", "ovs_interfaceid": "804319c6-55cb-4f30-908c-71817934fb45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:01:02 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a73e8694-f525-48fe-a051-446865aac4c4 req-a65e47fc-9141-4cc8-960c-498bf9d89814 service nova] Releasing lock "refresh_cache-b0a480de-e99b-4b54-bd81-36c216442137" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:01:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:01:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-8256ea92-03f5-4ab4-b203-fa2fb65196df tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Acquiring lock "b0a480de-e99b-4b54-bd81-36c216442137" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:01:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-8256ea92-03f5-4ab4-b203-fa2fb65196df tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "b0a480de-e99b-4b54-bd81-36c216442137" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:01:03 user nova-compute[103546]: DEBUG nova.objects.instance [None req-8256ea92-03f5-4ab4-b203-fa2fb65196df tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lazy-loading 'flavor' on Instance uuid b0a480de-e99b-4b54-bd81-36c216442137 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:01:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-8256ea92-03f5-4ab4-b203-fa2fb65196df tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "b0a480de-e99b-4b54-bd81-36c216442137" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:01:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-8256ea92-03f5-4ab4-b203-fa2fb65196df tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Acquiring lock "b0a480de-e99b-4b54-bd81-36c216442137" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:01:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-8256ea92-03f5-4ab4-b203-fa2fb65196df tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "b0a480de-e99b-4b54-bd81-36c216442137" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:01:03 user nova-compute[103546]: INFO nova.compute.manager [None req-8256ea92-03f5-4ab4-b203-fa2fb65196df tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Attaching volume cea53f8b-4d4d-4d25-99c7-1da6a373891e to /dev/vdb
Nov 16 04:01:04 user nova-compute[103546]: DEBUG os_brick.utils [None req-8256ea92-03f5-4ab4-b203-fa2fb65196df tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:01:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:01:04 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b685ca94-458b-481e-ae6a-11171b9a6457]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af5c39b14ece\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:01:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:01:04 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d533d15-aebe-4f43-b950-f7d159992b8b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:01:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:01:04 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44e790e-b306-43f8-b640-1be70e60a068]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:01:04 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d75d335-9dfd-4bf3-a77f-38280b381ab4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:01:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-8256ea92-03f5-4ab4-b203-fa2fb65196df tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Running cmd (subprocess): nvme version {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-8256ea92-03f5-4ab4-b203-fa2fb65196df tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] 'nvme version' failed. Not Retrying. {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 04:01:04 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8256ea92-03f5-4ab4-b203-fa2fb65196df tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] nvme not present on system {{(pid=103546) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 04:01:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 04:01:04 user nova-compute[103546]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 04:01:04 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c194d0b-6440-4106-a0f3-5f5e7692deb0]: (4, '') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:01:04 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-8256ea92-03f5-4ab4-b203-fa2fb65196df tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=103546) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 04:01:04 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-8256ea92-03f5-4ab4-b203-fa2fb65196df tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 04:01:04 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-8256ea92-03f5-4ab4-b203-fa2fb65196df tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] LIGHTOS: no hostnqn found. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 04:01:04 user nova-compute[103546]: DEBUG os_brick.utils [None req-8256ea92-03f5-4ab4-b203-fa2fb65196df tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af5c39b14ece', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:01:04 user nova-compute[103546]: DEBUG nova.virt.block_device [None req-8256ea92-03f5-4ab4-b203-fa2fb65196df tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Updating existing volume attachment record: d1cd2d0b-722b-4a4c-87d4-5c4594d241f5 {{(pid=103546) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 04:01:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:01:04 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:01:04 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:01:04 user nova-compute[103546]: DEBUG nova.objects.instance [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Lazy-loading 'pci_requests' on Instance uuid 66b98917-7551-47a5-94a1-79606cf1467d {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:01:04 user nova-compute[103546]: DEBUG nova.objects.instance [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Lazy-loading 'numa_topology' on Instance uuid 66b98917-7551-47a5-94a1-79606cf1467d {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:01:04 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=103546) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 04:01:04 user nova-compute[103546]: INFO nova.compute.claims [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Claim successful on node user
Nov 16 04:01:04 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:01:04 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:01:04 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.428s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:01:04 user nova-compute[103546]: INFO nova.network.neutron [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Updating port 7df3a25d-d802-44f8-8a98-bb6be3453d3e with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Acquiring lock "refresh_cache-66b98917-7551-47a5-94a1-79606cf1467d" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Acquired lock "refresh_cache-66b98917-7551-47a5-94a1-79606cf1467d" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG nova.network.neutron [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG nova.compute.manager [req-e8f239c2-7955-402d-9d9a-c92388c8d4b3 req-a960f041-c660-4c3e-909e-f87c90dfa39d service nova] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Received event network-changed-7df3a25d-d802-44f8-8a98-bb6be3453d3e {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG nova.compute.manager [req-e8f239c2-7955-402d-9d9a-c92388c8d4b3 req-a960f041-c660-4c3e-909e-f87c90dfa39d service nova] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Refreshing instance network info cache due to event network-changed-7df3a25d-d802-44f8-8a98-bb6be3453d3e. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-e8f239c2-7955-402d-9d9a-c92388c8d4b3 req-a960f041-c660-4c3e-909e-f87c90dfa39d service nova] Acquiring lock "refresh_cache-66b98917-7551-47a5-94a1-79606cf1467d" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG nova.network.neutron [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Updating instance_info_cache with network_info: [{"id": "7df3a25d-d802-44f8-8a98-bb6be3453d3e", "address": "fa:16:3e:7c:b1:ba", "network": {"id": "f9df40e7-5801-4e0c-8b8b-6cdb4da22727", "bridge": "br-int", "label": "tempest-TestShelveInstance-1586968346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "164c650c4ec44057973d5d1ab45b7440", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7df3a25d-d8", "ovs_interfaceid": "7df3a25d-d802-44f8-8a98-bb6be3453d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Releasing lock "refresh_cache-66b98917-7551-47a5-94a1-79606cf1467d" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Creating instance directory {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 04:01:05 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Creating image(s)
Nov 16 04:01:05 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Did not create local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Ensure instance console log exists: /opt/stack/data/nova/instances/66b98917-7551-47a5-94a1-79606cf1467d/console.log {{(pid=103546) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Start _get_guest_xml network_info=[{"id": "7df3a25d-d802-44f8-8a98-bb6be3453d3e", "address": "fa:16:3e:7c:b1:ba", "network": {"id": "f9df40e7-5801-4e0c-8b8b-6cdb4da22727", "bridge": "br-int", "label": "tempest-TestShelveInstance-1586968346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "164c650c4ec44057973d5d1ab45b7440", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7df3a25d-d8", "ovs_interfaceid": "7df3a25d-d802-44f8-8a98-bb6be3453d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZQtTeObl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '66b98917-7551-47a5-94a1-79606cf1467d', 'attached_at': '', 'detached_at': '', 'volume_id': '3690ac19-2af3-4701-97ba-2243a390f2af', 'serial': '3690ac19-2af3-4701-97ba-2243a390f2af'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': '92cb9207-1f5a-443d-9b17-9758094c6956', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-e8f239c2-7955-402d-9d9a-c92388c8d4b3 req-a960f041-c660-4c3e-909e-f87c90dfa39d service nova] Acquired lock "refresh_cache-66b98917-7551-47a5-94a1-79606cf1467d" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG nova.network.neutron [req-e8f239c2-7955-402d-9d9a-c92388c8d4b3 req-a960f041-c660-4c3e-909e-f87c90dfa39d service nova] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Refreshing network info cache for port 7df3a25d-d802-44f8-8a98-bb6be3453d3e {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 04:01:05 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:01:05 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:01:05 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG nova.objects.instance [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Lazy-loading 'vcpu_model' on Instance uuid 66b98917-7551-47a5-94a1-79606cf1467d {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG nova.objects.base [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Object Instance<66b98917-7551-47a5-94a1-79606cf1467d> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZQtTeObl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:01:05 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:01:05 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:01:05 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:01:05 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:01:05 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 04:01:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c220a2bc-306e-43a8-a2ac-78160dbc9e19]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 04:01:05 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af -p 172.16.0.220:3260 --interface default --op new {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd3bd55-c0ac-4691-bc0b-c45cb59e6624]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af] added\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af] added
Nov 16 04:01:05 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[808b537e-264c-418b-b27d-7518a16b5319]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb908e8-6c07-4888-bf1f-ff693dfb3cef]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZQtTeObl {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZQtTeObl" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde44f39-25ee-413c-a3d8-12b3fddc5411]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZQtTeObl'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2242a58-36aa-40a8-9bf7-15f75aca51bb]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbabfc7c-5c1a-40c3-86fa-4a81fe905a5e]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:01:05 user nova-compute[103546]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17 (non-flash)
Nov 16 04:01:05 user nova-compute[103546]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:01:05 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:01:05 user nova-compute[103546]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17 (non-flash)
Nov 16 04:01:05 user nova-compute[103546]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:01:05 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af -p 172.16.0.220:3260 --login {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc89e039-3e62-41c8-a0e4-c95ed13cc349]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af, portal: 172.16.0.220,3260]
Nov 16 04:01:05 user nova-compute[103546]: Login to [iface: default, target: iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af, portal: 172.16.0.220,3260] successful.
Nov 16 04:01:05 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[778180ce-89cc-45a0-bb43-4b6131642461]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b050784-045d-4cf6-bede-fcc27867eebb]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:01:05 user nova-compute[103546]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17 (non-flash)
Nov 16 04:01:05 user nova-compute[103546]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:01:05 user nova-compute[103546]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af (non-flash)
Nov 16 04:01:05 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:01:05 user nova-compute[103546]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17 (non-flash)
Nov 16 04:01:05 user nova-compute[103546]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:01:05 user nova-compute[103546]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af (non-flash)
Nov 16 04:01:05 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] HCTL ('35', '-', '-', 0) found on session 39 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 04:01:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:06 user nova-compute[103546]: DEBUG nova.network.neutron [req-e8f239c2-7955-402d-9d9a-c92388c8d4b3 req-a960f041-c660-4c3e-909e-f87c90dfa39d service nova] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Updated VIF entry in instance network info cache for port 7df3a25d-d802-44f8-8a98-bb6be3453d3e. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 04:01:06 user nova-compute[103546]: DEBUG nova.network.neutron [req-e8f239c2-7955-402d-9d9a-c92388c8d4b3 req-a960f041-c660-4c3e-909e-f87c90dfa39d service nova] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Updating instance_info_cache with network_info: [{"id": "7df3a25d-d802-44f8-8a98-bb6be3453d3e", "address": "fa:16:3e:7c:b1:ba", "network": {"id": "f9df40e7-5801-4e0c-8b8b-6cdb4da22727", "bridge": "br-int", "label": "tempest-TestShelveInstance-1586968346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "164c650c4ec44057973d5d1ab45b7440", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7df3a25d-d8", "ovs_interfaceid": "7df3a25d-d802-44f8-8a98-bb6be3453d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:01:06 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:01:06 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[262a5dac-a96f-487e-8fe4-7d8636d69f4e]: (4, ('- - 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:01:06 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Searching for a device in session 39 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 04:01:06 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZQtTeObl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 04:01:06 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-e8f239c2-7955-402d-9d9a-c92388c8d4b3 req-a960f041-c660-4c3e-909e-f87c90dfa39d service nova] Releasing lock "refresh_cache-66b98917-7551-47a5-94a1-79606cf1467d" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:01:07 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:01:07 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '23230623732613861', 'path': '/dev/sdd'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:01:07 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23230623732613861', 'path': '/dev/sdd'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 04:01:07 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T03:57:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1218331939',display_name='tempest-TestShelveInstance-server-1218331939',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1218331939',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1411640263',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:57:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='164c650c4ec44057973d5d1ab45b7440',ramdisk_id='',reservation_id='r-03lh0eut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2052053009',owner_user_name='tempest-TestShelveInstance-2052053009-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T04:00:59Z,user_data=None,user_id='7a83510fe87042529b22273d0b26a662',uuid=66b98917-7551-47a5-94a1-79606cf1467d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "7df3a25d-d802-44f8-8a98-bb6be3453d3e", "address": "fa:16:3e:7c:b1:ba", "network": {"id": "f9df40e7-5801-4e0c-8b8b-6cdb4da22727", "bridge": "br-int", "label": "tempest-TestShelveInstance-1586968346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "164c650c4ec44057973d5d1ab45b7440", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7df3a25d-d8", "ovs_interfaceid": "7df3a25d-d802-44f8-8a98-bb6be3453d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 04:01:07 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Converting VIF {"id": "7df3a25d-d802-44f8-8a98-bb6be3453d3e", "address": "fa:16:3e:7c:b1:ba", "network": {"id": "f9df40e7-5801-4e0c-8b8b-6cdb4da22727", "bridge": "br-int", "label": "tempest-TestShelveInstance-1586968346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "164c650c4ec44057973d5d1ab45b7440", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7df3a25d-d8", "ovs_interfaceid": "7df3a25d-d802-44f8-8a98-bb6be3453d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:01:07 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:b1:ba,bridge_name='br-int',has_traffic_filtering=True,id=7df3a25d-d802-44f8-8a98-bb6be3453d3e,network=Network(f9df40e7-5801-4e0c-8b8b-6cdb4da22727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7df3a25d-d8') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:01:07 user nova-compute[103546]: DEBUG nova.objects.instance [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Lazy-loading 'pci_devices' on Instance uuid 66b98917-7551-47a5-94a1-79606cf1467d {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:01:07 user nova-compute[103546]: DEBUG nova.objects.base [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Object Instance<66b98917-7551-47a5-94a1-79606cf1467d> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 04:01:07 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] End _get_guest_xml xml=<domain type="kvm">
Nov 16 04:01:07 user nova-compute[103546]:   <uuid>66b98917-7551-47a5-94a1-79606cf1467d</uuid>
Nov 16 04:01:07 user nova-compute[103546]:   <name>instance-0000001f</name>
Nov 16 04:01:07 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 04:01:07 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 04:01:07 user nova-compute[103546]:   <metadata>
Nov 16 04:01:07 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 04:01:07 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 04:01:07 user nova-compute[103546]:       <nova:name>tempest-TestShelveInstance-server-1218331939</nova:name>
Nov 16 04:01:07 user nova-compute[103546]:       <nova:creationTime>2023-11-16 04:01:05</nova:creationTime>
Nov 16 04:01:07 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 04:01:07 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 04:01:07 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 04:01:07 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 04:01:07 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 04:01:07 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 04:01:07 user nova-compute[103546]:       </nova:flavor>
Nov 16 04:01:07 user nova-compute[103546]:       <nova:owner>
Nov 16 04:01:07 user nova-compute[103546]:         <nova:user uuid="7a83510fe87042529b22273d0b26a662">tempest-TestShelveInstance-2052053009-project-member</nova:user>
Nov 16 04:01:07 user nova-compute[103546]:         <nova:project uuid="164c650c4ec44057973d5d1ab45b7440">tempest-TestShelveInstance-2052053009</nova:project>
Nov 16 04:01:07 user nova-compute[103546]:       </nova:owner>
Nov 16 04:01:07 user nova-compute[103546]:       <nova:ports>
Nov 16 04:01:07 user nova-compute[103546]:         <nova:port uuid="7df3a25d-d802-44f8-8a98-bb6be3453d3e">
Nov 16 04:01:07 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 16 04:01:07 user nova-compute[103546]:         </nova:port>
Nov 16 04:01:07 user nova-compute[103546]:       </nova:ports>
Nov 16 04:01:07 user nova-compute[103546]:     </nova:instance>
Nov 16 04:01:07 user nova-compute[103546]:   </metadata>
Nov 16 04:01:07 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 04:01:07 user nova-compute[103546]:     <system>
Nov 16 04:01:07 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 04:01:07 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 04:01:07 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 04:01:07 user nova-compute[103546]:       <entry name="serial">66b98917-7551-47a5-94a1-79606cf1467d</entry>
Nov 16 04:01:07 user nova-compute[103546]:       <entry name="uuid">66b98917-7551-47a5-94a1-79606cf1467d</entry>
Nov 16 04:01:07 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 04:01:07 user nova-compute[103546]:     </system>
Nov 16 04:01:07 user nova-compute[103546]:   </sysinfo>
Nov 16 04:01:07 user nova-compute[103546]:   <os>
Nov 16 04:01:07 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 04:01:07 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 04:01:07 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 04:01:07 user nova-compute[103546]:   </os>
Nov 16 04:01:07 user nova-compute[103546]:   <features>
Nov 16 04:01:07 user nova-compute[103546]:     <acpi/>
Nov 16 04:01:07 user nova-compute[103546]:     <apic/>
Nov 16 04:01:07 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 04:01:07 user nova-compute[103546]:   </features>
Nov 16 04:01:07 user nova-compute[103546]:   <clock offset="utc">
Nov 16 04:01:07 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 04:01:07 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 04:01:07 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 04:01:07 user nova-compute[103546]:   </clock>
Nov 16 04:01:07 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 04:01:07 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 04:01:07 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 04:01:07 user nova-compute[103546]:   </cpu>
Nov 16 04:01:07 user nova-compute[103546]:   <devices>
Nov 16 04:01:07 user nova-compute[103546]:     <disk type="block" device="disk">
Nov 16 04:01:07 user nova-compute[103546]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:01:07 user nova-compute[103546]:       <source dev="/dev/sdd"/>
Nov 16 04:01:07 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 04:01:07 user nova-compute[103546]:       <serial>3690ac19-2af3-4701-97ba-2243a390f2af</serial>
Nov 16 04:01:07 user nova-compute[103546]:     </disk>
Nov 16 04:01:07 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 04:01:07 user nova-compute[103546]:       <mac address="fa:16:3e:7c:b1:ba"/>
Nov 16 04:01:07 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 04:01:07 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 04:01:07 user nova-compute[103546]:       <target dev="tap7df3a25d-d8"/>
Nov 16 04:01:07 user nova-compute[103546]:     </interface>
Nov 16 04:01:07 user nova-compute[103546]:     <serial type="pty">
Nov 16 04:01:07 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/66b98917-7551-47a5-94a1-79606cf1467d/console.log" append="off"/>
Nov 16 04:01:07 user nova-compute[103546]:     </serial>
Nov 16 04:01:07 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 04:01:07 user nova-compute[103546]:     <video>
Nov 16 04:01:07 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 04:01:07 user nova-compute[103546]:     </video>
Nov 16 04:01:07 user nova-compute[103546]:     <rng model="virtio">
Nov 16 04:01:07 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 04:01:07 user nova-compute[103546]:     </rng>
Nov 16 04:01:07 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 04:01:07 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 04:01:07 user nova-compute[103546]:       <stats period="10"/>
Nov 16 04:01:07 user nova-compute[103546]:     </memballoon>
Nov 16 04:01:07 user nova-compute[103546]:   </devices>
Nov 16 04:01:07 user nova-compute[103546]: </domain>
Nov 16 04:01:07 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 04:01:07 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T03:57:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1218331939',display_name='tempest-TestShelveInstance-server-1218331939',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1218331939',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1411640263',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:57:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='164c650c4ec44057973d5d1ab45b7440',ramdisk_id='',reservation_id='r-03lh0eut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2052053009',owner_user_name='tempest-TestShelveInstance-2052053009-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T04:00:59Z,user_data=None,user_id='7a83510fe87042529b22273d0b26a662',uuid=66b98917-7551-47a5-94a1-79606cf1467d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "7df3a25d-d802-44f8-8a98-bb6be3453d3e", "address": "fa:16:3e:7c:b1:ba", "network": {"id": "f9df40e7-5801-4e0c-8b8b-6cdb4da22727", "bridge": "br-int", "label": "tempest-TestShelveInstance-1586968346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "164c650c4ec44057973d5d1ab45b7440", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7df3a25d-d8", "ovs_interfaceid": "7df3a25d-d802-44f8-8a98-bb6be3453d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 04:01:07 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Converting VIF {"id": "7df3a25d-d802-44f8-8a98-bb6be3453d3e", "address": "fa:16:3e:7c:b1:ba", "network": {"id": "f9df40e7-5801-4e0c-8b8b-6cdb4da22727", "bridge": "br-int", "label": "tempest-TestShelveInstance-1586968346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "164c650c4ec44057973d5d1ab45b7440", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7df3a25d-d8", "ovs_interfaceid": "7df3a25d-d802-44f8-8a98-bb6be3453d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:01:07 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:b1:ba,bridge_name='br-int',has_traffic_filtering=True,id=7df3a25d-d802-44f8-8a98-bb6be3453d3e,network=Network(f9df40e7-5801-4e0c-8b8b-6cdb4da22727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7df3a25d-d8') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:01:07 user nova-compute[103546]: DEBUG os_vif [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:b1:ba,bridge_name='br-int',has_traffic_filtering=True,id=7df3a25d-d802-44f8-8a98-bb6be3453d3e,network=Network(f9df40e7-5801-4e0c-8b8b-6cdb4da22727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7df3a25d-d8') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 04:01:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:01:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:01:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 04:01:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:01:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '105af4d9-f8fb-5aaf-b6d1-f230c76d4fb3', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:01:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:01:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:01:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:01:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7df3a25d-d8, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:01:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7df3a25d-d8, col_values=(('qos', UUID('d1532499-a7ad-4dc7-b140-2e93e603d68e')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:01:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7df3a25d-d8, col_values=(('external_ids', {'iface-id': '7df3a25d-d802-44f8-8a98-bb6be3453d3e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:b1:ba', 'vm-uuid': '66b98917-7551-47a5-94a1-79606cf1467d'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:01:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:01:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:01:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:01:07 user nova-compute[103546]: INFO os_vif [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:b1:ba,bridge_name='br-int',has_traffic_filtering=True,id=7df3a25d-d802-44f8-8a98-bb6be3453d3e,network=Network(f9df40e7-5801-4e0c-8b8b-6cdb4da22727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7df3a25d-d8')
Nov 16 04:01:07 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:01:07 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] No VIF found with MAC fa:16:3e:7c:b1:ba, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 04:01:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:01:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:01:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:01:08 user nova-compute[103546]: DEBUG nova.compute.manager [req-f214d2e0-8c79-4c78-9348-d13f1a29aa08 req-66c4662e-9cf7-4789-beee-1114184a1388 service nova] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Received event network-vif-plugged-7df3a25d-d802-44f8-8a98-bb6be3453d3e {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:01:08 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-f214d2e0-8c79-4c78-9348-d13f1a29aa08 req-66c4662e-9cf7-4789-beee-1114184a1388 service nova] Acquiring lock "66b98917-7551-47a5-94a1-79606cf1467d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:01:08 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-f214d2e0-8c79-4c78-9348-d13f1a29aa08 req-66c4662e-9cf7-4789-beee-1114184a1388 service nova] Lock "66b98917-7551-47a5-94a1-79606cf1467d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:01:08 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-f214d2e0-8c79-4c78-9348-d13f1a29aa08 req-66c4662e-9cf7-4789-beee-1114184a1388 service nova] Lock "66b98917-7551-47a5-94a1-79606cf1467d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:01:08 user nova-compute[103546]: DEBUG nova.compute.manager [req-f214d2e0-8c79-4c78-9348-d13f1a29aa08 req-66c4662e-9cf7-4789-beee-1114184a1388 service nova] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] No waiting events found dispatching network-vif-plugged-7df3a25d-d802-44f8-8a98-bb6be3453d3e {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:01:08 user nova-compute[103546]: WARNING nova.compute.manager [req-f214d2e0-8c79-4c78-9348-d13f1a29aa08 req-66c4662e-9cf7-4789-beee-1114184a1388 service nova] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Received unexpected event network-vif-plugged-7df3a25d-d802-44f8-8a98-bb6be3453d3e for instance with vm_state shelved_offloaded and task_state spawning.
Nov 16 04:01:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:01:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:01:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:01:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:01:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:01:09 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8256ea92-03f5-4ab4-b203-fa2fb65196df tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 04:01:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-8256ea92-03f5-4ab4-b203-fa2fb65196df tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AprzmwSJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:01:09 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-8256ea92-03f5-4ab4-b203-fa2fb65196df tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:01:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-8256ea92-03f5-4ab4-b203-fa2fb65196df tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:01:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-8256ea92-03f5-4ab4-b203-fa2fb65196df tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:01:09 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-8256ea92-03f5-4ab4-b203-fa2fb65196df tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:01:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-8256ea92-03f5-4ab4-b203-fa2fb65196df tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:01:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-8256ea92-03f5-4ab4-b203-fa2fb65196df tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:01:09 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-8256ea92-03f5-4ab4-b203-fa2fb65196df tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 04:01:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:01:09 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d31a97-036d-4220-a1f2-896b04aed074]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:01:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-8256ea92-03f5-4ab4-b203-fa2fb65196df tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 04:01:09 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:01:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e -p 172.16.0.220:3260 --interface default --op new {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:01:09 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[746cf1d9-73ed-4552-b98a-f6cf6bc871e3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e] added\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:01:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-8256ea92-03f5-4ab4-b203-fa2fb65196df tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e] added
Nov 16 04:01:09 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:01:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:01:09 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e426827-e780-4520-984b-93d33c009dfc]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:01:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-8256ea92-03f5-4ab4-b203-fa2fb65196df tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:01:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:01:09 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d5725d-2dad-4bcb-a573-464ec298c7d4]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:01:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-8256ea92-03f5-4ab4-b203-fa2fb65196df tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:01:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AprzmwSJ {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AprzmwSJ" returned: 0 in 0.028s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:01:09 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[700d04f8-8ec6-423d-ace0-fcb16472c542]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:01:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-8256ea92-03f5-4ab4-b203-fa2fb65196df tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AprzmwSJ'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:01:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:09 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-e1dba307-2fc4-4776-9660-ec8140a4b93c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d2781221-b5e3-468a-a9f5-436a04285f38 is timed out.
Nov 16 04:01:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:01:09 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c00bbff-35ef-44a2-9843-7c906ccc24cb]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:01:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-8256ea92-03f5-4ab4-b203-fa2fb65196df tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:01:09 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-e1dba307-2fc4-4776-9660-ec8140a4b93c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Successfully detached device vdb from instance d2781221-b5e3-468a-a9f5-436a04285f38 from the live domain config.
Nov 16 04:01:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:09 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1dba307-2fc4-4776-9660-ec8140a4b93c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 04:01:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1dba307-2fc4-4776-9660-ec8140a4b93c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zsxKYaUl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:01:09 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-e1dba307-2fc4-4776-9660-ec8140a4b93c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:01:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-e1dba307-2fc4-4776-9660-ec8140a4b93c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:01:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:01:09 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7cb665-d101-4a4b-94ae-de2a47ab8e60]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:01:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-8256ea92-03f5-4ab4-b203-fa2fb65196df tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:01:09 user nova-compute[103546]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17 (non-flash)
Nov 16 04:01:09 user nova-compute[103546]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:01:09 user nova-compute[103546]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af (non-flash)
Nov 16 04:01:09 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:01:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-8256ea92-03f5-4ab4-b203-fa2fb65196df tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:01:09 user nova-compute[103546]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17 (non-flash)
Nov 16 04:01:09 user nova-compute[103546]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:01:09 user nova-compute[103546]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af (non-flash)
Nov 16 04:01:09 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:01:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e -p 172.16.0.220:3260 --login {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:01:09 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1e25a0-a74f-44b0-8a66-33c14e4b5dd0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:01:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-8256ea92-03f5-4ab4-b203-fa2fb65196df tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e, portal: 172.16.0.220,3260]
Nov 16 04:01:09 user nova-compute[103546]: Login to [iface: default, target: iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e, portal: 172.16.0.220,3260] successful.
Nov 16 04:01:09 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:01:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:01:09 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[14347140-c21b-48c5-84cc-3337d7540c4d]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:01:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-8256ea92-03f5-4ab4-b203-fa2fb65196df tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:01:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:01:09 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be63fcd-03b3-45cd-a6b3-2b74412d2dcc]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:01:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-8256ea92-03f5-4ab4-b203-fa2fb65196df tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:01:09 user nova-compute[103546]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17 (non-flash)
Nov 16 04:01:09 user nova-compute[103546]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:01:09 user nova-compute[103546]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af (non-flash)
Nov 16 04:01:09 user nova-compute[103546]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)
Nov 16 04:01:09 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:01:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-8256ea92-03f5-4ab4-b203-fa2fb65196df tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:01:09 user nova-compute[103546]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17 (non-flash)
Nov 16 04:01:09 user nova-compute[103546]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:01:09 user nova-compute[103546]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af (non-flash)
Nov 16 04:01:09 user nova-compute[103546]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)
Nov 16 04:01:09 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:01:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-8256ea92-03f5-4ab4-b203-fa2fb65196df tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:01:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-8256ea92-03f5-4ab4-b203-fa2fb65196df tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 04:01:09 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-8256ea92-03f5-4ab4-b203-fa2fb65196df tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] HCTL ('36', '-', '-', 0) found on session 40 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 04:01:09 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-8256ea92-03f5-4ab4-b203-fa2fb65196df tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 04:01:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:09 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:01:09 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0fc94d-83e2-4064-be85-95f82c274ebc]: (4, ('- - 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:01:09 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-8256ea92-03f5-4ab4-b203-fa2fb65196df tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Searching for a device in session 40 and hctl ['36', '*', '*', 0] yield: sde {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 04:01:09 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-8256ea92-03f5-4ab4-b203-fa2fb65196df tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AprzmwSJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 04:01:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-8256ea92-03f5-4ab4-b203-fa2fb65196df tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.393s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:01:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-8256ea92-03f5-4ab4-b203-fa2fb65196df tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] <== connect_volume: return (1395ms) {'type': 'block', 'scsi_wwn': '26662333337323561', 'path': '/dev/sde'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:01:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8256ea92-03f5-4ab4-b203-fa2fb65196df tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662333337323561', 'path': '/dev/sde'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 04:01:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-e1dba307-2fc4-4776-9660-ec8140a4b93c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.214s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:01:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:10 user nova-compute[103546]: DEBUG nova.objects.instance [None req-8256ea92-03f5-4ab4-b203-fa2fb65196df tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lazy-loading 'flavor' on Instance uuid b0a480de-e99b-4b54-bd81-36c216442137 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:01:10 user nova-compute[103546]: DEBUG nova.compute.manager [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 04:01:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Guest created on hypervisor {{(pid=103546) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 04:01:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:01:10 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[57aa8928-507f-4dca-b537-eb112507f487]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:01:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1dba307-2fc4-4776-9660-ec8140a4b93c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 04:01:10 user nova-compute[103546]: No targets found.
Nov 16 04:01:10 user nova-compute[103546]: iSNS:
Nov 16 04:01:10 user nova-compute[103546]: No targets found.
Nov 16 04:01:10 user nova-compute[103546]: STATIC:
Nov 16 04:01:10 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e
Nov 16 04:01:10 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:01:10 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:01:10 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4
Nov 16 04:01:10 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:01:10 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:01:10 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e
Nov 16 04:01:10 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:01:10 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:01:10 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af
Nov 16 04:01:10 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:01:10 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:01:10 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17
Nov 16 04:01:10 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:01:10 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:01:10 user nova-compute[103546]: FIRMWARE:
Nov 16 04:01:10 user nova-compute[103546]: No targets found.
Nov 16 04:01:10 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:01:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1dba307-2fc4-4776-9660-ec8140a4b93c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 04:01:10 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 04:01:10 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 04:01:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1dba307-2fc4-4776-9660-ec8140a4b93c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 04:01:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:10 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Instance spawned successfully.
Nov 16 04:01:10 user nova-compute[103546]: DEBUG nova.compute.manager [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 04:01:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-8256ea92-03f5-4ab4-b203-fa2fb65196df tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 04:01:10 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:01:10 user nova-compute[103546]:   <source dev="/dev/sde"/>
Nov 16 04:01:10 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 04:01:10 user nova-compute[103546]:   <serial>cea53f8b-4d4d-4d25-99c7-1da6a373891e</serial>
Nov 16 04:01:10 user nova-compute[103546]: </disk>
Nov 16 04:01:10 user nova-compute[103546]:  {{(pid=103546) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 04:01:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:01:10 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc16c9f-31ff-47d2-a701-5a7814cc7dbb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:01:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:01:10 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c02a53a-0948-41c6-a844-5b8cc2963ab2]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:01:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1dba307-2fc4-4776-9660-ec8140a4b93c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:01:10 user nova-compute[103546]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17 (non-flash)
Nov 16 04:01:10 user nova-compute[103546]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:01:10 user nova-compute[103546]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af (non-flash)
Nov 16 04:01:10 user nova-compute[103546]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)
Nov 16 04:01:10 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:01:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1dba307-2fc4-4776-9660-ec8140a4b93c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:01:10 user nova-compute[103546]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17 (non-flash)
Nov 16 04:01:10 user nova-compute[103546]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:01:10 user nova-compute[103546]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af (non-flash)
Nov 16 04:01:10 user nova-compute[103546]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)
Nov 16 04:01:10 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:01:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1dba307-2fc4-4776-9660-ec8140a4b93c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60ac48b880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17'): ({'sdh'}, set())}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 04:01:10 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-e1dba307-2fc4-4776-9660-ec8140a4b93c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Removing single pathed devices sdh {{(pid=103546) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 04:01:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:01:10 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fdc81d3-2b47-4da9-be0e-c187daad83ac]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:01:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-bbb4cd7d-1984-4ed7-9da4-662a61091b11 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Lock "66b98917-7551-47a5-94a1-79606cf1467d" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.684s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:01:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.025s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:01:10 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5405874-7523-4f59-a1c9-b9458705a5d4]: (4, ('ok\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:01:10 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-e1dba307-2fc4-4776-9660-ec8140a4b93c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Flushing IO for device /dev/sdh {{(pid=103546) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 04:01:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:01:10 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b05385-0bfe-496c-9e84-e215b58b6aa8]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:01:10 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-e1dba307-2fc4-4776-9660-ec8140a4b93c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=103546) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 04:01:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:10 user nova-compute[103546]: DEBUG nova.compute.manager [req-f50978d2-b3c9-473d-902a-139754add6b1 req-3064d090-eebb-4c6f-8b13-e430ca8addba service nova] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Received event network-vif-plugged-7df3a25d-d802-44f8-8a98-bb6be3453d3e {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:01:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-f50978d2-b3c9-473d-902a-139754add6b1 req-3064d090-eebb-4c6f-8b13-e430ca8addba service nova] Acquiring lock "66b98917-7551-47a5-94a1-79606cf1467d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:01:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-f50978d2-b3c9-473d-902a-139754add6b1 req-3064d090-eebb-4c6f-8b13-e430ca8addba service nova] Lock "66b98917-7551-47a5-94a1-79606cf1467d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:01:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-f50978d2-b3c9-473d-902a-139754add6b1 req-3064d090-eebb-4c6f-8b13-e430ca8addba service nova] Lock "66b98917-7551-47a5-94a1-79606cf1467d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:01:10 user nova-compute[103546]: DEBUG nova.compute.manager [req-f50978d2-b3c9-473d-902a-139754add6b1 req-3064d090-eebb-4c6f-8b13-e430ca8addba service nova] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] No waiting events found dispatching network-vif-plugged-7df3a25d-d802-44f8-8a98-bb6be3453d3e {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:01:10 user nova-compute[103546]: WARNING nova.compute.manager [req-f50978d2-b3c9-473d-902a-139754add6b1 req-3064d090-eebb-4c6f-8b13-e430ca8addba service nova] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Received unexpected event network-vif-plugged-7df3a25d-d802-44f8-8a98-bb6be3453d3e for instance with vm_state active and task_state None.
Nov 16 04:01:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.032s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:01:10 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[7caef46a-c7d8-416d-b378-08e707b84fce]: (4, ('1', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:01:10 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-e1dba307-2fc4-4776-9660-ec8140a4b93c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 04:01:10 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-e1dba307-2fc4-4776-9660-ec8140a4b93c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] SCSI volumes sdh have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 04:01:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1dba307-2fc4-4776-9660-ec8140a4b93c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17')] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 04:01:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:01:10 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[0625948e-beeb-4ec1-831e-f45ff047f36e]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:01:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1dba307-2fc4-4776-9660-ec8140a4b93c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:01:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17 -p 172.16.0.220:3260 --logout {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:01:10 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[2380e2b6-fd78-469f-8de1-4cb528efa05d]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:01:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1dba307-2fc4-4776-9660-ec8140a4b93c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17, portal: 172.16.0.220,3260]
Nov 16 04:01:10 user nova-compute[103546]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17, portal: 172.16.0.220,3260] successful.
Nov 16 04:01:10 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:01:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17 -p 172.16.0.220:3260 --op delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eb2ddb2-cce9-416f-b15c-58dd8afa3e17 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:01:10 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c22b895-0ace-40c0-bd17-e9ce1d527be4]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:01:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1dba307-2fc4-4776-9660-ec8140a4b93c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:01:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-e1dba307-2fc4-4776-9660-ec8140a4b93c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:01:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1dba307-2fc4-4776-9660-ec8140a4b93c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] <== disconnect_volume: return (1565ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:01:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1dba307-2fc4-4776-9660-ec8140a4b93c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 04:01:11 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-8256ea92-03f5-4ab4-b203-fa2fb65196df tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:01:11 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-8256ea92-03f5-4ab4-b203-fa2fb65196df tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] No BDM found with device name vdb, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:01:11 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-8256ea92-03f5-4ab4-b203-fa2fb65196df tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] No VIF found with MAC fa:16:3e:d5:4f:3e, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 04:01:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-8256ea92-03f5-4ab4-b203-fa2fb65196df tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "b0a480de-e99b-4b54-bd81-36c216442137" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.233s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:01:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-bbae39ce-e88c-491d-a47a-da09cdc90b80 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Acquiring lock "b0a480de-e99b-4b54-bd81-36c216442137" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:01:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-bbae39ce-e88c-491d-a47a-da09cdc90b80 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "b0a480de-e99b-4b54-bd81-36c216442137" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:01:11 user nova-compute[103546]: DEBUG nova.compute.manager [None req-bbae39ce-e88c-491d-a47a-da09cdc90b80 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 04:01:11 user nova-compute[103546]: DEBUG nova.compute.manager [None req-bbae39ce-e88c-491d-a47a-da09cdc90b80 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=103546) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 16 04:01:11 user nova-compute[103546]: DEBUG nova.objects.instance [None req-bbae39ce-e88c-491d-a47a-da09cdc90b80 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lazy-loading 'flavor' on Instance uuid b0a480de-e99b-4b54-bd81-36c216442137 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:01:11 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:01:11 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:01:11 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:01:11 user nova-compute[103546]: DEBUG nova.objects.instance [None req-e1dba307-2fc4-4776-9660-ec8140a4b93c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lazy-loading 'flavor' on Instance uuid d2781221-b5e3-468a-a9f5-436a04285f38 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:01:11 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:01:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e1dba307-2fc4-4776-9660-ec8140a4b93c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "d2781221-b5e3-468a-a9f5-436a04285f38" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.255s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:01:12 user nova-compute[103546]: DEBUG nova.compute.manager [req-1375dccb-4c7f-45a7-9fcc-4f0cd9ce7334 req-6a2e4c90-47ba-4ad2-a95e-eb291d57a122 service nova] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Received event network-vif-unplugged-804319c6-55cb-4f30-908c-71817934fb45 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:01:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-1375dccb-4c7f-45a7-9fcc-4f0cd9ce7334 req-6a2e4c90-47ba-4ad2-a95e-eb291d57a122 service nova] Acquiring lock "b0a480de-e99b-4b54-bd81-36c216442137-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:01:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-1375dccb-4c7f-45a7-9fcc-4f0cd9ce7334 req-6a2e4c90-47ba-4ad2-a95e-eb291d57a122 service nova] Lock "b0a480de-e99b-4b54-bd81-36c216442137-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:01:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-1375dccb-4c7f-45a7-9fcc-4f0cd9ce7334 req-6a2e4c90-47ba-4ad2-a95e-eb291d57a122 service nova] Lock "b0a480de-e99b-4b54-bd81-36c216442137-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:01:12 user nova-compute[103546]: DEBUG nova.compute.manager [req-1375dccb-4c7f-45a7-9fcc-4f0cd9ce7334 req-6a2e4c90-47ba-4ad2-a95e-eb291d57a122 service nova] [instance: b0a480de-e99b-4b54-bd81-36c216442137] No waiting events found dispatching network-vif-unplugged-804319c6-55cb-4f30-908c-71817934fb45 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:01:12 user nova-compute[103546]: WARNING nova.compute.manager [req-1375dccb-4c7f-45a7-9fcc-4f0cd9ce7334 req-6a2e4c90-47ba-4ad2-a95e-eb291d57a122 service nova] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Received unexpected event network-vif-unplugged-804319c6-55cb-4f30-908c-71817934fb45 for instance with vm_state active and task_state powering-off.
Nov 16 04:01:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:01:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:01:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:01:12 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Instance destroyed successfully.
Nov 16 04:01:12 user nova-compute[103546]: DEBUG nova.compute.manager [None req-bbae39ce-e88c-491d-a47a-da09cdc90b80 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 04:01:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-bbae39ce-e88c-491d-a47a-da09cdc90b80 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "b0a480de-e99b-4b54-bd81-36c216442137" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.109s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:01:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:01:14 user nova-compute[103546]: DEBUG nova.compute.manager [req-1de50ec7-8e75-4bdb-b639-7c1bf97800f6 req-d50e4f9b-f8ed-4a85-8f2b-7302679c0364 service nova] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Received event network-vif-plugged-804319c6-55cb-4f30-908c-71817934fb45 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:01:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-1de50ec7-8e75-4bdb-b639-7c1bf97800f6 req-d50e4f9b-f8ed-4a85-8f2b-7302679c0364 service nova] Acquiring lock "b0a480de-e99b-4b54-bd81-36c216442137-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:01:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-1de50ec7-8e75-4bdb-b639-7c1bf97800f6 req-d50e4f9b-f8ed-4a85-8f2b-7302679c0364 service nova] Lock "b0a480de-e99b-4b54-bd81-36c216442137-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:01:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-1de50ec7-8e75-4bdb-b639-7c1bf97800f6 req-d50e4f9b-f8ed-4a85-8f2b-7302679c0364 service nova] Lock "b0a480de-e99b-4b54-bd81-36c216442137-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:01:14 user nova-compute[103546]: DEBUG nova.compute.manager [req-1de50ec7-8e75-4bdb-b639-7c1bf97800f6 req-d50e4f9b-f8ed-4a85-8f2b-7302679c0364 service nova] [instance: b0a480de-e99b-4b54-bd81-36c216442137] No waiting events found dispatching network-vif-plugged-804319c6-55cb-4f30-908c-71817934fb45 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:01:14 user nova-compute[103546]: WARNING nova.compute.manager [req-1de50ec7-8e75-4bdb-b639-7c1bf97800f6 req-d50e4f9b-f8ed-4a85-8f2b-7302679c0364 service nova] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Received unexpected event network-vif-plugged-804319c6-55cb-4f30-908c-71817934fb45 for instance with vm_state stopped and task_state None.
Nov 16 04:01:17 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:01:18 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:01:18 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:01:18 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=103546) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 04:01:18 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:01:19 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:01:20 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:01:21 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:01:21 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:01:21 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager.update_available_resource {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:01:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:01:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:01:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:01:21 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Auditing locally available compute resources for user (node: user) {{(pid=103546) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 04:01:21 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 04:01:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk.rescue --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:01:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:01:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk.rescue --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:01:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:01:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:01:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f7c407-3373-43ba-ac92-7eb0a43a7093/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f7c407-3373-43ba-ac92-7eb0a43a7093/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:01:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f7c407-3373-43ba-ac92-7eb0a43a7093/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f7c407-3373-43ba-ac92-7eb0a43a7093/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:01:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:01:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:01:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:01:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:01:23 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 04:01:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2781221-b5e3-468a-a9f5-436a04285f38/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2781221-b5e3-468a-a9f5-436a04285f38/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:01:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2781221-b5e3-468a-a9f5-436a04285f38/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2781221-b5e3-468a-a9f5-436a04285f38/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:01:24 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 04:01:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.rescue --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:01:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.rescue --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:01:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:01:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:01:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:01:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:01:25 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 04:01:25 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:01:25 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:01:25 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Hypervisor/Node resource view: name=user free_ram=7804MB free_disk=25.150039672851562GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=103546) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 04:01:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:01:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:01:25 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 9a89970b-fc61-4419-8ff9-b48013dccf9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:01:25 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 04101512-7333-4581-add3-7af3821e335b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:01:25 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance fa7e5468-9dd4-407d-85ec-d45ec76f9e29 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:01:25 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 246ccf69-847c-4ab2-b709-ad1a85e81eab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:01:25 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 8d229d05-95f1-4997-8539-802ac65cff8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:01:25 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance d2781221-b5e3-468a-a9f5-436a04285f38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:01:25 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance b0a480de-e99b-4b54-bd81-36c216442137 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:01:25 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 38f7c407-3373-43ba-ac92-7eb0a43a7093 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:01:25 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance e5b2903b-053a-4671-af52-aa08e0b220b8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:01:25 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 66b98917-7551-47a5-94a1-79606cf1467d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:01:25 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 04:01:25 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 04:01:26 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:01:26 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:01:26 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Compute_service record updated for user:user {{(pid=103546) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 04:01:26 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.521s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:01:26 user nova-compute[103546]: DEBUG nova.compute.manager [None req-cf089590-7d52-4130-b043-bf2bb3a0a059 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 04:01:26 user nova-compute[103546]: INFO nova.compute.manager [None req-cf089590-7d52-4130-b043-bf2bb3a0a059 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] instance snapshotting
Nov 16 04:01:26 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-cf089590-7d52-4130-b043-bf2bb3a0a059 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Beginning live snapshot process
Nov 16 04:01:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-cf089590-7d52-4130-b043-bf2bb3a0a059 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f7c407-3373-43ba-ac92-7eb0a43a7093/disk --force-share --output=json -f qcow2 {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-cf089590-7d52-4130-b043-bf2bb3a0a059 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f7c407-3373-43ba-ac92-7eb0a43a7093/disk --force-share --output=json -f qcow2" returned: 0 in 0.177s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:01:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-cf089590-7d52-4130-b043-bf2bb3a0a059 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f7c407-3373-43ba-ac92-7eb0a43a7093/disk --force-share --output=json -f qcow2 {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:27 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:01:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-cf089590-7d52-4130-b043-bf2bb3a0a059 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f7c407-3373-43ba-ac92-7eb0a43a7093/disk --force-share --output=json -f qcow2" returned: 0 in 0.181s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:01:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-cf089590-7d52-4130-b043-bf2bb3a0a059 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-cf089590-7d52-4130-b043-bf2bb3a0a059 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.195s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:01:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-cf089590-7d52-4130-b043-bf2bb3a0a059 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpyr_pp8fi/425a1740a578453ab2b2301d8d58aa3d.delta 1073741824 {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-cf089590-7d52-4130-b043-bf2bb3a0a059 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpyr_pp8fi/425a1740a578453ab2b2301d8d58aa3d.delta 1073741824" returned: 0 in 0.057s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:01:27 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-cf089590-7d52-4130-b043-bf2bb3a0a059 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 16 04:01:28 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-cf089590-7d52-4130-b043-bf2bb3a0a059 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=103546) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 04:01:28 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:01:28 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Starting heal instance info cache {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 04:01:28 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "refresh_cache-8d229d05-95f1-4997-8539-802ac65cff8b" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:01:28 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquired lock "refresh_cache-8d229d05-95f1-4997-8539-802ac65cff8b" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:01:28 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Forcefully refreshing network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 04:01:28 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:01:28 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-cf089590-7d52-4130-b043-bf2bb3a0a059 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=103546) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 04:01:28 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-cf089590-7d52-4130-b043-bf2bb3a0a059 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 16 04:01:28 user nova-compute[103546]: DEBUG nova.privsep.utils [None req-cf089590-7d52-4130-b043-bf2bb3a0a059 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=103546) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 04:01:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-cf089590-7d52-4130-b043-bf2bb3a0a059 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpyr_pp8fi/425a1740a578453ab2b2301d8d58aa3d.delta /opt/stack/data/nova/instances/snapshots/tmpyr_pp8fi/425a1740a578453ab2b2301d8d58aa3d {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:29 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Updating instance_info_cache with network_info: [{"id": "5c802613-81ea-4855-a8ee-d851a4ab2ff5", "address": "fa:16:3e:01:69:11", "network": {"id": "337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-40560053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca049d5674dc4c59814f98478752d73d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c802613-81", "ovs_interfaceid": "5c802613-81ea-4855-a8ee-d851a4ab2ff5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:01:29 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Releasing lock "refresh_cache-8d229d05-95f1-4997-8539-802ac65cff8b" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:01:29 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Updated the network info_cache for instance {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 04:01:29 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:01:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-cf089590-7d52-4130-b043-bf2bb3a0a059 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpyr_pp8fi/425a1740a578453ab2b2301d8d58aa3d.delta /opt/stack/data/nova/instances/snapshots/tmpyr_pp8fi/425a1740a578453ab2b2301d8d58aa3d" returned: 0 in 0.401s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:01:29 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-cf089590-7d52-4130-b043-bf2bb3a0a059 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Snapshot extracted, beginning image upload
Nov 16 04:01:31 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-cf089590-7d52-4130-b043-bf2bb3a0a059 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Snapshot image upload complete
Nov 16 04:01:31 user nova-compute[103546]: INFO nova.compute.manager [None req-cf089590-7d52-4130-b043-bf2bb3a0a059 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Took 5.11 seconds to snapshot the instance on the hypervisor.
Nov 16 04:01:32 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:01:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:01:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:01:38 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:01:39 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f5d4f091-d41f-4c38-8bbf-3b471a6122b7 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Acquiring lock "d2781221-b5e3-468a-a9f5-436a04285f38" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:01:39 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f5d4f091-d41f-4c38-8bbf-3b471a6122b7 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "d2781221-b5e3-468a-a9f5-436a04285f38" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:01:39 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f5d4f091-d41f-4c38-8bbf-3b471a6122b7 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Acquiring lock "d2781221-b5e3-468a-a9f5-436a04285f38-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:01:39 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f5d4f091-d41f-4c38-8bbf-3b471a6122b7 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "d2781221-b5e3-468a-a9f5-436a04285f38-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:01:39 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f5d4f091-d41f-4c38-8bbf-3b471a6122b7 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "d2781221-b5e3-468a-a9f5-436a04285f38-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:01:39 user nova-compute[103546]: INFO nova.compute.manager [None req-f5d4f091-d41f-4c38-8bbf-3b471a6122b7 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Terminating instance
Nov 16 04:01:39 user nova-compute[103546]: DEBUG nova.compute.manager [None req-f5d4f091-d41f-4c38-8bbf-3b471a6122b7 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Start destroying the instance on the hypervisor. {{(pid=103546) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 04:01:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:01:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:01:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:01:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:01:39 user nova-compute[103546]: DEBUG nova.compute.manager [req-1ef90eb7-bb87-460d-b761-ff60636e0a67 req-d533c8fc-45d1-4619-9afb-d9962d4a7555 service nova] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Received event network-vif-unplugged-eb9c9c0a-9b82-4cdf-8500-4ee860f7af29 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:01:39 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-1ef90eb7-bb87-460d-b761-ff60636e0a67 req-d533c8fc-45d1-4619-9afb-d9962d4a7555 service nova] Acquiring lock "d2781221-b5e3-468a-a9f5-436a04285f38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:01:39 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-1ef90eb7-bb87-460d-b761-ff60636e0a67 req-d533c8fc-45d1-4619-9afb-d9962d4a7555 service nova] Lock "d2781221-b5e3-468a-a9f5-436a04285f38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:01:39 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-1ef90eb7-bb87-460d-b761-ff60636e0a67 req-d533c8fc-45d1-4619-9afb-d9962d4a7555 service nova] Lock "d2781221-b5e3-468a-a9f5-436a04285f38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:01:39 user nova-compute[103546]: DEBUG nova.compute.manager [req-1ef90eb7-bb87-460d-b761-ff60636e0a67 req-d533c8fc-45d1-4619-9afb-d9962d4a7555 service nova] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] No waiting events found dispatching network-vif-unplugged-eb9c9c0a-9b82-4cdf-8500-4ee860f7af29 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:01:39 user nova-compute[103546]: DEBUG nova.compute.manager [req-1ef90eb7-bb87-460d-b761-ff60636e0a67 req-d533c8fc-45d1-4619-9afb-d9962d4a7555 service nova] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Received event network-vif-unplugged-eb9c9c0a-9b82-4cdf-8500-4ee860f7af29 for instance with task_state deleting. {{(pid=103546) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 04:01:39 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Instance destroyed successfully.
Nov 16 04:01:39 user nova-compute[103546]: DEBUG nova.objects.instance [None req-f5d4f091-d41f-4c38-8bbf-3b471a6122b7 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lazy-loading 'resources' on Instance uuid d2781221-b5e3-468a-a9f5-436a04285f38 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:01:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-f5d4f091-d41f-4c38-8bbf-3b471a6122b7 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:56:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1295336225',display_name='tempest-AttachVolumeNegativeTest-server-1295336225',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1295336225',id=29,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmFqW9Ya5huTzoeMqLWjm2iOiVpkMs9WeDX03O1VPlo9epVFzumZLl0TMAcD6CuUM4LCSbHULqHqP3ONdSQ3LH/y987ruX6Ior2qKUuAU3l1rCYF025N+ZX9LsQ7uZXbA==',key_name='tempest-keypair-379855101',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:56:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8e30b7ac9515458aa8a6eb1a34cc543a',ramdisk_id='',reservation_id='r-96jdt4g0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-64216432',owner_user_name='tempest-AttachVolumeNegativeTest-64216432-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T03:56:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d186163bddc48319b97f186f7c65e80',uuid=d2781221-b5e3-468a-a9f5-436a04285f38,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb9c9c0a-9b82-4cdf-8500-4ee860f7af29", "address": "fa:16:3e:28:2f:a8", "network": {"id": "6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038318316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e30b7ac9515458aa8a6eb1a34cc543a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb9c9c0a-9b", "ovs_interfaceid": "eb9c9c0a-9b82-4cdf-8500-4ee860f7af29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 04:01:39 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-f5d4f091-d41f-4c38-8bbf-3b471a6122b7 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Converting VIF {"id": "eb9c9c0a-9b82-4cdf-8500-4ee860f7af29", "address": "fa:16:3e:28:2f:a8", "network": {"id": "6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038318316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e30b7ac9515458aa8a6eb1a34cc543a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb9c9c0a-9b", "ovs_interfaceid": "eb9c9c0a-9b82-4cdf-8500-4ee860f7af29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:01:39 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-f5d4f091-d41f-4c38-8bbf-3b471a6122b7 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:2f:a8,bridge_name='br-int',has_traffic_filtering=True,id=eb9c9c0a-9b82-4cdf-8500-4ee860f7af29,network=Network(6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb9c9c0a-9b') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:01:39 user nova-compute[103546]: DEBUG os_vif [None req-f5d4f091-d41f-4c38-8bbf-3b471a6122b7 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:2f:a8,bridge_name='br-int',has_traffic_filtering=True,id=eb9c9c0a-9b82-4cdf-8500-4ee860f7af29,network=Network(6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb9c9c0a-9b') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 04:01:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:01:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeb9c9c0a-9b, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:01:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:01:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:01:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:01:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:01:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=343bc408-cc2b-420e-8dfc-79c08c582c3a) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:01:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:01:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:01:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:01:39 user nova-compute[103546]: INFO os_vif [None req-f5d4f091-d41f-4c38-8bbf-3b471a6122b7 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:2f:a8,bridge_name='br-int',has_traffic_filtering=True,id=eb9c9c0a-9b82-4cdf-8500-4ee860f7af29,network=Network(6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb9c9c0a-9b')
Nov 16 04:01:39 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-f5d4f091-d41f-4c38-8bbf-3b471a6122b7 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Deleting instance files /opt/stack/data/nova/instances/d2781221-b5e3-468a-a9f5-436a04285f38_del
Nov 16 04:01:39 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-f5d4f091-d41f-4c38-8bbf-3b471a6122b7 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Deletion of /opt/stack/data/nova/instances/d2781221-b5e3-468a-a9f5-436a04285f38_del complete
Nov 16 04:01:40 user nova-compute[103546]: INFO nova.compute.manager [None req-f5d4f091-d41f-4c38-8bbf-3b471a6122b7 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 16 04:01:40 user nova-compute[103546]: DEBUG oslo.service.loopingcall [None req-f5d4f091-d41f-4c38-8bbf-3b471a6122b7 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=103546) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 04:01:40 user nova-compute[103546]: DEBUG nova.compute.manager [-] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Deallocating network for instance {{(pid=103546) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 04:01:40 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] deallocate_for_instance() {{(pid=103546) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 04:01:40 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:01:40 user nova-compute[103546]: INFO nova.compute.manager [-] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Took 0.72 seconds to deallocate network for instance.
Nov 16 04:01:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f5d4f091-d41f-4c38-8bbf-3b471a6122b7 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:01:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f5d4f091-d41f-4c38-8bbf-3b471a6122b7 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:01:41 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-f5d4f091-d41f-4c38-8bbf-3b471a6122b7 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:01:41 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-f5d4f091-d41f-4c38-8bbf-3b471a6122b7 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:01:41 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f5d4f091-d41f-4c38-8bbf-3b471a6122b7 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.388s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:01:41 user nova-compute[103546]: INFO nova.scheduler.client.report [None req-f5d4f091-d41f-4c38-8bbf-3b471a6122b7 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Deleted allocations for instance d2781221-b5e3-468a-a9f5-436a04285f38
Nov 16 04:01:41 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f5d4f091-d41f-4c38-8bbf-3b471a6122b7 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "d2781221-b5e3-468a-a9f5-436a04285f38" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.162s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:01:41 user nova-compute[103546]: DEBUG nova.compute.manager [req-549db298-2147-4100-8abc-0ae1290d2958 req-29c4596b-e7d5-4713-9268-7bea8194c2d6 service nova] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Received event network-vif-plugged-eb9c9c0a-9b82-4cdf-8500-4ee860f7af29 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:01:41 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-549db298-2147-4100-8abc-0ae1290d2958 req-29c4596b-e7d5-4713-9268-7bea8194c2d6 service nova] Acquiring lock "d2781221-b5e3-468a-a9f5-436a04285f38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:01:41 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-549db298-2147-4100-8abc-0ae1290d2958 req-29c4596b-e7d5-4713-9268-7bea8194c2d6 service nova] Lock "d2781221-b5e3-468a-a9f5-436a04285f38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:01:41 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-549db298-2147-4100-8abc-0ae1290d2958 req-29c4596b-e7d5-4713-9268-7bea8194c2d6 service nova] Lock "d2781221-b5e3-468a-a9f5-436a04285f38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:01:41 user nova-compute[103546]: DEBUG nova.compute.manager [req-549db298-2147-4100-8abc-0ae1290d2958 req-29c4596b-e7d5-4713-9268-7bea8194c2d6 service nova] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] No waiting events found dispatching network-vif-plugged-eb9c9c0a-9b82-4cdf-8500-4ee860f7af29 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:01:41 user nova-compute[103546]: WARNING nova.compute.manager [req-549db298-2147-4100-8abc-0ae1290d2958 req-29c4596b-e7d5-4713-9268-7bea8194c2d6 service nova] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Received unexpected event network-vif-plugged-eb9c9c0a-9b82-4cdf-8500-4ee860f7af29 for instance with vm_state deleted and task_state None.
Nov 16 04:01:41 user nova-compute[103546]: DEBUG nova.compute.manager [req-549db298-2147-4100-8abc-0ae1290d2958 req-29c4596b-e7d5-4713-9268-7bea8194c2d6 service nova] [instance: d2781221-b5e3-468a-a9f5-436a04285f38] Received event network-vif-deleted-eb9c9c0a-9b82-4cdf-8500-4ee860f7af29 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:01:44 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:01:47 user nova-compute[103546]: INFO nova.compute.manager [None req-e6759044-e995-41e2-97e0-b924c120cbbd tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Unrescuing
Nov 16 04:01:47 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e6759044-e995-41e2-97e0-b924c120cbbd tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Acquiring lock "refresh_cache-246ccf69-847c-4ab2-b709-ad1a85e81eab" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:01:47 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e6759044-e995-41e2-97e0-b924c120cbbd tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Acquired lock "refresh_cache-246ccf69-847c-4ab2-b709-ad1a85e81eab" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:01:47 user nova-compute[103546]: DEBUG nova.network.neutron [None req-e6759044-e995-41e2-97e0-b924c120cbbd tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 04:01:47 user nova-compute[103546]: DEBUG nova.network.neutron [None req-e6759044-e995-41e2-97e0-b924c120cbbd tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Updating instance_info_cache with network_info: [{"id": "84add44b-0c93-4ebc-b45d-2f30d63d900f", "address": "fa:16:3e:13:18:5f", "network": {"id": "337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-40560053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca049d5674dc4c59814f98478752d73d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84add44b-0c", "ovs_interfaceid": "84add44b-0c93-4ebc-b45d-2f30d63d900f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:01:47 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e6759044-e995-41e2-97e0-b924c120cbbd tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Releasing lock "refresh_cache-246ccf69-847c-4ab2-b709-ad1a85e81eab" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:01:47 user nova-compute[103546]: DEBUG nova.objects.instance [None req-e6759044-e995-41e2-97e0-b924c120cbbd tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lazy-loading 'flavor' on Instance uuid 246ccf69-847c-4ab2-b709-ad1a85e81eab {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:01:48 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:01:48 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:01:48 user nova-compute[103546]: DEBUG nova.compute.manager [req-2f91d15c-fdac-42c7-8502-d0408c4e3105 req-26440f56-60b0-4376-8929-7cd27584843d service nova] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Received event network-vif-unplugged-84add44b-0c93-4ebc-b45d-2f30d63d900f {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:01:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-2f91d15c-fdac-42c7-8502-d0408c4e3105 req-26440f56-60b0-4376-8929-7cd27584843d service nova] Acquiring lock "246ccf69-847c-4ab2-b709-ad1a85e81eab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:01:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-2f91d15c-fdac-42c7-8502-d0408c4e3105 req-26440f56-60b0-4376-8929-7cd27584843d service nova] Lock "246ccf69-847c-4ab2-b709-ad1a85e81eab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:01:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-2f91d15c-fdac-42c7-8502-d0408c4e3105 req-26440f56-60b0-4376-8929-7cd27584843d service nova] Lock "246ccf69-847c-4ab2-b709-ad1a85e81eab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:01:48 user nova-compute[103546]: DEBUG nova.compute.manager [req-2f91d15c-fdac-42c7-8502-d0408c4e3105 req-26440f56-60b0-4376-8929-7cd27584843d service nova] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] No waiting events found dispatching network-vif-unplugged-84add44b-0c93-4ebc-b45d-2f30d63d900f {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:01:48 user nova-compute[103546]: WARNING nova.compute.manager [req-2f91d15c-fdac-42c7-8502-d0408c4e3105 req-26440f56-60b0-4376-8929-7cd27584843d service nova] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Received unexpected event network-vif-unplugged-84add44b-0c93-4ebc-b45d-2f30d63d900f for instance with vm_state rescued and task_state unrescuing.
Nov 16 04:01:48 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:01:48 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:01:48 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Instance destroyed successfully.
Nov 16 04:01:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:01:50 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:01:50 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:01:50 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:01:50 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:01:50 user nova-compute[103546]: DEBUG nova.compute.manager [req-585f6380-d38b-42aa-9601-785ba32ee56e req-d74fae40-87fe-4103-b972-2ee624d1471b service nova] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Received event network-vif-plugged-84add44b-0c93-4ebc-b45d-2f30d63d900f {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:01:50 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-585f6380-d38b-42aa-9601-785ba32ee56e req-d74fae40-87fe-4103-b972-2ee624d1471b service nova] Acquiring lock "246ccf69-847c-4ab2-b709-ad1a85e81eab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:01:50 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-585f6380-d38b-42aa-9601-785ba32ee56e req-d74fae40-87fe-4103-b972-2ee624d1471b service nova] Lock "246ccf69-847c-4ab2-b709-ad1a85e81eab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:01:50 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-585f6380-d38b-42aa-9601-785ba32ee56e req-d74fae40-87fe-4103-b972-2ee624d1471b service nova] Lock "246ccf69-847c-4ab2-b709-ad1a85e81eab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:01:50 user nova-compute[103546]: DEBUG nova.compute.manager [req-585f6380-d38b-42aa-9601-785ba32ee56e req-d74fae40-87fe-4103-b972-2ee624d1471b service nova] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] No waiting events found dispatching network-vif-plugged-84add44b-0c93-4ebc-b45d-2f30d63d900f {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:01:50 user nova-compute[103546]: WARNING nova.compute.manager [req-585f6380-d38b-42aa-9601-785ba32ee56e req-d74fae40-87fe-4103-b972-2ee624d1471b service nova] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Received unexpected event network-vif-plugged-84add44b-0c93-4ebc-b45d-2f30d63d900f for instance with vm_state rescued and task_state unrescuing.
Nov 16 04:01:50 user nova-compute[103546]: DEBUG nova.compute.manager [req-585f6380-d38b-42aa-9601-785ba32ee56e req-d74fae40-87fe-4103-b972-2ee624d1471b service nova] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Received event network-vif-plugged-84add44b-0c93-4ebc-b45d-2f30d63d900f {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:01:50 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-585f6380-d38b-42aa-9601-785ba32ee56e req-d74fae40-87fe-4103-b972-2ee624d1471b service nova] Acquiring lock "246ccf69-847c-4ab2-b709-ad1a85e81eab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:01:50 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-585f6380-d38b-42aa-9601-785ba32ee56e req-d74fae40-87fe-4103-b972-2ee624d1471b service nova] Lock "246ccf69-847c-4ab2-b709-ad1a85e81eab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:01:50 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-585f6380-d38b-42aa-9601-785ba32ee56e req-d74fae40-87fe-4103-b972-2ee624d1471b service nova] Lock "246ccf69-847c-4ab2-b709-ad1a85e81eab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:01:50 user nova-compute[103546]: DEBUG nova.compute.manager [req-585f6380-d38b-42aa-9601-785ba32ee56e req-d74fae40-87fe-4103-b972-2ee624d1471b service nova] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] No waiting events found dispatching network-vif-plugged-84add44b-0c93-4ebc-b45d-2f30d63d900f {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:01:50 user nova-compute[103546]: WARNING nova.compute.manager [req-585f6380-d38b-42aa-9601-785ba32ee56e req-d74fae40-87fe-4103-b972-2ee624d1471b service nova] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Received unexpected event network-vif-plugged-84add44b-0c93-4ebc-b45d-2f30d63d900f for instance with vm_state rescued and task_state unrescuing.
Nov 16 04:01:50 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:01:50 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:01:52 user nova-compute[103546]: DEBUG nova.compute.manager [None req-e6759044-e995-41e2-97e0-b924c120cbbd tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 04:01:52 user nova-compute[103546]: DEBUG nova.compute.manager [req-8a2fdf3a-df1f-41cc-8ff4-061baa3279ed req-42559553-f131-4b82-9bda-50864ca34e78 service nova] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Received event network-vif-plugged-84add44b-0c93-4ebc-b45d-2f30d63d900f {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:01:52 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8a2fdf3a-df1f-41cc-8ff4-061baa3279ed req-42559553-f131-4b82-9bda-50864ca34e78 service nova] Acquiring lock "246ccf69-847c-4ab2-b709-ad1a85e81eab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:01:52 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8a2fdf3a-df1f-41cc-8ff4-061baa3279ed req-42559553-f131-4b82-9bda-50864ca34e78 service nova] Lock "246ccf69-847c-4ab2-b709-ad1a85e81eab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:01:52 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8a2fdf3a-df1f-41cc-8ff4-061baa3279ed req-42559553-f131-4b82-9bda-50864ca34e78 service nova] Lock "246ccf69-847c-4ab2-b709-ad1a85e81eab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:01:52 user nova-compute[103546]: DEBUG nova.compute.manager [req-8a2fdf3a-df1f-41cc-8ff4-061baa3279ed req-42559553-f131-4b82-9bda-50864ca34e78 service nova] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] No waiting events found dispatching network-vif-plugged-84add44b-0c93-4ebc-b45d-2f30d63d900f {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:01:52 user nova-compute[103546]: WARNING nova.compute.manager [req-8a2fdf3a-df1f-41cc-8ff4-061baa3279ed req-42559553-f131-4b82-9bda-50864ca34e78 service nova] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Received unexpected event network-vif-plugged-84add44b-0c93-4ebc-b45d-2f30d63d900f for instance with vm_state rescued and task_state unrescuing.
Nov 16 04:01:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:01:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:01:56 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:01:56 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Acquiring lock "26ba7f48-9752-45af-ba68-8c3f70325e21" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:01:56 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "26ba7f48-9752-45af-ba68-8c3f70325e21" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:01:56 user nova-compute[103546]: DEBUG nova.compute.manager [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Starting instance... {{(pid=103546) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 04:01:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:01:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:01:57 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=103546) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 04:01:57 user nova-compute[103546]: INFO nova.compute.claims [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Claim successful on node user
Nov 16 04:01:57 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:01:57 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:01:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.455s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:01:57 user nova-compute[103546]: DEBUG nova.compute.manager [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Start building networks asynchronously for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 04:01:57 user nova-compute[103546]: DEBUG nova.compute.manager [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Allocating IP information in the background. {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 04:01:57 user nova-compute[103546]: DEBUG nova.network.neutron [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] allocate_for_instance() {{(pid=103546) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 04:01:57 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 04:01:57 user nova-compute[103546]: DEBUG nova.compute.manager [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Start building block device mappings for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 04:01:57 user nova-compute[103546]: INFO nova.virt.block_device [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Booting with volume 43ccf88b-7590-48b4-acc3-89388b6257bf at /dev/vda
Nov 16 04:01:57 user nova-compute[103546]: DEBUG nova.policy [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e471c69657c745bbbdfc82307a49946f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b30a015db444798ee72ff6fd14c69e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103546) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 04:01:57 user nova-compute[103546]: DEBUG os_brick.utils [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:01:57 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:57 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:01:57 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dfbecf3-068a-4a41-844c-45e67f1b0b38]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af5c39b14ece\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:01:57 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:57 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:01:57 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8229216-7b09-4af3-aee1-204163db569a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:01:57 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:57 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:01:57 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f4d3ef-6743-489c-ac1c-a7f743d61b07]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:01:57 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0efef2-17de-46c3-886e-e26984ece0b1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:01:57 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Running cmd (subprocess): nvme version {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:57 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] 'nvme version' failed. Not Retrying. {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 04:01:57 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] nvme not present on system {{(pid=103546) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 04:01:57 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:01:57 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 04:01:57 user nova-compute[103546]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 04:01:57 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b69b4d-6a69-481f-9e3a-4c75467bf102]: (4, '') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:01:57 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=103546) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 04:01:57 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 04:01:57 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] LIGHTOS: no hostnqn found. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 04:01:57 user nova-compute[103546]: DEBUG os_brick.utils [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af5c39b14ece', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:01:57 user nova-compute[103546]: DEBUG nova.virt.block_device [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Updating existing volume attachment record: be35e959-c20e-416e-8523-a49123afd548 {{(pid=103546) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 04:01:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:01:59 user nova-compute[103546]: DEBUG nova.network.neutron [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Successfully created port: 59aaf9cc-b110-4cb9-aff1-9320d79f55c0 {{(pid=103546) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 04:01:59 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:01:59 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:00 user nova-compute[103546]: DEBUG nova.network.neutron [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Successfully updated port: 59aaf9cc-b110-4cb9-aff1-9320d79f55c0 {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 04:02:00 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Acquiring lock "refresh_cache-26ba7f48-9752-45af-ba68-8c3f70325e21" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:02:00 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Acquired lock "refresh_cache-26ba7f48-9752-45af-ba68-8c3f70325e21" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:02:00 user nova-compute[103546]: DEBUG nova.network.neutron [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 04:02:00 user nova-compute[103546]: DEBUG nova.compute.manager [req-fca95405-5746-4ffc-a88f-8a63c0b1b345 req-b93787b3-b346-46f4-80eb-0365d9571b80 service nova] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Received event network-changed-59aaf9cc-b110-4cb9-aff1-9320d79f55c0 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:02:00 user nova-compute[103546]: DEBUG nova.compute.manager [req-fca95405-5746-4ffc-a88f-8a63c0b1b345 req-b93787b3-b346-46f4-80eb-0365d9571b80 service nova] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Refreshing instance network info cache due to event network-changed-59aaf9cc-b110-4cb9-aff1-9320d79f55c0. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 04:02:00 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-fca95405-5746-4ffc-a88f-8a63c0b1b345 req-b93787b3-b346-46f4-80eb-0365d9571b80 service nova] Acquiring lock "refresh_cache-26ba7f48-9752-45af-ba68-8c3f70325e21" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:02:00 user nova-compute[103546]: DEBUG nova.network.neutron [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 04:02:00 user nova-compute[103546]: DEBUG nova.network.neutron [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Updating instance_info_cache with network_info: [{"id": "59aaf9cc-b110-4cb9-aff1-9320d79f55c0", "address": "fa:16:3e:46:16:f7", "network": {"id": "29e9620f-313d-4679-89d7-459e7cf75b38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1690634205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72b30a015db444798ee72ff6fd14c69e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59aaf9cc-b1", "ovs_interfaceid": "59aaf9cc-b110-4cb9-aff1-9320d79f55c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:02:00 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Releasing lock "refresh_cache-26ba7f48-9752-45af-ba68-8c3f70325e21" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:02:00 user nova-compute[103546]: DEBUG nova.compute.manager [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Instance network_info: |[{"id": "59aaf9cc-b110-4cb9-aff1-9320d79f55c0", "address": "fa:16:3e:46:16:f7", "network": {"id": "29e9620f-313d-4679-89d7-459e7cf75b38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1690634205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72b30a015db444798ee72ff6fd14c69e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59aaf9cc-b1", "ovs_interfaceid": "59aaf9cc-b110-4cb9-aff1-9320d79f55c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 04:02:00 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-fca95405-5746-4ffc-a88f-8a63c0b1b345 req-b93787b3-b346-46f4-80eb-0365d9571b80 service nova] Acquired lock "refresh_cache-26ba7f48-9752-45af-ba68-8c3f70325e21" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:02:00 user nova-compute[103546]: DEBUG nova.network.neutron [req-fca95405-5746-4ffc-a88f-8a63c0b1b345 req-b93787b3-b346-46f4-80eb-0365d9571b80 service nova] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Refreshing network info cache for port 59aaf9cc-b110-4cb9-aff1-9320d79f55c0 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 04:02:00 user nova-compute[103546]: DEBUG nova.network.neutron [req-fca95405-5746-4ffc-a88f-8a63c0b1b345 req-b93787b3-b346-46f4-80eb-0365d9571b80 service nova] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Updated VIF entry in instance network info cache for port 59aaf9cc-b110-4cb9-aff1-9320d79f55c0. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 04:02:00 user nova-compute[103546]: DEBUG nova.network.neutron [req-fca95405-5746-4ffc-a88f-8a63c0b1b345 req-b93787b3-b346-46f4-80eb-0365d9571b80 service nova] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Updating instance_info_cache with network_info: [{"id": "59aaf9cc-b110-4cb9-aff1-9320d79f55c0", "address": "fa:16:3e:46:16:f7", "network": {"id": "29e9620f-313d-4679-89d7-459e7cf75b38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1690634205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72b30a015db444798ee72ff6fd14c69e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59aaf9cc-b1", "ovs_interfaceid": "59aaf9cc-b110-4cb9-aff1-9320d79f55c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:02:00 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-fca95405-5746-4ffc-a88f-8a63c0b1b345 req-b93787b3-b346-46f4-80eb-0365d9571b80 service nova] Releasing lock "refresh_cache-26ba7f48-9752-45af-ba68-8c3f70325e21" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG nova.compute.manager [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Start spawning the instance on the hypervisor. {{(pid=103546) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Creating instance directory {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 04:02:03 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Creating image(s)
Nov 16 04:02:03 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Did not create local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Ensure instance console log exists: /opt/stack/data/nova/instances/26ba7f48-9752-45af-ba68-8c3f70325e21/console.log {{(pid=103546) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Start _get_guest_xml network_info=[{"id": "59aaf9cc-b110-4cb9-aff1-9320d79f55c0", "address": "fa:16:3e:46:16:f7", "network": {"id": "29e9620f-313d-4679-89d7-459e7cf75b38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1690634205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72b30a015db444798ee72ff6fd14c69e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59aaf9cc-b1", "ovs_interfaceid": "59aaf9cc-b110-4cb9-aff1-9320d79f55c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AJewqSDp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '26ba7f48-9752-45af-ba68-8c3f70325e21', 'attached_at': '', 'detached_at': '', 'volume_id': '43ccf88b-7590-48b4-acc3-89388b6257bf', 'serial': '43ccf88b-7590-48b4-acc3-89388b6257bf'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': 'be35e959-c20e-416e-8523-a49123afd548', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 04:02:03 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:02:03 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:02:03 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AJewqSDp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:02:03 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:02:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:02:03 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:02:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:02:03 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 04:02:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac943ccf-a40a-44ae-b110-6886269c0330]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 04:02:03 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf -p 172.16.0.220:3260 --interface default --op new {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6ae71d-44e1-4515-a167-37b6f0887878]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf] added\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf] added
Nov 16 04:02:03 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.037s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ed40d6-20e6-46dc-8b53-241bdd3fdf3d]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5868e26-0559-4a2f-91f3-72d888c2d5ff]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AJewqSDp {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AJewqSDp" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a76360c-e3ca-45d2-9220-02ab07298579]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AJewqSDp'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9edc635-0398-4ad7-89aa-5a6eeee6ca0f]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d74436-6715-4fc7-9054-bd7be4251aaa]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:02:03 user nova-compute[103546]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:02:03 user nova-compute[103546]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af (non-flash)
Nov 16 04:02:03 user nova-compute[103546]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)
Nov 16 04:02:03 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:02:03 user nova-compute[103546]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:02:03 user nova-compute[103546]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af (non-flash)
Nov 16 04:02:03 user nova-compute[103546]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)
Nov 16 04:02:03 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf -p 172.16.0.220:3260 --login {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[102dd918-5cce-45ef-94cc-54227bd70288]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf, portal: 172.16.0.220,3260]
Nov 16 04:02:03 user nova-compute[103546]: Login to [iface: default, target: iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf, portal: 172.16.0.220,3260] successful.
Nov 16 04:02:03 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[130e8838-98d7-43d8-a998-797422b1a6cf]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[582dd6eb-26f8-4007-9b43-086bc812d1c0]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:02:03 user nova-compute[103546]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:02:03 user nova-compute[103546]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af (non-flash)
Nov 16 04:02:03 user nova-compute[103546]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)
Nov 16 04:02:03 user nova-compute[103546]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:02:03 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:02:03 user nova-compute[103546]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:02:03 user nova-compute[103546]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af (non-flash)
Nov 16 04:02:03 user nova-compute[103546]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)
Nov 16 04:02:03 user nova-compute[103546]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:02:03 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] HCTL ('37', '-', '-', 0) found on session 41 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be63449-7c44-4553-b330-18f89c27256b]: (4, ('- - 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Searching for a device in session 41 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AJewqSDp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 04:02:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:04 user nova-compute[103546]: DEBUG nova.compute.manager [req-4259386b-2fc6-4982-8844-d32f43a5b6e1 req-7e3117f8-ddf9-49e4-b5fd-4725dd47100b service nova] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Received event network-changed-9ab0370c-4cd8-49c4-9c20-c566d0db69cf {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:02:04 user nova-compute[103546]: DEBUG nova.compute.manager [req-4259386b-2fc6-4982-8844-d32f43a5b6e1 req-7e3117f8-ddf9-49e4-b5fd-4725dd47100b service nova] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Refreshing instance network info cache due to event network-changed-9ab0370c-4cd8-49c4-9c20-c566d0db69cf. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 04:02:04 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-4259386b-2fc6-4982-8844-d32f43a5b6e1 req-7e3117f8-ddf9-49e4-b5fd-4725dd47100b service nova] Acquiring lock "refresh_cache-e5b2903b-053a-4671-af52-aa08e0b220b8" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:02:04 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-4259386b-2fc6-4982-8844-d32f43a5b6e1 req-7e3117f8-ddf9-49e4-b5fd-4725dd47100b service nova] Acquired lock "refresh_cache-e5b2903b-053a-4671-af52-aa08e0b220b8" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:02:04 user nova-compute[103546]: DEBUG nova.network.neutron [req-4259386b-2fc6-4982-8844-d32f43a5b6e1 req-7e3117f8-ddf9-49e4-b5fd-4725dd47100b service nova] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Refreshing network info cache for port 9ab0370c-4cd8-49c4-9c20-c566d0db69cf {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 04:02:04 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:02:04 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '23234386534346435', 'path': '/dev/sdf'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:02:04 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234386534346435', 'path': '/dev/sdf'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 04:02:04 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:01:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1703728033',display_name='tempest-ServerActionsTestOtherA-server-1703728033',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1703728033',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJeuDielSI+1QllPRU8TUZPfRtLhxXlgqD+oFHNsy0a0jxMp9PNqxCpWdXKas+7wQ5fSoPylsuLGE6eRSK8cr/wsGQFy4MbHJizJ+GnVBc6KD3RZeGBoD7tDLXSKWjtJbw==',key_name='tempest-keypair-205381596',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72b30a015db444798ee72ff6fd14c69e',ramdisk_id='',reservation_id='r-ahsozgnl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1488667220',owner_user_name='tempest-ServerActionsTestOtherA-1488667220-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T04:01:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e471c69657c745bbbdfc82307a49946f',uuid=26ba7f48-9752-45af-ba68-8c3f70325e21,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59aaf9cc-b110-4cb9-aff1-9320d79f55c0", "address": "fa:16:3e:46:16:f7", "network": {"id": "29e9620f-313d-4679-89d7-459e7cf75b38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1690634205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72b30a015db444798ee72ff6fd14c69e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59aaf9cc-b1", "ovs_interfaceid": "59aaf9cc-b110-4cb9-aff1-9320d79f55c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 04:02:04 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Converting VIF {"id": "59aaf9cc-b110-4cb9-aff1-9320d79f55c0", "address": "fa:16:3e:46:16:f7", "network": {"id": "29e9620f-313d-4679-89d7-459e7cf75b38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1690634205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72b30a015db444798ee72ff6fd14c69e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59aaf9cc-b1", "ovs_interfaceid": "59aaf9cc-b110-4cb9-aff1-9320d79f55c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:02:04 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:16:f7,bridge_name='br-int',has_traffic_filtering=True,id=59aaf9cc-b110-4cb9-aff1-9320d79f55c0,network=Network(29e9620f-313d-4679-89d7-459e7cf75b38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59aaf9cc-b1') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:02:04 user nova-compute[103546]: DEBUG nova.objects.instance [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lazy-loading 'pci_devices' on Instance uuid 26ba7f48-9752-45af-ba68-8c3f70325e21 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:02:04 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] End _get_guest_xml xml=<domain type="kvm">
Nov 16 04:02:04 user nova-compute[103546]:   <uuid>26ba7f48-9752-45af-ba68-8c3f70325e21</uuid>
Nov 16 04:02:04 user nova-compute[103546]:   <name>instance-00000024</name>
Nov 16 04:02:04 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 04:02:04 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 04:02:04 user nova-compute[103546]:   <metadata>
Nov 16 04:02:04 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 04:02:04 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 04:02:04 user nova-compute[103546]:       <nova:name>tempest-ServerActionsTestOtherA-server-1703728033</nova:name>
Nov 16 04:02:04 user nova-compute[103546]:       <nova:creationTime>2023-11-16 04:02:03</nova:creationTime>
Nov 16 04:02:04 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 04:02:04 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 04:02:04 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 04:02:04 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 04:02:04 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 04:02:04 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 04:02:04 user nova-compute[103546]:       </nova:flavor>
Nov 16 04:02:04 user nova-compute[103546]:       <nova:owner>
Nov 16 04:02:04 user nova-compute[103546]:         <nova:user uuid="e471c69657c745bbbdfc82307a49946f">tempest-ServerActionsTestOtherA-1488667220-project-member</nova:user>
Nov 16 04:02:04 user nova-compute[103546]:         <nova:project uuid="72b30a015db444798ee72ff6fd14c69e">tempest-ServerActionsTestOtherA-1488667220</nova:project>
Nov 16 04:02:04 user nova-compute[103546]:       </nova:owner>
Nov 16 04:02:04 user nova-compute[103546]:       <nova:ports>
Nov 16 04:02:04 user nova-compute[103546]:         <nova:port uuid="59aaf9cc-b110-4cb9-aff1-9320d79f55c0">
Nov 16 04:02:04 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 16 04:02:04 user nova-compute[103546]:         </nova:port>
Nov 16 04:02:04 user nova-compute[103546]:       </nova:ports>
Nov 16 04:02:04 user nova-compute[103546]:     </nova:instance>
Nov 16 04:02:04 user nova-compute[103546]:   </metadata>
Nov 16 04:02:04 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 04:02:04 user nova-compute[103546]:     <system>
Nov 16 04:02:04 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 04:02:04 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 04:02:04 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 04:02:04 user nova-compute[103546]:       <entry name="serial">26ba7f48-9752-45af-ba68-8c3f70325e21</entry>
Nov 16 04:02:04 user nova-compute[103546]:       <entry name="uuid">26ba7f48-9752-45af-ba68-8c3f70325e21</entry>
Nov 16 04:02:04 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 04:02:04 user nova-compute[103546]:     </system>
Nov 16 04:02:04 user nova-compute[103546]:   </sysinfo>
Nov 16 04:02:04 user nova-compute[103546]:   <os>
Nov 16 04:02:04 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 04:02:04 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 04:02:04 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 04:02:04 user nova-compute[103546]:   </os>
Nov 16 04:02:04 user nova-compute[103546]:   <features>
Nov 16 04:02:04 user nova-compute[103546]:     <acpi/>
Nov 16 04:02:04 user nova-compute[103546]:     <apic/>
Nov 16 04:02:04 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 04:02:04 user nova-compute[103546]:   </features>
Nov 16 04:02:04 user nova-compute[103546]:   <clock offset="utc">
Nov 16 04:02:04 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 04:02:04 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 04:02:04 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 04:02:04 user nova-compute[103546]:   </clock>
Nov 16 04:02:04 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 04:02:04 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 04:02:04 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 04:02:04 user nova-compute[103546]:   </cpu>
Nov 16 04:02:04 user nova-compute[103546]:   <devices>
Nov 16 04:02:04 user nova-compute[103546]:     <disk type="block" device="disk">
Nov 16 04:02:04 user nova-compute[103546]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:02:04 user nova-compute[103546]:       <source dev="/dev/sdf"/>
Nov 16 04:02:04 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 04:02:04 user nova-compute[103546]:       <serial>43ccf88b-7590-48b4-acc3-89388b6257bf</serial>
Nov 16 04:02:04 user nova-compute[103546]:     </disk>
Nov 16 04:02:04 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 04:02:04 user nova-compute[103546]:       <mac address="fa:16:3e:46:16:f7"/>
Nov 16 04:02:04 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 04:02:04 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 04:02:04 user nova-compute[103546]:       <target dev="tap59aaf9cc-b1"/>
Nov 16 04:02:04 user nova-compute[103546]:     </interface>
Nov 16 04:02:04 user nova-compute[103546]:     <serial type="pty">
Nov 16 04:02:04 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/26ba7f48-9752-45af-ba68-8c3f70325e21/console.log" append="off"/>
Nov 16 04:02:04 user nova-compute[103546]:     </serial>
Nov 16 04:02:04 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 04:02:04 user nova-compute[103546]:     <video>
Nov 16 04:02:04 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 04:02:04 user nova-compute[103546]:     </video>
Nov 16 04:02:04 user nova-compute[103546]:     <rng model="virtio">
Nov 16 04:02:04 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 04:02:04 user nova-compute[103546]:     </rng>
Nov 16 04:02:04 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 04:02:04 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 04:02:04 user nova-compute[103546]:       <stats period="10"/>
Nov 16 04:02:04 user nova-compute[103546]:     </memballoon>
Nov 16 04:02:04 user nova-compute[103546]:   </devices>
Nov 16 04:02:04 user nova-compute[103546]: </domain>
Nov 16 04:02:04 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 04:02:04 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:01:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1703728033',display_name='tempest-ServerActionsTestOtherA-server-1703728033',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1703728033',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJeuDielSI+1QllPRU8TUZPfRtLhxXlgqD+oFHNsy0a0jxMp9PNqxCpWdXKas+7wQ5fSoPylsuLGE6eRSK8cr/wsGQFy4MbHJizJ+GnVBc6KD3RZeGBoD7tDLXSKWjtJbw==',key_name='tempest-keypair-205381596',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72b30a015db444798ee72ff6fd14c69e',ramdisk_id='',reservation_id='r-ahsozgnl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1488667220',owner_user_name='tempest-ServerActionsTestOtherA-1488667220-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T04:01:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e471c69657c745bbbdfc82307a49946f',uuid=26ba7f48-9752-45af-ba68-8c3f70325e21,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59aaf9cc-b110-4cb9-aff1-9320d79f55c0", "address": "fa:16:3e:46:16:f7", "network": {"id": "29e9620f-313d-4679-89d7-459e7cf75b38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1690634205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72b30a015db444798ee72ff6fd14c69e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59aaf9cc-b1", "ovs_interfaceid": "59aaf9cc-b110-4cb9-aff1-9320d79f55c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 04:02:04 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Converting VIF {"id": "59aaf9cc-b110-4cb9-aff1-9320d79f55c0", "address": "fa:16:3e:46:16:f7", "network": {"id": "29e9620f-313d-4679-89d7-459e7cf75b38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1690634205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72b30a015db444798ee72ff6fd14c69e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59aaf9cc-b1", "ovs_interfaceid": "59aaf9cc-b110-4cb9-aff1-9320d79f55c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:02:04 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:16:f7,bridge_name='br-int',has_traffic_filtering=True,id=59aaf9cc-b110-4cb9-aff1-9320d79f55c0,network=Network(29e9620f-313d-4679-89d7-459e7cf75b38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59aaf9cc-b1') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:02:04 user nova-compute[103546]: DEBUG os_vif [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:16:f7,bridge_name='br-int',has_traffic_filtering=True,id=59aaf9cc-b110-4cb9-aff1-9320d79f55c0,network=Network(29e9620f-313d-4679-89d7-459e7cf75b38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59aaf9cc-b1') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 04:02:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:02:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 04:02:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6b1aeec2-eb84-537d-9cf1-2432bd1b7f53', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:02:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:02:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap59aaf9cc-b1, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:02:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap59aaf9cc-b1, col_values=(('qos', UUID('7b06b8ad-1e0d-4836-b15a-8a0b3127b424')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:02:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap59aaf9cc-b1, col_values=(('external_ids', {'iface-id': '59aaf9cc-b110-4cb9-aff1-9320d79f55c0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:16:f7', 'vm-uuid': '26ba7f48-9752-45af-ba68-8c3f70325e21'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:02:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:02:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:04 user nova-compute[103546]: INFO os_vif [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:16:f7,bridge_name='br-int',has_traffic_filtering=True,id=59aaf9cc-b110-4cb9-aff1-9320d79f55c0,network=Network(29e9620f-313d-4679-89d7-459e7cf75b38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59aaf9cc-b1')
Nov 16 04:02:04 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:02:04 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] No VIF found with MAC fa:16:3e:46:16:f7, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 04:02:04 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-76176811-2701-4882-ab6e-71871d78b405 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquiring lock "e5b2903b-053a-4671-af52-aa08e0b220b8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:02:04 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-76176811-2701-4882-ab6e-71871d78b405 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "e5b2903b-053a-4671-af52-aa08e0b220b8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:02:04 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-76176811-2701-4882-ab6e-71871d78b405 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquiring lock "e5b2903b-053a-4671-af52-aa08e0b220b8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:02:04 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-76176811-2701-4882-ab6e-71871d78b405 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "e5b2903b-053a-4671-af52-aa08e0b220b8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:02:04 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-76176811-2701-4882-ab6e-71871d78b405 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "e5b2903b-053a-4671-af52-aa08e0b220b8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:02:04 user nova-compute[103546]: INFO nova.compute.manager [None req-76176811-2701-4882-ab6e-71871d78b405 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Terminating instance
Nov 16 04:02:04 user nova-compute[103546]: DEBUG nova.compute.manager [None req-76176811-2701-4882-ab6e-71871d78b405 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Start destroying the instance on the hypervisor. {{(pid=103546) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 04:02:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:05 user nova-compute[103546]: DEBUG nova.network.neutron [req-4259386b-2fc6-4982-8844-d32f43a5b6e1 req-7e3117f8-ddf9-49e4-b5fd-4725dd47100b service nova] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Updated VIF entry in instance network info cache for port 9ab0370c-4cd8-49c4-9c20-c566d0db69cf. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 04:02:05 user nova-compute[103546]: DEBUG nova.network.neutron [req-4259386b-2fc6-4982-8844-d32f43a5b6e1 req-7e3117f8-ddf9-49e4-b5fd-4725dd47100b service nova] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Updating instance_info_cache with network_info: [{"id": "9ab0370c-4cd8-49c4-9c20-c566d0db69cf", "address": "fa:16:3e:0b:51:11", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ab0370c-4c", "ovs_interfaceid": "9ab0370c-4cd8-49c4-9c20-c566d0db69cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:02:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-4259386b-2fc6-4982-8844-d32f43a5b6e1 req-7e3117f8-ddf9-49e4-b5fd-4725dd47100b service nova] Releasing lock "refresh_cache-e5b2903b-053a-4671-af52-aa08e0b220b8" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:02:05 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Instance destroyed successfully.
Nov 16 04:02:05 user nova-compute[103546]: DEBUG nova.objects.instance [None req-76176811-2701-4882-ab6e-71871d78b405 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lazy-loading 'resources' on Instance uuid e5b2903b-053a-4671-af52-aa08e0b220b8 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:02:05 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-76176811-2701-4882-ab6e-71871d78b405 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:00:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1328575671',display_name='tempest-TestVolumeBootPattern-server-1328575671',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1328575671',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAUuzWuYKsux0jTpLPt6gxhC1FaUy3kEUyYKr8BxuO29MPaSGm/xG+Qeyua0CAfOtv/fD3rdnfc1wGAbEANqJwnqI370L1woOSlI3nH8Q8Ypdr+d2TMfVLtiA9YGdx0zEg==',key_name='tempest-TestVolumeBootPattern-1153098015',keypairs=<?>,launch_index=0,launched_at=2023-11-16T04:00:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='40ce50192a9743b59a9430163dd6a51c',ramdisk_id='',reservation_id='r-wsv36jze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1283031547',owner_user_name='tempest-TestVolumeBootPattern-1283031547-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T04:00:23Z,user_data=None,user_id='ab77040a7b9846d28dc08852d678d1ed',uuid=e5b2903b-053a-4671-af52-aa08e0b220b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9ab0370c-4cd8-49c4-9c20-c566d0db69cf", "address": "fa:16:3e:0b:51:11", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ab0370c-4c", "ovs_interfaceid": "9ab0370c-4cd8-49c4-9c20-c566d0db69cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 04:02:05 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-76176811-2701-4882-ab6e-71871d78b405 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Converting VIF {"id": "9ab0370c-4cd8-49c4-9c20-c566d0db69cf", "address": "fa:16:3e:0b:51:11", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ab0370c-4c", "ovs_interfaceid": "9ab0370c-4cd8-49c4-9c20-c566d0db69cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:02:05 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-76176811-2701-4882-ab6e-71871d78b405 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:51:11,bridge_name='br-int',has_traffic_filtering=True,id=9ab0370c-4cd8-49c4-9c20-c566d0db69cf,network=Network(a13f532d-a30d-4c06-83fe-760bcffae183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ab0370c-4c') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:02:05 user nova-compute[103546]: DEBUG os_vif [None req-76176811-2701-4882-ab6e-71871d78b405 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:51:11,bridge_name='br-int',has_traffic_filtering=True,id=9ab0370c-4cd8-49c4-9c20-c566d0db69cf,network=Network(a13f532d-a30d-4c06-83fe-760bcffae183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ab0370c-4c') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 04:02:05 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:05 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9ab0370c-4c, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:02:05 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:05 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:02:05 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:05 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:05 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1e92c751-75e3-4028-9460-56ad882376aa) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:02:05 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:05 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:02:05 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:05 user nova-compute[103546]: INFO os_vif [None req-76176811-2701-4882-ab6e-71871d78b405 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:51:11,bridge_name='br-int',has_traffic_filtering=True,id=9ab0370c-4cd8-49c4-9c20-c566d0db69cf,network=Network(a13f532d-a30d-4c06-83fe-760bcffae183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ab0370c-4c')
Nov 16 04:02:05 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76176811-2701-4882-ab6e-71871d78b405 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 04:02:05 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-76176811-2701-4882-ab6e-71871d78b405 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QwVdAeaX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:02:05 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-76176811-2701-4882-ab6e-71871d78b405 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:02:05 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-76176811-2701-4882-ab6e-71871d78b405 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:02:05 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-76176811-2701-4882-ab6e-71871d78b405 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:02:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:06 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:02:06 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[8882c51c-c0d8-444c-872e-672a21109391]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:02:06 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-76176811-2701-4882-ab6e-71871d78b405 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 04:02:06 user nova-compute[103546]: No targets found.
Nov 16 04:02:06 user nova-compute[103546]: iSNS:
Nov 16 04:02:06 user nova-compute[103546]: No targets found.
Nov 16 04:02:06 user nova-compute[103546]: STATIC:
Nov 16 04:02:06 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e
Nov 16 04:02:06 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:02:06 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:02:06 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4
Nov 16 04:02:06 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:02:06 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:02:06 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e
Nov 16 04:02:06 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:02:06 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:02:06 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af
Nov 16 04:02:06 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:02:06 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:02:06 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf
Nov 16 04:02:06 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:02:06 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:02:06 user nova-compute[103546]: FIRMWARE:
Nov 16 04:02:06 user nova-compute[103546]: No targets found.
Nov 16 04:02:06 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:02:06 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-76176811-2701-4882-ab6e-71871d78b405 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 04:02:06 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 04:02:06 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 04:02:06 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-76176811-2701-4882-ab6e-71871d78b405 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 04:02:06 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:06 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:02:06 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[aebe3622-6803-464e-8bc9-e810bd7d90fc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:02:06 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:06 user nova-compute[103546]: DEBUG nova.compute.manager [req-46ac685d-be51-4c99-90b7-01e8fea684b4 req-6e97b8bf-d2b7-41ef-b059-6d39f7b1ce26 service nova] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Received event network-vif-unplugged-9ab0370c-4cd8-49c4-9c20-c566d0db69cf {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:02:06 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-46ac685d-be51-4c99-90b7-01e8fea684b4 req-6e97b8bf-d2b7-41ef-b059-6d39f7b1ce26 service nova] Acquiring lock "e5b2903b-053a-4671-af52-aa08e0b220b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:02:06 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-46ac685d-be51-4c99-90b7-01e8fea684b4 req-6e97b8bf-d2b7-41ef-b059-6d39f7b1ce26 service nova] Lock "e5b2903b-053a-4671-af52-aa08e0b220b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:02:06 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-46ac685d-be51-4c99-90b7-01e8fea684b4 req-6e97b8bf-d2b7-41ef-b059-6d39f7b1ce26 service nova] Lock "e5b2903b-053a-4671-af52-aa08e0b220b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:02:06 user nova-compute[103546]: DEBUG nova.compute.manager [req-46ac685d-be51-4c99-90b7-01e8fea684b4 req-6e97b8bf-d2b7-41ef-b059-6d39f7b1ce26 service nova] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] No waiting events found dispatching network-vif-unplugged-9ab0370c-4cd8-49c4-9c20-c566d0db69cf {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:02:06 user nova-compute[103546]: DEBUG nova.compute.manager [req-46ac685d-be51-4c99-90b7-01e8fea684b4 req-6e97b8bf-d2b7-41ef-b059-6d39f7b1ce26 service nova] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Received event network-vif-unplugged-9ab0370c-4cd8-49c4-9c20-c566d0db69cf for instance with task_state deleting. {{(pid=103546) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 04:02:06 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:02:06 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bcc6d63-ef5c-490d-8cc5-f2f99dd9bbd9]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:02:06 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-76176811-2701-4882-ab6e-71871d78b405 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:02:06 user nova-compute[103546]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:02:06 user nova-compute[103546]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af (non-flash)
Nov 16 04:02:06 user nova-compute[103546]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)
Nov 16 04:02:06 user nova-compute[103546]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:02:06 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:02:06 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-76176811-2701-4882-ab6e-71871d78b405 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:02:06 user nova-compute[103546]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:02:06 user nova-compute[103546]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af (non-flash)
Nov 16 04:02:06 user nova-compute[103546]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)
Nov 16 04:02:06 user nova-compute[103546]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:02:06 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:02:06 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-76176811-2701-4882-ab6e-71871d78b405 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60ac3e70a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e'): ({'sdc'}, set())}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 04:02:06 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-76176811-2701-4882-ab6e-71871d78b405 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Removing single pathed devices sdc {{(pid=103546) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 04:02:06 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:06 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:02:06 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de37a9d-2c5f-4349-a691-14636ad8f32e]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:02:06 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:06 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:02:06 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf8bf62-5d7f-4f05-81bb-babe4de8246d]: (4, ('ok\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:02:06 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-76176811-2701-4882-ab6e-71871d78b405 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Flushing IO for device /dev/sdc {{(pid=103546) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 04:02:06 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:06 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:02:06 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b298f089-703b-4ba0-b853-9378efe2c6b6]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:02:06 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-76176811-2701-4882-ab6e-71871d78b405 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=103546) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 04:02:06 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:06 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:02:06 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[7140cca2-082f-4d1e-b6cf-e3aaa6ee38bc]: (4, ('1', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:02:06 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-76176811-2701-4882-ab6e-71871d78b405 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 04:02:06 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-76176811-2701-4882-ab6e-71871d78b405 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] SCSI volumes sdc have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 04:02:06 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-76176811-2701-4882-ab6e-71871d78b405 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e')] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 04:02:06 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:06 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:02:06 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aefe888-c059-4600-b29a-f9a0815df5ca]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:02:06 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-76176811-2701-4882-ab6e-71871d78b405 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:02:06 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:06 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e -p 172.16.0.220:3260 --logout {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:06 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:06 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:06 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:06 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:02:06 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4d74ce-fa45-4d46-aa1a-69f0ba744415]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:02:06 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-76176811-2701-4882-ab6e-71871d78b405 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e, portal: 172.16.0.220,3260]
Nov 16 04:02:06 user nova-compute[103546]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e, portal: 172.16.0.220,3260] successful.
Nov 16 04:02:06 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:02:06 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e -p 172.16.0.220:3260 --op delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:06 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:02:06 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a23526b-dd79-467a-8a11-285ded3732ed]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:02:06 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-76176811-2701-4882-ab6e-71871d78b405 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:02:06 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-76176811-2701-4882-ab6e-71871d78b405 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:02:06 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-76176811-2701-4882-ab6e-71871d78b405 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] <== disconnect_volume: return (364ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:02:06 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76176811-2701-4882-ab6e-71871d78b405 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 04:02:06 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-76176811-2701-4882-ab6e-71871d78b405 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Deleting instance files /opt/stack/data/nova/instances/e5b2903b-053a-4671-af52-aa08e0b220b8_del
Nov 16 04:02:06 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-76176811-2701-4882-ab6e-71871d78b405 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Deletion of /opt/stack/data/nova/instances/e5b2903b-053a-4671-af52-aa08e0b220b8_del complete
Nov 16 04:02:06 user nova-compute[103546]: INFO nova.compute.manager [None req-76176811-2701-4882-ab6e-71871d78b405 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Took 1.71 seconds to destroy the instance on the hypervisor.
Nov 16 04:02:06 user nova-compute[103546]: DEBUG oslo.service.loopingcall [None req-76176811-2701-4882-ab6e-71871d78b405 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=103546) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 04:02:06 user nova-compute[103546]: DEBUG nova.compute.manager [-] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Deallocating network for instance {{(pid=103546) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 04:02:06 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] deallocate_for_instance() {{(pid=103546) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 04:02:06 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:06 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:07 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:02:07 user nova-compute[103546]: INFO nova.compute.manager [-] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Took 1.34 seconds to deallocate network for instance.
Nov 16 04:02:08 user nova-compute[103546]: DEBUG nova.compute.manager [req-a670eaf1-bd68-41c0-84bb-48ea84d30c56 req-1cfdaa86-4fbe-4044-b12a-b440a4af8696 service nova] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Received event network-vif-plugged-9ab0370c-4cd8-49c4-9c20-c566d0db69cf {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:02:08 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a670eaf1-bd68-41c0-84bb-48ea84d30c56 req-1cfdaa86-4fbe-4044-b12a-b440a4af8696 service nova] Acquiring lock "e5b2903b-053a-4671-af52-aa08e0b220b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:02:08 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a670eaf1-bd68-41c0-84bb-48ea84d30c56 req-1cfdaa86-4fbe-4044-b12a-b440a4af8696 service nova] Lock "e5b2903b-053a-4671-af52-aa08e0b220b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:02:08 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a670eaf1-bd68-41c0-84bb-48ea84d30c56 req-1cfdaa86-4fbe-4044-b12a-b440a4af8696 service nova] Lock "e5b2903b-053a-4671-af52-aa08e0b220b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:02:08 user nova-compute[103546]: DEBUG nova.compute.manager [req-a670eaf1-bd68-41c0-84bb-48ea84d30c56 req-1cfdaa86-4fbe-4044-b12a-b440a4af8696 service nova] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] No waiting events found dispatching network-vif-plugged-9ab0370c-4cd8-49c4-9c20-c566d0db69cf {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:02:08 user nova-compute[103546]: WARNING nova.compute.manager [req-a670eaf1-bd68-41c0-84bb-48ea84d30c56 req-1cfdaa86-4fbe-4044-b12a-b440a4af8696 service nova] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Received unexpected event network-vif-plugged-9ab0370c-4cd8-49c4-9c20-c566d0db69cf for instance with vm_state active and task_state deleting.
Nov 16 04:02:08 user nova-compute[103546]: DEBUG nova.compute.manager [req-a670eaf1-bd68-41c0-84bb-48ea84d30c56 req-1cfdaa86-4fbe-4044-b12a-b440a4af8696 service nova] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Received event network-vif-deleted-9ab0370c-4cd8-49c4-9c20-c566d0db69cf {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:02:08 user nova-compute[103546]: DEBUG nova.compute.manager [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 04:02:08 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Guest created on hypervisor {{(pid=103546) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 04:02:08 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Instance spawned successfully.
Nov 16 04:02:08 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 04:02:08 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Found default for hw_cdrom_bus of ide {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:02:08 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Found default for hw_disk_bus of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:02:08 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Found default for hw_input_bus of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:02:08 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Found default for hw_pointer_model of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:02:08 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Found default for hw_video_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:02:08 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Found default for hw_vif_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:02:08 user nova-compute[103546]: INFO nova.compute.manager [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Took 5.44 seconds to spawn the instance on the hypervisor.
Nov 16 04:02:08 user nova-compute[103546]: DEBUG nova.compute.manager [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 04:02:08 user nova-compute[103546]: INFO nova.compute.manager [None req-76176811-2701-4882-ab6e-71871d78b405 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: e5b2903b-053a-4671-af52-aa08e0b220b8] Took 0.76 seconds to detach 1 volumes for instance.
Nov 16 04:02:08 user nova-compute[103546]: INFO nova.compute.manager [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Took 11.52 seconds to build instance.
Nov 16 04:02:08 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-3bdf991f-044d-4295-bf40-ef6be39846df tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "26ba7f48-9752-45af-ba68-8c3f70325e21" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.655s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:02:08 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-76176811-2701-4882-ab6e-71871d78b405 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:02:08 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-76176811-2701-4882-ab6e-71871d78b405 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:02:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:08 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-76176811-2701-4882-ab6e-71871d78b405 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:02:08 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-76176811-2701-4882-ab6e-71871d78b405 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:02:08 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-76176811-2701-4882-ab6e-71871d78b405 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.364s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:02:08 user nova-compute[103546]: INFO nova.scheduler.client.report [None req-76176811-2701-4882-ab6e-71871d78b405 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Deleted allocations for instance e5b2903b-053a-4671-af52-aa08e0b220b8
Nov 16 04:02:09 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-76176811-2701-4882-ab6e-71871d78b405 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "e5b2903b-053a-4671-af52-aa08e0b220b8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.396s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:02:10 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Acquiring lock "fa33f516-2ec7-4a83-ace8-f144e80d9473" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:02:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "fa33f516-2ec7-4a83-ace8-f144e80d9473" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:02:11 user nova-compute[103546]: DEBUG nova.compute.manager [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Starting instance... {{(pid=103546) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 04:02:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:02:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:02:11 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=103546) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 04:02:11 user nova-compute[103546]: INFO nova.compute.claims [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Claim successful on node user
Nov 16 04:02:11 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:02:11 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:02:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.437s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:02:11 user nova-compute[103546]: DEBUG nova.compute.manager [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Start building networks asynchronously for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 04:02:11 user nova-compute[103546]: DEBUG nova.compute.manager [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Allocating IP information in the background. {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 04:02:11 user nova-compute[103546]: DEBUG nova.network.neutron [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] allocate_for_instance() {{(pid=103546) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 04:02:11 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 04:02:11 user nova-compute[103546]: DEBUG nova.compute.manager [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Start building block device mappings for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 04:02:11 user nova-compute[103546]: DEBUG nova.policy [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '341066fb5ead4ef28e4900c085593814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb839c76c0d4513b9be0ec92301707f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103546) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 04:02:11 user nova-compute[103546]: DEBUG nova.compute.manager [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Start spawning the instance on the hypervisor. {{(pid=103546) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 04:02:11 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Creating instance directory {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 04:02:11 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Creating image(s)
Nov 16 04:02:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Acquiring lock "/opt/stack/data/nova/instances/fa33f516-2ec7-4a83-ace8-f144e80d9473/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:02:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "/opt/stack/data/nova/instances/fa33f516-2ec7-4a83-ace8-f144e80d9473/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:02:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "/opt/stack/data/nova/instances/fa33f516-2ec7-4a83-ace8-f144e80d9473/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:02:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Acquiring lock "2ef5aa205bcf7f26d550c1475eac377d08e83f55" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:02:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "2ef5aa205bcf7f26d550c1475eac377d08e83f55" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:02:12 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef5aa205bcf7f26d550c1475eac377d08e83f55.part --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:12 user nova-compute[103546]: DEBUG nova.network.neutron [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Successfully created port: bd7cede4-510c-488f-bf84-773a345198d7 {{(pid=103546) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 04:02:12 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef5aa205bcf7f26d550c1475eac377d08e83f55.part --force-share --output=json" returned: 0 in 0.198s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:02:12 user nova-compute[103546]: DEBUG nova.virt.images [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] 86c537ce-7981-4390-941d-9b1ecf30cfa8 was qcow2, converting to raw {{(pid=103546) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 04:02:12 user nova-compute[103546]: DEBUG nova.privsep.utils [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=103546) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 04:02:12 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2ef5aa205bcf7f26d550c1475eac377d08e83f55.part /opt/stack/data/nova/instances/_base/2ef5aa205bcf7f26d550c1475eac377d08e83f55.converted {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:12 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2ef5aa205bcf7f26d550c1475eac377d08e83f55.part /opt/stack/data/nova/instances/_base/2ef5aa205bcf7f26d550c1475eac377d08e83f55.converted" returned: 0 in 0.374s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:02:12 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef5aa205bcf7f26d550c1475eac377d08e83f55.converted --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:13 user nova-compute[103546]: DEBUG nova.compute.manager [req-ea71139b-c441-4f92-a8b1-11bf79f750bc req-ae5c83a5-6884-44ce-8907-e003653c54a5 service nova] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Received event network-vif-plugged-59aaf9cc-b110-4cb9-aff1-9320d79f55c0 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:02:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ea71139b-c441-4f92-a8b1-11bf79f750bc req-ae5c83a5-6884-44ce-8907-e003653c54a5 service nova] Acquiring lock "26ba7f48-9752-45af-ba68-8c3f70325e21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:02:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ea71139b-c441-4f92-a8b1-11bf79f750bc req-ae5c83a5-6884-44ce-8907-e003653c54a5 service nova] Lock "26ba7f48-9752-45af-ba68-8c3f70325e21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:02:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ea71139b-c441-4f92-a8b1-11bf79f750bc req-ae5c83a5-6884-44ce-8907-e003653c54a5 service nova] Lock "26ba7f48-9752-45af-ba68-8c3f70325e21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:02:13 user nova-compute[103546]: DEBUG nova.compute.manager [req-ea71139b-c441-4f92-a8b1-11bf79f750bc req-ae5c83a5-6884-44ce-8907-e003653c54a5 service nova] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] No waiting events found dispatching network-vif-plugged-59aaf9cc-b110-4cb9-aff1-9320d79f55c0 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:02:13 user nova-compute[103546]: WARNING nova.compute.manager [req-ea71139b-c441-4f92-a8b1-11bf79f750bc req-ae5c83a5-6884-44ce-8907-e003653c54a5 service nova] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Received unexpected event network-vif-plugged-59aaf9cc-b110-4cb9-aff1-9320d79f55c0 for instance with vm_state active and task_state None.
Nov 16 04:02:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef5aa205bcf7f26d550c1475eac377d08e83f55.converted --force-share --output=json" returned: 0 in 0.207s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:02:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "2ef5aa205bcf7f26d550c1475eac377d08e83f55" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.343s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:02:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef5aa205bcf7f26d550c1475eac377d08e83f55 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef5aa205bcf7f26d550c1475eac377d08e83f55 --force-share --output=json" returned: 0 in 0.191s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:02:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Acquiring lock "2ef5aa205bcf7f26d550c1475eac377d08e83f55" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:02:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "2ef5aa205bcf7f26d550c1475eac377d08e83f55" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:02:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef5aa205bcf7f26d550c1475eac377d08e83f55 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:13 user nova-compute[103546]: DEBUG nova.network.neutron [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Successfully updated port: bd7cede4-510c-488f-bf84-773a345198d7 {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 04:02:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Acquiring lock "refresh_cache-fa33f516-2ec7-4a83-ace8-f144e80d9473" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:02:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Acquired lock "refresh_cache-fa33f516-2ec7-4a83-ace8-f144e80d9473" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:02:13 user nova-compute[103546]: DEBUG nova.network.neutron [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 04:02:13 user nova-compute[103546]: DEBUG nova.network.neutron [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 04:02:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef5aa205bcf7f26d550c1475eac377d08e83f55 --force-share --output=json" returned: 0 in 0.200s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:02:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef5aa205bcf7f26d550c1475eac377d08e83f55,backing_fmt=raw /opt/stack/data/nova/instances/fa33f516-2ec7-4a83-ace8-f144e80d9473/disk 1073741824 {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef5aa205bcf7f26d550c1475eac377d08e83f55,backing_fmt=raw /opt/stack/data/nova/instances/fa33f516-2ec7-4a83-ace8-f144e80d9473/disk 1073741824" returned: 0 in 0.050s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:02:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "2ef5aa205bcf7f26d550c1475eac377d08e83f55" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:02:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef5aa205bcf7f26d550c1475eac377d08e83f55 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef5aa205bcf7f26d550c1475eac377d08e83f55 --force-share --output=json" returned: 0 in 0.188s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:02:13 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fa33f516-2ec7-4a83-ace8-f144e80d9473/disk. size=1073741824 {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 04:02:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa33f516-2ec7-4a83-ace8-f144e80d9473/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:13 user nova-compute[103546]: DEBUG nova.network.neutron [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Updating instance_info_cache with network_info: [{"id": "bd7cede4-510c-488f-bf84-773a345198d7", "address": "fa:16:3e:84:89:24", "network": {"id": "d942264a-f03e-49a2-89eb-103a12c99518", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484356505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edb839c76c0d4513b9be0ec92301707f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd7cede4-51", "ovs_interfaceid": "bd7cede4-510c-488f-bf84-773a345198d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:02:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Releasing lock "refresh_cache-fa33f516-2ec7-4a83-ace8-f144e80d9473" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:02:13 user nova-compute[103546]: DEBUG nova.compute.manager [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Instance network_info: |[{"id": "bd7cede4-510c-488f-bf84-773a345198d7", "address": "fa:16:3e:84:89:24", "network": {"id": "d942264a-f03e-49a2-89eb-103a12c99518", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484356505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edb839c76c0d4513b9be0ec92301707f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd7cede4-51", "ovs_interfaceid": "bd7cede4-510c-488f-bf84-773a345198d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 04:02:13 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa33f516-2ec7-4a83-ace8-f144e80d9473/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:02:13 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Cannot resize image /opt/stack/data/nova/instances/fa33f516-2ec7-4a83-ace8-f144e80d9473/disk to a smaller size. {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 04:02:13 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Created local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 04:02:13 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Ensure instance console log exists: /opt/stack/data/nova/instances/fa33f516-2ec7-4a83-ace8-f144e80d9473/console.log {{(pid=103546) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 04:02:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:02:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:02:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:02:13 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Start _get_guest_xml network_info=[{"id": "bd7cede4-510c-488f-bf84-773a345198d7", "address": "fa:16:3e:84:89:24", "network": {"id": "d942264a-f03e-49a2-89eb-103a12c99518", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484356505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edb839c76c0d4513b9be0ec92301707f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd7cede4-51", "ovs_interfaceid": "bd7cede4-510c-488f-bf84-773a345198d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T04:02:08Z,direct_url=<?>,disk_format='qcow2',id=86c537ce-7981-4390-941d-9b1ecf30cfa8,min_disk=0,min_ram=0,name='tempest-scenario-img--1683569905',owner='edb839c76c0d4513b9be0ec92301707f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T04:02:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '86c537ce-7981-4390-941d-9b1ecf30cfa8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 04:02:13 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:02:13 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:02:13 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 04:02:13 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 04:02:13 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 04:02:13 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 04:02:13 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 04:02:13 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T04:02:08Z,direct_url=<?>,disk_format='qcow2',id=86c537ce-7981-4390-941d-9b1ecf30cfa8,min_disk=0,min_ram=0,name='tempest-scenario-img--1683569905',owner='edb839c76c0d4513b9be0ec92301707f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T04:02:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 04:02:13 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 04:02:13 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 04:02:13 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 04:02:13 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 04:02:13 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 04:02:13 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 04:02:13 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 04:02:13 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 04:02:13 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 04:02:13 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 04:02:14 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:02:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-709249967',display_name='tempest-TestMinimumBasicScenario-server-709249967',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-709249967',id=37,image_ref='86c537ce-7981-4390-941d-9b1ecf30cfa8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD46OWTtqlJgr04x6aVRv8hBUbSMBgUi9Q0DtKBivxbAnC1inBXyd+4fJHja3kf2qBA81MZvidHOGa042g3vmWGdjfDgRFBjel2colKkP05dlXdqCimpq+7wAT58G7LIyg==',key_name='tempest-TestMinimumBasicScenario-923881879',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='edb839c76c0d4513b9be0ec92301707f',ramdisk_id='',reservation_id='r-x0v3obzl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='86c537ce-7981-4390-941d-9b1ecf30cfa8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1416270309',owner_user_name='tempest-TestMinimumBasicScenario-1416270309-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T04:02:12Z,user_data=None,user_id='341066fb5ead4ef28e4900c085593814',uuid=fa33f516-2ec7-4a83-ace8-f144e80d9473,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd7cede4-510c-488f-bf84-773a345198d7", "address": "fa:16:3e:84:89:24", "network": {"id": "d942264a-f03e-49a2-89eb-103a12c99518", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484356505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edb839c76c0d4513b9be0ec92301707f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd7cede4-51", "ovs_interfaceid": "bd7cede4-510c-488f-bf84-773a345198d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 04:02:14 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Converting VIF {"id": "bd7cede4-510c-488f-bf84-773a345198d7", "address": "fa:16:3e:84:89:24", "network": {"id": "d942264a-f03e-49a2-89eb-103a12c99518", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484356505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edb839c76c0d4513b9be0ec92301707f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd7cede4-51", "ovs_interfaceid": "bd7cede4-510c-488f-bf84-773a345198d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:02:14 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:89:24,bridge_name='br-int',has_traffic_filtering=True,id=bd7cede4-510c-488f-bf84-773a345198d7,network=Network(d942264a-f03e-49a2-89eb-103a12c99518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd7cede4-51') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:02:14 user nova-compute[103546]: DEBUG nova.objects.instance [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lazy-loading 'pci_devices' on Instance uuid fa33f516-2ec7-4a83-ace8-f144e80d9473 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:02:14 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] End _get_guest_xml xml=<domain type="kvm">
Nov 16 04:02:14 user nova-compute[103546]:   <uuid>fa33f516-2ec7-4a83-ace8-f144e80d9473</uuid>
Nov 16 04:02:14 user nova-compute[103546]:   <name>instance-00000025</name>
Nov 16 04:02:14 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 04:02:14 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 04:02:14 user nova-compute[103546]:   <metadata>
Nov 16 04:02:14 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 04:02:14 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 04:02:14 user nova-compute[103546]:       <nova:name>tempest-TestMinimumBasicScenario-server-709249967</nova:name>
Nov 16 04:02:14 user nova-compute[103546]:       <nova:creationTime>2023-11-16 04:02:13</nova:creationTime>
Nov 16 04:02:14 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 04:02:14 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 04:02:14 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 04:02:14 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 04:02:14 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 04:02:14 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 04:02:14 user nova-compute[103546]:       </nova:flavor>
Nov 16 04:02:14 user nova-compute[103546]:       <nova:owner>
Nov 16 04:02:14 user nova-compute[103546]:         <nova:user uuid="341066fb5ead4ef28e4900c085593814">tempest-TestMinimumBasicScenario-1416270309-project-member</nova:user>
Nov 16 04:02:14 user nova-compute[103546]:         <nova:project uuid="edb839c76c0d4513b9be0ec92301707f">tempest-TestMinimumBasicScenario-1416270309</nova:project>
Nov 16 04:02:14 user nova-compute[103546]:       </nova:owner>
Nov 16 04:02:14 user nova-compute[103546]:       <nova:root type="image" uuid="86c537ce-7981-4390-941d-9b1ecf30cfa8"/>
Nov 16 04:02:14 user nova-compute[103546]:       <nova:ports>
Nov 16 04:02:14 user nova-compute[103546]:         <nova:port uuid="bd7cede4-510c-488f-bf84-773a345198d7">
Nov 16 04:02:14 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 16 04:02:14 user nova-compute[103546]:         </nova:port>
Nov 16 04:02:14 user nova-compute[103546]:       </nova:ports>
Nov 16 04:02:14 user nova-compute[103546]:     </nova:instance>
Nov 16 04:02:14 user nova-compute[103546]:   </metadata>
Nov 16 04:02:14 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 04:02:14 user nova-compute[103546]:     <system>
Nov 16 04:02:14 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 04:02:14 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 04:02:14 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 04:02:14 user nova-compute[103546]:       <entry name="serial">fa33f516-2ec7-4a83-ace8-f144e80d9473</entry>
Nov 16 04:02:14 user nova-compute[103546]:       <entry name="uuid">fa33f516-2ec7-4a83-ace8-f144e80d9473</entry>
Nov 16 04:02:14 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 04:02:14 user nova-compute[103546]:     </system>
Nov 16 04:02:14 user nova-compute[103546]:   </sysinfo>
Nov 16 04:02:14 user nova-compute[103546]:   <os>
Nov 16 04:02:14 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 04:02:14 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 04:02:14 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 04:02:14 user nova-compute[103546]:   </os>
Nov 16 04:02:14 user nova-compute[103546]:   <features>
Nov 16 04:02:14 user nova-compute[103546]:     <acpi/>
Nov 16 04:02:14 user nova-compute[103546]:     <apic/>
Nov 16 04:02:14 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 04:02:14 user nova-compute[103546]:   </features>
Nov 16 04:02:14 user nova-compute[103546]:   <clock offset="utc">
Nov 16 04:02:14 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 04:02:14 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 04:02:14 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 04:02:14 user nova-compute[103546]:   </clock>
Nov 16 04:02:14 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 04:02:14 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 04:02:14 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 04:02:14 user nova-compute[103546]:   </cpu>
Nov 16 04:02:14 user nova-compute[103546]:   <devices>
Nov 16 04:02:14 user nova-compute[103546]:     <disk type="file" device="disk">
Nov 16 04:02:14 user nova-compute[103546]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 04:02:14 user nova-compute[103546]:       <source file="/opt/stack/data/nova/instances/fa33f516-2ec7-4a83-ace8-f144e80d9473/disk"/>
Nov 16 04:02:14 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 04:02:14 user nova-compute[103546]:     </disk>
Nov 16 04:02:14 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 04:02:14 user nova-compute[103546]:       <mac address="fa:16:3e:84:89:24"/>
Nov 16 04:02:14 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 04:02:14 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 04:02:14 user nova-compute[103546]:       <target dev="tapbd7cede4-51"/>
Nov 16 04:02:14 user nova-compute[103546]:     </interface>
Nov 16 04:02:14 user nova-compute[103546]:     <serial type="pty">
Nov 16 04:02:14 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/fa33f516-2ec7-4a83-ace8-f144e80d9473/console.log" append="off"/>
Nov 16 04:02:14 user nova-compute[103546]:     </serial>
Nov 16 04:02:14 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 04:02:14 user nova-compute[103546]:     <video>
Nov 16 04:02:14 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 04:02:14 user nova-compute[103546]:     </video>
Nov 16 04:02:14 user nova-compute[103546]:     <rng model="virtio">
Nov 16 04:02:14 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 04:02:14 user nova-compute[103546]:     </rng>
Nov 16 04:02:14 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 04:02:14 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 04:02:14 user nova-compute[103546]:       <stats period="10"/>
Nov 16 04:02:14 user nova-compute[103546]:     </memballoon>
Nov 16 04:02:14 user nova-compute[103546]:   </devices>
Nov 16 04:02:14 user nova-compute[103546]: </domain>
Nov 16 04:02:14 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 04:02:14 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:02:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-709249967',display_name='tempest-TestMinimumBasicScenario-server-709249967',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-709249967',id=37,image_ref='86c537ce-7981-4390-941d-9b1ecf30cfa8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD46OWTtqlJgr04x6aVRv8hBUbSMBgUi9Q0DtKBivxbAnC1inBXyd+4fJHja3kf2qBA81MZvidHOGa042g3vmWGdjfDgRFBjel2colKkP05dlXdqCimpq+7wAT58G7LIyg==',key_name='tempest-TestMinimumBasicScenario-923881879',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='edb839c76c0d4513b9be0ec92301707f',ramdisk_id='',reservation_id='r-x0v3obzl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='86c537ce-7981-4390-941d-9b1ecf30cfa8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1416270309',owner_user_name='tempest-TestMinimumBasicScenario-1416270309-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T04:02:12Z,user_data=None,user_id='341066fb5ead4ef28e4900c085593814',uuid=fa33f516-2ec7-4a83-ace8-f144e80d9473,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd7cede4-510c-488f-bf84-773a345198d7", "address": "fa:16:3e:84:89:24", "network": {"id": "d942264a-f03e-49a2-89eb-103a12c99518", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484356505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edb839c76c0d4513b9be0ec92301707f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd7cede4-51", "ovs_interfaceid": "bd7cede4-510c-488f-bf84-773a345198d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 04:02:14 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Converting VIF {"id": "bd7cede4-510c-488f-bf84-773a345198d7", "address": "fa:16:3e:84:89:24", "network": {"id": "d942264a-f03e-49a2-89eb-103a12c99518", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484356505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edb839c76c0d4513b9be0ec92301707f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd7cede4-51", "ovs_interfaceid": "bd7cede4-510c-488f-bf84-773a345198d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:02:14 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:89:24,bridge_name='br-int',has_traffic_filtering=True,id=bd7cede4-510c-488f-bf84-773a345198d7,network=Network(d942264a-f03e-49a2-89eb-103a12c99518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd7cede4-51') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:02:14 user nova-compute[103546]: DEBUG os_vif [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:89:24,bridge_name='br-int',has_traffic_filtering=True,id=bd7cede4-510c-488f-bf84-773a345198d7,network=Network(d942264a-f03e-49a2-89eb-103a12c99518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd7cede4-51') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 04:02:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:02:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 04:02:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0f7ba833-b71f-5fca-a0d9-db8d07b3243a', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:02:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:02:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbd7cede4-51, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:02:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbd7cede4-51, col_values=(('qos', UUID('cbb6b56b-ef29-4632-a6ea-d7f5faea7809')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:02:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbd7cede4-51, col_values=(('external_ids', {'iface-id': 'bd7cede4-510c-488f-bf84-773a345198d7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:89:24', 'vm-uuid': 'fa33f516-2ec7-4a83-ace8-f144e80d9473'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:02:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:02:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:14 user nova-compute[103546]: INFO os_vif [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:89:24,bridge_name='br-int',has_traffic_filtering=True,id=bd7cede4-510c-488f-bf84-773a345198d7,network=Network(d942264a-f03e-49a2-89eb-103a12c99518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd7cede4-51')
Nov 16 04:02:14 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:02:14 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] No VIF found with MAC fa:16:3e:84:89:24, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 04:02:15 user nova-compute[103546]: DEBUG nova.compute.manager [req-a895d2c1-e64c-45bd-a3ae-1d2afcb2f743 req-dc85a0d4-c59c-4d89-8ca5-eee5b8054917 service nova] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Received event network-vif-plugged-59aaf9cc-b110-4cb9-aff1-9320d79f55c0 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:02:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a895d2c1-e64c-45bd-a3ae-1d2afcb2f743 req-dc85a0d4-c59c-4d89-8ca5-eee5b8054917 service nova] Acquiring lock "26ba7f48-9752-45af-ba68-8c3f70325e21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:02:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a895d2c1-e64c-45bd-a3ae-1d2afcb2f743 req-dc85a0d4-c59c-4d89-8ca5-eee5b8054917 service nova] Lock "26ba7f48-9752-45af-ba68-8c3f70325e21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:02:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a895d2c1-e64c-45bd-a3ae-1d2afcb2f743 req-dc85a0d4-c59c-4d89-8ca5-eee5b8054917 service nova] Lock "26ba7f48-9752-45af-ba68-8c3f70325e21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:02:15 user nova-compute[103546]: DEBUG nova.compute.manager [req-a895d2c1-e64c-45bd-a3ae-1d2afcb2f743 req-dc85a0d4-c59c-4d89-8ca5-eee5b8054917 service nova] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] No waiting events found dispatching network-vif-plugged-59aaf9cc-b110-4cb9-aff1-9320d79f55c0 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:02:15 user nova-compute[103546]: WARNING nova.compute.manager [req-a895d2c1-e64c-45bd-a3ae-1d2afcb2f743 req-dc85a0d4-c59c-4d89-8ca5-eee5b8054917 service nova] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Received unexpected event network-vif-plugged-59aaf9cc-b110-4cb9-aff1-9320d79f55c0 for instance with vm_state active and task_state None.
Nov 16 04:02:15 user nova-compute[103546]: DEBUG nova.compute.manager [req-a895d2c1-e64c-45bd-a3ae-1d2afcb2f743 req-dc85a0d4-c59c-4d89-8ca5-eee5b8054917 service nova] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Received event network-changed-bd7cede4-510c-488f-bf84-773a345198d7 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:02:15 user nova-compute[103546]: DEBUG nova.compute.manager [req-a895d2c1-e64c-45bd-a3ae-1d2afcb2f743 req-dc85a0d4-c59c-4d89-8ca5-eee5b8054917 service nova] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Refreshing instance network info cache due to event network-changed-bd7cede4-510c-488f-bf84-773a345198d7. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 04:02:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a895d2c1-e64c-45bd-a3ae-1d2afcb2f743 req-dc85a0d4-c59c-4d89-8ca5-eee5b8054917 service nova] Acquiring lock "refresh_cache-fa33f516-2ec7-4a83-ace8-f144e80d9473" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:02:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a895d2c1-e64c-45bd-a3ae-1d2afcb2f743 req-dc85a0d4-c59c-4d89-8ca5-eee5b8054917 service nova] Acquired lock "refresh_cache-fa33f516-2ec7-4a83-ace8-f144e80d9473" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:02:15 user nova-compute[103546]: DEBUG nova.network.neutron [req-a895d2c1-e64c-45bd-a3ae-1d2afcb2f743 req-dc85a0d4-c59c-4d89-8ca5-eee5b8054917 service nova] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Refreshing network info cache for port bd7cede4-510c-488f-bf84-773a345198d7 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 04:02:15 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:15 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:15 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:15 user nova-compute[103546]: DEBUG nova.network.neutron [req-a895d2c1-e64c-45bd-a3ae-1d2afcb2f743 req-dc85a0d4-c59c-4d89-8ca5-eee5b8054917 service nova] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Updated VIF entry in instance network info cache for port bd7cede4-510c-488f-bf84-773a345198d7. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 04:02:15 user nova-compute[103546]: DEBUG nova.network.neutron [req-a895d2c1-e64c-45bd-a3ae-1d2afcb2f743 req-dc85a0d4-c59c-4d89-8ca5-eee5b8054917 service nova] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Updating instance_info_cache with network_info: [{"id": "bd7cede4-510c-488f-bf84-773a345198d7", "address": "fa:16:3e:84:89:24", "network": {"id": "d942264a-f03e-49a2-89eb-103a12c99518", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484356505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edb839c76c0d4513b9be0ec92301707f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd7cede4-51", "ovs_interfaceid": "bd7cede4-510c-488f-bf84-773a345198d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:02:15 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a895d2c1-e64c-45bd-a3ae-1d2afcb2f743 req-dc85a0d4-c59c-4d89-8ca5-eee5b8054917 service nova] Releasing lock "refresh_cache-fa33f516-2ec7-4a83-ace8-f144e80d9473" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:02:15 user nova-compute[103546]: DEBUG nova.compute.manager [req-add1f9c0-fb6e-4129-ac49-33b2de660fc1 req-79f0e7ed-8fda-432a-a5f9-82ef909704c6 service nova] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Received event network-vif-plugged-bd7cede4-510c-488f-bf84-773a345198d7 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:02:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-add1f9c0-fb6e-4129-ac49-33b2de660fc1 req-79f0e7ed-8fda-432a-a5f9-82ef909704c6 service nova] Acquiring lock "fa33f516-2ec7-4a83-ace8-f144e80d9473-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:02:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-add1f9c0-fb6e-4129-ac49-33b2de660fc1 req-79f0e7ed-8fda-432a-a5f9-82ef909704c6 service nova] Lock "fa33f516-2ec7-4a83-ace8-f144e80d9473-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:02:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-add1f9c0-fb6e-4129-ac49-33b2de660fc1 req-79f0e7ed-8fda-432a-a5f9-82ef909704c6 service nova] Lock "fa33f516-2ec7-4a83-ace8-f144e80d9473-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:02:15 user nova-compute[103546]: DEBUG nova.compute.manager [req-add1f9c0-fb6e-4129-ac49-33b2de660fc1 req-79f0e7ed-8fda-432a-a5f9-82ef909704c6 service nova] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] No waiting events found dispatching network-vif-plugged-bd7cede4-510c-488f-bf84-773a345198d7 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:02:15 user nova-compute[103546]: WARNING nova.compute.manager [req-add1f9c0-fb6e-4129-ac49-33b2de660fc1 req-79f0e7ed-8fda-432a-a5f9-82ef909704c6 service nova] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Received unexpected event network-vif-plugged-bd7cede4-510c-488f-bf84-773a345198d7 for instance with vm_state building and task_state spawning.
Nov 16 04:02:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:16 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:02:16 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Cleaning up deleted instances {{(pid=103546) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 04:02:16 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] There are 0 instances to clean {{(pid=103546) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 04:02:17 user nova-compute[103546]: DEBUG nova.compute.manager [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 04:02:17 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Guest created on hypervisor {{(pid=103546) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 04:02:17 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Instance spawned successfully.
Nov 16 04:02:17 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 04:02:17 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Found default for hw_cdrom_bus of ide {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:02:17 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Found default for hw_disk_bus of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:02:17 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Found default for hw_input_bus of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:02:17 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Found default for hw_pointer_model of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:02:17 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Found default for hw_video_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:02:17 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Found default for hw_vif_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:02:17 user nova-compute[103546]: INFO nova.compute.manager [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Took 6.06 seconds to spawn the instance on the hypervisor.
Nov 16 04:02:17 user nova-compute[103546]: DEBUG nova.compute.manager [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 04:02:17 user nova-compute[103546]: DEBUG nova.compute.manager [req-82a7c9da-57b9-4c49-9071-87d7cde563e5 req-e67051ce-d31e-48f0-b296-9c58a58e253a service nova] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Received event network-vif-plugged-bd7cede4-510c-488f-bf84-773a345198d7 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:02:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-82a7c9da-57b9-4c49-9071-87d7cde563e5 req-e67051ce-d31e-48f0-b296-9c58a58e253a service nova] Acquiring lock "fa33f516-2ec7-4a83-ace8-f144e80d9473-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:02:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-82a7c9da-57b9-4c49-9071-87d7cde563e5 req-e67051ce-d31e-48f0-b296-9c58a58e253a service nova] Lock "fa33f516-2ec7-4a83-ace8-f144e80d9473-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:02:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-82a7c9da-57b9-4c49-9071-87d7cde563e5 req-e67051ce-d31e-48f0-b296-9c58a58e253a service nova] Lock "fa33f516-2ec7-4a83-ace8-f144e80d9473-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:02:17 user nova-compute[103546]: DEBUG nova.compute.manager [req-82a7c9da-57b9-4c49-9071-87d7cde563e5 req-e67051ce-d31e-48f0-b296-9c58a58e253a service nova] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] No waiting events found dispatching network-vif-plugged-bd7cede4-510c-488f-bf84-773a345198d7 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:02:17 user nova-compute[103546]: WARNING nova.compute.manager [req-82a7c9da-57b9-4c49-9071-87d7cde563e5 req-e67051ce-d31e-48f0-b296-9c58a58e253a service nova] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Received unexpected event network-vif-plugged-bd7cede4-510c-488f-bf84-773a345198d7 for instance with vm_state building and task_state spawning.
Nov 16 04:02:17 user nova-compute[103546]: INFO nova.compute.manager [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Took 6.85 seconds to build instance.
Nov 16 04:02:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-7948b319-698f-4843-bf63-a192e7ea4389 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "fa33f516-2ec7-4a83-ace8-f144e80d9473" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.959s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:02:18 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:19 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:19 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:02:19 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:02:19 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=103546) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 04:02:20 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:02:21 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:02:21 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:02:22 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:02:22 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:02:23 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager.update_available_resource {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:02:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:02:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:02:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:02:23 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Auditing locally available compute resources for user (node: user) {{(pid=103546) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 04:02:23 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:24 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:02:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:02:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f7c407-3373-43ba-ac92-7eb0a43a7093/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f7c407-3373-43ba-ac92-7eb0a43a7093/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:02:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f7c407-3373-43ba-ac92-7eb0a43a7093/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f7c407-3373-43ba-ac92-7eb0a43a7093/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:02:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:02:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:02:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:02:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:02:25 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 04:02:25 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 04:02:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa33f516-2ec7-4a83-ace8-f144e80d9473/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa33f516-2ec7-4a83-ace8-f144e80d9473/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:02:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa33f516-2ec7-4a83-ace8-f144e80d9473/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa33f516-2ec7-4a83-ace8-f144e80d9473/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:02:25 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 04:02:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.rescue --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:02:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.rescue --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:02:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:02:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:02:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:02:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:02:27 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 04:02:27 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:02:27 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:02:27 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Hypervisor/Node resource view: name=user free_ram=7937MB free_disk=25.03905487060547GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=103546) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 04:02:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:02:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:02:27 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 9a89970b-fc61-4419-8ff9-b48013dccf9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:02:27 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 04101512-7333-4581-add3-7af3821e335b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:02:27 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance fa7e5468-9dd4-407d-85ec-d45ec76f9e29 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:02:27 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 246ccf69-847c-4ab2-b709-ad1a85e81eab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:02:27 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 8d229d05-95f1-4997-8539-802ac65cff8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:02:27 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance b0a480de-e99b-4b54-bd81-36c216442137 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:02:27 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 38f7c407-3373-43ba-ac92-7eb0a43a7093 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:02:27 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 66b98917-7551-47a5-94a1-79606cf1467d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:02:27 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 26ba7f48-9752-45af-ba68-8c3f70325e21 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:02:27 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance fa33f516-2ec7-4a83-ace8-f144e80d9473 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:02:27 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 04:02:27 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 04:02:27 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Refreshing inventories for resource provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 04:02:27 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Updating ProviderTree inventory for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 04:02:27 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Updating inventory in ProviderTree for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 04:02:27 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Refreshing aggregate associations for resource provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a, aggregates: None {{(pid=103546) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 04:02:27 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Refreshing trait associations for resource provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=103546) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 04:02:28 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:02:28 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:02:28 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Compute_service record updated for user:user {{(pid=103546) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 04:02:28 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.680s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:02:28 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:29 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:02:29 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Starting heal instance info cache {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 04:02:29 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Didn't find any instances for network info cache update. {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 04:02:29 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:02:29 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:02:33 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Acquiring lock "d31c22d9-0691-4f24-817b-93b1a57d6ff4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:02:33 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "d31c22d9-0691-4f24-817b-93b1a57d6ff4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:02:33 user nova-compute[103546]: DEBUG nova.compute.manager [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Starting instance... {{(pid=103546) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 04:02:33 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:02:33 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:02:33 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=103546) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 04:02:33 user nova-compute[103546]: INFO nova.compute.claims [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Claim successful on node user
Nov 16 04:02:33 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:02:33 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:02:33 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.459s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:02:33 user nova-compute[103546]: DEBUG nova.compute.manager [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Start building networks asynchronously for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 04:02:33 user nova-compute[103546]: DEBUG nova.compute.manager [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Allocating IP information in the background. {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 04:02:33 user nova-compute[103546]: DEBUG nova.network.neutron [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] allocate_for_instance() {{(pid=103546) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 04:02:33 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 04:02:33 user nova-compute[103546]: DEBUG nova.compute.manager [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Start building block device mappings for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 04:02:33 user nova-compute[103546]: DEBUG nova.policy [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9d186163bddc48319b97f186f7c65e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e30b7ac9515458aa8a6eb1a34cc543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103546) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 04:02:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:33 user nova-compute[103546]: DEBUG nova.compute.manager [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Start spawning the instance on the hypervisor. {{(pid=103546) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 04:02:33 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Creating instance directory {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 04:02:33 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Creating image(s)
Nov 16 04:02:33 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Acquiring lock "/opt/stack/data/nova/instances/d31c22d9-0691-4f24-817b-93b1a57d6ff4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:02:33 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "/opt/stack/data/nova/instances/d31c22d9-0691-4f24-817b-93b1a57d6ff4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:02:33 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "/opt/stack/data/nova/instances/d31c22d9-0691-4f24-817b-93b1a57d6ff4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:02:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.179s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:02:33 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Acquiring lock "8c9efafb670bfe5842ba1f4ce398924612164af7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:02:33 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:02:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:34 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.176s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:02:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/d31c22d9-0691-4f24-817b-93b1a57d6ff4/disk 1073741824 {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/d31c22d9-0691-4f24-817b-93b1a57d6ff4/disk 1073741824" returned: 0 in 0.049s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:02:34 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:02:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:34 user nova-compute[103546]: DEBUG nova.network.neutron [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Successfully created port: 32d2afdc-7f04-4be3-b45c-19b2c5deabf4 {{(pid=103546) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 04:02:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.185s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:02:34 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d31c22d9-0691-4f24-817b-93b1a57d6ff4/disk. size=1073741824 {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 04:02:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d31c22d9-0691-4f24-817b-93b1a57d6ff4/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d31c22d9-0691-4f24-817b-93b1a57d6ff4/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:02:34 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Cannot resize image /opt/stack/data/nova/instances/d31c22d9-0691-4f24-817b-93b1a57d6ff4/disk to a smaller size. {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 04:02:34 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Created local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 04:02:34 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Ensure instance console log exists: /opt/stack/data/nova/instances/d31c22d9-0691-4f24-817b-93b1a57d6ff4/console.log {{(pid=103546) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 04:02:34 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:02:34 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:02:34 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:02:34 user nova-compute[103546]: DEBUG nova.network.neutron [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Successfully updated port: 32d2afdc-7f04-4be3-b45c-19b2c5deabf4 {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 04:02:34 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Acquiring lock "refresh_cache-d31c22d9-0691-4f24-817b-93b1a57d6ff4" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:02:34 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Acquired lock "refresh_cache-d31c22d9-0691-4f24-817b-93b1a57d6ff4" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:02:34 user nova-compute[103546]: DEBUG nova.network.neutron [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 04:02:35 user nova-compute[103546]: DEBUG nova.network.neutron [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 04:02:35 user nova-compute[103546]: DEBUG nova.compute.manager [req-258b901f-9848-4666-93fc-776971774267 req-dfd88a9e-aa82-4e9c-9bc7-d494d2f9e078 service nova] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Received event network-changed-32d2afdc-7f04-4be3-b45c-19b2c5deabf4 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:02:35 user nova-compute[103546]: DEBUG nova.compute.manager [req-258b901f-9848-4666-93fc-776971774267 req-dfd88a9e-aa82-4e9c-9bc7-d494d2f9e078 service nova] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Refreshing instance network info cache due to event network-changed-32d2afdc-7f04-4be3-b45c-19b2c5deabf4. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 04:02:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-258b901f-9848-4666-93fc-776971774267 req-dfd88a9e-aa82-4e9c-9bc7-d494d2f9e078 service nova] Acquiring lock "refresh_cache-d31c22d9-0691-4f24-817b-93b1a57d6ff4" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:02:35 user nova-compute[103546]: DEBUG nova.network.neutron [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Updating instance_info_cache with network_info: [{"id": "32d2afdc-7f04-4be3-b45c-19b2c5deabf4", "address": "fa:16:3e:7a:cf:df", "network": {"id": "6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038318316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e30b7ac9515458aa8a6eb1a34cc543a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32d2afdc-7f", "ovs_interfaceid": "32d2afdc-7f04-4be3-b45c-19b2c5deabf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:02:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Releasing lock "refresh_cache-d31c22d9-0691-4f24-817b-93b1a57d6ff4" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:02:35 user nova-compute[103546]: DEBUG nova.compute.manager [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Instance network_info: |[{"id": "32d2afdc-7f04-4be3-b45c-19b2c5deabf4", "address": "fa:16:3e:7a:cf:df", "network": {"id": "6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038318316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e30b7ac9515458aa8a6eb1a34cc543a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32d2afdc-7f", "ovs_interfaceid": "32d2afdc-7f04-4be3-b45c-19b2c5deabf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 04:02:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-258b901f-9848-4666-93fc-776971774267 req-dfd88a9e-aa82-4e9c-9bc7-d494d2f9e078 service nova] Acquired lock "refresh_cache-d31c22d9-0691-4f24-817b-93b1a57d6ff4" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:02:35 user nova-compute[103546]: DEBUG nova.network.neutron [req-258b901f-9848-4666-93fc-776971774267 req-dfd88a9e-aa82-4e9c-9bc7-d494d2f9e078 service nova] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Refreshing network info cache for port 32d2afdc-7f04-4be3-b45c-19b2c5deabf4 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 04:02:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Start _get_guest_xml network_info=[{"id": "32d2afdc-7f04-4be3-b45c-19b2c5deabf4", "address": "fa:16:3e:7a:cf:df", "network": {"id": "6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038318316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e30b7ac9515458aa8a6eb1a34cc543a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32d2afdc-7f", "ovs_interfaceid": "32d2afdc-7f04-4be3-b45c-19b2c5deabf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '5c6f539a-01e5-4478-bf8f-a14310b5d7dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 04:02:35 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:02:35 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:02:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 04:02:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 04:02:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 04:02:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 04:02:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 04:02:35 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 04:02:35 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 04:02:35 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 04:02:35 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 04:02:35 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 04:02:35 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 04:02:35 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 04:02:35 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 04:02:35 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 04:02:35 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 04:02:35 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 04:02:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:02:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1492269291',display_name='tempest-AttachVolumeNegativeTest-server-1492269291',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1492269291',id=38,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0EYW4UBVsS6W0Y5qmoYSoiOUkbNsiy2qk5HkV/ssQR5IAuVPrW/mKnBd47kH5BZHLesXRDDOhAVv4gjobri4LIU2McqbfGbUNfLYLAaAc6HixXmOfv/silzBxk2WJEPA==',key_name='tempest-keypair-2004008295',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8e30b7ac9515458aa8a6eb1a34cc543a',ramdisk_id='',reservation_id='r-g38jbr3t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-64216432',owner_user_name='tempest-AttachVolumeNegativeTest-64216432-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T04:02:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d186163bddc48319b97f186f7c65e80',uuid=d31c22d9-0691-4f24-817b-93b1a57d6ff4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32d2afdc-7f04-4be3-b45c-19b2c5deabf4", "address": "fa:16:3e:7a:cf:df", "network": {"id": "6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038318316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e30b7ac9515458aa8a6eb1a34cc543a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32d2afdc-7f", "ovs_interfaceid": "32d2afdc-7f04-4be3-b45c-19b2c5deabf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 04:02:35 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Converting VIF {"id": "32d2afdc-7f04-4be3-b45c-19b2c5deabf4", "address": "fa:16:3e:7a:cf:df", "network": {"id": "6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038318316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e30b7ac9515458aa8a6eb1a34cc543a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32d2afdc-7f", "ovs_interfaceid": "32d2afdc-7f04-4be3-b45c-19b2c5deabf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:02:35 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:cf:df,bridge_name='br-int',has_traffic_filtering=True,id=32d2afdc-7f04-4be3-b45c-19b2c5deabf4,network=Network(6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32d2afdc-7f') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:02:35 user nova-compute[103546]: DEBUG nova.objects.instance [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lazy-loading 'pci_devices' on Instance uuid d31c22d9-0691-4f24-817b-93b1a57d6ff4 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:02:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] End _get_guest_xml xml=<domain type="kvm">
Nov 16 04:02:35 user nova-compute[103546]:   <uuid>d31c22d9-0691-4f24-817b-93b1a57d6ff4</uuid>
Nov 16 04:02:35 user nova-compute[103546]:   <name>instance-00000026</name>
Nov 16 04:02:35 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 04:02:35 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 04:02:35 user nova-compute[103546]:   <metadata>
Nov 16 04:02:35 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 04:02:35 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 04:02:35 user nova-compute[103546]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1492269291</nova:name>
Nov 16 04:02:35 user nova-compute[103546]:       <nova:creationTime>2023-11-16 04:02:35</nova:creationTime>
Nov 16 04:02:35 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 04:02:35 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 04:02:35 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 04:02:35 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 04:02:35 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 04:02:35 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 04:02:35 user nova-compute[103546]:       </nova:flavor>
Nov 16 04:02:35 user nova-compute[103546]:       <nova:owner>
Nov 16 04:02:35 user nova-compute[103546]:         <nova:user uuid="9d186163bddc48319b97f186f7c65e80">tempest-AttachVolumeNegativeTest-64216432-project-member</nova:user>
Nov 16 04:02:35 user nova-compute[103546]:         <nova:project uuid="8e30b7ac9515458aa8a6eb1a34cc543a">tempest-AttachVolumeNegativeTest-64216432</nova:project>
Nov 16 04:02:35 user nova-compute[103546]:       </nova:owner>
Nov 16 04:02:35 user nova-compute[103546]:       <nova:root type="image" uuid="5c6f539a-01e5-4478-bf8f-a14310b5d7dd"/>
Nov 16 04:02:35 user nova-compute[103546]:       <nova:ports>
Nov 16 04:02:35 user nova-compute[103546]:         <nova:port uuid="32d2afdc-7f04-4be3-b45c-19b2c5deabf4">
Nov 16 04:02:35 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 16 04:02:35 user nova-compute[103546]:         </nova:port>
Nov 16 04:02:35 user nova-compute[103546]:       </nova:ports>
Nov 16 04:02:35 user nova-compute[103546]:     </nova:instance>
Nov 16 04:02:35 user nova-compute[103546]:   </metadata>
Nov 16 04:02:35 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 04:02:35 user nova-compute[103546]:     <system>
Nov 16 04:02:35 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 04:02:35 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 04:02:35 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 04:02:35 user nova-compute[103546]:       <entry name="serial">d31c22d9-0691-4f24-817b-93b1a57d6ff4</entry>
Nov 16 04:02:35 user nova-compute[103546]:       <entry name="uuid">d31c22d9-0691-4f24-817b-93b1a57d6ff4</entry>
Nov 16 04:02:35 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 04:02:35 user nova-compute[103546]:     </system>
Nov 16 04:02:35 user nova-compute[103546]:   </sysinfo>
Nov 16 04:02:35 user nova-compute[103546]:   <os>
Nov 16 04:02:35 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 04:02:35 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 04:02:35 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 04:02:35 user nova-compute[103546]:   </os>
Nov 16 04:02:35 user nova-compute[103546]:   <features>
Nov 16 04:02:35 user nova-compute[103546]:     <acpi/>
Nov 16 04:02:35 user nova-compute[103546]:     <apic/>
Nov 16 04:02:35 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 04:02:35 user nova-compute[103546]:   </features>
Nov 16 04:02:35 user nova-compute[103546]:   <clock offset="utc">
Nov 16 04:02:35 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 04:02:35 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 04:02:35 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 04:02:35 user nova-compute[103546]:   </clock>
Nov 16 04:02:35 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 04:02:35 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 04:02:35 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 04:02:35 user nova-compute[103546]:   </cpu>
Nov 16 04:02:35 user nova-compute[103546]:   <devices>
Nov 16 04:02:35 user nova-compute[103546]:     <disk type="file" device="disk">
Nov 16 04:02:35 user nova-compute[103546]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 04:02:35 user nova-compute[103546]:       <source file="/opt/stack/data/nova/instances/d31c22d9-0691-4f24-817b-93b1a57d6ff4/disk"/>
Nov 16 04:02:35 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 04:02:35 user nova-compute[103546]:     </disk>
Nov 16 04:02:35 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 04:02:35 user nova-compute[103546]:       <mac address="fa:16:3e:7a:cf:df"/>
Nov 16 04:02:35 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 04:02:35 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 04:02:35 user nova-compute[103546]:       <target dev="tap32d2afdc-7f"/>
Nov 16 04:02:35 user nova-compute[103546]:     </interface>
Nov 16 04:02:35 user nova-compute[103546]:     <serial type="pty">
Nov 16 04:02:35 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/d31c22d9-0691-4f24-817b-93b1a57d6ff4/console.log" append="off"/>
Nov 16 04:02:35 user nova-compute[103546]:     </serial>
Nov 16 04:02:35 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 04:02:35 user nova-compute[103546]:     <video>
Nov 16 04:02:35 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 04:02:35 user nova-compute[103546]:     </video>
Nov 16 04:02:35 user nova-compute[103546]:     <rng model="virtio">
Nov 16 04:02:35 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 04:02:35 user nova-compute[103546]:     </rng>
Nov 16 04:02:35 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 04:02:35 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 04:02:35 user nova-compute[103546]:       <stats period="10"/>
Nov 16 04:02:35 user nova-compute[103546]:     </memballoon>
Nov 16 04:02:35 user nova-compute[103546]:   </devices>
Nov 16 04:02:35 user nova-compute[103546]: </domain>
Nov 16 04:02:35 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 04:02:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:02:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1492269291',display_name='tempest-AttachVolumeNegativeTest-server-1492269291',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1492269291',id=38,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0EYW4UBVsS6W0Y5qmoYSoiOUkbNsiy2qk5HkV/ssQR5IAuVPrW/mKnBd47kH5BZHLesXRDDOhAVv4gjobri4LIU2McqbfGbUNfLYLAaAc6HixXmOfv/silzBxk2WJEPA==',key_name='tempest-keypair-2004008295',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8e30b7ac9515458aa8a6eb1a34cc543a',ramdisk_id='',reservation_id='r-g38jbr3t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-64216432',owner_user_name='tempest-AttachVolumeNegativeTest-64216432-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T04:02:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d186163bddc48319b97f186f7c65e80',uuid=d31c22d9-0691-4f24-817b-93b1a57d6ff4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32d2afdc-7f04-4be3-b45c-19b2c5deabf4", "address": "fa:16:3e:7a:cf:df", "network": {"id": "6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038318316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e30b7ac9515458aa8a6eb1a34cc543a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32d2afdc-7f", "ovs_interfaceid": "32d2afdc-7f04-4be3-b45c-19b2c5deabf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 04:02:35 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Converting VIF {"id": "32d2afdc-7f04-4be3-b45c-19b2c5deabf4", "address": "fa:16:3e:7a:cf:df", "network": {"id": "6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038318316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e30b7ac9515458aa8a6eb1a34cc543a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32d2afdc-7f", "ovs_interfaceid": "32d2afdc-7f04-4be3-b45c-19b2c5deabf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:02:35 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:cf:df,bridge_name='br-int',has_traffic_filtering=True,id=32d2afdc-7f04-4be3-b45c-19b2c5deabf4,network=Network(6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32d2afdc-7f') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:02:35 user nova-compute[103546]: DEBUG os_vif [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:cf:df,bridge_name='br-int',has_traffic_filtering=True,id=32d2afdc-7f04-4be3-b45c-19b2c5deabf4,network=Network(6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32d2afdc-7f') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 04:02:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:02:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 04:02:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '47559150-9757-5b26-b66e-532877fd131e', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:02:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:02:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap32d2afdc-7f, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:02:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap32d2afdc-7f, col_values=(('qos', UUID('45300e7b-fa7a-4448-9874-b36f708e9fcd')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:02:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap32d2afdc-7f, col_values=(('external_ids', {'iface-id': '32d2afdc-7f04-4be3-b45c-19b2c5deabf4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:cf:df', 'vm-uuid': 'd31c22d9-0691-4f24-817b-93b1a57d6ff4'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:02:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:02:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:35 user nova-compute[103546]: INFO os_vif [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:cf:df,bridge_name='br-int',has_traffic_filtering=True,id=32d2afdc-7f04-4be3-b45c-19b2c5deabf4,network=Network(6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32d2afdc-7f')
Nov 16 04:02:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:02:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] No VIF found with MAC fa:16:3e:7a:cf:df, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 04:02:35 user nova-compute[103546]: DEBUG nova.network.neutron [req-258b901f-9848-4666-93fc-776971774267 req-dfd88a9e-aa82-4e9c-9bc7-d494d2f9e078 service nova] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Updated VIF entry in instance network info cache for port 32d2afdc-7f04-4be3-b45c-19b2c5deabf4. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 04:02:35 user nova-compute[103546]: DEBUG nova.network.neutron [req-258b901f-9848-4666-93fc-776971774267 req-dfd88a9e-aa82-4e9c-9bc7-d494d2f9e078 service nova] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Updating instance_info_cache with network_info: [{"id": "32d2afdc-7f04-4be3-b45c-19b2c5deabf4", "address": "fa:16:3e:7a:cf:df", "network": {"id": "6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038318316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e30b7ac9515458aa8a6eb1a34cc543a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32d2afdc-7f", "ovs_interfaceid": "32d2afdc-7f04-4be3-b45c-19b2c5deabf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:02:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-258b901f-9848-4666-93fc-776971774267 req-dfd88a9e-aa82-4e9c-9bc7-d494d2f9e078 service nova] Releasing lock "refresh_cache-d31c22d9-0691-4f24-817b-93b1a57d6ff4" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:02:36 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:36 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:36 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:36 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:37 user nova-compute[103546]: DEBUG nova.compute.manager [req-a165dd59-06ee-4c08-a382-21eb9ff91421 req-8519c333-f9dd-4b30-b081-4ce34693b4a2 service nova] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Received event network-vif-plugged-32d2afdc-7f04-4be3-b45c-19b2c5deabf4 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:02:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a165dd59-06ee-4c08-a382-21eb9ff91421 req-8519c333-f9dd-4b30-b081-4ce34693b4a2 service nova] Acquiring lock "d31c22d9-0691-4f24-817b-93b1a57d6ff4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:02:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a165dd59-06ee-4c08-a382-21eb9ff91421 req-8519c333-f9dd-4b30-b081-4ce34693b4a2 service nova] Lock "d31c22d9-0691-4f24-817b-93b1a57d6ff4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:02:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a165dd59-06ee-4c08-a382-21eb9ff91421 req-8519c333-f9dd-4b30-b081-4ce34693b4a2 service nova] Lock "d31c22d9-0691-4f24-817b-93b1a57d6ff4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:02:37 user nova-compute[103546]: DEBUG nova.compute.manager [req-a165dd59-06ee-4c08-a382-21eb9ff91421 req-8519c333-f9dd-4b30-b081-4ce34693b4a2 service nova] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] No waiting events found dispatching network-vif-plugged-32d2afdc-7f04-4be3-b45c-19b2c5deabf4 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:02:37 user nova-compute[103546]: WARNING nova.compute.manager [req-a165dd59-06ee-4c08-a382-21eb9ff91421 req-8519c333-f9dd-4b30-b081-4ce34693b4a2 service nova] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Received unexpected event network-vif-plugged-32d2afdc-7f04-4be3-b45c-19b2c5deabf4 for instance with vm_state building and task_state spawning.
Nov 16 04:02:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:38 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:02:38 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Cleaning up deleted instances with incomplete migration  {{(pid=103546) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 04:02:38 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:39 user nova-compute[103546]: DEBUG nova.compute.manager [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 04:02:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Guest created on hypervisor {{(pid=103546) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 04:02:39 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Instance spawned successfully.
Nov 16 04:02:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 04:02:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Found default for hw_cdrom_bus of ide {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:02:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Found default for hw_disk_bus of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:02:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Found default for hw_input_bus of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:02:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Found default for hw_pointer_model of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:02:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Found default for hw_video_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:02:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Found default for hw_vif_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:02:39 user nova-compute[103546]: INFO nova.compute.manager [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Took 5.31 seconds to spawn the instance on the hypervisor.
Nov 16 04:02:39 user nova-compute[103546]: DEBUG nova.compute.manager [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 04:02:39 user nova-compute[103546]: INFO nova.compute.manager [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Took 6.09 seconds to build instance.
Nov 16 04:02:39 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b70b48f0-6f19-4a90-9a97-dede7b7e5ca6 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "d31c22d9-0691-4f24-817b-93b1a57d6ff4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.186s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:02:39 user nova-compute[103546]: DEBUG nova.compute.manager [req-e1b9c6d3-8037-41b1-92b4-5bca36c76ff1 req-e0554942-3c2e-4eda-82c6-2d663232b84d service nova] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Received event network-vif-plugged-32d2afdc-7f04-4be3-b45c-19b2c5deabf4 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:02:39 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-e1b9c6d3-8037-41b1-92b4-5bca36c76ff1 req-e0554942-3c2e-4eda-82c6-2d663232b84d service nova] Acquiring lock "d31c22d9-0691-4f24-817b-93b1a57d6ff4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:02:39 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-e1b9c6d3-8037-41b1-92b4-5bca36c76ff1 req-e0554942-3c2e-4eda-82c6-2d663232b84d service nova] Lock "d31c22d9-0691-4f24-817b-93b1a57d6ff4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:02:39 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-e1b9c6d3-8037-41b1-92b4-5bca36c76ff1 req-e0554942-3c2e-4eda-82c6-2d663232b84d service nova] Lock "d31c22d9-0691-4f24-817b-93b1a57d6ff4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:02:39 user nova-compute[103546]: DEBUG nova.compute.manager [req-e1b9c6d3-8037-41b1-92b4-5bca36c76ff1 req-e0554942-3c2e-4eda-82c6-2d663232b84d service nova] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] No waiting events found dispatching network-vif-plugged-32d2afdc-7f04-4be3-b45c-19b2c5deabf4 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:02:39 user nova-compute[103546]: WARNING nova.compute.manager [req-e1b9c6d3-8037-41b1-92b4-5bca36c76ff1 req-e0554942-3c2e-4eda-82c6-2d663232b84d service nova] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Received unexpected event network-vif-plugged-32d2afdc-7f04-4be3-b45c-19b2c5deabf4 for instance with vm_state active and task_state None.
Nov 16 04:02:40 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:45 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:48 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:49 user nova-compute[103546]: DEBUG nova.compute.manager [req-5fc5bb65-b326-49a9-95ed-3d8382e3fb59 req-41935bcf-992b-4092-b871-ec94d47607f1 service nova] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Received event network-changed-7df3a25d-d802-44f8-8a98-bb6be3453d3e {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:02:49 user nova-compute[103546]: DEBUG nova.compute.manager [req-5fc5bb65-b326-49a9-95ed-3d8382e3fb59 req-41935bcf-992b-4092-b871-ec94d47607f1 service nova] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Refreshing instance network info cache due to event network-changed-7df3a25d-d802-44f8-8a98-bb6be3453d3e. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 04:02:49 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-5fc5bb65-b326-49a9-95ed-3d8382e3fb59 req-41935bcf-992b-4092-b871-ec94d47607f1 service nova] Acquiring lock "refresh_cache-66b98917-7551-47a5-94a1-79606cf1467d" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:02:49 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-5fc5bb65-b326-49a9-95ed-3d8382e3fb59 req-41935bcf-992b-4092-b871-ec94d47607f1 service nova] Acquired lock "refresh_cache-66b98917-7551-47a5-94a1-79606cf1467d" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:02:49 user nova-compute[103546]: DEBUG nova.network.neutron [req-5fc5bb65-b326-49a9-95ed-3d8382e3fb59 req-41935bcf-992b-4092-b871-ec94d47607f1 service nova] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Refreshing network info cache for port 7df3a25d-d802-44f8-8a98-bb6be3453d3e {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 04:02:49 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b377ead9-85dd-4a55-9553-00ba1cefca67 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Acquiring lock "66b98917-7551-47a5-94a1-79606cf1467d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:02:49 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b377ead9-85dd-4a55-9553-00ba1cefca67 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Lock "66b98917-7551-47a5-94a1-79606cf1467d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:02:49 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b377ead9-85dd-4a55-9553-00ba1cefca67 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Acquiring lock "66b98917-7551-47a5-94a1-79606cf1467d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:02:49 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b377ead9-85dd-4a55-9553-00ba1cefca67 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Lock "66b98917-7551-47a5-94a1-79606cf1467d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:02:49 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b377ead9-85dd-4a55-9553-00ba1cefca67 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Lock "66b98917-7551-47a5-94a1-79606cf1467d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:02:49 user nova-compute[103546]: INFO nova.compute.manager [None req-b377ead9-85dd-4a55-9553-00ba1cefca67 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Terminating instance
Nov 16 04:02:49 user nova-compute[103546]: DEBUG nova.compute.manager [None req-b377ead9-85dd-4a55-9553-00ba1cefca67 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Start destroying the instance on the hypervisor. {{(pid=103546) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 04:02:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG nova.network.neutron [req-5fc5bb65-b326-49a9-95ed-3d8382e3fb59 req-41935bcf-992b-4092-b871-ec94d47607f1 service nova] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Updated VIF entry in instance network info cache for port 7df3a25d-d802-44f8-8a98-bb6be3453d3e. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG nova.network.neutron [req-5fc5bb65-b326-49a9-95ed-3d8382e3fb59 req-41935bcf-992b-4092-b871-ec94d47607f1 service nova] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Updating instance_info_cache with network_info: [{"id": "7df3a25d-d802-44f8-8a98-bb6be3453d3e", "address": "fa:16:3e:7c:b1:ba", "network": {"id": "f9df40e7-5801-4e0c-8b8b-6cdb4da22727", "bridge": "br-int", "label": "tempest-TestShelveInstance-1586968346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "164c650c4ec44057973d5d1ab45b7440", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7df3a25d-d8", "ovs_interfaceid": "7df3a25d-d802-44f8-8a98-bb6be3453d3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-5fc5bb65-b326-49a9-95ed-3d8382e3fb59 req-41935bcf-992b-4092-b871-ec94d47607f1 service nova] Releasing lock "refresh_cache-66b98917-7551-47a5-94a1-79606cf1467d" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:50 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Instance destroyed successfully.
Nov 16 04:02:50 user nova-compute[103546]: DEBUG nova.objects.instance [None req-b377ead9-85dd-4a55-9553-00ba1cefca67 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Lazy-loading 'resources' on Instance uuid 66b98917-7551-47a5-94a1-79606cf1467d {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-b377ead9-85dd-4a55-9553-00ba1cefca67 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T03:57:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1218331939',display_name='tempest-TestShelveInstance-server-1218331939',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1218331939',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJefuleNA9cJ5haFDD+0Ot28lloio76de7VtRTQxzp9Sope/G7fhj4H3KkfSIX4gC5WiTW4ss845RgTAxK6IS7sfMf51A1/Fabu1CWHujElttuESJP/RjYphT+75MUNs3Q==',key_name='tempest-TestShelveInstance-1411640263',keypairs=<?>,launch_index=0,launched_at=2023-11-16T04:01:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='164c650c4ec44057973d5d1ab45b7440',ramdisk_id='',reservation_id='r-03lh0eut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2052053009',owner_user_name='tempest-TestShelveInstance-2052053009-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T04:01:11Z,user_data=None,user_id='7a83510fe87042529b22273d0b26a662',uuid=66b98917-7551-47a5-94a1-79606cf1467d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7df3a25d-d802-44f8-8a98-bb6be3453d3e", "address": "fa:16:3e:7c:b1:ba", "network": {"id": "f9df40e7-5801-4e0c-8b8b-6cdb4da22727", "bridge": "br-int", "label": "tempest-TestShelveInstance-1586968346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "164c650c4ec44057973d5d1ab45b7440", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7df3a25d-d8", "ovs_interfaceid": "7df3a25d-d802-44f8-8a98-bb6be3453d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-b377ead9-85dd-4a55-9553-00ba1cefca67 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Converting VIF {"id": "7df3a25d-d802-44f8-8a98-bb6be3453d3e", "address": "fa:16:3e:7c:b1:ba", "network": {"id": "f9df40e7-5801-4e0c-8b8b-6cdb4da22727", "bridge": "br-int", "label": "tempest-TestShelveInstance-1586968346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "164c650c4ec44057973d5d1ab45b7440", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7df3a25d-d8", "ovs_interfaceid": "7df3a25d-d802-44f8-8a98-bb6be3453d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-b377ead9-85dd-4a55-9553-00ba1cefca67 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:b1:ba,bridge_name='br-int',has_traffic_filtering=True,id=7df3a25d-d802-44f8-8a98-bb6be3453d3e,network=Network(f9df40e7-5801-4e0c-8b8b-6cdb4da22727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7df3a25d-d8') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG os_vif [None req-b377ead9-85dd-4a55-9553-00ba1cefca67 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:b1:ba,bridge_name='br-int',has_traffic_filtering=True,id=7df3a25d-d802-44f8-8a98-bb6be3453d3e,network=Network(f9df40e7-5801-4e0c-8b8b-6cdb4da22727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7df3a25d-d8') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7df3a25d-d8, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d1532499-a7ad-4dc7-b140-2e93e603d68e) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:50 user nova-compute[103546]: INFO os_vif [None req-b377ead9-85dd-4a55-9553-00ba1cefca67 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:b1:ba,bridge_name='br-int',has_traffic_filtering=True,id=7df3a25d-d802-44f8-8a98-bb6be3453d3e,network=Network(f9df40e7-5801-4e0c-8b8b-6cdb4da22727),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7df3a25d-d8')
Nov 16 04:02:50 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b377ead9-85dd-4a55-9553-00ba1cefca67 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b377ead9-85dd-4a55-9553-00ba1cefca67 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZQtTeObl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:02:50 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-b377ead9-85dd-4a55-9553-00ba1cefca67 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:02:50 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-b377ead9-85dd-4a55-9553-00ba1cefca67 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-b377ead9-85dd-4a55-9553-00ba1cefca67 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1f12ef-57c5-4b65-bffe-1122a5b766ed]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b377ead9-85dd-4a55-9553-00ba1cefca67 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 04:02:50 user nova-compute[103546]: No targets found.
Nov 16 04:02:50 user nova-compute[103546]: iSNS:
Nov 16 04:02:50 user nova-compute[103546]: No targets found.
Nov 16 04:02:50 user nova-compute[103546]: STATIC:
Nov 16 04:02:50 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4
Nov 16 04:02:50 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:02:50 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:02:50 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e
Nov 16 04:02:50 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:02:50 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:02:50 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af
Nov 16 04:02:50 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:02:50 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:02:50 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf
Nov 16 04:02:50 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:02:50 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:02:50 user nova-compute[103546]: FIRMWARE:
Nov 16 04:02:50 user nova-compute[103546]: No targets found.
Nov 16 04:02:50 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b377ead9-85dd-4a55-9553-00ba1cefca67 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 04:02:50 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 04:02:50 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b377ead9-85dd-4a55-9553-00ba1cefca67 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[1927fe77-10aa-4331-a610-ff9bd1a4b793]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c79e71-8b61-4804-9b60-40e216d4543a]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b377ead9-85dd-4a55-9553-00ba1cefca67 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:02:50 user nova-compute[103546]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af (non-flash)
Nov 16 04:02:50 user nova-compute[103546]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)
Nov 16 04:02:50 user nova-compute[103546]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:02:50 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b377ead9-85dd-4a55-9553-00ba1cefca67 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:02:50 user nova-compute[103546]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af (non-flash)
Nov 16 04:02:50 user nova-compute[103546]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)
Nov 16 04:02:50 user nova-compute[103546]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:02:50 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b377ead9-85dd-4a55-9553-00ba1cefca67 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60c416b7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af'): ({'sdd'}, set())}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-b377ead9-85dd-4a55-9553-00ba1cefca67 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Removing single pathed devices sdd {{(pid=103546) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47022fe-d536-4048-81ad-23b219a11911]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a178be5-45fc-4304-873f-597b81d275e0]: (4, ('ok\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-b377ead9-85dd-4a55-9553-00ba1cefca67 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Flushing IO for device /dev/sdd {{(pid=103546) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[1adadd4d-191e-42c6-8c70-53a313baa9ac]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-b377ead9-85dd-4a55-9553-00ba1cefca67 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=103546) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.058s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd62b0e-1f31-4640-b804-0c69d8b23a57]: (4, ('1', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-b377ead9-85dd-4a55-9553-00ba1cefca67 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-b377ead9-85dd-4a55-9553-00ba1cefca67 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] SCSI volumes sdd have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b377ead9-85dd-4a55-9553-00ba1cefca67 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af')] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6686a8d-88af-4fe2-9995-c652079cbe4d]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b377ead9-85dd-4a55-9553-00ba1cefca67 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af -p 172.16.0.220:3260 --logout {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a908d52f-edff-4e1f-b24f-42efddf9f321]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b377ead9-85dd-4a55-9553-00ba1cefca67 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af, portal: 172.16.0.220,3260]
Nov 16 04:02:50 user nova-compute[103546]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af, portal: 172.16.0.220,3260] successful.
Nov 16 04:02:50 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:02:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af -p 172.16.0.220:3260 --op delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:51 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3690ac19-2af3-4701-97ba-2243a390f2af -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:02:51 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[88347a5d-c2d8-4847-a9c0-227ab148cfa1]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:02:51 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b377ead9-85dd-4a55-9553-00ba1cefca67 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:02:51 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-b377ead9-85dd-4a55-9553-00ba1cefca67 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:02:51 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b377ead9-85dd-4a55-9553-00ba1cefca67 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] <== disconnect_volume: return (342ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:02:51 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b377ead9-85dd-4a55-9553-00ba1cefca67 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 04:02:51 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-b377ead9-85dd-4a55-9553-00ba1cefca67 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Deleting instance files /opt/stack/data/nova/instances/66b98917-7551-47a5-94a1-79606cf1467d_del
Nov 16 04:02:51 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-b377ead9-85dd-4a55-9553-00ba1cefca67 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Deletion of /opt/stack/data/nova/instances/66b98917-7551-47a5-94a1-79606cf1467d_del complete
Nov 16 04:02:51 user nova-compute[103546]: INFO nova.compute.manager [None req-b377ead9-85dd-4a55-9553-00ba1cefca67 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 16 04:02:51 user nova-compute[103546]: DEBUG oslo.service.loopingcall [None req-b377ead9-85dd-4a55-9553-00ba1cefca67 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=103546) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 04:02:51 user nova-compute[103546]: DEBUG nova.compute.manager [-] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Deallocating network for instance {{(pid=103546) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 04:02:51 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] deallocate_for_instance() {{(pid=103546) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 04:02:51 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:02:51 user nova-compute[103546]: INFO nova.compute.manager [-] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Took 0.71 seconds to deallocate network for instance.
Nov 16 04:02:51 user nova-compute[103546]: DEBUG nova.compute.manager [req-19a64d3c-df46-428b-8405-bdcb75f5a7fb req-fac261dd-15b7-4de9-93e6-a0efd6d6a9fa service nova] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Received event network-vif-deleted-7df3a25d-d802-44f8-8a98-bb6be3453d3e {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:02:51 user nova-compute[103546]: INFO nova.compute.manager [req-19a64d3c-df46-428b-8405-bdcb75f5a7fb req-fac261dd-15b7-4de9-93e6-a0efd6d6a9fa service nova] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Neutron deleted interface 7df3a25d-d802-44f8-8a98-bb6be3453d3e; detaching it from the instance and deleting it from the info cache
Nov 16 04:02:51 user nova-compute[103546]: DEBUG nova.network.neutron [req-19a64d3c-df46-428b-8405-bdcb75f5a7fb req-fac261dd-15b7-4de9-93e6-a0efd6d6a9fa service nova] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:02:51 user nova-compute[103546]: DEBUG nova.compute.manager [req-19a64d3c-df46-428b-8405-bdcb75f5a7fb req-fac261dd-15b7-4de9-93e6-a0efd6d6a9fa service nova] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Detach interface failed, port_id=7df3a25d-d802-44f8-8a98-bb6be3453d3e, reason: Instance 66b98917-7551-47a5-94a1-79606cf1467d could not be found. {{(pid=103546) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 04:02:51 user nova-compute[103546]: DEBUG nova.compute.manager [req-d77d4ade-62a8-4c0f-b539-c5563bf97203 req-236228bb-f9de-4d86-bed8-029c2efdf5c7 service nova] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Received event network-vif-unplugged-7df3a25d-d802-44f8-8a98-bb6be3453d3e {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:02:51 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d77d4ade-62a8-4c0f-b539-c5563bf97203 req-236228bb-f9de-4d86-bed8-029c2efdf5c7 service nova] Acquiring lock "66b98917-7551-47a5-94a1-79606cf1467d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:02:51 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d77d4ade-62a8-4c0f-b539-c5563bf97203 req-236228bb-f9de-4d86-bed8-029c2efdf5c7 service nova] Lock "66b98917-7551-47a5-94a1-79606cf1467d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:02:51 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d77d4ade-62a8-4c0f-b539-c5563bf97203 req-236228bb-f9de-4d86-bed8-029c2efdf5c7 service nova] Lock "66b98917-7551-47a5-94a1-79606cf1467d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:02:51 user nova-compute[103546]: DEBUG nova.compute.manager [req-d77d4ade-62a8-4c0f-b539-c5563bf97203 req-236228bb-f9de-4d86-bed8-029c2efdf5c7 service nova] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] No waiting events found dispatching network-vif-unplugged-7df3a25d-d802-44f8-8a98-bb6be3453d3e {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:02:51 user nova-compute[103546]: DEBUG nova.compute.manager [req-d77d4ade-62a8-4c0f-b539-c5563bf97203 req-236228bb-f9de-4d86-bed8-029c2efdf5c7 service nova] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Received event network-vif-unplugged-7df3a25d-d802-44f8-8a98-bb6be3453d3e for instance with task_state deleting. {{(pid=103546) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 04:02:51 user nova-compute[103546]: DEBUG nova.compute.manager [req-d77d4ade-62a8-4c0f-b539-c5563bf97203 req-236228bb-f9de-4d86-bed8-029c2efdf5c7 service nova] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Received event network-vif-plugged-7df3a25d-d802-44f8-8a98-bb6be3453d3e {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:02:51 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d77d4ade-62a8-4c0f-b539-c5563bf97203 req-236228bb-f9de-4d86-bed8-029c2efdf5c7 service nova] Acquiring lock "66b98917-7551-47a5-94a1-79606cf1467d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:02:51 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d77d4ade-62a8-4c0f-b539-c5563bf97203 req-236228bb-f9de-4d86-bed8-029c2efdf5c7 service nova] Lock "66b98917-7551-47a5-94a1-79606cf1467d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:02:51 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d77d4ade-62a8-4c0f-b539-c5563bf97203 req-236228bb-f9de-4d86-bed8-029c2efdf5c7 service nova] Lock "66b98917-7551-47a5-94a1-79606cf1467d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:02:51 user nova-compute[103546]: DEBUG nova.compute.manager [req-d77d4ade-62a8-4c0f-b539-c5563bf97203 req-236228bb-f9de-4d86-bed8-029c2efdf5c7 service nova] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] No waiting events found dispatching network-vif-plugged-7df3a25d-d802-44f8-8a98-bb6be3453d3e {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:02:51 user nova-compute[103546]: WARNING nova.compute.manager [req-d77d4ade-62a8-4c0f-b539-c5563bf97203 req-236228bb-f9de-4d86-bed8-029c2efdf5c7 service nova] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Received unexpected event network-vif-plugged-7df3a25d-d802-44f8-8a98-bb6be3453d3e for instance with vm_state active and task_state deleting.
Nov 16 04:02:52 user nova-compute[103546]: INFO nova.compute.manager [None req-b377ead9-85dd-4a55-9553-00ba1cefca67 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Took 0.77 seconds to detach 1 volumes for instance.
Nov 16 04:02:52 user nova-compute[103546]: DEBUG nova.compute.manager [None req-b377ead9-85dd-4a55-9553-00ba1cefca67 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] [instance: 66b98917-7551-47a5-94a1-79606cf1467d] Deleting volume: 3690ac19-2af3-4701-97ba-2243a390f2af {{(pid=103546) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 16 04:02:52 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b377ead9-85dd-4a55-9553-00ba1cefca67 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:02:52 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b377ead9-85dd-4a55-9553-00ba1cefca67 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:02:52 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-b377ead9-85dd-4a55-9553-00ba1cefca67 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:02:52 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-b377ead9-85dd-4a55-9553-00ba1cefca67 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:02:53 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b377ead9-85dd-4a55-9553-00ba1cefca67 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.343s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:02:53 user nova-compute[103546]: INFO nova.scheduler.client.report [None req-b377ead9-85dd-4a55-9553-00ba1cefca67 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Deleted allocations for instance 66b98917-7551-47a5-94a1-79606cf1467d
Nov 16 04:02:53 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b377ead9-85dd-4a55-9553-00ba1cefca67 tempest-TestShelveInstance-2052053009 tempest-TestShelveInstance-2052053009-project-member] Lock "66b98917-7551-47a5-94a1-79606cf1467d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.265s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:02:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:55 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:56 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquiring lock "9a421bf0-70b6-4a2c-85da-813707619b84" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:02:56 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "9a421bf0-70b6-4a2c-85da-813707619b84" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:02:56 user nova-compute[103546]: DEBUG nova.compute.manager [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Starting instance... {{(pid=103546) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 04:02:56 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:02:56 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:02:56 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=103546) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 04:02:56 user nova-compute[103546]: INFO nova.compute.claims [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Claim successful on node user
Nov 16 04:02:56 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:02:56 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:02:56 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.727s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:02:56 user nova-compute[103546]: DEBUG nova.compute.manager [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Start building networks asynchronously for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 04:02:56 user nova-compute[103546]: DEBUG nova.compute.manager [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Allocating IP information in the background. {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 04:02:56 user nova-compute[103546]: DEBUG nova.network.neutron [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] allocate_for_instance() {{(pid=103546) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 04:02:57 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 04:02:57 user nova-compute[103546]: DEBUG nova.compute.manager [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Start building block device mappings for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 04:02:57 user nova-compute[103546]: DEBUG nova.policy [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ab77040a7b9846d28dc08852d678d1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ce50192a9743b59a9430163dd6a51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103546) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 04:02:57 user nova-compute[103546]: INFO nova.virt.block_device [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Booting with volume 6dd96488-81c4-484b-ada5-812f7adb960e at /dev/vda
Nov 16 04:02:57 user nova-compute[103546]: DEBUG os_brick.utils [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:02:57 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:57 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:02:57 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b4cea8-66ea-40a7-958c-1fd07f91a980]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af5c39b14ece\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:02:57 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:57 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:02:57 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[85803f18-5f43-4a4c-82fe-d39f315ae208]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:02:57 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:57 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:02:57 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b72cda0-9f29-4bbe-8d38-68ee3a85fc25]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:02:57 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[70fd5a1b-5a5e-4fd6-bb70-f9c6f262bf8c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:02:57 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Running cmd (subprocess): nvme version {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:57 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] 'nvme version' failed. Not Retrying. {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 04:02:57 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] nvme not present on system {{(pid=103546) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 04:02:57 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:02:57 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 04:02:57 user nova-compute[103546]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 04:02:57 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[937183ee-ae72-4046-8c60-59a9673d7c3f]: (4, '') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:02:57 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=103546) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 04:02:57 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 04:02:57 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] LIGHTOS: no hostnqn found. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 04:02:57 user nova-compute[103546]: DEBUG os_brick.utils [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af5c39b14ece', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:02:57 user nova-compute[103546]: DEBUG nova.virt.block_device [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Updating existing volume attachment record: d1f83fbd-1676-48e5-a885-a14da06f49e1 {{(pid=103546) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 04:02:57 user nova-compute[103546]: DEBUG nova.network.neutron [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Successfully created port: dda2828f-7054-49e9-97d4-7279c0305ea7 {{(pid=103546) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 04:02:58 user nova-compute[103546]: DEBUG nova.network.neutron [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Successfully updated port: dda2828f-7054-49e9-97d4-7279c0305ea7 {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 04:02:58 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquiring lock "refresh_cache-9a421bf0-70b6-4a2c-85da-813707619b84" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:02:58 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquired lock "refresh_cache-9a421bf0-70b6-4a2c-85da-813707619b84" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:02:58 user nova-compute[103546]: DEBUG nova.network.neutron [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 04:02:58 user nova-compute[103546]: DEBUG nova.compute.manager [req-3e6724ad-eb8c-4d64-9609-0dfb9f72e113 req-94774836-ef02-495e-8189-c58f706c7aaf service nova] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Received event network-changed-dda2828f-7054-49e9-97d4-7279c0305ea7 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:02:58 user nova-compute[103546]: DEBUG nova.compute.manager [req-3e6724ad-eb8c-4d64-9609-0dfb9f72e113 req-94774836-ef02-495e-8189-c58f706c7aaf service nova] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Refreshing instance network info cache due to event network-changed-dda2828f-7054-49e9-97d4-7279c0305ea7. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 04:02:58 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3e6724ad-eb8c-4d64-9609-0dfb9f72e113 req-94774836-ef02-495e-8189-c58f706c7aaf service nova] Acquiring lock "refresh_cache-9a421bf0-70b6-4a2c-85da-813707619b84" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:02:58 user nova-compute[103546]: DEBUG nova.network.neutron [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 04:02:58 user nova-compute[103546]: DEBUG nova.network.neutron [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Updating instance_info_cache with network_info: [{"id": "dda2828f-7054-49e9-97d4-7279c0305ea7", "address": "fa:16:3e:17:bc:47", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda2828f-70", "ovs_interfaceid": "dda2828f-7054-49e9-97d4-7279c0305ea7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:02:58 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Releasing lock "refresh_cache-9a421bf0-70b6-4a2c-85da-813707619b84" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:02:58 user nova-compute[103546]: DEBUG nova.compute.manager [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Instance network_info: |[{"id": "dda2828f-7054-49e9-97d4-7279c0305ea7", "address": "fa:16:3e:17:bc:47", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda2828f-70", "ovs_interfaceid": "dda2828f-7054-49e9-97d4-7279c0305ea7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 04:02:58 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3e6724ad-eb8c-4d64-9609-0dfb9f72e113 req-94774836-ef02-495e-8189-c58f706c7aaf service nova] Acquired lock "refresh_cache-9a421bf0-70b6-4a2c-85da-813707619b84" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:02:58 user nova-compute[103546]: DEBUG nova.network.neutron [req-3e6724ad-eb8c-4d64-9609-0dfb9f72e113 req-94774836-ef02-495e-8189-c58f706c7aaf service nova] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Refreshing network info cache for port dda2828f-7054-49e9-97d4-7279c0305ea7 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 04:02:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:02:58 user nova-compute[103546]: DEBUG nova.network.neutron [req-3e6724ad-eb8c-4d64-9609-0dfb9f72e113 req-94774836-ef02-495e-8189-c58f706c7aaf service nova] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Updated VIF entry in instance network info cache for port dda2828f-7054-49e9-97d4-7279c0305ea7. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 04:02:58 user nova-compute[103546]: DEBUG nova.network.neutron [req-3e6724ad-eb8c-4d64-9609-0dfb9f72e113 req-94774836-ef02-495e-8189-c58f706c7aaf service nova] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Updating instance_info_cache with network_info: [{"id": "dda2828f-7054-49e9-97d4-7279c0305ea7", "address": "fa:16:3e:17:bc:47", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda2828f-70", "ovs_interfaceid": "dda2828f-7054-49e9-97d4-7279c0305ea7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:02:58 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3e6724ad-eb8c-4d64-9609-0dfb9f72e113 req-94774836-ef02-495e-8189-c58f706c7aaf service nova] Releasing lock "refresh_cache-9a421bf0-70b6-4a2c-85da-813707619b84" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:03:00 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG nova.compute.manager [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Start spawning the instance on the hypervisor. {{(pid=103546) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Creating instance directory {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 04:03:02 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Creating image(s)
Nov 16 04:03:02 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Did not create local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Ensure instance console log exists: /opt/stack/data/nova/instances/9a421bf0-70b6-4a2c-85da-813707619b84/console.log {{(pid=103546) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Start _get_guest_xml network_info=[{"id": "dda2828f-7054-49e9-97d4-7279c0305ea7", "address": "fa:16:3e:17:bc:47", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda2828f-70", "ovs_interfaceid": "dda2828f-7054-49e9-97d4-7279c0305ea7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QwVdAeaX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9a421bf0-70b6-4a2c-85da-813707619b84', 'attached_at': '', 'detached_at': '', 'volume_id': '6dd96488-81c4-484b-ada5-812f7adb960e', 'serial': '6dd96488-81c4-484b-ada5-812f7adb960e'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': 'd1f83fbd-1676-48e5-a885-a14da06f49e1', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 04:03:02 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:03:02 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:03:02 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QwVdAeaX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:03:02 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:03:02 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:03:02 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:03:02 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:03:02 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 04:03:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[0357170e-85c8-4603-9c20-770212366dbe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 04:03:02 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e -p 172.16.0.220:3260 --interface default --op new {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[66066775-aa0c-4473-9286-3cb1193f658b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e] added\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e] added
Nov 16 04:03:02 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[17781237-4b5b-4388-a423-18975b832c4f]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[86685227-ab2d-4e17-b7a2-cdbd3d688ca9]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QwVdAeaX {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QwVdAeaX" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a102e061-0812-445e-bf65-50818e9df9fc]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QwVdAeaX'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d51516-5cb0-43aa-87ac-898493b47e85]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec80c19-5eef-475e-ad1e-81b03a9ae2b4]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:03:02 user nova-compute[103546]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)
Nov 16 04:03:02 user nova-compute[103546]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:03:02 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:03:02 user nova-compute[103546]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)
Nov 16 04:03:02 user nova-compute[103546]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:03:02 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e -p 172.16.0.220:3260 --login {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a053f46b-e62d-48eb-9c6c-b63525db009b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e, portal: 172.16.0.220,3260]
Nov 16 04:03:02 user nova-compute[103546]: Login to [iface: default, target: iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e, portal: 172.16.0.220,3260] successful.
Nov 16 04:03:02 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1794f5f-8a81-4a4d-9fc7-62325126bd0a]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fbfb1c0-1a2d-4dc9-a90d-37e2e5e744bf]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:03:02 user nova-compute[103546]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)
Nov 16 04:03:02 user nova-compute[103546]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:03:02 user nova-compute[103546]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:03:02 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:03:02 user nova-compute[103546]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)
Nov 16 04:03:02 user nova-compute[103546]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:03:02 user nova-compute[103546]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:03:02 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a77e346-cac0-4dbb-8cc0-37b78f90216e]: (4, ('- - 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QwVdAeaX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG nova.objects.instance [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lazy-loading 'flavor' on Instance uuid b0a480de-e99b-4b54-bd81-36c216442137 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Acquiring lock "refresh_cache-b0a480de-e99b-4b54-bd81-36c216442137" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Acquired lock "refresh_cache-b0a480de-e99b-4b54-bd81-36c216442137" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG nova.network.neutron [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG nova.objects.instance [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lazy-loading 'info_cache' on Instance uuid b0a480de-e99b-4b54-bd81-36c216442137 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG nova.objects.base [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Object Instance<b0a480de-e99b-4b54-bd81-36c216442137> lazy-loaded attributes: flavor,info_cache {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG nova.network.neutron [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Updating instance_info_cache with network_info: [{"id": "804319c6-55cb-4f30-908c-71817934fb45", "address": "fa:16:3e:d5:4f:3e", "network": {"id": "23baa589-ae15-4a44-8991-d6fe8569dc8a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-464431710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f33e7eff7954fcc895f66982d7d45c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804319c6-55", "ovs_interfaceid": "804319c6-55cb-4f30-908c-71817934fb45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Releasing lock "refresh_cache-b0a480de-e99b-4b54-bd81-36c216442137" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:03:02 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Instance destroyed successfully.
Nov 16 04:03:02 user nova-compute[103546]: DEBUG nova.objects.instance [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lazy-loading 'resources' on Instance uuid b0a480de-e99b-4b54-bd81-36c216442137 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG nova.objects.base [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Object Instance<b0a480de-e99b-4b54-bd81-36c216442137> lazy-loaded attributes: flavor,info_cache,resources {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:59:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1194569156',display_name='tempest-AttachVolumeTestJSON-server-1194569156',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1194569156',id=33,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGulyvMv6DBB41Qe8XWF63e9B3iBHOwlSkAryW1iz72Aw6HfFs0cTFUdIe1uTx/ceIRIbAXp8f4Mb3WAscOyquzQNMRUlWLf10PNP0Nn0ZjiELMrAE3x8QFH1PXFWQSd/w==',key_name='tempest-keypair-309978137',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:59:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5f33e7eff7954fcc895f66982d7d45c8',ramdisk_id='',reservation_id='r-sa4b0m91',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1584447380',owner_user_name='tempest-AttachVolumeTestJSON-1584447380-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T04:01:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='005ffc068a19494bb5a436fc4a07aaa1',uuid=b0a480de-e99b-4b54-bd81-36c216442137,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "804319c6-55cb-4f30-908c-71817934fb45", "address": "fa:16:3e:d5:4f:3e", "network": {"id": "23baa589-ae15-4a44-8991-d6fe8569dc8a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-464431710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f33e7eff7954fcc895f66982d7d45c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804319c6-55", "ovs_interfaceid": "804319c6-55cb-4f30-908c-71817934fb45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Converting VIF {"id": "804319c6-55cb-4f30-908c-71817934fb45", "address": "fa:16:3e:d5:4f:3e", "network": {"id": "23baa589-ae15-4a44-8991-d6fe8569dc8a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-464431710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f33e7eff7954fcc895f66982d7d45c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804319c6-55", "ovs_interfaceid": "804319c6-55cb-4f30-908c-71817934fb45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:4f:3e,bridge_name='br-int',has_traffic_filtering=True,id=804319c6-55cb-4f30-908c-71817934fb45,network=Network(23baa589-ae15-4a44-8991-d6fe8569dc8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap804319c6-55') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG os_vif [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:4f:3e,bridge_name='br-int',has_traffic_filtering=True,id=804319c6-55cb-4f30-908c-71817934fb45,network=Network(23baa589-ae15-4a44-8991-d6fe8569dc8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap804319c6-55') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:02 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap804319c6-55, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f67fb2ff-e871-42ab-aae0-eaffb2cec538) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:03 user nova-compute[103546]: INFO os_vif [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:4f:3e,bridge_name='br-int',has_traffic_filtering=True,id=804319c6-55cb-4f30-908c-71817934fb45,network=Network(23baa589-ae15-4a44-8991-d6fe8569dc8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap804319c6-55')
Nov 16 04:03:03 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AprzmwSJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:03:03 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:03:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23836303834323539', 'path': '/dev/sdc'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836303834323539', 'path': '/dev/sdc'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.430s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[0277ec36-cd8e-4557-a336-d65d223503d2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 04:03:03 user nova-compute[103546]: No targets found.
Nov 16 04:03:03 user nova-compute[103546]: iSNS:
Nov 16 04:03:03 user nova-compute[103546]: No targets found.
Nov 16 04:03:03 user nova-compute[103546]: STATIC:
Nov 16 04:03:03 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e
Nov 16 04:03:03 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:03:03 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:03:03 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4
Nov 16 04:03:03 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:03:03 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:03:03 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e
Nov 16 04:03:03 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:03:03 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:03:03 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf
Nov 16 04:03:03 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:03:03 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:03:03 user nova-compute[103546]: FIRMWARE:
Nov 16 04:03:03 user nova-compute[103546]: No targets found.
Nov 16 04:03:03 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 04:03:03 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 04:03:03 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:02:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2010514899',display_name='tempest-TestVolumeBootPattern-server-2010514899',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2010514899',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAUuzWuYKsux0jTpLPt6gxhC1FaUy3kEUyYKr8BxuO29MPaSGm/xG+Qeyua0CAfOtv/fD3rdnfc1wGAbEANqJwnqI370L1woOSlI3nH8Q8Ypdr+d2TMfVLtiA9YGdx0zEg==',key_name='tempest-TestVolumeBootPattern-1153098015',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40ce50192a9743b59a9430163dd6a51c',ramdisk_id='',reservation_id='r-0x808ey7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1283031547',owner_user_name='tempest-TestVolumeBootPattern-1283031547-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T04:02:57Z,user_data=None,user_id='ab77040a7b9846d28dc08852d678d1ed',uuid=9a421bf0-70b6-4a2c-85da-813707619b84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dda2828f-7054-49e9-97d4-7279c0305ea7", "address": "fa:16:3e:17:bc:47", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda2828f-70", "ovs_interfaceid": "dda2828f-7054-49e9-97d4-7279c0305ea7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Converting VIF {"id": "dda2828f-7054-49e9-97d4-7279c0305ea7", "address": "fa:16:3e:17:bc:47", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda2828f-70", "ovs_interfaceid": "dda2828f-7054-49e9-97d4-7279c0305ea7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:bc:47,bridge_name='br-int',has_traffic_filtering=True,id=dda2828f-7054-49e9-97d4-7279c0305ea7,network=Network(a13f532d-a30d-4c06-83fe-760bcffae183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdda2828f-70') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG nova.objects.instance [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lazy-loading 'pci_devices' on Instance uuid 9a421bf0-70b6-4a2c-85da-813707619b84 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] End _get_guest_xml xml=<domain type="kvm">
Nov 16 04:03:03 user nova-compute[103546]:   <uuid>9a421bf0-70b6-4a2c-85da-813707619b84</uuid>
Nov 16 04:03:03 user nova-compute[103546]:   <name>instance-00000027</name>
Nov 16 04:03:03 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 04:03:03 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 04:03:03 user nova-compute[103546]:   <metadata>
Nov 16 04:03:03 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 04:03:03 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 04:03:03 user nova-compute[103546]:       <nova:name>tempest-TestVolumeBootPattern-server-2010514899</nova:name>
Nov 16 04:03:03 user nova-compute[103546]:       <nova:creationTime>2023-11-16 04:03:02</nova:creationTime>
Nov 16 04:03:03 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 04:03:03 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 04:03:03 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 04:03:03 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 04:03:03 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 04:03:03 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 04:03:03 user nova-compute[103546]:       </nova:flavor>
Nov 16 04:03:03 user nova-compute[103546]:       <nova:owner>
Nov 16 04:03:03 user nova-compute[103546]:         <nova:user uuid="ab77040a7b9846d28dc08852d678d1ed">tempest-TestVolumeBootPattern-1283031547-project-member</nova:user>
Nov 16 04:03:03 user nova-compute[103546]:         <nova:project uuid="40ce50192a9743b59a9430163dd6a51c">tempest-TestVolumeBootPattern-1283031547</nova:project>
Nov 16 04:03:03 user nova-compute[103546]:       </nova:owner>
Nov 16 04:03:03 user nova-compute[103546]:       <nova:ports>
Nov 16 04:03:03 user nova-compute[103546]:         <nova:port uuid="dda2828f-7054-49e9-97d4-7279c0305ea7">
Nov 16 04:03:03 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 16 04:03:03 user nova-compute[103546]:         </nova:port>
Nov 16 04:03:03 user nova-compute[103546]:       </nova:ports>
Nov 16 04:03:03 user nova-compute[103546]:     </nova:instance>
Nov 16 04:03:03 user nova-compute[103546]:   </metadata>
Nov 16 04:03:03 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 04:03:03 user nova-compute[103546]:     <system>
Nov 16 04:03:03 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 04:03:03 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 04:03:03 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 04:03:03 user nova-compute[103546]:       <entry name="serial">9a421bf0-70b6-4a2c-85da-813707619b84</entry>
Nov 16 04:03:03 user nova-compute[103546]:       <entry name="uuid">9a421bf0-70b6-4a2c-85da-813707619b84</entry>
Nov 16 04:03:03 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 04:03:03 user nova-compute[103546]:     </system>
Nov 16 04:03:03 user nova-compute[103546]:   </sysinfo>
Nov 16 04:03:03 user nova-compute[103546]:   <os>
Nov 16 04:03:03 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 04:03:03 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 04:03:03 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 04:03:03 user nova-compute[103546]:   </os>
Nov 16 04:03:03 user nova-compute[103546]:   <features>
Nov 16 04:03:03 user nova-compute[103546]:     <acpi/>
Nov 16 04:03:03 user nova-compute[103546]:     <apic/>
Nov 16 04:03:03 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 04:03:03 user nova-compute[103546]:   </features>
Nov 16 04:03:03 user nova-compute[103546]:   <clock offset="utc">
Nov 16 04:03:03 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 04:03:03 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 04:03:03 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 04:03:03 user nova-compute[103546]:   </clock>
Nov 16 04:03:03 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 04:03:03 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 04:03:03 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 04:03:03 user nova-compute[103546]:   </cpu>
Nov 16 04:03:03 user nova-compute[103546]:   <devices>
Nov 16 04:03:03 user nova-compute[103546]:     <disk type="block" device="disk">
Nov 16 04:03:03 user nova-compute[103546]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:03:03 user nova-compute[103546]:       <source dev="/dev/sdc"/>
Nov 16 04:03:03 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 04:03:03 user nova-compute[103546]:       <serial>6dd96488-81c4-484b-ada5-812f7adb960e</serial>
Nov 16 04:03:03 user nova-compute[103546]:     </disk>
Nov 16 04:03:03 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 04:03:03 user nova-compute[103546]:       <mac address="fa:16:3e:17:bc:47"/>
Nov 16 04:03:03 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 04:03:03 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 04:03:03 user nova-compute[103546]:       <target dev="tapdda2828f-70"/>
Nov 16 04:03:03 user nova-compute[103546]:     </interface>
Nov 16 04:03:03 user nova-compute[103546]:     <serial type="pty">
Nov 16 04:03:03 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/9a421bf0-70b6-4a2c-85da-813707619b84/console.log" append="off"/>
Nov 16 04:03:03 user nova-compute[103546]:     </serial>
Nov 16 04:03:03 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 04:03:03 user nova-compute[103546]:     <video>
Nov 16 04:03:03 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 04:03:03 user nova-compute[103546]:     </video>
Nov 16 04:03:03 user nova-compute[103546]:     <rng model="virtio">
Nov 16 04:03:03 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 04:03:03 user nova-compute[103546]:     </rng>
Nov 16 04:03:03 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 04:03:03 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 04:03:03 user nova-compute[103546]:       <stats period="10"/>
Nov 16 04:03:03 user nova-compute[103546]:     </memballoon>
Nov 16 04:03:03 user nova-compute[103546]:   </devices>
Nov 16 04:03:03 user nova-compute[103546]: </domain>
Nov 16 04:03:03 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:02:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2010514899',display_name='tempest-TestVolumeBootPattern-server-2010514899',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2010514899',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAUuzWuYKsux0jTpLPt6gxhC1FaUy3kEUyYKr8BxuO29MPaSGm/xG+Qeyua0CAfOtv/fD3rdnfc1wGAbEANqJwnqI370L1woOSlI3nH8Q8Ypdr+d2TMfVLtiA9YGdx0zEg==',key_name='tempest-TestVolumeBootPattern-1153098015',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40ce50192a9743b59a9430163dd6a51c',ramdisk_id='',reservation_id='r-0x808ey7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1283031547',owner_user_name='tempest-TestVolumeBootPattern-1283031547-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T04:02:57Z,user_data=None,user_id='ab77040a7b9846d28dc08852d678d1ed',uuid=9a421bf0-70b6-4a2c-85da-813707619b84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dda2828f-7054-49e9-97d4-7279c0305ea7", "address": "fa:16:3e:17:bc:47", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda2828f-70", "ovs_interfaceid": "dda2828f-7054-49e9-97d4-7279c0305ea7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Converting VIF {"id": "dda2828f-7054-49e9-97d4-7279c0305ea7", "address": "fa:16:3e:17:bc:47", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda2828f-70", "ovs_interfaceid": "dda2828f-7054-49e9-97d4-7279c0305ea7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:bc:47,bridge_name='br-int',has_traffic_filtering=True,id=dda2828f-7054-49e9-97d4-7279c0305ea7,network=Network(a13f532d-a30d-4c06-83fe-760bcffae183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdda2828f-70') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG os_vif [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:bc:47,bridge_name='br-int',has_traffic_filtering=True,id=dda2828f-7054-49e9-97d4-7279c0305ea7,network=Network(a13f532d-a30d-4c06-83fe-760bcffae183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdda2828f-70') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dbcf21eb-d49f-577c-ac75-2c133d0a2db2', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[8889ba29-0693-45bf-b901-bd58ddec80ee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdda2828f-70, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdda2828f-70, col_values=(('qos', UUID('7c676dbb-02bc-4bb9-8c33-2acdcad3cf12')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdda2828f-70, col_values=(('external_ids', {'iface-id': 'dda2828f-7054-49e9-97d4-7279c0305ea7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:bc:47', 'vm-uuid': '9a421bf0-70b6-4a2c-85da-813707619b84'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:03 user nova-compute[103546]: INFO os_vif [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:bc:47,bridge_name='br-int',has_traffic_filtering=True,id=dda2828f-7054-49e9-97d4-7279c0305ea7,network=Network(a13f532d-a30d-4c06-83fe-760bcffae183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdda2828f-70')
Nov 16 04:03:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d35a40-4701-45a6-bd2f-0f90be0cf95f]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:03:03 user nova-compute[103546]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)
Nov 16 04:03:03 user nova-compute[103546]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:03:03 user nova-compute[103546]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:03:03 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:03:03 user nova-compute[103546]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)
Nov 16 04:03:03 user nova-compute[103546]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:03:03 user nova-compute[103546]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:03:03 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60ac303b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e'): ({'sde'}, set())}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Removing single pathed devices sde {{(pid=103546) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3659bcb-27d4-4a0f-870b-1ae4bb051299]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] No VIF found with MAC fa:16:3e:17:bc:47, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65df119-9e40-4301-ad28-b8e92d95c641]: (4, ('ok\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Flushing IO for device /dev/sde {{(pid=103546) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[7895b5d8-44c9-44c2-b9fa-25cd9a279d92]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=103546) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[777fd458-2451-43d0-81c1-73bd550a1295]: (4, ('1', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] SCSI volumes sde have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e')] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[410913fd-1e3e-4e04-b748-dc13ea417bd5]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e -p 172.16.0.220:3260 --logout {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8c84c5-1263-47f2-9dad-e37bd7db643c]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e, portal: 172.16.0.220,3260]
Nov 16 04:03:03 user nova-compute[103546]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e, portal: 172.16.0.220,3260] successful.
Nov 16 04:03:03 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e -p 172.16.0.220:3260 --op delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20c5d44-7c0b-4060-9332-63292cb06eae]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] <== disconnect_volume: return (745ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Start _get_guest_xml network_info=[{"id": "804319c6-55cb-4f30-908c-71817934fb45", "address": "fa:16:3e:d5:4f:3e", "network": {"id": "23baa589-ae15-4a44-8991-d6fe8569dc8a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-464431710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f33e7eff7954fcc895f66982d7d45c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804319c6-55", "ovs_interfaceid": "804319c6-55cb-4f30-908c-71817934fb45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '5c6f539a-01e5-4478-bf8f-a14310b5d7dd'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AprzmwSJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'b0a480de-e99b-4b54-bd81-36c216442137', 'attached_at': '', 'detached_at': '', 'volume_id': 'cea53f8b-4d4d-4d25-99c7-1da6a373891e', 'serial': 'cea53f8b-4d4d-4d25-99c7-1da6a373891e'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'attachment_id': 'd1cd2d0b-722b-4a4c-87d4-5c4594d241f5', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG nova.objects.instance [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lazy-loading 'numa_topology' on Instance uuid b0a480de-e99b-4b54-bd81-36c216442137 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG nova.objects.base [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Object Instance<b0a480de-e99b-4b54-bd81-36c216442137> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 04:03:03 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:03:03 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:03:03 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG nova.objects.instance [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lazy-loading 'vcpu_model' on Instance uuid b0a480de-e99b-4b54-bd81-36c216442137 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG nova.objects.base [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Object Instance<b0a480de-e99b-4b54-bd81-36c216442137> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AprzmwSJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:03:03 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:03:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:03:03 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:03:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:03:03 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 04:03:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[43bd406c-a187-415f-8cc9-2a39b26fc67c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 04:03:03 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e -p 172.16.0.220:3260 --interface default --op new {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d760a31-409f-43a7-88bf-fdc7a86c8210]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e] added\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e] added
Nov 16 04:03:03 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf652735-e90b-487a-a2fe-17bbc7de27bf]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[34dd9d59-87c3-4e96-9d92-bcf9b1a46c36]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AprzmwSJ {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AprzmwSJ" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[694d2d74-38c3-4431-97e4-90b37f9affbe]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AprzmwSJ'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f838d0-cc34-4232-bf40-e4e956e28608]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[238ea51c-51c0-41de-970f-2d41b62860d2]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:03:03 user nova-compute[103546]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:03:03 user nova-compute[103546]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:03:03 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:03:03 user nova-compute[103546]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:03:03 user nova-compute[103546]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:03:03 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:03:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e -p 172.16.0.220:3260 --login {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:04 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcfd0b72-765f-4728-ae89-fae7a492c7d2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:03:04 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e, portal: 172.16.0.220,3260]
Nov 16 04:03:04 user nova-compute[103546]: Login to [iface: default, target: iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e, portal: 172.16.0.220,3260] successful.
Nov 16 04:03:04 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:03:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:04 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e5e4cb-e508-4dbf-94cf-0ac9eb7e7e69]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:03:04 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:03:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:04 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6472a41-fbed-4a34-9cb7-8ae5897fc2ba]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:03:04 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:03:04 user nova-compute[103546]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:03:04 user nova-compute[103546]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:03:04 user nova-compute[103546]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)
Nov 16 04:03:04 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:03:04 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:03:04 user nova-compute[103546]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:03:04 user nova-compute[103546]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:03:04 user nova-compute[103546]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)
Nov 16 04:03:04 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:03:04 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:03:04 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 04:03:04 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] HCTL ('35', '-', '-', 0) found on session 43 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 04:03:04 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 04:03:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:04 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[90865b3e-5a5c-4863-8674-6d1c2acaa7b6]: (4, ('- - 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:03:04 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: None {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 04:03:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:04 user nova-compute[103546]: DEBUG nova.compute.manager [req-790953af-9c5e-44da-af5f-f11e73f8f29d req-c5094a12-3cf7-41bf-9b0d-d337cdd36b30 service nova] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Received event network-vif-plugged-dda2828f-7054-49e9-97d4-7279c0305ea7 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:03:04 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-790953af-9c5e-44da-af5f-f11e73f8f29d req-c5094a12-3cf7-41bf-9b0d-d337cdd36b30 service nova] Acquiring lock "9a421bf0-70b6-4a2c-85da-813707619b84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:03:04 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-790953af-9c5e-44da-af5f-f11e73f8f29d req-c5094a12-3cf7-41bf-9b0d-d337cdd36b30 service nova] Lock "9a421bf0-70b6-4a2c-85da-813707619b84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:03:04 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-790953af-9c5e-44da-af5f-f11e73f8f29d req-c5094a12-3cf7-41bf-9b0d-d337cdd36b30 service nova] Lock "9a421bf0-70b6-4a2c-85da-813707619b84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:03:04 user nova-compute[103546]: DEBUG nova.compute.manager [req-790953af-9c5e-44da-af5f-f11e73f8f29d req-c5094a12-3cf7-41bf-9b0d-d337cdd36b30 service nova] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] No waiting events found dispatching network-vif-plugged-dda2828f-7054-49e9-97d4-7279c0305ea7 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:03:04 user nova-compute[103546]: WARNING nova.compute.manager [req-790953af-9c5e-44da-af5f-f11e73f8f29d req-c5094a12-3cf7-41bf-9b0d-d337cdd36b30 service nova] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Received unexpected event network-vif-plugged-dda2828f-7054-49e9-97d4-7279c0305ea7 for instance with vm_state building and task_state spawning.
Nov 16 04:03:05 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 04:03:05 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AprzmwSJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 04:03:05 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:03:05 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '26662333337323561', 'path': '/dev/sdd'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:03:05 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662333337323561', 'path': '/dev/sdd'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 04:03:05 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:59:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1194569156',display_name='tempest-AttachVolumeTestJSON-server-1194569156',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1194569156',id=33,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGulyvMv6DBB41Qe8XWF63e9B3iBHOwlSkAryW1iz72Aw6HfFs0cTFUdIe1uTx/ceIRIbAXp8f4Mb3WAscOyquzQNMRUlWLf10PNP0Nn0ZjiELMrAE3x8QFH1PXFWQSd/w==',key_name='tempest-keypair-309978137',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:59:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5f33e7eff7954fcc895f66982d7d45c8',ramdisk_id='',reservation_id='r-sa4b0m91',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1584447380',owner_user_name='tempest-AttachVolumeTestJSON-1584447380-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T04:01:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='005ffc068a19494bb5a436fc4a07aaa1',uuid=b0a480de-e99b-4b54-bd81-36c216442137,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "804319c6-55cb-4f30-908c-71817934fb45", "address": "fa:16:3e:d5:4f:3e", "network": {"id": "23baa589-ae15-4a44-8991-d6fe8569dc8a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-464431710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f33e7eff7954fcc895f66982d7d45c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804319c6-55", "ovs_interfaceid": "804319c6-55cb-4f30-908c-71817934fb45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 04:03:05 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Converting VIF {"id": "804319c6-55cb-4f30-908c-71817934fb45", "address": "fa:16:3e:d5:4f:3e", "network": {"id": "23baa589-ae15-4a44-8991-d6fe8569dc8a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-464431710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f33e7eff7954fcc895f66982d7d45c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804319c6-55", "ovs_interfaceid": "804319c6-55cb-4f30-908c-71817934fb45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:03:05 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:4f:3e,bridge_name='br-int',has_traffic_filtering=True,id=804319c6-55cb-4f30-908c-71817934fb45,network=Network(23baa589-ae15-4a44-8991-d6fe8569dc8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap804319c6-55') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:03:05 user nova-compute[103546]: DEBUG nova.objects.instance [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lazy-loading 'pci_devices' on Instance uuid b0a480de-e99b-4b54-bd81-36c216442137 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:03:05 user nova-compute[103546]: DEBUG nova.objects.base [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Object Instance<b0a480de-e99b-4b54-bd81-36c216442137> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 04:03:05 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] End _get_guest_xml xml=<domain type="kvm">
Nov 16 04:03:05 user nova-compute[103546]:   <uuid>b0a480de-e99b-4b54-bd81-36c216442137</uuid>
Nov 16 04:03:05 user nova-compute[103546]:   <name>instance-00000021</name>
Nov 16 04:03:05 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 04:03:05 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 04:03:05 user nova-compute[103546]:   <metadata>
Nov 16 04:03:05 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 04:03:05 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 04:03:05 user nova-compute[103546]:       <nova:name>tempest-AttachVolumeTestJSON-server-1194569156</nova:name>
Nov 16 04:03:05 user nova-compute[103546]:       <nova:creationTime>2023-11-16 04:03:03</nova:creationTime>
Nov 16 04:03:05 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 04:03:05 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 04:03:05 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 04:03:05 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 04:03:05 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 04:03:05 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 04:03:05 user nova-compute[103546]:       </nova:flavor>
Nov 16 04:03:05 user nova-compute[103546]:       <nova:owner>
Nov 16 04:03:05 user nova-compute[103546]:         <nova:user uuid="005ffc068a19494bb5a436fc4a07aaa1">tempest-AttachVolumeTestJSON-1584447380-project-member</nova:user>
Nov 16 04:03:05 user nova-compute[103546]:         <nova:project uuid="5f33e7eff7954fcc895f66982d7d45c8">tempest-AttachVolumeTestJSON-1584447380</nova:project>
Nov 16 04:03:05 user nova-compute[103546]:       </nova:owner>
Nov 16 04:03:05 user nova-compute[103546]:       <nova:root type="image" uuid="5c6f539a-01e5-4478-bf8f-a14310b5d7dd"/>
Nov 16 04:03:05 user nova-compute[103546]:       <nova:ports>
Nov 16 04:03:05 user nova-compute[103546]:         <nova:port uuid="804319c6-55cb-4f30-908c-71817934fb45">
Nov 16 04:03:05 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 16 04:03:05 user nova-compute[103546]:         </nova:port>
Nov 16 04:03:05 user nova-compute[103546]:       </nova:ports>
Nov 16 04:03:05 user nova-compute[103546]:     </nova:instance>
Nov 16 04:03:05 user nova-compute[103546]:   </metadata>
Nov 16 04:03:05 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 04:03:05 user nova-compute[103546]:     <system>
Nov 16 04:03:05 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 04:03:05 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 04:03:05 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 04:03:05 user nova-compute[103546]:       <entry name="serial">b0a480de-e99b-4b54-bd81-36c216442137</entry>
Nov 16 04:03:05 user nova-compute[103546]:       <entry name="uuid">b0a480de-e99b-4b54-bd81-36c216442137</entry>
Nov 16 04:03:05 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 04:03:05 user nova-compute[103546]:     </system>
Nov 16 04:03:05 user nova-compute[103546]:   </sysinfo>
Nov 16 04:03:05 user nova-compute[103546]:   <os>
Nov 16 04:03:05 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 04:03:05 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 04:03:05 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 04:03:05 user nova-compute[103546]:   </os>
Nov 16 04:03:05 user nova-compute[103546]:   <features>
Nov 16 04:03:05 user nova-compute[103546]:     <acpi/>
Nov 16 04:03:05 user nova-compute[103546]:     <apic/>
Nov 16 04:03:05 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 04:03:05 user nova-compute[103546]:   </features>
Nov 16 04:03:05 user nova-compute[103546]:   <clock offset="utc">
Nov 16 04:03:05 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 04:03:05 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 04:03:05 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 04:03:05 user nova-compute[103546]:   </clock>
Nov 16 04:03:05 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 04:03:05 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 04:03:05 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 04:03:05 user nova-compute[103546]:   </cpu>
Nov 16 04:03:05 user nova-compute[103546]:   <devices>
Nov 16 04:03:05 user nova-compute[103546]:     <disk type="file" device="disk">
Nov 16 04:03:05 user nova-compute[103546]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 04:03:05 user nova-compute[103546]:       <source file="/opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk"/>
Nov 16 04:03:05 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 04:03:05 user nova-compute[103546]:     </disk>
Nov 16 04:03:05 user nova-compute[103546]:     <disk type="block" device="disk">
Nov 16 04:03:05 user nova-compute[103546]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:03:05 user nova-compute[103546]:       <source dev="/dev/sdd"/>
Nov 16 04:03:05 user nova-compute[103546]:       <target dev="vdb" bus="virtio"/>
Nov 16 04:03:05 user nova-compute[103546]:       <serial>cea53f8b-4d4d-4d25-99c7-1da6a373891e</serial>
Nov 16 04:03:05 user nova-compute[103546]:     </disk>
Nov 16 04:03:05 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 04:03:05 user nova-compute[103546]:       <mac address="fa:16:3e:d5:4f:3e"/>
Nov 16 04:03:05 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 04:03:05 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 04:03:05 user nova-compute[103546]:       <target dev="tap804319c6-55"/>
Nov 16 04:03:05 user nova-compute[103546]:     </interface>
Nov 16 04:03:05 user nova-compute[103546]:     <serial type="pty">
Nov 16 04:03:05 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/console.log" append="off"/>
Nov 16 04:03:05 user nova-compute[103546]:     </serial>
Nov 16 04:03:05 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 04:03:05 user nova-compute[103546]:     <video>
Nov 16 04:03:05 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 04:03:05 user nova-compute[103546]:     </video>
Nov 16 04:03:05 user nova-compute[103546]:     <rng model="virtio">
Nov 16 04:03:05 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 04:03:05 user nova-compute[103546]:     </rng>
Nov 16 04:03:05 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 04:03:05 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 04:03:05 user nova-compute[103546]:       <stats period="10"/>
Nov 16 04:03:05 user nova-compute[103546]:     </memballoon>
Nov 16 04:03:05 user nova-compute[103546]:   </devices>
Nov 16 04:03:05 user nova-compute[103546]: </domain>
Nov 16 04:03:05 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 04:03:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:05 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:05 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 04:03:05 user nova-compute[103546]: DEBUG nova.objects.instance [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lazy-loading 'trusted_certs' on Instance uuid b0a480de-e99b-4b54-bd81-36c216442137 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:03:05 user nova-compute[103546]: DEBUG nova.objects.base [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Object Instance<b0a480de-e99b-4b54-bd81-36c216442137> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 04:03:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.181s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:05 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk. size=1073741824 {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 04:03:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:05 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Cannot resize image /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk to a smaller size. {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 04:03:05 user nova-compute[103546]: DEBUG nova.objects.instance [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lazy-loading 'migration_context' on Instance uuid b0a480de-e99b-4b54-bd81-36c216442137 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:03:05 user nova-compute[103546]: DEBUG nova.objects.base [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Object Instance<b0a480de-e99b-4b54-bd81-36c216442137> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 04:03:05 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:59:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1194569156',display_name='tempest-AttachVolumeTestJSON-server-1194569156',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1194569156',id=33,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGulyvMv6DBB41Qe8XWF63e9B3iBHOwlSkAryW1iz72Aw6HfFs0cTFUdIe1uTx/ceIRIbAXp8f4Mb3WAscOyquzQNMRUlWLf10PNP0Nn0ZjiELMrAE3x8QFH1PXFWQSd/w==',key_name='tempest-keypair-309978137',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:59:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='5f33e7eff7954fcc895f66982d7d45c8',ramdisk_id='',reservation_id='r-sa4b0m91',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1584447380',owner_user_name='tempest-AttachVolumeTestJSON-1584447380-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T04:01:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='005ffc068a19494bb5a436fc4a07aaa1',uuid=b0a480de-e99b-4b54-bd81-36c216442137,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "804319c6-55cb-4f30-908c-71817934fb45", "address": "fa:16:3e:d5:4f:3e", "network": {"id": "23baa589-ae15-4a44-8991-d6fe8569dc8a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-464431710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f33e7eff7954fcc895f66982d7d45c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804319c6-55", "ovs_interfaceid": "804319c6-55cb-4f30-908c-71817934fb45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 04:03:05 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Converting VIF {"id": "804319c6-55cb-4f30-908c-71817934fb45", "address": "fa:16:3e:d5:4f:3e", "network": {"id": "23baa589-ae15-4a44-8991-d6fe8569dc8a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-464431710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f33e7eff7954fcc895f66982d7d45c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804319c6-55", "ovs_interfaceid": "804319c6-55cb-4f30-908c-71817934fb45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:03:05 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:4f:3e,bridge_name='br-int',has_traffic_filtering=True,id=804319c6-55cb-4f30-908c-71817934fb45,network=Network(23baa589-ae15-4a44-8991-d6fe8569dc8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap804319c6-55') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:03:05 user nova-compute[103546]: DEBUG os_vif [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:4f:3e,bridge_name='br-int',has_traffic_filtering=True,id=804319c6-55cb-4f30-908c-71817934fb45,network=Network(23baa589-ae15-4a44-8991-d6fe8569dc8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap804319c6-55') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 04:03:05 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:05 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:03:05 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 04:03:05 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:05 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '48de04b5-06ba-556b-8a0c-fe984b5b9f91', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:03:05 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:05 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:05 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:05 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap804319c6-55, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:03:05 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap804319c6-55, col_values=(('qos', UUID('369be0e6-570b-4aa4-ae4b-a1532c7826ba')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:03:05 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap804319c6-55, col_values=(('external_ids', {'iface-id': '804319c6-55cb-4f30-908c-71817934fb45', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:4f:3e', 'vm-uuid': 'b0a480de-e99b-4b54-bd81-36c216442137'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:03:05 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:05 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:03:05 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:05 user nova-compute[103546]: INFO os_vif [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:4f:3e,bridge_name='br-int',has_traffic_filtering=True,id=804319c6-55cb-4f30-908c-71817934fb45,network=Network(23baa589-ae15-4a44-8991-d6fe8569dc8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap804319c6-55')
Nov 16 04:03:06 user nova-compute[103546]: DEBUG nova.compute.manager [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 04:03:06 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Guest created on hypervisor {{(pid=103546) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 04:03:06 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Instance spawned successfully.
Nov 16 04:03:06 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 04:03:06 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Found default for hw_cdrom_bus of ide {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:03:06 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Found default for hw_disk_bus of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:03:06 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Found default for hw_input_bus of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:03:06 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Found default for hw_pointer_model of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:03:06 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Found default for hw_video_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:03:06 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Found default for hw_vif_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:03:06 user nova-compute[103546]: DEBUG nova.compute.manager [req-360c79a5-1ff3-41b4-99f0-a0a800856bee req-18d6d84f-1eee-40f4-b71a-d1a65057fed3 service nova] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Received event network-vif-plugged-dda2828f-7054-49e9-97d4-7279c0305ea7 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:03:06 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-360c79a5-1ff3-41b4-99f0-a0a800856bee req-18d6d84f-1eee-40f4-b71a-d1a65057fed3 service nova] Acquiring lock "9a421bf0-70b6-4a2c-85da-813707619b84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:03:06 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-360c79a5-1ff3-41b4-99f0-a0a800856bee req-18d6d84f-1eee-40f4-b71a-d1a65057fed3 service nova] Lock "9a421bf0-70b6-4a2c-85da-813707619b84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:03:06 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-360c79a5-1ff3-41b4-99f0-a0a800856bee req-18d6d84f-1eee-40f4-b71a-d1a65057fed3 service nova] Lock "9a421bf0-70b6-4a2c-85da-813707619b84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:03:06 user nova-compute[103546]: DEBUG nova.compute.manager [req-360c79a5-1ff3-41b4-99f0-a0a800856bee req-18d6d84f-1eee-40f4-b71a-d1a65057fed3 service nova] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] No waiting events found dispatching network-vif-plugged-dda2828f-7054-49e9-97d4-7279c0305ea7 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:03:06 user nova-compute[103546]: WARNING nova.compute.manager [req-360c79a5-1ff3-41b4-99f0-a0a800856bee req-18d6d84f-1eee-40f4-b71a-d1a65057fed3 service nova] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Received unexpected event network-vif-plugged-dda2828f-7054-49e9-97d4-7279c0305ea7 for instance with vm_state building and task_state spawning.
Nov 16 04:03:06 user nova-compute[103546]: INFO nova.compute.manager [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Took 4.90 seconds to spawn the instance on the hypervisor.
Nov 16 04:03:06 user nova-compute[103546]: DEBUG nova.compute.manager [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 04:03:07 user nova-compute[103546]: INFO nova.compute.manager [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Took 10.90 seconds to build instance.
Nov 16 04:03:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-9d172ed1-6636-4457-a4fb-2ad30164875a tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "9a421bf0-70b6-4a2c-85da-813707619b84" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.998s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:03:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:09 user nova-compute[103546]: DEBUG nova.compute.manager [req-d86c8283-69b5-45ba-9975-9c4cb67525b0 req-a831bb6d-9e47-447d-92f0-b7f3c374b9ca service nova] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Received event network-vif-plugged-804319c6-55cb-4f30-908c-71817934fb45 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:03:09 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d86c8283-69b5-45ba-9975-9c4cb67525b0 req-a831bb6d-9e47-447d-92f0-b7f3c374b9ca service nova] Acquiring lock "b0a480de-e99b-4b54-bd81-36c216442137-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:03:09 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d86c8283-69b5-45ba-9975-9c4cb67525b0 req-a831bb6d-9e47-447d-92f0-b7f3c374b9ca service nova] Lock "b0a480de-e99b-4b54-bd81-36c216442137-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:03:09 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d86c8283-69b5-45ba-9975-9c4cb67525b0 req-a831bb6d-9e47-447d-92f0-b7f3c374b9ca service nova] Lock "b0a480de-e99b-4b54-bd81-36c216442137-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:03:09 user nova-compute[103546]: DEBUG nova.compute.manager [req-d86c8283-69b5-45ba-9975-9c4cb67525b0 req-a831bb6d-9e47-447d-92f0-b7f3c374b9ca service nova] [instance: b0a480de-e99b-4b54-bd81-36c216442137] No waiting events found dispatching network-vif-plugged-804319c6-55cb-4f30-908c-71817934fb45 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:03:09 user nova-compute[103546]: WARNING nova.compute.manager [req-d86c8283-69b5-45ba-9975-9c4cb67525b0 req-a831bb6d-9e47-447d-92f0-b7f3c374b9ca service nova] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Received unexpected event network-vif-plugged-804319c6-55cb-4f30-908c-71817934fb45 for instance with vm_state stopped and task_state powering-on.
Nov 16 04:03:09 user nova-compute[103546]: DEBUG nova.compute.manager [req-d86c8283-69b5-45ba-9975-9c4cb67525b0 req-a831bb6d-9e47-447d-92f0-b7f3c374b9ca service nova] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Received event network-vif-plugged-804319c6-55cb-4f30-908c-71817934fb45 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:03:09 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d86c8283-69b5-45ba-9975-9c4cb67525b0 req-a831bb6d-9e47-447d-92f0-b7f3c374b9ca service nova] Acquiring lock "b0a480de-e99b-4b54-bd81-36c216442137-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:03:09 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d86c8283-69b5-45ba-9975-9c4cb67525b0 req-a831bb6d-9e47-447d-92f0-b7f3c374b9ca service nova] Lock "b0a480de-e99b-4b54-bd81-36c216442137-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:03:09 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d86c8283-69b5-45ba-9975-9c4cb67525b0 req-a831bb6d-9e47-447d-92f0-b7f3c374b9ca service nova] Lock "b0a480de-e99b-4b54-bd81-36c216442137-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:03:09 user nova-compute[103546]: DEBUG nova.compute.manager [req-d86c8283-69b5-45ba-9975-9c4cb67525b0 req-a831bb6d-9e47-447d-92f0-b7f3c374b9ca service nova] [instance: b0a480de-e99b-4b54-bd81-36c216442137] No waiting events found dispatching network-vif-plugged-804319c6-55cb-4f30-908c-71817934fb45 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:03:09 user nova-compute[103546]: WARNING nova.compute.manager [req-d86c8283-69b5-45ba-9975-9c4cb67525b0 req-a831bb6d-9e47-447d-92f0-b7f3c374b9ca service nova] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Received unexpected event network-vif-plugged-804319c6-55cb-4f30-908c-71817934fb45 for instance with vm_state stopped and task_state powering-on.
Nov 16 04:03:09 user nova-compute[103546]: DEBUG nova.compute.manager [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 04:03:09 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Instance rebooted successfully.
Nov 16 04:03:09 user nova-compute[103546]: DEBUG nova.compute.manager [None req-42da7939-7153-4c2a-b917-c6aafd9b31f9 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 04:03:10 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:15 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:20 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:03:20 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:03:21 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:03:21 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=103546) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 04:03:22 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:03:22 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._sync_power_states {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:03:23 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Triggering sync for uuid 9a89970b-fc61-4419-8ff9-b48013dccf9f {{(pid=103546) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 04:03:23 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Triggering sync for uuid 04101512-7333-4581-add3-7af3821e335b {{(pid=103546) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 04:03:23 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Triggering sync for uuid fa7e5468-9dd4-407d-85ec-d45ec76f9e29 {{(pid=103546) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 04:03:23 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Triggering sync for uuid 246ccf69-847c-4ab2-b709-ad1a85e81eab {{(pid=103546) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 04:03:23 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Triggering sync for uuid 8d229d05-95f1-4997-8539-802ac65cff8b {{(pid=103546) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 04:03:23 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Triggering sync for uuid b0a480de-e99b-4b54-bd81-36c216442137 {{(pid=103546) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 04:03:23 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Triggering sync for uuid 38f7c407-3373-43ba-ac92-7eb0a43a7093 {{(pid=103546) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 04:03:23 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Triggering sync for uuid 26ba7f48-9752-45af-ba68-8c3f70325e21 {{(pid=103546) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 04:03:23 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Triggering sync for uuid fa33f516-2ec7-4a83-ace8-f144e80d9473 {{(pid=103546) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 04:03:23 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Triggering sync for uuid d31c22d9-0691-4f24-817b-93b1a57d6ff4 {{(pid=103546) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 04:03:23 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Triggering sync for uuid 9a421bf0-70b6-4a2c-85da-813707619b84 {{(pid=103546) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 04:03:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "9a89970b-fc61-4419-8ff9-b48013dccf9f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:03:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "9a89970b-fc61-4419-8ff9-b48013dccf9f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:03:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "04101512-7333-4581-add3-7af3821e335b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:03:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "04101512-7333-4581-add3-7af3821e335b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:03:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "fa7e5468-9dd4-407d-85ec-d45ec76f9e29" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:03:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "fa7e5468-9dd4-407d-85ec-d45ec76f9e29" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:03:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "246ccf69-847c-4ab2-b709-ad1a85e81eab" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:03:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "246ccf69-847c-4ab2-b709-ad1a85e81eab" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:03:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "8d229d05-95f1-4997-8539-802ac65cff8b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:03:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "8d229d05-95f1-4997-8539-802ac65cff8b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:03:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "b0a480de-e99b-4b54-bd81-36c216442137" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:03:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "b0a480de-e99b-4b54-bd81-36c216442137" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:03:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "38f7c407-3373-43ba-ac92-7eb0a43a7093" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:03:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "38f7c407-3373-43ba-ac92-7eb0a43a7093" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:03:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "26ba7f48-9752-45af-ba68-8c3f70325e21" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:03:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "26ba7f48-9752-45af-ba68-8c3f70325e21" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:03:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "fa33f516-2ec7-4a83-ace8-f144e80d9473" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:03:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "fa33f516-2ec7-4a83-ace8-f144e80d9473" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:03:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "d31c22d9-0691-4f24-817b-93b1a57d6ff4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:03:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "d31c22d9-0691-4f24-817b-93b1a57d6ff4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:03:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "9a421bf0-70b6-4a2c-85da-813707619b84" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:03:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "9a421bf0-70b6-4a2c-85da-813707619b84" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:03:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "04101512-7333-4581-add3-7af3821e335b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:03:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "9a89970b-fc61-4419-8ff9-b48013dccf9f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:03:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "fa7e5468-9dd4-407d-85ec-d45ec76f9e29" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.052s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:03:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "8d229d05-95f1-4997-8539-802ac65cff8b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:03:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "b0a480de-e99b-4b54-bd81-36c216442137" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:03:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "26ba7f48-9752-45af-ba68-8c3f70325e21" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:03:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "fa33f516-2ec7-4a83-ace8-f144e80d9473" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:03:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "246ccf69-847c-4ab2-b709-ad1a85e81eab" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.075s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:03:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "9a421bf0-70b6-4a2c-85da-813707619b84" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.067s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:03:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "38f7c407-3373-43ba-ac92-7eb0a43a7093" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:03:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "d31c22d9-0691-4f24-817b-93b1a57d6ff4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:03:23 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:03:23 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:03:23 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:03:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Acquiring lock "271adc7b-bfc6-48c5-8700-69b2b079ce4b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:03:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "271adc7b-bfc6-48c5-8700-69b2b079ce4b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:03:23 user nova-compute[103546]: DEBUG nova.compute.manager [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Starting instance... {{(pid=103546) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 04:03:23 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:03:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:03:23 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=103546) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 04:03:23 user nova-compute[103546]: INFO nova.compute.claims [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Claim successful on node user
Nov 16 04:03:24 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:03:24 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:03:24 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.417s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:03:24 user nova-compute[103546]: DEBUG nova.compute.manager [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Start building networks asynchronously for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 04:03:24 user nova-compute[103546]: DEBUG nova.compute.manager [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Allocating IP information in the background. {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 04:03:24 user nova-compute[103546]: DEBUG nova.network.neutron [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] allocate_for_instance() {{(pid=103546) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 04:03:24 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 04:03:24 user nova-compute[103546]: DEBUG nova.compute.manager [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Start building block device mappings for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 04:03:24 user nova-compute[103546]: INFO nova.virt.block_device [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Booting with volume-backed-image 5c6f539a-01e5-4478-bf8f-a14310b5d7dd at /dev/vda
Nov 16 04:03:24 user nova-compute[103546]: DEBUG nova.policy [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e1176a2817ef428ea81e2fb18299a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2a38a5eb514ce8a7569c8322657eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103546) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 04:03:24 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:24 user nova-compute[103546]: DEBUG nova.network.neutron [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Successfully created port: 30eba06b-aff6-43cf-b792-7624b1bc12a9 {{(pid=103546) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 04:03:25 user nova-compute[103546]: DEBUG nova.network.neutron [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Successfully updated port: 30eba06b-aff6-43cf-b792-7624b1bc12a9 {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 04:03:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Acquiring lock "refresh_cache-271adc7b-bfc6-48c5-8700-69b2b079ce4b" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:03:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Acquired lock "refresh_cache-271adc7b-bfc6-48c5-8700-69b2b079ce4b" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:03:25 user nova-compute[103546]: DEBUG nova.network.neutron [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 04:03:25 user nova-compute[103546]: DEBUG nova.compute.manager [req-3ca20596-a168-445d-8be3-df0e78e4a326 req-ed5991bd-2c6b-4a3e-ba73-bf98fae12fb4 service nova] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Received event network-changed-30eba06b-aff6-43cf-b792-7624b1bc12a9 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:03:25 user nova-compute[103546]: DEBUG nova.compute.manager [req-3ca20596-a168-445d-8be3-df0e78e4a326 req-ed5991bd-2c6b-4a3e-ba73-bf98fae12fb4 service nova] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Refreshing instance network info cache due to event network-changed-30eba06b-aff6-43cf-b792-7624b1bc12a9. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 04:03:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3ca20596-a168-445d-8be3-df0e78e4a326 req-ed5991bd-2c6b-4a3e-ba73-bf98fae12fb4 service nova] Acquiring lock "refresh_cache-271adc7b-bfc6-48c5-8700-69b2b079ce4b" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:03:25 user nova-compute[103546]: DEBUG nova.network.neutron [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 04:03:25 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager.update_available_resource {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:03:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:03:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:03:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:03:25 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Auditing locally available compute resources for user (node: user) {{(pid=103546) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 04:03:25 user nova-compute[103546]: DEBUG nova.network.neutron [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Updating instance_info_cache with network_info: [{"id": "30eba06b-aff6-43cf-b792-7624b1bc12a9", "address": "fa:16:3e:ae:80:8d", "network": {"id": "fdbb2d2c-9a54-4517-b33a-cf27ce7570b1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79661471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2a38a5eb514ce8a7569c8322657eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30eba06b-af", "ovs_interfaceid": "30eba06b-aff6-43cf-b792-7624b1bc12a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:03:25 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 04:03:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Releasing lock "refresh_cache-271adc7b-bfc6-48c5-8700-69b2b079ce4b" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:03:25 user nova-compute[103546]: DEBUG nova.compute.manager [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Instance network_info: |[{"id": "30eba06b-aff6-43cf-b792-7624b1bc12a9", "address": "fa:16:3e:ae:80:8d", "network": {"id": "fdbb2d2c-9a54-4517-b33a-cf27ce7570b1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79661471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2a38a5eb514ce8a7569c8322657eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30eba06b-af", "ovs_interfaceid": "30eba06b-aff6-43cf-b792-7624b1bc12a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 04:03:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3ca20596-a168-445d-8be3-df0e78e4a326 req-ed5991bd-2c6b-4a3e-ba73-bf98fae12fb4 service nova] Acquired lock "refresh_cache-271adc7b-bfc6-48c5-8700-69b2b079ce4b" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:03:25 user nova-compute[103546]: DEBUG nova.network.neutron [req-3ca20596-a168-445d-8be3-df0e78e4a326 req-ed5991bd-2c6b-4a3e-ba73-bf98fae12fb4 service nova] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Refreshing network info cache for port 30eba06b-aff6-43cf-b792-7624b1bc12a9 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 04:03:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:25 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d31c22d9-0691-4f24-817b-93b1a57d6ff4/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:26 user nova-compute[103546]: DEBUG nova.network.neutron [req-3ca20596-a168-445d-8be3-df0e78e4a326 req-ed5991bd-2c6b-4a3e-ba73-bf98fae12fb4 service nova] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Updated VIF entry in instance network info cache for port 30eba06b-aff6-43cf-b792-7624b1bc12a9. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 04:03:26 user nova-compute[103546]: DEBUG nova.network.neutron [req-3ca20596-a168-445d-8be3-df0e78e4a326 req-ed5991bd-2c6b-4a3e-ba73-bf98fae12fb4 service nova] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Updating instance_info_cache with network_info: [{"id": "30eba06b-aff6-43cf-b792-7624b1bc12a9", "address": "fa:16:3e:ae:80:8d", "network": {"id": "fdbb2d2c-9a54-4517-b33a-cf27ce7570b1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79661471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2a38a5eb514ce8a7569c8322657eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30eba06b-af", "ovs_interfaceid": "30eba06b-aff6-43cf-b792-7624b1bc12a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:03:26 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3ca20596-a168-445d-8be3-df0e78e4a326 req-ed5991bd-2c6b-4a3e-ba73-bf98fae12fb4 service nova] Releasing lock "refresh_cache-271adc7b-bfc6-48c5-8700-69b2b079ce4b" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:03:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d31c22d9-0691-4f24-817b-93b1a57d6ff4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d31c22d9-0691-4f24-817b-93b1a57d6ff4/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d31c22d9-0691-4f24-817b-93b1a57d6ff4/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f7c407-3373-43ba-ac92-7eb0a43a7093/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f7c407-3373-43ba-ac92-7eb0a43a7093/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f7c407-3373-43ba-ac92-7eb0a43a7093/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f7c407-3373-43ba-ac92-7eb0a43a7093/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:27 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 04:03:27 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 04:03:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa33f516-2ec7-4a83-ace8-f144e80d9473/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa33f516-2ec7-4a83-ace8-f144e80d9473/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa33f516-2ec7-4a83-ace8-f144e80d9473/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa33f516-2ec7-4a83-ace8-f144e80d9473/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:28 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 04:03:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.rescue --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.rescue --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:28 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.rescue --force-share --output=json" returned: 0 in 0.216s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:29 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:03:29 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:03:29 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Hypervisor/Node resource view: name=user free_ram=7513MB free_disk=24.978836059570312GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=103546) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 04:03:29 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:03:29 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:03:29 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 9a89970b-fc61-4419-8ff9-b48013dccf9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:03:29 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 04101512-7333-4581-add3-7af3821e335b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:03:29 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance fa7e5468-9dd4-407d-85ec-d45ec76f9e29 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:03:29 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 246ccf69-847c-4ab2-b709-ad1a85e81eab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:03:29 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 8d229d05-95f1-4997-8539-802ac65cff8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:03:29 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance b0a480de-e99b-4b54-bd81-36c216442137 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:03:29 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 38f7c407-3373-43ba-ac92-7eb0a43a7093 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:03:29 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 26ba7f48-9752-45af-ba68-8c3f70325e21 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:03:29 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance fa33f516-2ec7-4a83-ace8-f144e80d9473 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:03:29 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance d31c22d9-0691-4f24-817b-93b1a57d6ff4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:03:29 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 9a421bf0-70b6-4a2c-85da-813707619b84 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:03:29 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 271adc7b-bfc6-48c5-8700-69b2b079ce4b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:03:29 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 04:03:29 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 04:03:30 user nova-compute[103546]: DEBUG os_brick.utils [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:03:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:30 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af378ec-16f2-4fe1-8085-b86818e15970]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af5c39b14ece\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:03:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:30 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[4473a28a-cd91-4a50-9993-ddfc2af80aef]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:03:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:30 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e640c00e-bf3f-4da6-afd9-6924cf7f3366]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:03:30 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c93a06-b212-4177-8476-32f847d25001]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:03:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Running cmd (subprocess): nvme version {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] 'nvme version' failed. Not Retrying. {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 04:03:30 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] nvme not present on system {{(pid=103546) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 04:03:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:30 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:03:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 04:03:30 user nova-compute[103546]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 04:03:30 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f71219-cb24-49d6-8b81-a2526d7bf060]: (4, '') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:03:30 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=103546) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 04:03:30 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 04:03:30 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] LIGHTOS: no hostnqn found. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 04:03:30 user nova-compute[103546]: DEBUG os_brick.utils [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af5c39b14ece', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:03:30 user nova-compute[103546]: DEBUG nova.virt.block_device [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Updating existing volume attachment record: baae5703-7e28-4199-b02f-e24a356b1672 {{(pid=103546) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 04:03:30 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:03:30 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Compute_service record updated for user:user {{(pid=103546) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 04:03:30 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.588s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:03:30 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:31 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:03:31 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Starting heal instance info cache {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 04:03:31 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Rebuilding the list of instances to heal {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 04:03:31 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Skipping network cache update for instance because it is Building. {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 16 04:03:31 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "refresh_cache-9a89970b-fc61-4419-8ff9-b48013dccf9f" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:03:31 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquired lock "refresh_cache-9a89970b-fc61-4419-8ff9-b48013dccf9f" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:03:31 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Forcefully refreshing network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 04:03:31 user nova-compute[103546]: DEBUG nova.objects.instance [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lazy-loading 'info_cache' on Instance uuid 9a89970b-fc61-4419-8ff9-b48013dccf9f {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:03:31 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Updating instance_info_cache with network_info: [{"id": "5f4e3564-4185-44d2-93f6-2e3803aaf0f8", "address": "fa:16:3e:56:e2:fb", "network": {"id": "29e9620f-313d-4679-89d7-459e7cf75b38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1690634205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72b30a015db444798ee72ff6fd14c69e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f4e3564-41", "ovs_interfaceid": "5f4e3564-4185-44d2-93f6-2e3803aaf0f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:03:31 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Releasing lock "refresh_cache-9a89970b-fc61-4419-8ff9-b48013dccf9f" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:03:31 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Updated the network info_cache for instance {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 04:03:31 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:03:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG nova.compute.manager [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Start spawning the instance on the hypervisor. {{(pid=103546) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Creating instance directory {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 04:03:35 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Creating image(s)
Nov 16 04:03:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Did not create local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Ensure instance console log exists: /opt/stack/data/nova/instances/271adc7b-bfc6-48c5-8700-69b2b079ce4b/console.log {{(pid=103546) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Start _get_guest_xml network_info=[{"id": "30eba06b-aff6-43cf-b792-7624b1bc12a9", "address": "fa:16:3e:ae:80:8d", "network": {"id": "fdbb2d2c-9a54-4517-b33a-cf27ce7570b1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79661471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2a38a5eb514ce8a7569c8322657eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30eba06b-af", "ovs_interfaceid": "30eba06b-aff6-43cf-b792-7624b1bc12a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TxYFhoMJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '271adc7b-bfc6-48c5-8700-69b2b079ce4b', 'attached_at': '', 'detached_at': '', 'volume_id': '6d1a0410-4f73-4d23-a8d8-d745c527cdf7', 'serial': '6d1a0410-4f73-4d23-a8d8-d745c527cdf7'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': 'baae5703-7e28-4199-b02f-e24a356b1672', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 04:03:35 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:03:35 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:03:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TxYFhoMJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:03:35 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:03:35 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:03:35 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:03:35 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:03:35 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 04:03:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[59449616-9081-48ab-b809-cd38055ffe39]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 04:03:35 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 -p 172.16.0.220:3260 --interface default --op new {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0db737-d193-45ef-92b0-15ed01465254]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7] added\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7] added
Nov 16 04:03:35 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[9216c8f3-d2e0-4c47-9f3b-3f48c02a22d5]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4bf73e-0d58-44b4-9802-93d6dac1553a]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TxYFhoMJ {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TxYFhoMJ" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd39b22c-3395-4818-ba26-3c7aa2d09d06]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TxYFhoMJ'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b29a5e-5fa6-4121-853b-33aa01bf0788]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[589ce968-24e4-488e-a5b3-ef206e562baf]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:03:35 user nova-compute[103546]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:03:35 user nova-compute[103546]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:03:35 user nova-compute[103546]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)
Nov 16 04:03:35 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:03:35 user nova-compute[103546]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:03:35 user nova-compute[103546]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:03:35 user nova-compute[103546]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)
Nov 16 04:03:35 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 -p 172.16.0.220:3260 --login {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2ae2f1-51fc-4785-9859-04c3ec0c0a0c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7, portal: 172.16.0.220,3260]
Nov 16 04:03:35 user nova-compute[103546]: Login to [iface: default, target: iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7, portal: 172.16.0.220,3260] successful.
Nov 16 04:03:35 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c13569-cbc7-4bce-ae32-acf7cd405059]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a96cda3-84d8-4034-92e6-57e1fa8cf94c]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:03:35 user nova-compute[103546]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:03:35 user nova-compute[103546]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:03:35 user nova-compute[103546]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)
Nov 16 04:03:35 user nova-compute[103546]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)
Nov 16 04:03:35 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:03:35 user nova-compute[103546]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:03:35 user nova-compute[103546]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:03:35 user nova-compute[103546]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)
Nov 16 04:03:35 user nova-compute[103546]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)
Nov 16 04:03:35 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] HCTL ('36', '-', '-', 0) found on session 44 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a57db3b-1062-4331-8fa3-665a3127ef11]: (4, ('- - 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Searching for a device in session 44 and hctl ['36', '*', '*', 0] yield: sde {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TxYFhoMJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 04:03:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:36 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:03:36 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23132393937343964', 'path': '/dev/sde'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:03:36 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23132393937343964', 'path': '/dev/sde'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 04:03:36 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:03:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2082323718',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2082323718',id=40,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f2a38a5eb514ce8a7569c8322657eac',ramdisk_id='',reservation_id='r-d5wsh0km',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1634874924',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T04:03:24Z,user_data=None,user_id='e1176a2817ef428ea81e2fb18299a306',uuid=271adc7b-bfc6-48c5-8700-69b2b079ce4b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30eba06b-aff6-43cf-b792-7624b1bc12a9", "address": "fa:16:3e:ae:80:8d", "network": {"id": "fdbb2d2c-9a54-4517-b33a-cf27ce7570b1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79661471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2a38a5eb514ce8a7569c8322657eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30eba06b-af", "ovs_interfaceid": "30eba06b-aff6-43cf-b792-7624b1bc12a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 04:03:36 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Converting VIF {"id": "30eba06b-aff6-43cf-b792-7624b1bc12a9", "address": "fa:16:3e:ae:80:8d", "network": {"id": "fdbb2d2c-9a54-4517-b33a-cf27ce7570b1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79661471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2a38a5eb514ce8a7569c8322657eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30eba06b-af", "ovs_interfaceid": "30eba06b-aff6-43cf-b792-7624b1bc12a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:03:36 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:80:8d,bridge_name='br-int',has_traffic_filtering=True,id=30eba06b-aff6-43cf-b792-7624b1bc12a9,network=Network(fdbb2d2c-9a54-4517-b33a-cf27ce7570b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30eba06b-af') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:03:36 user nova-compute[103546]: DEBUG nova.objects.instance [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lazy-loading 'pci_devices' on Instance uuid 271adc7b-bfc6-48c5-8700-69b2b079ce4b {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:03:36 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] End _get_guest_xml xml=<domain type="kvm">
Nov 16 04:03:36 user nova-compute[103546]:   <uuid>271adc7b-bfc6-48c5-8700-69b2b079ce4b</uuid>
Nov 16 04:03:36 user nova-compute[103546]:   <name>instance-00000028</name>
Nov 16 04:03:36 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 04:03:36 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 04:03:36 user nova-compute[103546]:   <metadata>
Nov 16 04:03:36 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 04:03:36 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 04:03:36 user nova-compute[103546]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2082323718</nova:name>
Nov 16 04:03:36 user nova-compute[103546]:       <nova:creationTime>2023-11-16 04:03:35</nova:creationTime>
Nov 16 04:03:36 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 04:03:36 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 04:03:36 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 04:03:36 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 04:03:36 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 04:03:36 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 04:03:36 user nova-compute[103546]:       </nova:flavor>
Nov 16 04:03:36 user nova-compute[103546]:       <nova:owner>
Nov 16 04:03:36 user nova-compute[103546]:         <nova:user uuid="e1176a2817ef428ea81e2fb18299a306">tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member</nova:user>
Nov 16 04:03:36 user nova-compute[103546]:         <nova:project uuid="6f2a38a5eb514ce8a7569c8322657eac">tempest-ServerBootFromVolumeStableRescueTest-1634874924</nova:project>
Nov 16 04:03:36 user nova-compute[103546]:       </nova:owner>
Nov 16 04:03:36 user nova-compute[103546]:       <nova:root type="image" uuid="5c6f539a-01e5-4478-bf8f-a14310b5d7dd"/>
Nov 16 04:03:36 user nova-compute[103546]:       <nova:ports>
Nov 16 04:03:36 user nova-compute[103546]:         <nova:port uuid="30eba06b-aff6-43cf-b792-7624b1bc12a9">
Nov 16 04:03:36 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 16 04:03:36 user nova-compute[103546]:         </nova:port>
Nov 16 04:03:36 user nova-compute[103546]:       </nova:ports>
Nov 16 04:03:36 user nova-compute[103546]:     </nova:instance>
Nov 16 04:03:36 user nova-compute[103546]:   </metadata>
Nov 16 04:03:36 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 04:03:36 user nova-compute[103546]:     <system>
Nov 16 04:03:36 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 04:03:36 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 04:03:36 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 04:03:36 user nova-compute[103546]:       <entry name="serial">271adc7b-bfc6-48c5-8700-69b2b079ce4b</entry>
Nov 16 04:03:36 user nova-compute[103546]:       <entry name="uuid">271adc7b-bfc6-48c5-8700-69b2b079ce4b</entry>
Nov 16 04:03:36 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 04:03:36 user nova-compute[103546]:     </system>
Nov 16 04:03:36 user nova-compute[103546]:   </sysinfo>
Nov 16 04:03:36 user nova-compute[103546]:   <os>
Nov 16 04:03:36 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 04:03:36 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 04:03:36 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 04:03:36 user nova-compute[103546]:   </os>
Nov 16 04:03:36 user nova-compute[103546]:   <features>
Nov 16 04:03:36 user nova-compute[103546]:     <acpi/>
Nov 16 04:03:36 user nova-compute[103546]:     <apic/>
Nov 16 04:03:36 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 04:03:36 user nova-compute[103546]:   </features>
Nov 16 04:03:36 user nova-compute[103546]:   <clock offset="utc">
Nov 16 04:03:36 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 04:03:36 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 04:03:36 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 04:03:36 user nova-compute[103546]:   </clock>
Nov 16 04:03:36 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 04:03:36 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 04:03:36 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 04:03:36 user nova-compute[103546]:   </cpu>
Nov 16 04:03:36 user nova-compute[103546]:   <devices>
Nov 16 04:03:36 user nova-compute[103546]:     <disk type="block" device="disk">
Nov 16 04:03:36 user nova-compute[103546]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:03:36 user nova-compute[103546]:       <source dev="/dev/sde"/>
Nov 16 04:03:36 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 04:03:36 user nova-compute[103546]:       <serial>6d1a0410-4f73-4d23-a8d8-d745c527cdf7</serial>
Nov 16 04:03:36 user nova-compute[103546]:     </disk>
Nov 16 04:03:36 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 04:03:36 user nova-compute[103546]:       <mac address="fa:16:3e:ae:80:8d"/>
Nov 16 04:03:36 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 04:03:36 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 04:03:36 user nova-compute[103546]:       <target dev="tap30eba06b-af"/>
Nov 16 04:03:36 user nova-compute[103546]:     </interface>
Nov 16 04:03:36 user nova-compute[103546]:     <serial type="pty">
Nov 16 04:03:36 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/271adc7b-bfc6-48c5-8700-69b2b079ce4b/console.log" append="off"/>
Nov 16 04:03:36 user nova-compute[103546]:     </serial>
Nov 16 04:03:36 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 04:03:36 user nova-compute[103546]:     <video>
Nov 16 04:03:36 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 04:03:36 user nova-compute[103546]:     </video>
Nov 16 04:03:36 user nova-compute[103546]:     <rng model="virtio">
Nov 16 04:03:36 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 04:03:36 user nova-compute[103546]:     </rng>
Nov 16 04:03:36 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 04:03:36 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 04:03:36 user nova-compute[103546]:       <stats period="10"/>
Nov 16 04:03:36 user nova-compute[103546]:     </memballoon>
Nov 16 04:03:36 user nova-compute[103546]:   </devices>
Nov 16 04:03:36 user nova-compute[103546]: </domain>
Nov 16 04:03:36 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 04:03:36 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:03:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2082323718',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2082323718',id=40,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f2a38a5eb514ce8a7569c8322657eac',ramdisk_id='',reservation_id='r-d5wsh0km',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1634874924',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T04:03:24Z,user_data=None,user_id='e1176a2817ef428ea81e2fb18299a306',uuid=271adc7b-bfc6-48c5-8700-69b2b079ce4b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30eba06b-aff6-43cf-b792-7624b1bc12a9", "address": "fa:16:3e:ae:80:8d", "network": {"id": "fdbb2d2c-9a54-4517-b33a-cf27ce7570b1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79661471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2a38a5eb514ce8a7569c8322657eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30eba06b-af", "ovs_interfaceid": "30eba06b-aff6-43cf-b792-7624b1bc12a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 04:03:36 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Converting VIF {"id": "30eba06b-aff6-43cf-b792-7624b1bc12a9", "address": "fa:16:3e:ae:80:8d", "network": {"id": "fdbb2d2c-9a54-4517-b33a-cf27ce7570b1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79661471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2a38a5eb514ce8a7569c8322657eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30eba06b-af", "ovs_interfaceid": "30eba06b-aff6-43cf-b792-7624b1bc12a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:03:36 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:80:8d,bridge_name='br-int',has_traffic_filtering=True,id=30eba06b-aff6-43cf-b792-7624b1bc12a9,network=Network(fdbb2d2c-9a54-4517-b33a-cf27ce7570b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30eba06b-af') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:03:36 user nova-compute[103546]: DEBUG os_vif [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:80:8d,bridge_name='br-int',has_traffic_filtering=True,id=30eba06b-aff6-43cf-b792-7624b1bc12a9,network=Network(fdbb2d2c-9a54-4517-b33a-cf27ce7570b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30eba06b-af') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 04:03:36 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:36 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:03:36 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 04:03:36 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:36 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '245a7ac1-e504-579e-b570-f9b68edc98d1', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:03:36 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:36 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:36 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:36 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap30eba06b-af, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:03:36 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap30eba06b-af, col_values=(('qos', UUID('c8ab4ca6-334f-43fa-b3f8-14c82801b800')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:03:36 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap30eba06b-af, col_values=(('external_ids', {'iface-id': '30eba06b-aff6-43cf-b792-7624b1bc12a9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:80:8d', 'vm-uuid': '271adc7b-bfc6-48c5-8700-69b2b079ce4b'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:03:36 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:36 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:03:36 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:36 user nova-compute[103546]: INFO os_vif [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:80:8d,bridge_name='br-int',has_traffic_filtering=True,id=30eba06b-aff6-43cf-b792-7624b1bc12a9,network=Network(fdbb2d2c-9a54-4517-b33a-cf27ce7570b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30eba06b-af')
Nov 16 04:03:36 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:03:36 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] No VIF found with MAC fa:16:3e:ae:80:8d, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 04:03:38 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:38 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:38 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:38 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:38 user nova-compute[103546]: DEBUG nova.compute.manager [req-c8825a62-9328-44dc-a931-7cfc6af74081 req-4801dddb-6932-46f9-8f99-540e21d82a9a service nova] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Received event network-vif-plugged-30eba06b-aff6-43cf-b792-7624b1bc12a9 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:03:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-c8825a62-9328-44dc-a931-7cfc6af74081 req-4801dddb-6932-46f9-8f99-540e21d82a9a service nova] Acquiring lock "271adc7b-bfc6-48c5-8700-69b2b079ce4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:03:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-c8825a62-9328-44dc-a931-7cfc6af74081 req-4801dddb-6932-46f9-8f99-540e21d82a9a service nova] Lock "271adc7b-bfc6-48c5-8700-69b2b079ce4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:03:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-c8825a62-9328-44dc-a931-7cfc6af74081 req-4801dddb-6932-46f9-8f99-540e21d82a9a service nova] Lock "271adc7b-bfc6-48c5-8700-69b2b079ce4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:03:38 user nova-compute[103546]: DEBUG nova.compute.manager [req-c8825a62-9328-44dc-a931-7cfc6af74081 req-4801dddb-6932-46f9-8f99-540e21d82a9a service nova] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] No waiting events found dispatching network-vif-plugged-30eba06b-aff6-43cf-b792-7624b1bc12a9 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:03:38 user nova-compute[103546]: WARNING nova.compute.manager [req-c8825a62-9328-44dc-a931-7cfc6af74081 req-4801dddb-6932-46f9-8f99-540e21d82a9a service nova] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Received unexpected event network-vif-plugged-30eba06b-aff6-43cf-b792-7624b1bc12a9 for instance with vm_state building and task_state spawning.
Nov 16 04:03:38 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:38 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:40 user nova-compute[103546]: DEBUG nova.compute.manager [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 04:03:40 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Guest created on hypervisor {{(pid=103546) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 04:03:40 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Instance spawned successfully.
Nov 16 04:03:40 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 04:03:40 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Found default for hw_cdrom_bus of ide {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:03:40 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Found default for hw_disk_bus of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:03:40 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Found default for hw_input_bus of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:03:40 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Found default for hw_pointer_model of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:03:40 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Found default for hw_video_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:03:40 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Found default for hw_vif_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:03:40 user nova-compute[103546]: INFO nova.compute.manager [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Took 4.96 seconds to spawn the instance on the hypervisor.
Nov 16 04:03:40 user nova-compute[103546]: DEBUG nova.compute.manager [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 04:03:40 user nova-compute[103546]: DEBUG nova.compute.manager [req-ef447796-799e-4bb5-a6b9-9c75c911be8a req-ed925a33-0abb-4b0d-9de3-e6e930499475 service nova] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Received event network-vif-plugged-30eba06b-aff6-43cf-b792-7624b1bc12a9 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:03:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ef447796-799e-4bb5-a6b9-9c75c911be8a req-ed925a33-0abb-4b0d-9de3-e6e930499475 service nova] Acquiring lock "271adc7b-bfc6-48c5-8700-69b2b079ce4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:03:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ef447796-799e-4bb5-a6b9-9c75c911be8a req-ed925a33-0abb-4b0d-9de3-e6e930499475 service nova] Lock "271adc7b-bfc6-48c5-8700-69b2b079ce4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:03:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ef447796-799e-4bb5-a6b9-9c75c911be8a req-ed925a33-0abb-4b0d-9de3-e6e930499475 service nova] Lock "271adc7b-bfc6-48c5-8700-69b2b079ce4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:03:40 user nova-compute[103546]: DEBUG nova.compute.manager [req-ef447796-799e-4bb5-a6b9-9c75c911be8a req-ed925a33-0abb-4b0d-9de3-e6e930499475 service nova] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] No waiting events found dispatching network-vif-plugged-30eba06b-aff6-43cf-b792-7624b1bc12a9 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:03:40 user nova-compute[103546]: WARNING nova.compute.manager [req-ef447796-799e-4bb5-a6b9-9c75c911be8a req-ed925a33-0abb-4b0d-9de3-e6e930499475 service nova] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Received unexpected event network-vif-plugged-30eba06b-aff6-43cf-b792-7624b1bc12a9 for instance with vm_state building and task_state spawning.
Nov 16 04:03:40 user nova-compute[103546]: INFO nova.compute.manager [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Took 16.52 seconds to build instance.
Nov 16 04:03:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-5c51ab5c-924b-4fab-a816-2db44db99958 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "271adc7b-bfc6-48c5-8700-69b2b079ce4b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.623s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:03:41 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:42 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Acquiring lock "8c02873d-469e-41a4-b492-69f793c8a07c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:03:42 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "8c02873d-469e-41a4-b492-69f793c8a07c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:03:42 user nova-compute[103546]: DEBUG nova.compute.manager [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Starting instance... {{(pid=103546) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 04:03:42 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:03:42 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:03:42 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=103546) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 04:03:42 user nova-compute[103546]: INFO nova.compute.claims [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Claim successful on node user
Nov 16 04:03:43 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:03:43 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:03:43 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.596s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:03:43 user nova-compute[103546]: DEBUG nova.compute.manager [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Start building networks asynchronously for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 04:03:43 user nova-compute[103546]: DEBUG nova.compute.manager [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Allocating IP information in the background. {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 04:03:43 user nova-compute[103546]: DEBUG nova.network.neutron [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] allocate_for_instance() {{(pid=103546) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 04:03:43 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 04:03:43 user nova-compute[103546]: DEBUG nova.compute.manager [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Start building block device mappings for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 04:03:43 user nova-compute[103546]: DEBUG nova.compute.manager [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Start spawning the instance on the hypervisor. {{(pid=103546) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 04:03:43 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Creating instance directory {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 04:03:43 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Creating image(s)
Nov 16 04:03:43 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Acquiring lock "/opt/stack/data/nova/instances/8c02873d-469e-41a4-b492-69f793c8a07c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:03:43 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "/opt/stack/data/nova/instances/8c02873d-469e-41a4-b492-69f793c8a07c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:03:43 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "/opt/stack/data/nova/instances/8c02873d-469e-41a4-b492-69f793c8a07c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:03:43 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:43 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.188s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:43 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Acquiring lock "8c9efafb670bfe5842ba1f4ce398924612164af7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:03:43 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:03:43 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:43 user nova-compute[103546]: DEBUG nova.policy [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7626749c82fb4b5c81e696e4beeed858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca049d5674dc4c59814f98478752d73d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103546) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 04:03:44 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.194s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:44 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/8c02873d-469e-41a4-b492-69f793c8a07c/disk 1073741824 {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:44 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/8c02873d-469e-41a4-b492-69f793c8a07c/disk 1073741824" returned: 0 in 0.054s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:03:44 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:44 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.192s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:44 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8c02873d-469e-41a4-b492-69f793c8a07c/disk. size=1073741824 {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 04:03:44 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c02873d-469e-41a4-b492-69f793c8a07c/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:44 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:44 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c02873d-469e-41a4-b492-69f793c8a07c/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:44 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Cannot resize image /opt/stack/data/nova/instances/8c02873d-469e-41a4-b492-69f793c8a07c/disk to a smaller size. {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 04:03:44 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Created local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 04:03:44 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Ensure instance console log exists: /opt/stack/data/nova/instances/8c02873d-469e-41a4-b492-69f793c8a07c/console.log {{(pid=103546) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 04:03:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:03:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:03:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:03:44 user nova-compute[103546]: DEBUG nova.network.neutron [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Successfully created port: 96edd323-af11-4e10-a7bb-a6e0d0ea12ff {{(pid=103546) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 04:03:45 user nova-compute[103546]: DEBUG nova.network.neutron [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Successfully updated port: 96edd323-af11-4e10-a7bb-a6e0d0ea12ff {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 04:03:45 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Acquiring lock "refresh_cache-8c02873d-469e-41a4-b492-69f793c8a07c" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:03:45 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Acquired lock "refresh_cache-8c02873d-469e-41a4-b492-69f793c8a07c" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:03:45 user nova-compute[103546]: DEBUG nova.network.neutron [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 04:03:45 user nova-compute[103546]: DEBUG nova.compute.manager [req-9c40ddb2-1b34-4fc7-b080-6c58e1c8cad7 req-4f6bf1e2-e1ed-4908-8932-4b1c86ae25c8 service nova] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Received event network-changed-96edd323-af11-4e10-a7bb-a6e0d0ea12ff {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:03:45 user nova-compute[103546]: DEBUG nova.compute.manager [req-9c40ddb2-1b34-4fc7-b080-6c58e1c8cad7 req-4f6bf1e2-e1ed-4908-8932-4b1c86ae25c8 service nova] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Refreshing instance network info cache due to event network-changed-96edd323-af11-4e10-a7bb-a6e0d0ea12ff. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 04:03:45 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-9c40ddb2-1b34-4fc7-b080-6c58e1c8cad7 req-4f6bf1e2-e1ed-4908-8932-4b1c86ae25c8 service nova] Acquiring lock "refresh_cache-8c02873d-469e-41a4-b492-69f793c8a07c" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:03:45 user nova-compute[103546]: DEBUG nova.network.neutron [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 04:03:45 user nova-compute[103546]: DEBUG nova.network.neutron [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Updating instance_info_cache with network_info: [{"id": "96edd323-af11-4e10-a7bb-a6e0d0ea12ff", "address": "fa:16:3e:5a:5c:31", "network": {"id": "337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-40560053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca049d5674dc4c59814f98478752d73d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96edd323-af", "ovs_interfaceid": "96edd323-af11-4e10-a7bb-a6e0d0ea12ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:03:45 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Releasing lock "refresh_cache-8c02873d-469e-41a4-b492-69f793c8a07c" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:03:45 user nova-compute[103546]: DEBUG nova.compute.manager [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Instance network_info: |[{"id": "96edd323-af11-4e10-a7bb-a6e0d0ea12ff", "address": "fa:16:3e:5a:5c:31", "network": {"id": "337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-40560053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca049d5674dc4c59814f98478752d73d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96edd323-af", "ovs_interfaceid": "96edd323-af11-4e10-a7bb-a6e0d0ea12ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 04:03:45 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-9c40ddb2-1b34-4fc7-b080-6c58e1c8cad7 req-4f6bf1e2-e1ed-4908-8932-4b1c86ae25c8 service nova] Acquired lock "refresh_cache-8c02873d-469e-41a4-b492-69f793c8a07c" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:03:45 user nova-compute[103546]: DEBUG nova.network.neutron [req-9c40ddb2-1b34-4fc7-b080-6c58e1c8cad7 req-4f6bf1e2-e1ed-4908-8932-4b1c86ae25c8 service nova] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Refreshing network info cache for port 96edd323-af11-4e10-a7bb-a6e0d0ea12ff {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 04:03:45 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Start _get_guest_xml network_info=[{"id": "96edd323-af11-4e10-a7bb-a6e0d0ea12ff", "address": "fa:16:3e:5a:5c:31", "network": {"id": "337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-40560053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca049d5674dc4c59814f98478752d73d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96edd323-af", "ovs_interfaceid": "96edd323-af11-4e10-a7bb-a6e0d0ea12ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '5c6f539a-01e5-4478-bf8f-a14310b5d7dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 04:03:45 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:03:45 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:03:45 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 04:03:45 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 04:03:45 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 04:03:45 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 04:03:45 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 04:03:45 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 04:03:45 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 04:03:45 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 04:03:45 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 04:03:45 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 04:03:45 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 04:03:45 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 04:03:45 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 04:03:45 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 04:03:45 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 04:03:45 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 04:03:45 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:03:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-563151612',display_name='tempest-ServerRescueNegativeTestJSON-server-563151612',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-563151612',id=41,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPimoHFW0lef+vE/gmpf/A37NZe+DyQwwLeT9RTaaZRkk4sSIIvf2JY7pK9OsbSpgTcfdwXllC/ZBjX4ZD6jJMjV9YFlTmNXttYPxCshd7r/7KOHpnM6mHKwsTuNdrmBLA==',key_name='tempest-keypair-959060809',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca049d5674dc4c59814f98478752d73d',ramdisk_id='',reservation_id='r-judr5tlu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1943614153',owner_user_name='tempest-ServerRescueNegativeTestJSON-1943614153-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T04:03:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7626749c82fb4b5c81e696e4beeed858',uuid=8c02873d-469e-41a4-b492-69f793c8a07c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96edd323-af11-4e10-a7bb-a6e0d0ea12ff", "address": "fa:16:3e:5a:5c:31", "network": {"id": "337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-40560053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca049d5674dc4c59814f98478752d73d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96edd323-af", "ovs_interfaceid": "96edd323-af11-4e10-a7bb-a6e0d0ea12ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 04:03:45 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Converting VIF {"id": "96edd323-af11-4e10-a7bb-a6e0d0ea12ff", "address": "fa:16:3e:5a:5c:31", "network": {"id": "337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-40560053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca049d5674dc4c59814f98478752d73d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96edd323-af", "ovs_interfaceid": "96edd323-af11-4e10-a7bb-a6e0d0ea12ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:03:45 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:5c:31,bridge_name='br-int',has_traffic_filtering=True,id=96edd323-af11-4e10-a7bb-a6e0d0ea12ff,network=Network(337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96edd323-af') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:03:45 user nova-compute[103546]: DEBUG nova.objects.instance [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lazy-loading 'pci_devices' on Instance uuid 8c02873d-469e-41a4-b492-69f793c8a07c {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:03:45 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] End _get_guest_xml xml=<domain type="kvm">
Nov 16 04:03:45 user nova-compute[103546]:   <uuid>8c02873d-469e-41a4-b492-69f793c8a07c</uuid>
Nov 16 04:03:45 user nova-compute[103546]:   <name>instance-00000029</name>
Nov 16 04:03:45 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 04:03:45 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 04:03:45 user nova-compute[103546]:   <metadata>
Nov 16 04:03:45 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 04:03:45 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 04:03:45 user nova-compute[103546]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-563151612</nova:name>
Nov 16 04:03:45 user nova-compute[103546]:       <nova:creationTime>2023-11-16 04:03:45</nova:creationTime>
Nov 16 04:03:45 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 04:03:45 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 04:03:45 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 04:03:45 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 04:03:45 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 04:03:45 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 04:03:45 user nova-compute[103546]:       </nova:flavor>
Nov 16 04:03:45 user nova-compute[103546]:       <nova:owner>
Nov 16 04:03:45 user nova-compute[103546]:         <nova:user uuid="7626749c82fb4b5c81e696e4beeed858">tempest-ServerRescueNegativeTestJSON-1943614153-project-member</nova:user>
Nov 16 04:03:45 user nova-compute[103546]:         <nova:project uuid="ca049d5674dc4c59814f98478752d73d">tempest-ServerRescueNegativeTestJSON-1943614153</nova:project>
Nov 16 04:03:45 user nova-compute[103546]:       </nova:owner>
Nov 16 04:03:45 user nova-compute[103546]:       <nova:root type="image" uuid="5c6f539a-01e5-4478-bf8f-a14310b5d7dd"/>
Nov 16 04:03:45 user nova-compute[103546]:       <nova:ports>
Nov 16 04:03:45 user nova-compute[103546]:         <nova:port uuid="96edd323-af11-4e10-a7bb-a6e0d0ea12ff">
Nov 16 04:03:45 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 16 04:03:45 user nova-compute[103546]:         </nova:port>
Nov 16 04:03:45 user nova-compute[103546]:       </nova:ports>
Nov 16 04:03:45 user nova-compute[103546]:     </nova:instance>
Nov 16 04:03:45 user nova-compute[103546]:   </metadata>
Nov 16 04:03:45 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 04:03:45 user nova-compute[103546]:     <system>
Nov 16 04:03:45 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 04:03:45 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 04:03:45 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 04:03:45 user nova-compute[103546]:       <entry name="serial">8c02873d-469e-41a4-b492-69f793c8a07c</entry>
Nov 16 04:03:45 user nova-compute[103546]:       <entry name="uuid">8c02873d-469e-41a4-b492-69f793c8a07c</entry>
Nov 16 04:03:45 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 04:03:45 user nova-compute[103546]:     </system>
Nov 16 04:03:45 user nova-compute[103546]:   </sysinfo>
Nov 16 04:03:45 user nova-compute[103546]:   <os>
Nov 16 04:03:45 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 04:03:45 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 04:03:45 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 04:03:45 user nova-compute[103546]:   </os>
Nov 16 04:03:45 user nova-compute[103546]:   <features>
Nov 16 04:03:45 user nova-compute[103546]:     <acpi/>
Nov 16 04:03:45 user nova-compute[103546]:     <apic/>
Nov 16 04:03:45 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 04:03:45 user nova-compute[103546]:   </features>
Nov 16 04:03:45 user nova-compute[103546]:   <clock offset="utc">
Nov 16 04:03:45 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 04:03:45 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 04:03:45 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 04:03:45 user nova-compute[103546]:   </clock>
Nov 16 04:03:45 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 04:03:45 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 04:03:45 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 04:03:45 user nova-compute[103546]:   </cpu>
Nov 16 04:03:45 user nova-compute[103546]:   <devices>
Nov 16 04:03:45 user nova-compute[103546]:     <disk type="file" device="disk">
Nov 16 04:03:45 user nova-compute[103546]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 04:03:45 user nova-compute[103546]:       <source file="/opt/stack/data/nova/instances/8c02873d-469e-41a4-b492-69f793c8a07c/disk"/>
Nov 16 04:03:45 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 04:03:45 user nova-compute[103546]:     </disk>
Nov 16 04:03:45 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 04:03:45 user nova-compute[103546]:       <mac address="fa:16:3e:5a:5c:31"/>
Nov 16 04:03:45 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 04:03:45 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 04:03:45 user nova-compute[103546]:       <target dev="tap96edd323-af"/>
Nov 16 04:03:45 user nova-compute[103546]:     </interface>
Nov 16 04:03:45 user nova-compute[103546]:     <serial type="pty">
Nov 16 04:03:45 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/8c02873d-469e-41a4-b492-69f793c8a07c/console.log" append="off"/>
Nov 16 04:03:45 user nova-compute[103546]:     </serial>
Nov 16 04:03:45 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 04:03:45 user nova-compute[103546]:     <video>
Nov 16 04:03:45 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 04:03:45 user nova-compute[103546]:     </video>
Nov 16 04:03:45 user nova-compute[103546]:     <rng model="virtio">
Nov 16 04:03:45 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 04:03:45 user nova-compute[103546]:     </rng>
Nov 16 04:03:45 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 04:03:45 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 04:03:45 user nova-compute[103546]:       <stats period="10"/>
Nov 16 04:03:45 user nova-compute[103546]:     </memballoon>
Nov 16 04:03:45 user nova-compute[103546]:   </devices>
Nov 16 04:03:45 user nova-compute[103546]: </domain>
Nov 16 04:03:45 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 04:03:45 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:03:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-563151612',display_name='tempest-ServerRescueNegativeTestJSON-server-563151612',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-563151612',id=41,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPimoHFW0lef+vE/gmpf/A37NZe+DyQwwLeT9RTaaZRkk4sSIIvf2JY7pK9OsbSpgTcfdwXllC/ZBjX4ZD6jJMjV9YFlTmNXttYPxCshd7r/7KOHpnM6mHKwsTuNdrmBLA==',key_name='tempest-keypair-959060809',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca049d5674dc4c59814f98478752d73d',ramdisk_id='',reservation_id='r-judr5tlu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1943614153',owner_user_name='tempest-ServerRescueNegativeTestJSON-1943614153-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T04:03:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7626749c82fb4b5c81e696e4beeed858',uuid=8c02873d-469e-41a4-b492-69f793c8a07c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96edd323-af11-4e10-a7bb-a6e0d0ea12ff", "address": "fa:16:3e:5a:5c:31", "network": {"id": "337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-40560053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca049d5674dc4c59814f98478752d73d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96edd323-af", "ovs_interfaceid": "96edd323-af11-4e10-a7bb-a6e0d0ea12ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 04:03:45 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Converting VIF {"id": "96edd323-af11-4e10-a7bb-a6e0d0ea12ff", "address": "fa:16:3e:5a:5c:31", "network": {"id": "337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-40560053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca049d5674dc4c59814f98478752d73d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96edd323-af", "ovs_interfaceid": "96edd323-af11-4e10-a7bb-a6e0d0ea12ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:03:45 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:5c:31,bridge_name='br-int',has_traffic_filtering=True,id=96edd323-af11-4e10-a7bb-a6e0d0ea12ff,network=Network(337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96edd323-af') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:03:45 user nova-compute[103546]: DEBUG os_vif [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:5c:31,bridge_name='br-int',has_traffic_filtering=True,id=96edd323-af11-4e10-a7bb-a6e0d0ea12ff,network=Network(337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96edd323-af') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 04:03:45 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:45 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:03:45 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 04:03:45 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:45 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5127dd43-1d4c-588b-b810-1de5d5529a72', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:03:45 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:03:45 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:45 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96edd323-af, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:03:45 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap96edd323-af, col_values=(('qos', UUID('c8101188-88fe-414c-b1dd-65e40d4c42d5')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:03:45 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap96edd323-af, col_values=(('external_ids', {'iface-id': '96edd323-af11-4e10-a7bb-a6e0d0ea12ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:5c:31', 'vm-uuid': '8c02873d-469e-41a4-b492-69f793c8a07c'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:03:45 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:03:45 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:45 user nova-compute[103546]: INFO os_vif [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:5c:31,bridge_name='br-int',has_traffic_filtering=True,id=96edd323-af11-4e10-a7bb-a6e0d0ea12ff,network=Network(337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96edd323-af')
Nov 16 04:03:45 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:03:45 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] No VIF found with MAC fa:16:3e:5a:5c:31, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 04:03:46 user nova-compute[103546]: DEBUG nova.network.neutron [req-9c40ddb2-1b34-4fc7-b080-6c58e1c8cad7 req-4f6bf1e2-e1ed-4908-8932-4b1c86ae25c8 service nova] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Updated VIF entry in instance network info cache for port 96edd323-af11-4e10-a7bb-a6e0d0ea12ff. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 04:03:46 user nova-compute[103546]: DEBUG nova.network.neutron [req-9c40ddb2-1b34-4fc7-b080-6c58e1c8cad7 req-4f6bf1e2-e1ed-4908-8932-4b1c86ae25c8 service nova] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Updating instance_info_cache with network_info: [{"id": "96edd323-af11-4e10-a7bb-a6e0d0ea12ff", "address": "fa:16:3e:5a:5c:31", "network": {"id": "337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-40560053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca049d5674dc4c59814f98478752d73d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96edd323-af", "ovs_interfaceid": "96edd323-af11-4e10-a7bb-a6e0d0ea12ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:03:46 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-9c40ddb2-1b34-4fc7-b080-6c58e1c8cad7 req-4f6bf1e2-e1ed-4908-8932-4b1c86ae25c8 service nova] Releasing lock "refresh_cache-8c02873d-469e-41a4-b492-69f793c8a07c" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:03:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:47 user nova-compute[103546]: DEBUG nova.compute.manager [req-a4cccba6-86c2-4c18-9bc0-891c17e5f972 req-a63dd51f-bb1d-4c47-af3c-092b870a344e service nova] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Received event network-vif-plugged-96edd323-af11-4e10-a7bb-a6e0d0ea12ff {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:03:47 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a4cccba6-86c2-4c18-9bc0-891c17e5f972 req-a63dd51f-bb1d-4c47-af3c-092b870a344e service nova] Acquiring lock "8c02873d-469e-41a4-b492-69f793c8a07c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:03:47 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a4cccba6-86c2-4c18-9bc0-891c17e5f972 req-a63dd51f-bb1d-4c47-af3c-092b870a344e service nova] Lock "8c02873d-469e-41a4-b492-69f793c8a07c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:03:47 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a4cccba6-86c2-4c18-9bc0-891c17e5f972 req-a63dd51f-bb1d-4c47-af3c-092b870a344e service nova] Lock "8c02873d-469e-41a4-b492-69f793c8a07c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:03:47 user nova-compute[103546]: DEBUG nova.compute.manager [req-a4cccba6-86c2-4c18-9bc0-891c17e5f972 req-a63dd51f-bb1d-4c47-af3c-092b870a344e service nova] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] No waiting events found dispatching network-vif-plugged-96edd323-af11-4e10-a7bb-a6e0d0ea12ff {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:03:47 user nova-compute[103546]: WARNING nova.compute.manager [req-a4cccba6-86c2-4c18-9bc0-891c17e5f972 req-a63dd51f-bb1d-4c47-af3c-092b870a344e service nova] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Received unexpected event network-vif-plugged-96edd323-af11-4e10-a7bb-a6e0d0ea12ff for instance with vm_state building and task_state spawning.
Nov 16 04:03:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:47 user nova-compute[103546]: DEBUG nova.compute.manager [req-5ffd5632-0d5f-46f1-895d-3fa9e3458078 req-34046d0d-1ef4-4cc3-9247-2a03d93dc221 service nova] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Received event network-changed-5f4e3564-4185-44d2-93f6-2e3803aaf0f8 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:03:47 user nova-compute[103546]: DEBUG nova.compute.manager [req-5ffd5632-0d5f-46f1-895d-3fa9e3458078 req-34046d0d-1ef4-4cc3-9247-2a03d93dc221 service nova] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Refreshing instance network info cache due to event network-changed-5f4e3564-4185-44d2-93f6-2e3803aaf0f8. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 04:03:47 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-5ffd5632-0d5f-46f1-895d-3fa9e3458078 req-34046d0d-1ef4-4cc3-9247-2a03d93dc221 service nova] Acquiring lock "refresh_cache-9a89970b-fc61-4419-8ff9-b48013dccf9f" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:03:47 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-5ffd5632-0d5f-46f1-895d-3fa9e3458078 req-34046d0d-1ef4-4cc3-9247-2a03d93dc221 service nova] Acquired lock "refresh_cache-9a89970b-fc61-4419-8ff9-b48013dccf9f" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:03:47 user nova-compute[103546]: DEBUG nova.network.neutron [req-5ffd5632-0d5f-46f1-895d-3fa9e3458078 req-34046d0d-1ef4-4cc3-9247-2a03d93dc221 service nova] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Refreshing network info cache for port 5f4e3564-4185-44d2-93f6-2e3803aaf0f8 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 04:03:48 user nova-compute[103546]: DEBUG nova.network.neutron [req-5ffd5632-0d5f-46f1-895d-3fa9e3458078 req-34046d0d-1ef4-4cc3-9247-2a03d93dc221 service nova] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Updated VIF entry in instance network info cache for port 5f4e3564-4185-44d2-93f6-2e3803aaf0f8. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 04:03:48 user nova-compute[103546]: DEBUG nova.network.neutron [req-5ffd5632-0d5f-46f1-895d-3fa9e3458078 req-34046d0d-1ef4-4cc3-9247-2a03d93dc221 service nova] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Updating instance_info_cache with network_info: [{"id": "5f4e3564-4185-44d2-93f6-2e3803aaf0f8", "address": "fa:16:3e:56:e2:fb", "network": {"id": "29e9620f-313d-4679-89d7-459e7cf75b38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1690634205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72b30a015db444798ee72ff6fd14c69e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f4e3564-41", "ovs_interfaceid": "5f4e3564-4185-44d2-93f6-2e3803aaf0f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:03:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-5ffd5632-0d5f-46f1-895d-3fa9e3458078 req-34046d0d-1ef4-4cc3-9247-2a03d93dc221 service nova] Releasing lock "refresh_cache-9a89970b-fc61-4419-8ff9-b48013dccf9f" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:03:48 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:49 user nova-compute[103546]: DEBUG nova.compute.manager [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 04:03:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Guest created on hypervisor {{(pid=103546) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 04:03:49 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Instance spawned successfully.
Nov 16 04:03:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 04:03:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Found default for hw_cdrom_bus of ide {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:03:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Found default for hw_disk_bus of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:03:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Found default for hw_input_bus of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:03:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Found default for hw_pointer_model of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:03:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Found default for hw_video_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:03:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Found default for hw_vif_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:03:49 user nova-compute[103546]: INFO nova.compute.manager [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Took 5.83 seconds to spawn the instance on the hypervisor.
Nov 16 04:03:49 user nova-compute[103546]: DEBUG nova.compute.manager [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 04:03:49 user nova-compute[103546]: INFO nova.compute.manager [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Took 7.03 seconds to build instance.
Nov 16 04:03:49 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d6ed2157-5251-4249-9d94-b1f792dc79e0 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "8c02873d-469e-41a4-b492-69f793c8a07c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.156s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:03:49 user nova-compute[103546]: DEBUG nova.compute.manager [req-5d5a9300-7ea2-4b61-9da3-bb64319a9cc5 req-848cad27-da41-4151-a8bd-8c7bedc4e492 service nova] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Received event network-vif-plugged-96edd323-af11-4e10-a7bb-a6e0d0ea12ff {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:03:49 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-5d5a9300-7ea2-4b61-9da3-bb64319a9cc5 req-848cad27-da41-4151-a8bd-8c7bedc4e492 service nova] Acquiring lock "8c02873d-469e-41a4-b492-69f793c8a07c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:03:49 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-5d5a9300-7ea2-4b61-9da3-bb64319a9cc5 req-848cad27-da41-4151-a8bd-8c7bedc4e492 service nova] Lock "8c02873d-469e-41a4-b492-69f793c8a07c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:03:49 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-5d5a9300-7ea2-4b61-9da3-bb64319a9cc5 req-848cad27-da41-4151-a8bd-8c7bedc4e492 service nova] Lock "8c02873d-469e-41a4-b492-69f793c8a07c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:03:49 user nova-compute[103546]: DEBUG nova.compute.manager [req-5d5a9300-7ea2-4b61-9da3-bb64319a9cc5 req-848cad27-da41-4151-a8bd-8c7bedc4e492 service nova] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] No waiting events found dispatching network-vif-plugged-96edd323-af11-4e10-a7bb-a6e0d0ea12ff {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:03:49 user nova-compute[103546]: WARNING nova.compute.manager [req-5d5a9300-7ea2-4b61-9da3-bb64319a9cc5 req-848cad27-da41-4151-a8bd-8c7bedc4e492 service nova] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Received unexpected event network-vif-plugged-96edd323-af11-4e10-a7bb-a6e0d0ea12ff for instance with vm_state active and task_state None.
Nov 16 04:03:50 user nova-compute[103546]: DEBUG nova.compute.manager [req-54305453-729f-4b32-9435-a666bb2ce6a4 req-90ff6e9b-5cd4-4460-bca2-65ee1a61a883 service nova] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Received event network-changed-59aaf9cc-b110-4cb9-aff1-9320d79f55c0 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:03:50 user nova-compute[103546]: DEBUG nova.compute.manager [req-54305453-729f-4b32-9435-a666bb2ce6a4 req-90ff6e9b-5cd4-4460-bca2-65ee1a61a883 service nova] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Refreshing instance network info cache due to event network-changed-59aaf9cc-b110-4cb9-aff1-9320d79f55c0. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 04:03:50 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-54305453-729f-4b32-9435-a666bb2ce6a4 req-90ff6e9b-5cd4-4460-bca2-65ee1a61a883 service nova] Acquiring lock "refresh_cache-26ba7f48-9752-45af-ba68-8c3f70325e21" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:03:50 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-54305453-729f-4b32-9435-a666bb2ce6a4 req-90ff6e9b-5cd4-4460-bca2-65ee1a61a883 service nova] Acquired lock "refresh_cache-26ba7f48-9752-45af-ba68-8c3f70325e21" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:03:50 user nova-compute[103546]: DEBUG nova.network.neutron [req-54305453-729f-4b32-9435-a666bb2ce6a4 req-90ff6e9b-5cd4-4460-bca2-65ee1a61a883 service nova] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Refreshing network info cache for port 59aaf9cc-b110-4cb9-aff1-9320d79f55c0 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 04:03:50 user nova-compute[103546]: DEBUG nova.compute.manager [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Stashing vm_state: active {{(pid=103546) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 16 04:03:50 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:03:50 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:03:50 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=103546) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 04:03:50 user nova-compute[103546]: INFO nova.compute.claims [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Claim successful on node user
Nov 16 04:03:50 user nova-compute[103546]: INFO nova.compute.resource_tracker [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Updating resource usage from migration 34a7d1e3-efee-4564-9eaf-e8028ab5c851
Nov 16 04:03:50 user nova-compute[103546]: DEBUG nova.network.neutron [req-54305453-729f-4b32-9435-a666bb2ce6a4 req-90ff6e9b-5cd4-4460-bca2-65ee1a61a883 service nova] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Updated VIF entry in instance network info cache for port 59aaf9cc-b110-4cb9-aff1-9320d79f55c0. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 04:03:50 user nova-compute[103546]: DEBUG nova.network.neutron [req-54305453-729f-4b32-9435-a666bb2ce6a4 req-90ff6e9b-5cd4-4460-bca2-65ee1a61a883 service nova] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Updating instance_info_cache with network_info: [{"id": "59aaf9cc-b110-4cb9-aff1-9320d79f55c0", "address": "fa:16:3e:46:16:f7", "network": {"id": "29e9620f-313d-4679-89d7-459e7cf75b38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1690634205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72b30a015db444798ee72ff6fd14c69e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59aaf9cc-b1", "ovs_interfaceid": "59aaf9cc-b110-4cb9-aff1-9320d79f55c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:03:50 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-54305453-729f-4b32-9435-a666bb2ce6a4 req-90ff6e9b-5cd4-4460-bca2-65ee1a61a883 service nova] Releasing lock "refresh_cache-26ba7f48-9752-45af-ba68-8c3f70325e21" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:03:50 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:50 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:03:50 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:03:50 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.623s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:03:50 user nova-compute[103546]: INFO nova.compute.manager [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Migrating
Nov 16 04:03:50 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Acquiring lock "refresh_cache-26ba7f48-9752-45af-ba68-8c3f70325e21" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:03:50 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Acquired lock "refresh_cache-26ba7f48-9752-45af-ba68-8c3f70325e21" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:03:50 user nova-compute[103546]: DEBUG nova.network.neutron [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 04:03:51 user nova-compute[103546]: DEBUG nova.network.neutron [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Updating instance_info_cache with network_info: [{"id": "59aaf9cc-b110-4cb9-aff1-9320d79f55c0", "address": "fa:16:3e:46:16:f7", "network": {"id": "29e9620f-313d-4679-89d7-459e7cf75b38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1690634205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72b30a015db444798ee72ff6fd14c69e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59aaf9cc-b1", "ovs_interfaceid": "59aaf9cc-b110-4cb9-aff1-9320d79f55c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:03:51 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Releasing lock "refresh_cache-26ba7f48-9752-45af-ba68-8c3f70325e21" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:03:51 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Starting migrate_disk_and_power_off {{(pid=103546) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 16 04:03:51 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:51 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:51 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:51 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG nova.compute.manager [req-1621f66d-36f3-4352-8e25-807b4ae98980 req-80be16a9-88ac-466c-9e0f-66e9dc94d5f9 service nova] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Received event network-vif-unplugged-59aaf9cc-b110-4cb9-aff1-9320d79f55c0 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-1621f66d-36f3-4352-8e25-807b4ae98980 req-80be16a9-88ac-466c-9e0f-66e9dc94d5f9 service nova] Acquiring lock "26ba7f48-9752-45af-ba68-8c3f70325e21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-1621f66d-36f3-4352-8e25-807b4ae98980 req-80be16a9-88ac-466c-9e0f-66e9dc94d5f9 service nova] Lock "26ba7f48-9752-45af-ba68-8c3f70325e21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-1621f66d-36f3-4352-8e25-807b4ae98980 req-80be16a9-88ac-466c-9e0f-66e9dc94d5f9 service nova] Lock "26ba7f48-9752-45af-ba68-8c3f70325e21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG nova.compute.manager [req-1621f66d-36f3-4352-8e25-807b4ae98980 req-80be16a9-88ac-466c-9e0f-66e9dc94d5f9 service nova] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] No waiting events found dispatching network-vif-unplugged-59aaf9cc-b110-4cb9-aff1-9320d79f55c0 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:03:52 user nova-compute[103546]: WARNING nova.compute.manager [req-1621f66d-36f3-4352-8e25-807b4ae98980 req-80be16a9-88ac-466c-9e0f-66e9dc94d5f9 service nova] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Received unexpected event network-vif-unplugged-59aaf9cc-b110-4cb9-aff1-9320d79f55c0 for instance with vm_state active and task_state resize_migrating.
Nov 16 04:03:52 user nova-compute[103546]: DEBUG nova.compute.manager [req-1621f66d-36f3-4352-8e25-807b4ae98980 req-80be16a9-88ac-466c-9e0f-66e9dc94d5f9 service nova] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Received event network-vif-plugged-59aaf9cc-b110-4cb9-aff1-9320d79f55c0 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-1621f66d-36f3-4352-8e25-807b4ae98980 req-80be16a9-88ac-466c-9e0f-66e9dc94d5f9 service nova] Acquiring lock "26ba7f48-9752-45af-ba68-8c3f70325e21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-1621f66d-36f3-4352-8e25-807b4ae98980 req-80be16a9-88ac-466c-9e0f-66e9dc94d5f9 service nova] Lock "26ba7f48-9752-45af-ba68-8c3f70325e21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-1621f66d-36f3-4352-8e25-807b4ae98980 req-80be16a9-88ac-466c-9e0f-66e9dc94d5f9 service nova] Lock "26ba7f48-9752-45af-ba68-8c3f70325e21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG nova.compute.manager [req-1621f66d-36f3-4352-8e25-807b4ae98980 req-80be16a9-88ac-466c-9e0f-66e9dc94d5f9 service nova] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] No waiting events found dispatching network-vif-plugged-59aaf9cc-b110-4cb9-aff1-9320d79f55c0 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:03:52 user nova-compute[103546]: WARNING nova.compute.manager [req-1621f66d-36f3-4352-8e25-807b4ae98980 req-80be16a9-88ac-466c-9e0f-66e9dc94d5f9 service nova] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Received unexpected event network-vif-plugged-59aaf9cc-b110-4cb9-aff1-9320d79f55c0 for instance with vm_state active and task_state resize_migrating.
Nov 16 04:03:52 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Instance destroyed successfully.
Nov 16 04:03:52 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:01:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1703728033',display_name='tempest-ServerActionsTestOtherA-server-1703728033',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1703728033',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJeuDielSI+1QllPRU8TUZPfRtLhxXlgqD+oFHNsy0a0jxMp9PNqxCpWdXKas+7wQ5fSoPylsuLGE6eRSK8cr/wsGQFy4MbHJizJ+GnVBc6KD3RZeGBoD7tDLXSKWjtJbw==',key_name='tempest-keypair-205381596',keypairs=<?>,launch_index=0,launched_at=2023-11-16T04:02:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='72b30a015db444798ee72ff6fd14c69e',ramdisk_id='',reservation_id='r-ahsozgnl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1488667220',owner_user_name='tempest-ServerActionsTestOtherA-1488667220-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T04:03:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e471c69657c745bbbdfc82307a49946f',uuid=26ba7f48-9752-45af-ba68-8c3f70325e21,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "59aaf9cc-b110-4cb9-aff1-9320d79f55c0", "address": "fa:16:3e:46:16:f7", "network": {"id": "29e9620f-313d-4679-89d7-459e7cf75b38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1690634205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1690634205-network", "vif_mac": "fa:16:3e:46:16:f7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72b30a015db444798ee72ff6fd14c69e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59aaf9cc-b1", "ovs_interfaceid": "59aaf9cc-b110-4cb9-aff1-9320d79f55c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Converting VIF {"id": "59aaf9cc-b110-4cb9-aff1-9320d79f55c0", "address": "fa:16:3e:46:16:f7", "network": {"id": "29e9620f-313d-4679-89d7-459e7cf75b38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1690634205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1690634205-network", "vif_mac": "fa:16:3e:46:16:f7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72b30a015db444798ee72ff6fd14c69e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59aaf9cc-b1", "ovs_interfaceid": "59aaf9cc-b110-4cb9-aff1-9320d79f55c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:16:f7,bridge_name='br-int',has_traffic_filtering=True,id=59aaf9cc-b110-4cb9-aff1-9320d79f55c0,network=Network(29e9620f-313d-4679-89d7-459e7cf75b38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59aaf9cc-b1') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG os_vif [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:16:f7,bridge_name='br-int',has_traffic_filtering=True,id=59aaf9cc-b110-4cb9-aff1-9320d79f55c0,network=Network(29e9620f-313d-4679-89d7-459e7cf75b38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59aaf9cc-b1') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap59aaf9cc-b1, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7b06b8ad-1e0d-4836-b15a-8a0b3127b424) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:52 user nova-compute[103546]: INFO os_vif [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:16:f7,bridge_name='br-int',has_traffic_filtering=True,id=59aaf9cc-b110-4cb9-aff1-9320d79f55c0,network=Network(29e9620f-313d-4679-89d7-459e7cf75b38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59aaf9cc-b1')
Nov 16 04:03:52 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AJewqSDp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:03:52 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:03:52 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5bd4e4d-12a4-48ec-826a-cc1d7f46ea9f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 04:03:52 user nova-compute[103546]: No targets found.
Nov 16 04:03:52 user nova-compute[103546]: iSNS:
Nov 16 04:03:52 user nova-compute[103546]: No targets found.
Nov 16 04:03:52 user nova-compute[103546]: STATIC:
Nov 16 04:03:52 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e
Nov 16 04:03:52 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:03:52 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:03:52 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7
Nov 16 04:03:52 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:03:52 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:03:52 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4
Nov 16 04:03:52 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:03:52 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:03:52 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e
Nov 16 04:03:52 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:03:52 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:03:52 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf
Nov 16 04:03:52 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:03:52 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:03:52 user nova-compute[103546]: FIRMWARE:
Nov 16 04:03:52 user nova-compute[103546]: No targets found.
Nov 16 04:03:52 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 04:03:52 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 04:03:52 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53cda5b-25c1-4e58-9af8-c5ecb8732fb9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[368db1aa-17f6-44fc-a67c-5de0726a9fc4]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:03:52 user nova-compute[103546]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:03:52 user nova-compute[103546]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:03:52 user nova-compute[103546]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)
Nov 16 04:03:52 user nova-compute[103546]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)
Nov 16 04:03:52 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:03:52 user nova-compute[103546]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:03:52 user nova-compute[103546]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:03:52 user nova-compute[103546]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)
Nov 16 04:03:52 user nova-compute[103546]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)
Nov 16 04:03:52 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60c40edea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf'): ({'sdf'}, set())}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Removing single pathed devices sdf {{(pid=103546) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec09cc0-1e19-423b-9d51-ee6f7b5f5b73]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f433b6-d0cd-4d74-9d1d-67665c406df7]: (4, ('ok\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Flushing IO for device /dev/sdf {{(pid=103546) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe40d15-b7ce-40e6-93b4-87cf11a2d543]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=103546) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.051s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d2da47-99e8-4e84-ba1d-a7d351dc5eae]: (4, ('1', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] SCSI volumes sdf have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf')] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25894c1-5688-48c8-94e5-aa7f5ad5694d]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf -p 172.16.0.220:3260 --logout {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[406ff635-1ca9-4a43-9926-11b7d138a3a1]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf, portal: 172.16.0.220,3260]
Nov 16 04:03:52 user nova-compute[103546]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf, portal: 172.16.0.220,3260] successful.
Nov 16 04:03:52 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf -p 172.16.0.220:3260 --op delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4421ab-42e4-4c63-b721-bcc060777ba6]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.376s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] <== disconnect_volume: return (377ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 04:03:52 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] skipping disk /dev/sdf (vda) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 04:03:54 user nova-compute[103546]: DEBUG nova.network.neutron [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Port 59aaf9cc-b110-4cb9-aff1-9320d79f55c0 binding to destination host user is already ACTIVE {{(pid=103546) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 16 04:03:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Acquiring lock "26ba7f48-9752-45af-ba68-8c3f70325e21-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:03:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "26ba7f48-9752-45af-ba68-8c3f70325e21-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:03:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "26ba7f48-9752-45af-ba68-8c3f70325e21-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:03:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Acquiring lock "refresh_cache-26ba7f48-9752-45af-ba68-8c3f70325e21" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:03:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Acquired lock "refresh_cache-26ba7f48-9752-45af-ba68-8c3f70325e21" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:03:54 user nova-compute[103546]: DEBUG nova.network.neutron [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 04:03:54 user nova-compute[103546]: DEBUG nova.network.neutron [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Updating instance_info_cache with network_info: [{"id": "59aaf9cc-b110-4cb9-aff1-9320d79f55c0", "address": "fa:16:3e:46:16:f7", "network": {"id": "29e9620f-313d-4679-89d7-459e7cf75b38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1690634205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72b30a015db444798ee72ff6fd14c69e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59aaf9cc-b1", "ovs_interfaceid": "59aaf9cc-b110-4cb9-aff1-9320d79f55c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:03:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Releasing lock "refresh_cache-26ba7f48-9752-45af-ba68-8c3f70325e21" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:03:55 user nova-compute[103546]: DEBUG os_brick.utils [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:03:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:55 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab8891a-92d2-45db-aaeb-fa864682be4c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af5c39b14ece\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:03:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:55 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13ae6ff-30be-4566-98f2-a43e6a9c02e3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:03:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:03:55 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[47dd3fcc-1c49-41e4-8051-8b38b2b81771]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:03:55 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b3d796-568e-4aec-985b-9f35f2d4fe30]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:03:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Running cmd (subprocess): nvme version {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] 'nvme version' failed. Not Retrying. {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 04:03:55 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] nvme not present on system {{(pid=103546) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 04:03:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:03:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 04:03:55 user nova-compute[103546]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 04:03:55 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e8ae1f-521f-4e0f-8bc0-0685a121e3c3]: (4, '') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:03:55 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=103546) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 04:03:55 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 04:03:55 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] LIGHTOS: no hostnqn found. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 04:03:55 user nova-compute[103546]: DEBUG os_brick.utils [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af5c39b14ece', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:03:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:03:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:04:00 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Starting finish_migration {{(pid=103546) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 16 04:04:00 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Instance directory exists: not creating {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 16 04:04:00 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Creating image(s)
Nov 16 04:04:00 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Did not create local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 04:04:00 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Ensure instance console log exists: /opt/stack/data/nova/instances/26ba7f48-9752-45af-ba68-8c3f70325e21/console.log {{(pid=103546) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 04:04:00 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:04:00 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:04:00 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:04:00 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Start _get_guest_xml network_info=[{"id": "59aaf9cc-b110-4cb9-aff1-9320d79f55c0", "address": "fa:16:3e:46:16:f7", "network": {"id": "29e9620f-313d-4679-89d7-459e7cf75b38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1690634205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1690634205-network", "vif_mac": "fa:16:3e:46:16:f7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72b30a015db444798ee72ff6fd14c69e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59aaf9cc-b1", "ovs_interfaceid": "59aaf9cc-b110-4cb9-aff1-9320d79f55c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AJewqSDp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '26ba7f48-9752-45af-ba68-8c3f70325e21', 'attached_at': '2023-11-16T04:04:01.000000', 'detached_at': '', 'volume_id': '43ccf88b-7590-48b4-acc3-89388b6257bf', 'serial': '43ccf88b-7590-48b4-acc3-89388b6257bf'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': 'd9becf8d-32f2-4b70-becb-9d3f6c51f4d4', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 04:04:00 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:04:00 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:04:00 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 04:04:00 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 04:04:00 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 04:04:00 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 04:04:00 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 04:04:00 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 04:04:00 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 04:04:00 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 04:04:00 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 04:04:00 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 04:04:00 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 04:04:00 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 04:04:00 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 04:04:00 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 04:04:00 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 04:04:00 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 04:04:00 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 04:04:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AJewqSDp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:04:00 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:04:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:04:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:04:00 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:04:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:04:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:04:00 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 04:04:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:01 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:01 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f882c8-9445-4356-ba93-019f53297877]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:01 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 04:04:01 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:04:01 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf -p 172.16.0.220:3260 --interface default --op new {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:01 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:01 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c6885c-5fdf-4ded-a6a5-c24b581a0fe9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf] added\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:01 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf] added
Nov 16 04:04:01 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:04:01 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:01 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.091s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:01 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec49351a-e52b-4378-bed5-98ef021a45d2]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:01 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:04:01 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:01 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:01 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c6f320-c7c7-4811-880f-2ac8ec4b478f]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:01 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:04:01 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AJewqSDp {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:01 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AJewqSDp" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:01 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a1c085-52ac-4d71-8efe-fef6b63cdb98]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:01 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AJewqSDp'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:04:01 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:01 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:01 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b41c3ec-8fff-4aa5-8c22-bb6eb2a85ae2]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:01 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:04:01 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:01 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:01 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a274a28e-4cf1-47a4-bfac-519592ed8baa]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:01 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:04:01 user nova-compute[103546]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:04:01 user nova-compute[103546]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)
Nov 16 04:04:01 user nova-compute[103546]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)
Nov 16 04:04:01 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:04:01 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:04:01 user nova-compute[103546]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:04:01 user nova-compute[103546]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)
Nov 16 04:04:01 user nova-compute[103546]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)
Nov 16 04:04:01 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:04:01 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf -p 172.16.0.220:3260 --login {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:01 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:01 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1a8775-0a01-4528-a542-558a35fab9f1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:01 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf, portal: 172.16.0.220,3260]
Nov 16 04:04:01 user nova-compute[103546]: Login to [iface: default, target: iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf, portal: 172.16.0.220,3260] successful.
Nov 16 04:04:01 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:04:01 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:01 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:01 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0e3bc8-1a85-48ee-be82-4280a1eaad5b]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:01 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:04:01 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:01 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:01 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b9757c-cf7e-4693-a859-742484267a6a]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:01 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:04:01 user nova-compute[103546]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:04:01 user nova-compute[103546]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)
Nov 16 04:04:01 user nova-compute[103546]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)
Nov 16 04:04:01 user nova-compute[103546]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:04:01 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:04:01 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:04:01 user nova-compute[103546]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:04:01 user nova-compute[103546]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)
Nov 16 04:04:01 user nova-compute[103546]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)
Nov 16 04:04:01 user nova-compute[103546]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:04:01 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:04:01 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.403s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:04:01 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 04:04:01 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] HCTL ('37', '-', '-', 0) found on session 45 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 04:04:01 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 04:04:01 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:01 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:01 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c71723-8898-441c-ba23-b586c5f1d23d]: (4, ('- - 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:01 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Searching for a device in session 45 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 04:04:01 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AJewqSDp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 04:04:02 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:04:02 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.446s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:04:02 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] <== connect_volume: return (1448ms) {'type': 'block', 'scsi_wwn': '23234386534346435', 'path': '/dev/sdf'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:04:02 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234386534346435', 'path': '/dev/sdf'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 04:04:02 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:01:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1703728033',display_name='tempest-ServerActionsTestOtherA-server-1703728033',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1703728033',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJeuDielSI+1QllPRU8TUZPfRtLhxXlgqD+oFHNsy0a0jxMp9PNqxCpWdXKas+7wQ5fSoPylsuLGE6eRSK8cr/wsGQFy4MbHJizJ+GnVBc6KD3RZeGBoD7tDLXSKWjtJbw==',key_name='tempest-keypair-205381596',keypairs=<?>,launch_index=0,launched_at=2023-11-16T04:02:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='72b30a015db444798ee72ff6fd14c69e',ramdisk_id='',reservation_id='r-ahsozgnl',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1488667220',owner_user_name='tempest-ServerActionsTestOtherA-1488667220-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T04:03:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e471c69657c745bbbdfc82307a49946f',uuid=26ba7f48-9752-45af-ba68-8c3f70325e21,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "59aaf9cc-b110-4cb9-aff1-9320d79f55c0", "address": "fa:16:3e:46:16:f7", "network": {"id": "29e9620f-313d-4679-89d7-459e7cf75b38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1690634205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1690634205-network", "vif_mac": "fa:16:3e:46:16:f7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72b30a015db444798ee72ff6fd14c69e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59aaf9cc-b1", "ovs_interfaceid": "59aaf9cc-b110-4cb9-aff1-9320d79f55c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 04:04:02 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Converting VIF {"id": "59aaf9cc-b110-4cb9-aff1-9320d79f55c0", "address": "fa:16:3e:46:16:f7", "network": {"id": "29e9620f-313d-4679-89d7-459e7cf75b38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1690634205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1690634205-network", "vif_mac": "fa:16:3e:46:16:f7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72b30a015db444798ee72ff6fd14c69e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59aaf9cc-b1", "ovs_interfaceid": "59aaf9cc-b110-4cb9-aff1-9320d79f55c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:04:02 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:16:f7,bridge_name='br-int',has_traffic_filtering=True,id=59aaf9cc-b110-4cb9-aff1-9320d79f55c0,network=Network(29e9620f-313d-4679-89d7-459e7cf75b38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59aaf9cc-b1') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:04:02 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] End _get_guest_xml xml=<domain type="kvm">
Nov 16 04:04:02 user nova-compute[103546]:   <uuid>26ba7f48-9752-45af-ba68-8c3f70325e21</uuid>
Nov 16 04:04:02 user nova-compute[103546]:   <name>instance-00000024</name>
Nov 16 04:04:02 user nova-compute[103546]:   <memory>2097152</memory>
Nov 16 04:04:02 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 04:04:02 user nova-compute[103546]:   <metadata>
Nov 16 04:04:02 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 04:04:02 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 04:04:02 user nova-compute[103546]:       <nova:name>tempest-ServerActionsTestOtherA-server-1703728033</nova:name>
Nov 16 04:04:02 user nova-compute[103546]:       <nova:creationTime>2023-11-16 04:04:00</nova:creationTime>
Nov 16 04:04:02 user nova-compute[103546]:       <nova:flavor name="m1.small">
Nov 16 04:04:02 user nova-compute[103546]:         <nova:memory>2048</nova:memory>
Nov 16 04:04:02 user nova-compute[103546]:         <nova:disk>20</nova:disk>
Nov 16 04:04:02 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 04:04:02 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 04:04:02 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 04:04:02 user nova-compute[103546]:       </nova:flavor>
Nov 16 04:04:02 user nova-compute[103546]:       <nova:owner>
Nov 16 04:04:02 user nova-compute[103546]:         <nova:user uuid="e471c69657c745bbbdfc82307a49946f">tempest-ServerActionsTestOtherA-1488667220-project-member</nova:user>
Nov 16 04:04:02 user nova-compute[103546]:         <nova:project uuid="72b30a015db444798ee72ff6fd14c69e">tempest-ServerActionsTestOtherA-1488667220</nova:project>
Nov 16 04:04:02 user nova-compute[103546]:       </nova:owner>
Nov 16 04:04:02 user nova-compute[103546]:       <nova:ports>
Nov 16 04:04:02 user nova-compute[103546]:         <nova:port uuid="59aaf9cc-b110-4cb9-aff1-9320d79f55c0">
Nov 16 04:04:02 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 16 04:04:02 user nova-compute[103546]:         </nova:port>
Nov 16 04:04:02 user nova-compute[103546]:       </nova:ports>
Nov 16 04:04:02 user nova-compute[103546]:     </nova:instance>
Nov 16 04:04:02 user nova-compute[103546]:   </metadata>
Nov 16 04:04:02 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 04:04:02 user nova-compute[103546]:     <system>
Nov 16 04:04:02 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 04:04:02 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 04:04:02 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 04:04:02 user nova-compute[103546]:       <entry name="serial">26ba7f48-9752-45af-ba68-8c3f70325e21</entry>
Nov 16 04:04:02 user nova-compute[103546]:       <entry name="uuid">26ba7f48-9752-45af-ba68-8c3f70325e21</entry>
Nov 16 04:04:02 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 04:04:02 user nova-compute[103546]:     </system>
Nov 16 04:04:02 user nova-compute[103546]:   </sysinfo>
Nov 16 04:04:02 user nova-compute[103546]:   <os>
Nov 16 04:04:02 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 04:04:02 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 04:04:02 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 04:04:02 user nova-compute[103546]:   </os>
Nov 16 04:04:02 user nova-compute[103546]:   <features>
Nov 16 04:04:02 user nova-compute[103546]:     <acpi/>
Nov 16 04:04:02 user nova-compute[103546]:     <apic/>
Nov 16 04:04:02 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 04:04:02 user nova-compute[103546]:   </features>
Nov 16 04:04:02 user nova-compute[103546]:   <clock offset="utc">
Nov 16 04:04:02 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 04:04:02 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 04:04:02 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 04:04:02 user nova-compute[103546]:   </clock>
Nov 16 04:04:02 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 04:04:02 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 04:04:02 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 04:04:02 user nova-compute[103546]:   </cpu>
Nov 16 04:04:02 user nova-compute[103546]:   <devices>
Nov 16 04:04:02 user nova-compute[103546]:     <disk type="block" device="disk">
Nov 16 04:04:02 user nova-compute[103546]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:04:02 user nova-compute[103546]:       <source dev="/dev/sdf"/>
Nov 16 04:04:02 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 04:04:02 user nova-compute[103546]:       <serial>43ccf88b-7590-48b4-acc3-89388b6257bf</serial>
Nov 16 04:04:02 user nova-compute[103546]:     </disk>
Nov 16 04:04:02 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 04:04:02 user nova-compute[103546]:       <mac address="fa:16:3e:46:16:f7"/>
Nov 16 04:04:02 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 04:04:02 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 04:04:02 user nova-compute[103546]:       <target dev="tap59aaf9cc-b1"/>
Nov 16 04:04:02 user nova-compute[103546]:     </interface>
Nov 16 04:04:02 user nova-compute[103546]:     <serial type="pty">
Nov 16 04:04:02 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/26ba7f48-9752-45af-ba68-8c3f70325e21/console.log" append="off"/>
Nov 16 04:04:02 user nova-compute[103546]:     </serial>
Nov 16 04:04:02 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 04:04:02 user nova-compute[103546]:     <video>
Nov 16 04:04:02 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 04:04:02 user nova-compute[103546]:     </video>
Nov 16 04:04:02 user nova-compute[103546]:     <rng model="virtio">
Nov 16 04:04:02 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 04:04:02 user nova-compute[103546]:     </rng>
Nov 16 04:04:02 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 04:04:02 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 04:04:02 user nova-compute[103546]:       <stats period="10"/>
Nov 16 04:04:02 user nova-compute[103546]:     </memballoon>
Nov 16 04:04:02 user nova-compute[103546]:   </devices>
Nov 16 04:04:02 user nova-compute[103546]: </domain>
Nov 16 04:04:02 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 04:04:02 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:01:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1703728033',display_name='tempest-ServerActionsTestOtherA-server-1703728033',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1703728033',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJeuDielSI+1QllPRU8TUZPfRtLhxXlgqD+oFHNsy0a0jxMp9PNqxCpWdXKas+7wQ5fSoPylsuLGE6eRSK8cr/wsGQFy4MbHJizJ+GnVBc6KD3RZeGBoD7tDLXSKWjtJbw==',key_name='tempest-keypair-205381596',keypairs=<?>,launch_index=0,launched_at=2023-11-16T04:02:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='72b30a015db444798ee72ff6fd14c69e',ramdisk_id='',reservation_id='r-ahsozgnl',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1488667220',owner_user_name='tempest-ServerActionsTestOtherA-1488667220-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T04:03:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e471c69657c745bbbdfc82307a49946f',uuid=26ba7f48-9752-45af-ba68-8c3f70325e21,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "59aaf9cc-b110-4cb9-aff1-9320d79f55c0", "address": "fa:16:3e:46:16:f7", "network": {"id": "29e9620f-313d-4679-89d7-459e7cf75b38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1690634205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1690634205-network", "vif_mac": "fa:16:3e:46:16:f7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72b30a015db444798ee72ff6fd14c69e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59aaf9cc-b1", "ovs_interfaceid": "59aaf9cc-b110-4cb9-aff1-9320d79f55c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 04:04:02 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Converting VIF {"id": "59aaf9cc-b110-4cb9-aff1-9320d79f55c0", "address": "fa:16:3e:46:16:f7", "network": {"id": "29e9620f-313d-4679-89d7-459e7cf75b38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1690634205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1690634205-network", "vif_mac": "fa:16:3e:46:16:f7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72b30a015db444798ee72ff6fd14c69e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59aaf9cc-b1", "ovs_interfaceid": "59aaf9cc-b110-4cb9-aff1-9320d79f55c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:04:02 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:16:f7,bridge_name='br-int',has_traffic_filtering=True,id=59aaf9cc-b110-4cb9-aff1-9320d79f55c0,network=Network(29e9620f-313d-4679-89d7-459e7cf75b38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59aaf9cc-b1') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:04:02 user nova-compute[103546]: DEBUG os_vif [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:16:f7,bridge_name='br-int',has_traffic_filtering=True,id=59aaf9cc-b110-4cb9-aff1-9320d79f55c0,network=Network(29e9620f-313d-4679-89d7-459e7cf75b38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59aaf9cc-b1') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 04:04:02 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:04:02 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:04:02 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 04:04:02 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:04:02 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6b1aeec2-eb84-537d-9cf1-2432bd1b7f53', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:04:02 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:04:02 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:04:02 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap59aaf9cc-b1, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:04:02 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap59aaf9cc-b1, col_values=(('qos', UUID('4b694dee-b932-4ed3-8650-d9d91b1036c7')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:04:02 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap59aaf9cc-b1, col_values=(('external_ids', {'iface-id': '59aaf9cc-b110-4cb9-aff1-9320d79f55c0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:16:f7', 'vm-uuid': '26ba7f48-9752-45af-ba68-8c3f70325e21'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:04:02 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:04:02 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:04:02 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:04:02 user nova-compute[103546]: INFO os_vif [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:16:f7,bridge_name='br-int',has_traffic_filtering=True,id=59aaf9cc-b110-4cb9-aff1-9320d79f55c0,network=Network(29e9620f-313d-4679-89d7-459e7cf75b38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59aaf9cc-b1')
Nov 16 04:04:02 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:04:02 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] No VIF found with MAC fa:16:3e:46:16:f7, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 04:04:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:04:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:04:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:04:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:04:04 user nova-compute[103546]: DEBUG nova.compute.manager [req-36789694-354a-4cc1-b6ea-aeef8b72c0b9 req-19cd2fbf-59a8-41b5-8c32-619b27c2f41d service nova] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Received event network-vif-plugged-59aaf9cc-b110-4cb9-aff1-9320d79f55c0 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:04:04 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-36789694-354a-4cc1-b6ea-aeef8b72c0b9 req-19cd2fbf-59a8-41b5-8c32-619b27c2f41d service nova] Acquiring lock "26ba7f48-9752-45af-ba68-8c3f70325e21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:04:04 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-36789694-354a-4cc1-b6ea-aeef8b72c0b9 req-19cd2fbf-59a8-41b5-8c32-619b27c2f41d service nova] Lock "26ba7f48-9752-45af-ba68-8c3f70325e21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:04:04 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-36789694-354a-4cc1-b6ea-aeef8b72c0b9 req-19cd2fbf-59a8-41b5-8c32-619b27c2f41d service nova] Lock "26ba7f48-9752-45af-ba68-8c3f70325e21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:04:04 user nova-compute[103546]: DEBUG nova.compute.manager [req-36789694-354a-4cc1-b6ea-aeef8b72c0b9 req-19cd2fbf-59a8-41b5-8c32-619b27c2f41d service nova] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] No waiting events found dispatching network-vif-plugged-59aaf9cc-b110-4cb9-aff1-9320d79f55c0 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:04:04 user nova-compute[103546]: WARNING nova.compute.manager [req-36789694-354a-4cc1-b6ea-aeef8b72c0b9 req-19cd2fbf-59a8-41b5-8c32-619b27c2f41d service nova] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Received unexpected event network-vif-plugged-59aaf9cc-b110-4cb9-aff1-9320d79f55c0 for instance with vm_state active and task_state resize_finish.
Nov 16 04:04:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:04:04 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4d098d75-9e3a-4bf7-9e97-e0a21d20b3d5 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Acquiring lock "fa33f516-2ec7-4a83-ace8-f144e80d9473" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:04:04 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4d098d75-9e3a-4bf7-9e97-e0a21d20b3d5 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "fa33f516-2ec7-4a83-ace8-f144e80d9473" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:04:04 user nova-compute[103546]: DEBUG nova.objects.instance [None req-4d098d75-9e3a-4bf7-9e97-e0a21d20b3d5 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lazy-loading 'flavor' on Instance uuid fa33f516-2ec7-4a83-ace8-f144e80d9473 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:04:04 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4d098d75-9e3a-4bf7-9e97-e0a21d20b3d5 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "fa33f516-2ec7-4a83-ace8-f144e80d9473" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.087s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:04:04 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4d098d75-9e3a-4bf7-9e97-e0a21d20b3d5 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Acquiring lock "fa33f516-2ec7-4a83-ace8-f144e80d9473" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:04:04 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4d098d75-9e3a-4bf7-9e97-e0a21d20b3d5 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "fa33f516-2ec7-4a83-ace8-f144e80d9473" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:04:04 user nova-compute[103546]: INFO nova.compute.manager [None req-4d098d75-9e3a-4bf7-9e97-e0a21d20b3d5 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Attaching volume 9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 to /dev/vdb
Nov 16 04:04:05 user nova-compute[103546]: DEBUG os_brick.utils [None req-4d098d75-9e3a-4bf7-9e97-e0a21d20b3d5 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:04:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:05 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9fba9b-9379-4de3-96cd-9117a9a7ed49]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af5c39b14ece\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:05 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[419cfa86-1f36-44a7-a98b-cdb2037c4503]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:05 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[535813ff-397f-4400-a48c-ee47bf1e7919]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:05 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[743fcfbc-10d2-4d92-afe0-2d1581168426]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-4d098d75-9e3a-4bf7-9e97-e0a21d20b3d5 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Running cmd (subprocess): nvme version {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-4d098d75-9e3a-4bf7-9e97-e0a21d20b3d5 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] 'nvme version' failed. Not Retrying. {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 04:04:05 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4d098d75-9e3a-4bf7-9e97-e0a21d20b3d5 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] nvme not present on system {{(pid=103546) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 04:04:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 04:04:05 user nova-compute[103546]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 04:04:05 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cbcabd3-c60b-40f2-9551-8c2e93f1b503]: (4, '') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:05 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-4d098d75-9e3a-4bf7-9e97-e0a21d20b3d5 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=103546) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 04:04:05 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-4d098d75-9e3a-4bf7-9e97-e0a21d20b3d5 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 04:04:05 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-4d098d75-9e3a-4bf7-9e97-e0a21d20b3d5 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] LIGHTOS: no hostnqn found. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 04:04:05 user nova-compute[103546]: DEBUG os_brick.utils [None req-4d098d75-9e3a-4bf7-9e97-e0a21d20b3d5 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af5c39b14ece', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:04:05 user nova-compute[103546]: DEBUG nova.virt.block_device [None req-4d098d75-9e3a-4bf7-9e97-e0a21d20b3d5 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Updating existing volume attachment record: 2f3dd649-bc97-4ed4-b64c-21493d562322 {{(pid=103546) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 04:04:06 user nova-compute[103546]: DEBUG nova.compute.manager [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 04:04:06 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Instance running successfully.
Nov 16 04:04:06 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Failed to set time: agent not configured {{(pid=103546) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 16 04:04:06 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-6aa0e05f-6e33-41f4-aff2-c1d862db5bcc tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] finish_migration finished successfully. {{(pid=103546) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 16 04:04:06 user nova-compute[103546]: DEBUG nova.compute.manager [req-5d622b71-87f9-4334-8bbc-727e3f8853ec req-3274a5ce-73d3-4b33-9b43-996096a273af service nova] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Received event network-vif-plugged-59aaf9cc-b110-4cb9-aff1-9320d79f55c0 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:04:06 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-5d622b71-87f9-4334-8bbc-727e3f8853ec req-3274a5ce-73d3-4b33-9b43-996096a273af service nova] Acquiring lock "26ba7f48-9752-45af-ba68-8c3f70325e21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:04:06 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-5d622b71-87f9-4334-8bbc-727e3f8853ec req-3274a5ce-73d3-4b33-9b43-996096a273af service nova] Lock "26ba7f48-9752-45af-ba68-8c3f70325e21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:04:06 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-5d622b71-87f9-4334-8bbc-727e3f8853ec req-3274a5ce-73d3-4b33-9b43-996096a273af service nova] Lock "26ba7f48-9752-45af-ba68-8c3f70325e21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:04:06 user nova-compute[103546]: DEBUG nova.compute.manager [req-5d622b71-87f9-4334-8bbc-727e3f8853ec req-3274a5ce-73d3-4b33-9b43-996096a273af service nova] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] No waiting events found dispatching network-vif-plugged-59aaf9cc-b110-4cb9-aff1-9320d79f55c0 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:04:06 user nova-compute[103546]: WARNING nova.compute.manager [req-5d622b71-87f9-4334-8bbc-727e3f8853ec req-3274a5ce-73d3-4b33-9b43-996096a273af service nova] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Received unexpected event network-vif-plugged-59aaf9cc-b110-4cb9-aff1-9320d79f55c0 for instance with vm_state active and task_state resize_finish.
Nov 16 04:04:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:04:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:04:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d098d75-9e3a-4bf7-9e97-e0a21d20b3d5 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 04:04:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d098d75-9e3a-4bf7-9e97-e0a21d20b3d5 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MGChUBIZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:04:10 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-4d098d75-9e3a-4bf7-9e97-e0a21d20b3d5 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:04:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-4d098d75-9e3a-4bf7-9e97-e0a21d20b3d5 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:04:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-4d098d75-9e3a-4bf7-9e97-e0a21d20b3d5 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:04:10 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-4d098d75-9e3a-4bf7-9e97-e0a21d20b3d5 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:04:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-4d098d75-9e3a-4bf7-9e97-e0a21d20b3d5 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:04:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-4d098d75-9e3a-4bf7-9e97-e0a21d20b3d5 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:04:10 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-4d098d75-9e3a-4bf7-9e97-e0a21d20b3d5 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 04:04:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:10 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5c92ec-6b10-4978-b11c-aed91f981ec8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d098d75-9e3a-4bf7-9e97-e0a21d20b3d5 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 04:04:10 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:04:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 -p 172.16.0.220:3260 --interface default --op new {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:10 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf39843-e5f4-4a6a-81f0-73bd623fe304]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67] added\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d098d75-9e3a-4bf7-9e97-e0a21d20b3d5 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67] added
Nov 16 04:04:10 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:04:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:10 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[47bb1c4b-668a-4688-a814-0fbfefcf1d66]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d098d75-9e3a-4bf7-9e97-e0a21d20b3d5 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:04:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:10 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[81da872b-bd35-42d1-b053-a269ec932e1a]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d098d75-9e3a-4bf7-9e97-e0a21d20b3d5 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:04:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MGChUBIZ {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MGChUBIZ" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:10 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5148bfb2-f4ca-4620-b664-dd5b72f9e39b]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d098d75-9e3a-4bf7-9e97-e0a21d20b3d5 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MGChUBIZ'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:04:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:10 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a47e550-a751-4a9f-a8e6-98a37056f268]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d098d75-9e3a-4bf7-9e97-e0a21d20b3d5 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:04:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:10 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a24b3d-faf1-4e13-9656-6fd20799c2d8]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d098d75-9e3a-4bf7-9e97-e0a21d20b3d5 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:04:10 user nova-compute[103546]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:04:10 user nova-compute[103546]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)
Nov 16 04:04:10 user nova-compute[103546]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)
Nov 16 04:04:10 user nova-compute[103546]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:04:10 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:04:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d098d75-9e3a-4bf7-9e97-e0a21d20b3d5 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:04:10 user nova-compute[103546]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:04:10 user nova-compute[103546]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)
Nov 16 04:04:10 user nova-compute[103546]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)
Nov 16 04:04:10 user nova-compute[103546]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:04:10 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:04:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 -p 172.16.0.220:3260 --login {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:10 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[29bdf445-85a9-4cb1-9f10-2d933e4c2699]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d098d75-9e3a-4bf7-9e97-e0a21d20b3d5 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67, portal: 172.16.0.220,3260]
Nov 16 04:04:10 user nova-compute[103546]: Login to [iface: default, target: iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67, portal: 172.16.0.220,3260] successful.
Nov 16 04:04:10 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:04:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:10 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1d3380-2f7b-49f1-8fb2-7a0c319bfa75]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d098d75-9e3a-4bf7-9e97-e0a21d20b3d5 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:04:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:10 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[6035a400-3a2f-4438-970c-5cc8fe1f392d]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d098d75-9e3a-4bf7-9e97-e0a21d20b3d5 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:04:10 user nova-compute[103546]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:04:10 user nova-compute[103546]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)
Nov 16 04:04:10 user nova-compute[103546]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)
Nov 16 04:04:10 user nova-compute[103546]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:04:10 user nova-compute[103546]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 (non-flash)
Nov 16 04:04:10 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:04:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d098d75-9e3a-4bf7-9e97-e0a21d20b3d5 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:04:10 user nova-compute[103546]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:04:10 user nova-compute[103546]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)
Nov 16 04:04:10 user nova-compute[103546]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)
Nov 16 04:04:10 user nova-compute[103546]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:04:10 user nova-compute[103546]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 (non-flash)
Nov 16 04:04:10 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:04:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-4d098d75-9e3a-4bf7-9e97-e0a21d20b3d5 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:04:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d098d75-9e3a-4bf7-9e97-e0a21d20b3d5 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 04:04:10 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-4d098d75-9e3a-4bf7-9e97-e0a21d20b3d5 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] HCTL ('38', '-', '-', 0) found on session 46 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 04:04:10 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-4d098d75-9e3a-4bf7-9e97-e0a21d20b3d5 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 04:04:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:10 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef861b80-738f-4052-99aa-07837e9fd953]: (4, ('- - 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:10 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-4d098d75-9e3a-4bf7-9e97-e0a21d20b3d5 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Searching for a device in session 46 and hctl ['38', '*', '*', 0] yield: None {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 04:04:11 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-4d098d75-9e3a-4bf7-9e97-e0a21d20b3d5 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Searching for a device in session 46 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 04:04:11 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d098d75-9e3a-4bf7-9e97-e0a21d20b3d5 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MGChUBIZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 04:04:11 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-4d098d75-9e3a-4bf7-9e97-e0a21d20b3d5 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:04:11 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d098d75-9e3a-4bf7-9e97-e0a21d20b3d5 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '26336323834633538', 'path': '/dev/sdg'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:04:11 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d098d75-9e3a-4bf7-9e97-e0a21d20b3d5 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26336323834633538', 'path': '/dev/sdg'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 04:04:11 user nova-compute[103546]: DEBUG nova.objects.instance [None req-4d098d75-9e3a-4bf7-9e97-e0a21d20b3d5 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lazy-loading 'flavor' on Instance uuid fa33f516-2ec7-4a83-ace8-f144e80d9473 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:04:11 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-4d098d75-9e3a-4bf7-9e97-e0a21d20b3d5 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 04:04:11 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:04:11 user nova-compute[103546]:   <source dev="/dev/sdg"/>
Nov 16 04:04:11 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 04:04:11 user nova-compute[103546]:   <serial>9afdea37-b4cf-49d2-b3a4-81bcbc9adb67</serial>
Nov 16 04:04:11 user nova-compute[103546]: </disk>
Nov 16 04:04:11 user nova-compute[103546]:  {{(pid=103546) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 04:04:12 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-4d098d75-9e3a-4bf7-9e97-e0a21d20b3d5 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:04:12 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-4d098d75-9e3a-4bf7-9e97-e0a21d20b3d5 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] No BDM found with device name vdb, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:04:12 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-4d098d75-9e3a-4bf7-9e97-e0a21d20b3d5 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] No VIF found with MAC fa:16:3e:84:89:24, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 04:04:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4d098d75-9e3a-4bf7-9e97-e0a21d20b3d5 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "fa33f516-2ec7-4a83-ace8-f144e80d9473" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.360s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:04:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:04:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:04:16 user nova-compute[103546]: DEBUG nova.compute.manager [req-92449917-650f-4637-bdef-4e8c3ade2f7a req-849103a2-780e-4b25-903b-d292f3a66039 service nova] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Received event network-changed-bd7cede4-510c-488f-bf84-773a345198d7 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:04:16 user nova-compute[103546]: DEBUG nova.compute.manager [req-92449917-650f-4637-bdef-4e8c3ade2f7a req-849103a2-780e-4b25-903b-d292f3a66039 service nova] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Refreshing instance network info cache due to event network-changed-bd7cede4-510c-488f-bf84-773a345198d7. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 04:04:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-92449917-650f-4637-bdef-4e8c3ade2f7a req-849103a2-780e-4b25-903b-d292f3a66039 service nova] Acquiring lock "refresh_cache-fa33f516-2ec7-4a83-ace8-f144e80d9473" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:04:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-92449917-650f-4637-bdef-4e8c3ade2f7a req-849103a2-780e-4b25-903b-d292f3a66039 service nova] Acquired lock "refresh_cache-fa33f516-2ec7-4a83-ace8-f144e80d9473" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:04:16 user nova-compute[103546]: DEBUG nova.network.neutron [req-92449917-650f-4637-bdef-4e8c3ade2f7a req-849103a2-780e-4b25-903b-d292f3a66039 service nova] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Refreshing network info cache for port bd7cede4-510c-488f-bf84-773a345198d7 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 04:04:17 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:04:17 user nova-compute[103546]: DEBUG nova.network.neutron [req-92449917-650f-4637-bdef-4e8c3ade2f7a req-849103a2-780e-4b25-903b-d292f3a66039 service nova] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Updated VIF entry in instance network info cache for port bd7cede4-510c-488f-bf84-773a345198d7. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 04:04:17 user nova-compute[103546]: DEBUG nova.network.neutron [req-92449917-650f-4637-bdef-4e8c3ade2f7a req-849103a2-780e-4b25-903b-d292f3a66039 service nova] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Updating instance_info_cache with network_info: [{"id": "bd7cede4-510c-488f-bf84-773a345198d7", "address": "fa:16:3e:84:89:24", "network": {"id": "d942264a-f03e-49a2-89eb-103a12c99518", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484356505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edb839c76c0d4513b9be0ec92301707f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd7cede4-51", "ovs_interfaceid": "bd7cede4-510c-488f-bf84-773a345198d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:04:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-92449917-650f-4637-bdef-4e8c3ade2f7a req-849103a2-780e-4b25-903b-d292f3a66039 service nova] Releasing lock "refresh_cache-fa33f516-2ec7-4a83-ace8-f144e80d9473" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:04:18 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:04:19 user nova-compute[103546]: DEBUG nova.compute.manager [req-ea0e6926-74e9-4cbe-9164-6f3f841fc722 req-e40748f2-50e1-4c06-8900-bc797e579c9f service nova] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Received event network-changed-bd7cede4-510c-488f-bf84-773a345198d7 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:04:19 user nova-compute[103546]: DEBUG nova.compute.manager [req-ea0e6926-74e9-4cbe-9164-6f3f841fc722 req-e40748f2-50e1-4c06-8900-bc797e579c9f service nova] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Refreshing instance network info cache due to event network-changed-bd7cede4-510c-488f-bf84-773a345198d7. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 04:04:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ea0e6926-74e9-4cbe-9164-6f3f841fc722 req-e40748f2-50e1-4c06-8900-bc797e579c9f service nova] Acquiring lock "refresh_cache-fa33f516-2ec7-4a83-ace8-f144e80d9473" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:04:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ea0e6926-74e9-4cbe-9164-6f3f841fc722 req-e40748f2-50e1-4c06-8900-bc797e579c9f service nova] Acquired lock "refresh_cache-fa33f516-2ec7-4a83-ace8-f144e80d9473" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:04:19 user nova-compute[103546]: DEBUG nova.network.neutron [req-ea0e6926-74e9-4cbe-9164-6f3f841fc722 req-e40748f2-50e1-4c06-8900-bc797e579c9f service nova] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Refreshing network info cache for port bd7cede4-510c-488f-bf84-773a345198d7 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 04:04:19 user nova-compute[103546]: DEBUG nova.network.neutron [req-ea0e6926-74e9-4cbe-9164-6f3f841fc722 req-e40748f2-50e1-4c06-8900-bc797e579c9f service nova] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Updated VIF entry in instance network info cache for port bd7cede4-510c-488f-bf84-773a345198d7. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 04:04:19 user nova-compute[103546]: DEBUG nova.network.neutron [req-ea0e6926-74e9-4cbe-9164-6f3f841fc722 req-e40748f2-50e1-4c06-8900-bc797e579c9f service nova] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Updating instance_info_cache with network_info: [{"id": "bd7cede4-510c-488f-bf84-773a345198d7", "address": "fa:16:3e:84:89:24", "network": {"id": "d942264a-f03e-49a2-89eb-103a12c99518", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484356505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edb839c76c0d4513b9be0ec92301707f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd7cede4-51", "ovs_interfaceid": "bd7cede4-510c-488f-bf84-773a345198d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:04:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ea0e6926-74e9-4cbe-9164-6f3f841fc722 req-e40748f2-50e1-4c06-8900-bc797e579c9f service nova] Releasing lock "refresh_cache-fa33f516-2ec7-4a83-ace8-f144e80d9473" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:04:22 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Acquiring lock "fa33f516-2ec7-4a83-ace8-f144e80d9473" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:04:22 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "fa33f516-2ec7-4a83-ace8-f144e80d9473" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:04:22 user nova-compute[103546]: INFO nova.compute.manager [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Rebooting instance
Nov 16 04:04:22 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Acquiring lock "refresh_cache-fa33f516-2ec7-4a83-ace8-f144e80d9473" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:04:22 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Acquired lock "refresh_cache-fa33f516-2ec7-4a83-ace8-f144e80d9473" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:04:22 user nova-compute[103546]: DEBUG nova.network.neutron [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 04:04:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:04:22 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:04:22 user nova-compute[103546]: DEBUG nova.network.neutron [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Updating instance_info_cache with network_info: [{"id": "bd7cede4-510c-488f-bf84-773a345198d7", "address": "fa:16:3e:84:89:24", "network": {"id": "d942264a-f03e-49a2-89eb-103a12c99518", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484356505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edb839c76c0d4513b9be0ec92301707f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd7cede4-51", "ovs_interfaceid": "bd7cede4-510c-488f-bf84-773a345198d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:04:22 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Releasing lock "refresh_cache-fa33f516-2ec7-4a83-ace8-f144e80d9473" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:04:22 user nova-compute[103546]: DEBUG nova.compute.manager [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 04:04:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:04:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:04:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:04:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:04:23 user nova-compute[103546]: DEBUG nova.compute.manager [req-7c02b356-d730-406a-a4a8-bbe2b70c5a44 req-a6b568cb-2d80-4fdb-9796-cf01f342aee6 service nova] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Received event network-vif-unplugged-bd7cede4-510c-488f-bf84-773a345198d7 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:04:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-7c02b356-d730-406a-a4a8-bbe2b70c5a44 req-a6b568cb-2d80-4fdb-9796-cf01f342aee6 service nova] Acquiring lock "fa33f516-2ec7-4a83-ace8-f144e80d9473-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:04:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-7c02b356-d730-406a-a4a8-bbe2b70c5a44 req-a6b568cb-2d80-4fdb-9796-cf01f342aee6 service nova] Lock "fa33f516-2ec7-4a83-ace8-f144e80d9473-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:04:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-7c02b356-d730-406a-a4a8-bbe2b70c5a44 req-a6b568cb-2d80-4fdb-9796-cf01f342aee6 service nova] Lock "fa33f516-2ec7-4a83-ace8-f144e80d9473-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:04:23 user nova-compute[103546]: DEBUG nova.compute.manager [req-7c02b356-d730-406a-a4a8-bbe2b70c5a44 req-a6b568cb-2d80-4fdb-9796-cf01f342aee6 service nova] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] No waiting events found dispatching network-vif-unplugged-bd7cede4-510c-488f-bf84-773a345198d7 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:04:23 user nova-compute[103546]: WARNING nova.compute.manager [req-7c02b356-d730-406a-a4a8-bbe2b70c5a44 req-a6b568cb-2d80-4fdb-9796-cf01f342aee6 service nova] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Received unexpected event network-vif-unplugged-bd7cede4-510c-488f-bf84-773a345198d7 for instance with vm_state active and task_state reboot_started_hard.
Nov 16 04:04:23 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:04:23 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:04:23 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=103546) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 04:04:23 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Instance destroyed successfully.
Nov 16 04:04:23 user nova-compute[103546]: DEBUG nova.objects.instance [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lazy-loading 'resources' on Instance uuid fa33f516-2ec7-4a83-ace8-f144e80d9473 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:04:23 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:02:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-709249967',display_name='tempest-TestMinimumBasicScenario-server-709249967',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-709249967',id=37,image_ref='86c537ce-7981-4390-941d-9b1ecf30cfa8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD46OWTtqlJgr04x6aVRv8hBUbSMBgUi9Q0DtKBivxbAnC1inBXyd+4fJHja3kf2qBA81MZvidHOGa042g3vmWGdjfDgRFBjel2colKkP05dlXdqCimpq+7wAT58G7LIyg==',key_name='tempest-TestMinimumBasicScenario-923881879',keypairs=<?>,launch_index=0,launched_at=2023-11-16T04:02:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='edb839c76c0d4513b9be0ec92301707f',ramdisk_id='',reservation_id='r-x0v3obzl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='86c537ce-7981-4390-941d-9b1ecf30cfa8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1416270309',owner_user_name='tempest-TestMinimumBasicScenario-1416270309-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T04:04:23Z,user_data=None,user_id='341066fb5ead4ef28e4900c085593814',uuid=fa33f516-2ec7-4a83-ace8-f144e80d9473,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd7cede4-510c-488f-bf84-773a345198d7", "address": "fa:16:3e:84:89:24", "network": {"id": "d942264a-f03e-49a2-89eb-103a12c99518", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484356505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edb839c76c0d4513b9be0ec92301707f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd7cede4-51", "ovs_interfaceid": "bd7cede4-510c-488f-bf84-773a345198d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 04:04:23 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Converting VIF {"id": "bd7cede4-510c-488f-bf84-773a345198d7", "address": "fa:16:3e:84:89:24", "network": {"id": "d942264a-f03e-49a2-89eb-103a12c99518", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484356505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edb839c76c0d4513b9be0ec92301707f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd7cede4-51", "ovs_interfaceid": "bd7cede4-510c-488f-bf84-773a345198d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:04:23 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:84:89:24,bridge_name='br-int',has_traffic_filtering=True,id=bd7cede4-510c-488f-bf84-773a345198d7,network=Network(d942264a-f03e-49a2-89eb-103a12c99518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd7cede4-51') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:04:23 user nova-compute[103546]: DEBUG os_vif [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:89:24,bridge_name='br-int',has_traffic_filtering=True,id=bd7cede4-510c-488f-bf84-773a345198d7,network=Network(d942264a-f03e-49a2-89eb-103a12c99518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd7cede4-51') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 04:04:23 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:04:23 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbd7cede4-51, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:04:23 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:04:23 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:04:23 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:04:23 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cbb6b56b-ef29-4632-a6ea-d7f5faea7809) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:04:23 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:04:23 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:04:23 user nova-compute[103546]: INFO os_vif [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:89:24,bridge_name='br-int',has_traffic_filtering=True,id=bd7cede4-510c-488f-bf84-773a345198d7,network=Network(d942264a-f03e-49a2-89eb-103a12c99518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd7cede4-51')
Nov 16 04:04:23 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 04:04:23 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MGChUBIZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:04:23 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:04:23 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:04:23 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:04:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:23 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[54656a20-843a-4f83-ac51-db360817eda2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:23 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 04:04:23 user nova-compute[103546]: No targets found.
Nov 16 04:04:23 user nova-compute[103546]: iSNS:
Nov 16 04:04:23 user nova-compute[103546]: No targets found.
Nov 16 04:04:23 user nova-compute[103546]: STATIC:
Nov 16 04:04:23 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e
Nov 16 04:04:23 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:04:23 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:04:23 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7
Nov 16 04:04:23 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:04:23 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:04:23 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4
Nov 16 04:04:23 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:04:23 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:04:23 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e
Nov 16 04:04:23 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:04:23 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:04:23 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67
Nov 16 04:04:23 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:04:23 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:04:23 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf
Nov 16 04:04:23 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:04:23 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:04:23 user nova-compute[103546]: FIRMWARE:
Nov 16 04:04:23 user nova-compute[103546]: No targets found.
Nov 16 04:04:23 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:04:23 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 04:04:23 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 04:04:23 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 04:04:23 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 04:04:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:23 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:04:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:23 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[8614dac2-1393-4ca0-a7db-4ce4d414a867]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:23 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86e3b7b-ae19-4ecb-9ab2-543a697a3d50]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:23 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:04:23 user nova-compute[103546]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:04:23 user nova-compute[103546]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)
Nov 16 04:04:23 user nova-compute[103546]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)
Nov 16 04:04:23 user nova-compute[103546]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:04:23 user nova-compute[103546]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 (non-flash)
Nov 16 04:04:23 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:04:23 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:04:23 user nova-compute[103546]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:04:23 user nova-compute[103546]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)
Nov 16 04:04:23 user nova-compute[103546]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)
Nov 16 04:04:23 user nova-compute[103546]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:04:23 user nova-compute[103546]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 (non-flash)
Nov 16 04:04:23 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:04:23 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60c40ec8b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67'): ({'sdg'}, set())}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 04:04:23 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Removing single pathed devices sdg {{(pid=103546) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 04:04:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:23 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[85eb3d68-ecb5-43cf-9572-e26c3288bcfc]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:23 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[91eb89b1-2478-457f-9249-cbca6658b716]: (4, ('ok\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:23 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Flushing IO for device /dev/sdg {{(pid=103546) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 04:04:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:23 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1bde69-dc8b-49df-ad6d-263d8654581e]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:23 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=103546) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 04:04:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.031s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:23 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae98159-26f3-4bd2-8e05-29d9b1c91eac]: (4, ('1', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:23 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 04:04:23 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] SCSI volumes sdg have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 04:04:23 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67')] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 04:04:23 user nova-compute[103546]: DEBUG nova.compute.manager [req-e9befb67-f746-48ab-8cf6-d82103771cd2 req-3f26360f-37aa-4e69-b481-24cd807b700a service nova] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Received event network-changed-32d2afdc-7f04-4be3-b45c-19b2c5deabf4 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:04:23 user nova-compute[103546]: DEBUG nova.compute.manager [req-e9befb67-f746-48ab-8cf6-d82103771cd2 req-3f26360f-37aa-4e69-b481-24cd807b700a service nova] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Refreshing instance network info cache due to event network-changed-32d2afdc-7f04-4be3-b45c-19b2c5deabf4. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 04:04:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-e9befb67-f746-48ab-8cf6-d82103771cd2 req-3f26360f-37aa-4e69-b481-24cd807b700a service nova] Acquiring lock "refresh_cache-d31c22d9-0691-4f24-817b-93b1a57d6ff4" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:04:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-e9befb67-f746-48ab-8cf6-d82103771cd2 req-3f26360f-37aa-4e69-b481-24cd807b700a service nova] Acquired lock "refresh_cache-d31c22d9-0691-4f24-817b-93b1a57d6ff4" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:04:23 user nova-compute[103546]: DEBUG nova.network.neutron [req-e9befb67-f746-48ab-8cf6-d82103771cd2 req-3f26360f-37aa-4e69-b481-24cd807b700a service nova] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Refreshing network info cache for port 32d2afdc-7f04-4be3-b45c-19b2c5deabf4 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 04:04:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd324ea-cbd6-4c0a-998e-793e5e05d29e]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 -p 172.16.0.220:3260 --logout {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[53aeb314-0eee-4279-8888-b4c93358788c]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67, portal: 172.16.0.220,3260]
Nov 16 04:04:24 user nova-compute[103546]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67, portal: 172.16.0.220,3260] successful.
Nov 16 04:04:24 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 -p 172.16.0.220:3260 --op delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d233ea-8f66-4132-ac28-7cc5c0877056]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] <== disconnect_volume: return (328ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Start _get_guest_xml network_info=[{"id": "bd7cede4-510c-488f-bf84-773a345198d7", "address": "fa:16:3e:84:89:24", "network": {"id": "d942264a-f03e-49a2-89eb-103a12c99518", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484356505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edb839c76c0d4513b9be0ec92301707f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd7cede4-51", "ovs_interfaceid": "bd7cede4-510c-488f-bf84-773a345198d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=86c537ce-7981-4390-941d-9b1ecf30cfa8,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '86c537ce-7981-4390-941d-9b1ecf30cfa8'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MGChUBIZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': 'fa33f516-2ec7-4a83-ace8-f144e80d9473', 'attached_at': '', 'detached_at': '', 'volume_id': '9afdea37-b4cf-49d2-b3a4-81bcbc9adb67', 'serial': '9afdea37-b4cf-49d2-b3a4-81bcbc9adb67'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'attachment_id': '2f3dd649-bc97-4ed4-b64c-21493d562322', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 04:04:24 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:04:24 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:04:24 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=86c537ce-7981-4390-941d-9b1ecf30cfa8,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG nova.objects.instance [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lazy-loading 'vcpu_model' on Instance uuid fa33f516-2ec7-4a83-ace8-f144e80d9473 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG nova.objects.base [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Object Instance<fa33f516-2ec7-4a83-ace8-f144e80d9473> lazy-loaded attributes: resources,vcpu_model {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MGChUBIZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:04:24 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:04:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:04:24 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:04:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:04:24 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 04:04:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bdc5ae7-72a9-4a96-b490-9491d67340f3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 04:04:24 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 -p 172.16.0.220:3260 --interface default --op new {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[22234321-2a6b-4c70-a84e-cd1b8825a580]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67] added\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67] added
Nov 16 04:04:24 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[4467ea08-3af0-446a-abb2-b21875a80867]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf7580e-0dbb-4402-a042-253bfc216f19]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MGChUBIZ {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MGChUBIZ" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b78547f-1c2f-4a89-8a5e-2f30d37c01ff]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MGChUBIZ'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea52277b-6bea-4b00-a7e4-d2ae6f919451]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d7e59f-dc16-4e7e-bb5f-5ed989ce17b1]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:04:24 user nova-compute[103546]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:04:24 user nova-compute[103546]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)
Nov 16 04:04:24 user nova-compute[103546]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)
Nov 16 04:04:24 user nova-compute[103546]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:04:24 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:04:24 user nova-compute[103546]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:04:24 user nova-compute[103546]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)
Nov 16 04:04:24 user nova-compute[103546]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)
Nov 16 04:04:24 user nova-compute[103546]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:04:24 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 -p 172.16.0.220:3260 --login {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG nova.network.neutron [req-e9befb67-f746-48ab-8cf6-d82103771cd2 req-3f26360f-37aa-4e69-b481-24cd807b700a service nova] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Updated VIF entry in instance network info cache for port 32d2afdc-7f04-4be3-b45c-19b2c5deabf4. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG nova.network.neutron [req-e9befb67-f746-48ab-8cf6-d82103771cd2 req-3f26360f-37aa-4e69-b481-24cd807b700a service nova] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Updating instance_info_cache with network_info: [{"id": "32d2afdc-7f04-4be3-b45c-19b2c5deabf4", "address": "fa:16:3e:7a:cf:df", "network": {"id": "6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038318316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e30b7ac9515458aa8a6eb1a34cc543a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32d2afdc-7f", "ovs_interfaceid": "32d2afdc-7f04-4be3-b45c-19b2c5deabf4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[387d3061-7bba-4a4b-b6eb-a138fa091a08]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67, portal: 172.16.0.220,3260]
Nov 16 04:04:24 user nova-compute[103546]: Login to [iface: default, target: iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67, portal: 172.16.0.220,3260] successful.
Nov 16 04:04:24 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-e9befb67-f746-48ab-8cf6-d82103771cd2 req-3f26360f-37aa-4e69-b481-24cd807b700a service nova] Releasing lock "refresh_cache-d31c22d9-0691-4f24-817b-93b1a57d6ff4" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[8633cc88-9474-41a6-b09a-6c7099c23dfa]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a56c84-3b80-4ebc-96b0-48f7a3819fff]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:04:24 user nova-compute[103546]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:04:24 user nova-compute[103546]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)
Nov 16 04:04:24 user nova-compute[103546]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)
Nov 16 04:04:24 user nova-compute[103546]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:04:24 user nova-compute[103546]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 (non-flash)
Nov 16 04:04:24 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:04:24 user nova-compute[103546]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:04:24 user nova-compute[103546]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)
Nov 16 04:04:24 user nova-compute[103546]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)
Nov 16 04:04:24 user nova-compute[103546]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:04:24 user nova-compute[103546]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 (non-flash)
Nov 16 04:04:24 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] HCTL ('38', '-', '-', 0) found on session 47 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae5e342-55fb-4506-a502-7d599f82df22]: (4, ('- - 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Searching for a device in session 47 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MGChUBIZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:04:24 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:04:25 user nova-compute[103546]: DEBUG nova.compute.manager [req-108cab32-428e-41a5-a427-dc213701ac6d req-e8e54d36-b344-4f7e-87f0-b84ce39163d9 service nova] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Received event network-vif-plugged-bd7cede4-510c-488f-bf84-773a345198d7 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:04:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-108cab32-428e-41a5-a427-dc213701ac6d req-e8e54d36-b344-4f7e-87f0-b84ce39163d9 service nova] Acquiring lock "fa33f516-2ec7-4a83-ace8-f144e80d9473-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:04:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-108cab32-428e-41a5-a427-dc213701ac6d req-e8e54d36-b344-4f7e-87f0-b84ce39163d9 service nova] Lock "fa33f516-2ec7-4a83-ace8-f144e80d9473-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:04:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-108cab32-428e-41a5-a427-dc213701ac6d req-e8e54d36-b344-4f7e-87f0-b84ce39163d9 service nova] Lock "fa33f516-2ec7-4a83-ace8-f144e80d9473-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:04:25 user nova-compute[103546]: DEBUG nova.compute.manager [req-108cab32-428e-41a5-a427-dc213701ac6d req-e8e54d36-b344-4f7e-87f0-b84ce39163d9 service nova] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] No waiting events found dispatching network-vif-plugged-bd7cede4-510c-488f-bf84-773a345198d7 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:04:25 user nova-compute[103546]: WARNING nova.compute.manager [req-108cab32-428e-41a5-a427-dc213701ac6d req-e8e54d36-b344-4f7e-87f0-b84ce39163d9 service nova] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Received unexpected event network-vif-plugged-bd7cede4-510c-488f-bf84-773a345198d7 for instance with vm_state active and task_state reboot_started_hard.
Nov 16 04:04:25 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:04:25 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '26336323834633538', 'path': '/dev/sdg'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:04:25 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26336323834633538', 'path': '/dev/sdg'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 04:04:25 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:02:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-709249967',display_name='tempest-TestMinimumBasicScenario-server-709249967',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-709249967',id=37,image_ref='86c537ce-7981-4390-941d-9b1ecf30cfa8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD46OWTtqlJgr04x6aVRv8hBUbSMBgUi9Q0DtKBivxbAnC1inBXyd+4fJHja3kf2qBA81MZvidHOGa042g3vmWGdjfDgRFBjel2colKkP05dlXdqCimpq+7wAT58G7LIyg==',key_name='tempest-TestMinimumBasicScenario-923881879',keypairs=<?>,launch_index=0,launched_at=2023-11-16T04:02:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='edb839c76c0d4513b9be0ec92301707f',ramdisk_id='',reservation_id='r-x0v3obzl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='86c537ce-7981-4390-941d-9b1ecf30cfa8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1416270309',owner_user_name='tempest-TestMinimumBasicScenario-1416270309-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T04:04:23Z,user_data=None,user_id='341066fb5ead4ef28e4900c085593814',uuid=fa33f516-2ec7-4a83-ace8-f144e80d9473,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd7cede4-510c-488f-bf84-773a345198d7", "address": "fa:16:3e:84:89:24", "network": {"id": "d942264a-f03e-49a2-89eb-103a12c99518", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484356505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edb839c76c0d4513b9be0ec92301707f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd7cede4-51", "ovs_interfaceid": "bd7cede4-510c-488f-bf84-773a345198d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 04:04:25 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Converting VIF {"id": "bd7cede4-510c-488f-bf84-773a345198d7", "address": "fa:16:3e:84:89:24", "network": {"id": "d942264a-f03e-49a2-89eb-103a12c99518", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484356505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edb839c76c0d4513b9be0ec92301707f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd7cede4-51", "ovs_interfaceid": "bd7cede4-510c-488f-bf84-773a345198d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:04:25 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:84:89:24,bridge_name='br-int',has_traffic_filtering=True,id=bd7cede4-510c-488f-bf84-773a345198d7,network=Network(d942264a-f03e-49a2-89eb-103a12c99518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd7cede4-51') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:04:25 user nova-compute[103546]: DEBUG nova.objects.instance [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lazy-loading 'pci_devices' on Instance uuid fa33f516-2ec7-4a83-ace8-f144e80d9473 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:04:25 user nova-compute[103546]: DEBUG nova.objects.base [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Object Instance<fa33f516-2ec7-4a83-ace8-f144e80d9473> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 04:04:25 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] End _get_guest_xml xml=<domain type="kvm">
Nov 16 04:04:25 user nova-compute[103546]:   <uuid>fa33f516-2ec7-4a83-ace8-f144e80d9473</uuid>
Nov 16 04:04:25 user nova-compute[103546]:   <name>instance-00000025</name>
Nov 16 04:04:25 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 04:04:25 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 04:04:25 user nova-compute[103546]:   <metadata>
Nov 16 04:04:25 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 04:04:25 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 04:04:25 user nova-compute[103546]:       <nova:name>tempest-TestMinimumBasicScenario-server-709249967</nova:name>
Nov 16 04:04:25 user nova-compute[103546]:       <nova:creationTime>2023-11-16 04:04:24</nova:creationTime>
Nov 16 04:04:25 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 04:04:25 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 04:04:25 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 04:04:25 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 04:04:25 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 04:04:25 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 04:04:25 user nova-compute[103546]:       </nova:flavor>
Nov 16 04:04:25 user nova-compute[103546]:       <nova:owner>
Nov 16 04:04:25 user nova-compute[103546]:         <nova:user uuid="341066fb5ead4ef28e4900c085593814">tempest-TestMinimumBasicScenario-1416270309-project-member</nova:user>
Nov 16 04:04:25 user nova-compute[103546]:         <nova:project uuid="edb839c76c0d4513b9be0ec92301707f">tempest-TestMinimumBasicScenario-1416270309</nova:project>
Nov 16 04:04:25 user nova-compute[103546]:       </nova:owner>
Nov 16 04:04:25 user nova-compute[103546]:       <nova:root type="image" uuid="86c537ce-7981-4390-941d-9b1ecf30cfa8"/>
Nov 16 04:04:25 user nova-compute[103546]:       <nova:ports>
Nov 16 04:04:25 user nova-compute[103546]:         <nova:port uuid="bd7cede4-510c-488f-bf84-773a345198d7">
Nov 16 04:04:25 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 16 04:04:25 user nova-compute[103546]:         </nova:port>
Nov 16 04:04:25 user nova-compute[103546]:       </nova:ports>
Nov 16 04:04:25 user nova-compute[103546]:     </nova:instance>
Nov 16 04:04:25 user nova-compute[103546]:   </metadata>
Nov 16 04:04:25 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 04:04:25 user nova-compute[103546]:     <system>
Nov 16 04:04:25 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 04:04:25 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 04:04:25 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 04:04:25 user nova-compute[103546]:       <entry name="serial">fa33f516-2ec7-4a83-ace8-f144e80d9473</entry>
Nov 16 04:04:25 user nova-compute[103546]:       <entry name="uuid">fa33f516-2ec7-4a83-ace8-f144e80d9473</entry>
Nov 16 04:04:25 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 04:04:25 user nova-compute[103546]:     </system>
Nov 16 04:04:25 user nova-compute[103546]:   </sysinfo>
Nov 16 04:04:25 user nova-compute[103546]:   <os>
Nov 16 04:04:25 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 04:04:25 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 04:04:25 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 04:04:25 user nova-compute[103546]:   </os>
Nov 16 04:04:25 user nova-compute[103546]:   <features>
Nov 16 04:04:25 user nova-compute[103546]:     <acpi/>
Nov 16 04:04:25 user nova-compute[103546]:     <apic/>
Nov 16 04:04:25 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 04:04:25 user nova-compute[103546]:   </features>
Nov 16 04:04:25 user nova-compute[103546]:   <clock offset="utc">
Nov 16 04:04:25 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 04:04:25 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 04:04:25 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 04:04:25 user nova-compute[103546]:   </clock>
Nov 16 04:04:25 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 04:04:25 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 04:04:25 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 04:04:25 user nova-compute[103546]:   </cpu>
Nov 16 04:04:25 user nova-compute[103546]:   <devices>
Nov 16 04:04:25 user nova-compute[103546]:     <disk type="file" device="disk">
Nov 16 04:04:25 user nova-compute[103546]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 04:04:25 user nova-compute[103546]:       <source file="/opt/stack/data/nova/instances/fa33f516-2ec7-4a83-ace8-f144e80d9473/disk"/>
Nov 16 04:04:25 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 04:04:25 user nova-compute[103546]:     </disk>
Nov 16 04:04:25 user nova-compute[103546]:     <disk type="block" device="disk">
Nov 16 04:04:25 user nova-compute[103546]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:04:25 user nova-compute[103546]:       <source dev="/dev/sdg"/>
Nov 16 04:04:25 user nova-compute[103546]:       <target dev="vdb" bus="virtio"/>
Nov 16 04:04:25 user nova-compute[103546]:       <serial>9afdea37-b4cf-49d2-b3a4-81bcbc9adb67</serial>
Nov 16 04:04:25 user nova-compute[103546]:     </disk>
Nov 16 04:04:25 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 04:04:25 user nova-compute[103546]:       <mac address="fa:16:3e:84:89:24"/>
Nov 16 04:04:25 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 04:04:25 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 04:04:25 user nova-compute[103546]:       <target dev="tapbd7cede4-51"/>
Nov 16 04:04:25 user nova-compute[103546]:     </interface>
Nov 16 04:04:25 user nova-compute[103546]:     <serial type="pty">
Nov 16 04:04:25 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/fa33f516-2ec7-4a83-ace8-f144e80d9473/console.log" append="off"/>
Nov 16 04:04:25 user nova-compute[103546]:     </serial>
Nov 16 04:04:25 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 04:04:25 user nova-compute[103546]:     <video>
Nov 16 04:04:25 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 04:04:25 user nova-compute[103546]:     </video>
Nov 16 04:04:25 user nova-compute[103546]:     <rng model="virtio">
Nov 16 04:04:25 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 04:04:25 user nova-compute[103546]:     </rng>
Nov 16 04:04:25 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 04:04:25 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 04:04:25 user nova-compute[103546]:       <stats period="10"/>
Nov 16 04:04:25 user nova-compute[103546]:     </memballoon>
Nov 16 04:04:25 user nova-compute[103546]:   </devices>
Nov 16 04:04:25 user nova-compute[103546]: </domain>
Nov 16 04:04:25 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 04:04:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa33f516-2ec7-4a83-ace8-f144e80d9473/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-df2e7ab7-b5d2-4a8d-81c1-24f420d50369 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Acquiring lock "d31c22d9-0691-4f24-817b-93b1a57d6ff4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:04:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-df2e7ab7-b5d2-4a8d-81c1-24f420d50369 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "d31c22d9-0691-4f24-817b-93b1a57d6ff4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:04:25 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:04:25 user nova-compute[103546]: DEBUG nova.objects.instance [None req-df2e7ab7-b5d2-4a8d-81c1-24f420d50369 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lazy-loading 'flavor' on Instance uuid d31c22d9-0691-4f24-817b-93b1a57d6ff4 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:04:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-df2e7ab7-b5d2-4a8d-81c1-24f420d50369 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "d31c22d9-0691-4f24-817b-93b1a57d6ff4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:04:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa33f516-2ec7-4a83-ace8-f144e80d9473/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa33f516-2ec7-4a83-ace8-f144e80d9473/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-df2e7ab7-b5d2-4a8d-81c1-24f420d50369 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Acquiring lock "d31c22d9-0691-4f24-817b-93b1a57d6ff4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:04:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-df2e7ab7-b5d2-4a8d-81c1-24f420d50369 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "d31c22d9-0691-4f24-817b-93b1a57d6ff4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:04:25 user nova-compute[103546]: INFO nova.compute.manager [None req-df2e7ab7-b5d2-4a8d-81c1-24f420d50369 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Attaching volume 1bc7f564-eb78-433b-9ffe-7aeae3546520 to /dev/vdb
Nov 16 04:04:25 user nova-compute[103546]: DEBUG os_brick.utils [None req-df2e7ab7-b5d2-4a8d-81c1-24f420d50369 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:04:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa33f516-2ec7-4a83-ace8-f144e80d9473/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:25 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 04:04:25 user nova-compute[103546]: DEBUG nova.objects.instance [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lazy-loading 'trusted_certs' on Instance uuid fa33f516-2ec7-4a83-ace8-f144e80d9473 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:04:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:25 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4de143-fc0c-405d-aa98-8caae41b0396]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af5c39b14ece\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:25 user nova-compute[103546]: DEBUG nova.objects.base [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Object Instance<fa33f516-2ec7-4a83-ace8-f144e80d9473> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 04:04:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef5aa205bcf7f26d550c1475eac377d08e83f55 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:26 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebaca5b5-1dae-45ff-9f14-501089067e5d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:26 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b8aa32-95c5-4c07-9a9d-b726f40170a2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:26 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f227b5-0e40-4c18-af23-378dd190e0ed]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-df2e7ab7-b5d2-4a8d-81c1-24f420d50369 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Running cmd (subprocess): nvme version {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-df2e7ab7-b5d2-4a8d-81c1-24f420d50369 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] 'nvme version' failed. Not Retrying. {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 04:04:26 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.nvmeof [None req-df2e7ab7-b5d2-4a8d-81c1-24f420d50369 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] nvme not present on system {{(pid=103546) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 04:04:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 04:04:26 user nova-compute[103546]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 04:04:26 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[23986092-7e0a-40b0-b7a5-5eb7b0944def]: (4, '') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:26 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-df2e7ab7-b5d2-4a8d-81c1-24f420d50369 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=103546) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 04:04:26 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-df2e7ab7-b5d2-4a8d-81c1-24f420d50369 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 04:04:26 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-df2e7ab7-b5d2-4a8d-81c1-24f420d50369 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] LIGHTOS: no hostnqn found. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 04:04:26 user nova-compute[103546]: DEBUG os_brick.utils [None req-df2e7ab7-b5d2-4a8d-81c1-24f420d50369 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af5c39b14ece', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:04:26 user nova-compute[103546]: DEBUG nova.virt.block_device [None req-df2e7ab7-b5d2-4a8d-81c1-24f420d50369 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Updating existing volume attachment record: 2223b21f-06e9-4f62-96f0-dc2fe3e507e1 {{(pid=103546) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 04:04:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef5aa205bcf7f26d550c1475eac377d08e83f55 --force-share --output=json" returned: 0 in 0.172s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:26 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fa33f516-2ec7-4a83-ace8-f144e80d9473/disk. size=1073741824 {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 04:04:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa33f516-2ec7-4a83-ace8-f144e80d9473/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa33f516-2ec7-4a83-ace8-f144e80d9473/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:26 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Cannot resize image /opt/stack/data/nova/instances/fa33f516-2ec7-4a83-ace8-f144e80d9473/disk to a smaller size. {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 04:04:26 user nova-compute[103546]: DEBUG nova.objects.instance [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lazy-loading 'migration_context' on Instance uuid fa33f516-2ec7-4a83-ace8-f144e80d9473 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:04:26 user nova-compute[103546]: DEBUG nova.objects.base [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Object Instance<fa33f516-2ec7-4a83-ace8-f144e80d9473> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 04:04:26 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:02:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-709249967',display_name='tempest-TestMinimumBasicScenario-server-709249967',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-709249967',id=37,image_ref='86c537ce-7981-4390-941d-9b1ecf30cfa8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD46OWTtqlJgr04x6aVRv8hBUbSMBgUi9Q0DtKBivxbAnC1inBXyd+4fJHja3kf2qBA81MZvidHOGa042g3vmWGdjfDgRFBjel2colKkP05dlXdqCimpq+7wAT58G7LIyg==',key_name='tempest-TestMinimumBasicScenario-923881879',keypairs=<?>,launch_index=0,launched_at=2023-11-16T04:02:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='edb839c76c0d4513b9be0ec92301707f',ramdisk_id='',reservation_id='r-x0v3obzl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='86c537ce-7981-4390-941d-9b1ecf30cfa8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1416270309',owner_user_name='tempest-TestMinimumBasicScenario-1416270309-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T04:04:23Z,user_data=None,user_id='341066fb5ead4ef28e4900c085593814',uuid=fa33f516-2ec7-4a83-ace8-f144e80d9473,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd7cede4-510c-488f-bf84-773a345198d7", "address": "fa:16:3e:84:89:24", "network": {"id": "d942264a-f03e-49a2-89eb-103a12c99518", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484356505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edb839c76c0d4513b9be0ec92301707f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd7cede4-51", "ovs_interfaceid": "bd7cede4-510c-488f-bf84-773a345198d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 04:04:26 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Converting VIF {"id": "bd7cede4-510c-488f-bf84-773a345198d7", "address": "fa:16:3e:84:89:24", "network": {"id": "d942264a-f03e-49a2-89eb-103a12c99518", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484356505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edb839c76c0d4513b9be0ec92301707f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd7cede4-51", "ovs_interfaceid": "bd7cede4-510c-488f-bf84-773a345198d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:04:26 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:84:89:24,bridge_name='br-int',has_traffic_filtering=True,id=bd7cede4-510c-488f-bf84-773a345198d7,network=Network(d942264a-f03e-49a2-89eb-103a12c99518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd7cede4-51') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:04:26 user nova-compute[103546]: DEBUG os_vif [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:89:24,bridge_name='br-int',has_traffic_filtering=True,id=bd7cede4-510c-488f-bf84-773a345198d7,network=Network(d942264a-f03e-49a2-89eb-103a12c99518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd7cede4-51') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 04:04:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:04:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:04:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 04:04:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:04:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0f7ba833-b71f-5fca-a0d9-db8d07b3243a', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:04:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:04:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:04:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:04:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbd7cede4-51, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:04:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbd7cede4-51, col_values=(('qos', UUID('b6d6f19c-4cc2-4e5a-859c-6718b3f98773')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:04:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbd7cede4-51, col_values=(('external_ids', {'iface-id': 'bd7cede4-510c-488f-bf84-773a345198d7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:89:24', 'vm-uuid': 'fa33f516-2ec7-4a83-ace8-f144e80d9473'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:04:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:04:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:04:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:04:26 user nova-compute[103546]: INFO os_vif [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:89:24,bridge_name='br-int',has_traffic_filtering=True,id=bd7cede4-510c-488f-bf84-773a345198d7,network=Network(d942264a-f03e-49a2-89eb-103a12c99518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd7cede4-51')
Nov 16 04:04:26 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:04:26 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager.update_available_resource {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:04:26 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:04:26 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:04:26 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:04:26 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Auditing locally available compute resources for user (node: user) {{(pid=103546) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 04:04:27 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:04:27 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:04:27 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:04:27 user nova-compute[103546]: DEBUG nova.compute.manager [req-a3b5232d-ef5c-4b1a-a694-306c7325d65a req-c5af006b-922e-4506-bb12-7258f0f444d2 service nova] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Received event network-vif-plugged-bd7cede4-510c-488f-bf84-773a345198d7 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:04:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a3b5232d-ef5c-4b1a-a694-306c7325d65a req-c5af006b-922e-4506-bb12-7258f0f444d2 service nova] Acquiring lock "fa33f516-2ec7-4a83-ace8-f144e80d9473-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:04:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a3b5232d-ef5c-4b1a-a694-306c7325d65a req-c5af006b-922e-4506-bb12-7258f0f444d2 service nova] Lock "fa33f516-2ec7-4a83-ace8-f144e80d9473-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:04:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a3b5232d-ef5c-4b1a-a694-306c7325d65a req-c5af006b-922e-4506-bb12-7258f0f444d2 service nova] Lock "fa33f516-2ec7-4a83-ace8-f144e80d9473-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:04:27 user nova-compute[103546]: DEBUG nova.compute.manager [req-a3b5232d-ef5c-4b1a-a694-306c7325d65a req-c5af006b-922e-4506-bb12-7258f0f444d2 service nova] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] No waiting events found dispatching network-vif-plugged-bd7cede4-510c-488f-bf84-773a345198d7 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:04:27 user nova-compute[103546]: WARNING nova.compute.manager [req-a3b5232d-ef5c-4b1a-a694-306c7325d65a req-c5af006b-922e-4506-bb12-7258f0f444d2 service nova] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Received unexpected event network-vif-plugged-bd7cede4-510c-488f-bf84-773a345198d7 for instance with vm_state active and task_state reboot_started_hard.
Nov 16 04:04:28 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 04:04:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c02873d-469e-41a4-b492-69f793c8a07c/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:28 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:04:28 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:04:28 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:04:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c02873d-469e-41a4-b492-69f793c8a07c/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c02873d-469e-41a4-b492-69f793c8a07c/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c02873d-469e-41a4-b492-69f793c8a07c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:28 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:04:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d31c22d9-0691-4f24-817b-93b1a57d6ff4/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d31c22d9-0691-4f24-817b-93b1a57d6ff4/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d31c22d9-0691-4f24-817b-93b1a57d6ff4/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d31c22d9-0691-4f24-817b-93b1a57d6ff4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f7c407-3373-43ba-ac92-7eb0a43a7093/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f7c407-3373-43ba-ac92-7eb0a43a7093/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f7c407-3373-43ba-ac92-7eb0a43a7093/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f7c407-3373-43ba-ac92-7eb0a43a7093/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:29 user nova-compute[103546]: DEBUG nova.compute.manager [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 04:04:29 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Instance rebooted successfully.
Nov 16 04:04:29 user nova-compute[103546]: DEBUG nova.compute.manager [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 04:04:29 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-ec3d0b54-6ee5-4fa7-bfe1-1a881fd4328a tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "fa33f516-2ec7-4a83-ace8-f144e80d9473" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.714s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:04:29 user nova-compute[103546]: DEBUG nova.compute.manager [req-6679f534-c29b-4bae-8819-0e1cc76a5487 req-b84ade10-3fcd-4a6a-be47-43e447840d0a service nova] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Received event network-vif-plugged-bd7cede4-510c-488f-bf84-773a345198d7 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:04:29 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6679f534-c29b-4bae-8819-0e1cc76a5487 req-b84ade10-3fcd-4a6a-be47-43e447840d0a service nova] Acquiring lock "fa33f516-2ec7-4a83-ace8-f144e80d9473-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:04:29 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6679f534-c29b-4bae-8819-0e1cc76a5487 req-b84ade10-3fcd-4a6a-be47-43e447840d0a service nova] Lock "fa33f516-2ec7-4a83-ace8-f144e80d9473-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:04:29 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6679f534-c29b-4bae-8819-0e1cc76a5487 req-b84ade10-3fcd-4a6a-be47-43e447840d0a service nova] Lock "fa33f516-2ec7-4a83-ace8-f144e80d9473-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:04:29 user nova-compute[103546]: DEBUG nova.compute.manager [req-6679f534-c29b-4bae-8819-0e1cc76a5487 req-b84ade10-3fcd-4a6a-be47-43e447840d0a service nova] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] No waiting events found dispatching network-vif-plugged-bd7cede4-510c-488f-bf84-773a345198d7 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:04:29 user nova-compute[103546]: WARNING nova.compute.manager [req-6679f534-c29b-4bae-8819-0e1cc76a5487 req-b84ade10-3fcd-4a6a-be47-43e447840d0a service nova] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Received unexpected event network-vif-plugged-bd7cede4-510c-488f-bf84-773a345198d7 for instance with vm_state active and task_state None.
Nov 16 04:04:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:30 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 04:04:30 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 04:04:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa33f516-2ec7-4a83-ace8-f144e80d9473/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa33f516-2ec7-4a83-ace8-f144e80d9473/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa33f516-2ec7-4a83-ace8-f144e80d9473/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa33f516-2ec7-4a83-ace8-f144e80d9473/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:31 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 04:04:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:31 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:04:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:31 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 04:04:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.rescue --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:31 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df2e7ab7-b5d2-4a8d-81c1-24f420d50369 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 04:04:31 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-df2e7ab7-b5d2-4a8d-81c1-24f420d50369 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1bc7f564-eb78-433b-9ffe-7aeae3546520', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LdexQRBz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:04:31 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-df2e7ab7-b5d2-4a8d-81c1-24f420d50369 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:04:31 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-df2e7ab7-b5d2-4a8d-81c1-24f420d50369 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:04:31 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-df2e7ab7-b5d2-4a8d-81c1-24f420d50369 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:04:31 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-df2e7ab7-b5d2-4a8d-81c1-24f420d50369 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:04:31 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-df2e7ab7-b5d2-4a8d-81c1-24f420d50369 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1bc7f564-eb78-433b-9ffe-7aeae3546520" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:04:31 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-df2e7ab7-b5d2-4a8d-81c1-24f420d50369 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1bc7f564-eb78-433b-9ffe-7aeae3546520" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:04:31 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-df2e7ab7-b5d2-4a8d-81c1-24f420d50369 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 04:04:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bc7f564-eb78-433b-9ffe-7aeae3546520 -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bc7f564-eb78-433b-9ffe-7aeae3546520 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:31 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9b3ec5-a3db-41cd-98d2-0bd19db8e31e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:31 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-df2e7ab7-b5d2-4a8d-81c1-24f420d50369 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 04:04:31 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:04:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bc7f564-eb78-433b-9ffe-7aeae3546520 -p 172.16.0.220:3260 --interface default --op new {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.rescue --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bc7f564-eb78-433b-9ffe-7aeae3546520 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:31 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0206170-5c2a-4c4d-b9c0-58532885c668]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1bc7f564-eb78-433b-9ffe-7aeae3546520] added\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:31 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-df2e7ab7-b5d2-4a8d-81c1-24f420d50369 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1bc7f564-eb78-433b-9ffe-7aeae3546520] added
Nov 16 04:04:31 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:04:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bc7f564-eb78-433b-9ffe-7aeae3546520 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bc7f564-eb78-433b-9ffe-7aeae3546520 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:32 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9747550-b3d4-446d-b59b-3a33b358a933]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:32 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-df2e7ab7-b5d2-4a8d-81c1-24f420d50369 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:04:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bc7f564-eb78-433b-9ffe-7aeae3546520 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bc7f564-eb78-433b-9ffe-7aeae3546520 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:32 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5810f202-08c2-4343-9826-2c681fcff29f]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:32 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-df2e7ab7-b5d2-4a8d-81c1-24f420d50369 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:04:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bc7f564-eb78-433b-9ffe-7aeae3546520 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LdexQRBz {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bc7f564-eb78-433b-9ffe-7aeae3546520 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LdexQRBz" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:32 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab1f3d6-83f5-4fb7-a9cb-582d70419281]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:32 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-df2e7ab7-b5d2-4a8d-81c1-24f420d50369 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LdexQRBz'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:04:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bc7f564-eb78-433b-9ffe-7aeae3546520 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bc7f564-eb78-433b-9ffe-7aeae3546520 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:32 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e01d48f-3404-4546-a332-182cc7a38183]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:32 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-df2e7ab7-b5d2-4a8d-81c1-24f420d50369 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:04:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:32 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e83f91-3672-4c0d-938a-fc6bf7a88dae]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:32 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-df2e7ab7-b5d2-4a8d-81c1-24f420d50369 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:04:32 user nova-compute[103546]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:04:32 user nova-compute[103546]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)
Nov 16 04:04:32 user nova-compute[103546]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)
Nov 16 04:04:32 user nova-compute[103546]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:04:32 user nova-compute[103546]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 (non-flash)
Nov 16 04:04:32 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:04:32 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-df2e7ab7-b5d2-4a8d-81c1-24f420d50369 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:04:32 user nova-compute[103546]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:04:32 user nova-compute[103546]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)
Nov 16 04:04:32 user nova-compute[103546]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)
Nov 16 04:04:32 user nova-compute[103546]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:04:32 user nova-compute[103546]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 (non-flash)
Nov 16 04:04:32 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:04:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bc7f564-eb78-433b-9ffe-7aeae3546520 -p 172.16.0.220:3260 --login {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bc7f564-eb78-433b-9ffe-7aeae3546520 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:32 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[844a723a-d2cf-441f-9b86-afea35aeef58]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1bc7f564-eb78-433b-9ffe-7aeae3546520, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1bc7f564-eb78-433b-9ffe-7aeae3546520, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:32 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-df2e7ab7-b5d2-4a8d-81c1-24f420d50369 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1bc7f564-eb78-433b-9ffe-7aeae3546520, portal: 172.16.0.220,3260]
Nov 16 04:04:32 user nova-compute[103546]: Login to [iface: default, target: iqn.2010-10.org.openstack:1bc7f564-eb78-433b-9ffe-7aeae3546520, portal: 172.16.0.220,3260] successful.
Nov 16 04:04:32 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:04:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bc7f564-eb78-433b-9ffe-7aeae3546520 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bc7f564-eb78-433b-9ffe-7aeae3546520 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:32 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[39521e6e-8adf-4599-a59c-7f90646c9eec]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:32 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-df2e7ab7-b5d2-4a8d-81c1-24f420d50369 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:04:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:32 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2aec7d-eb37-41b3-9625-1833170f1a7a]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bc7f564-eb78-433b-9ffe-7aeae3546520 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:32 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-df2e7ab7-b5d2-4a8d-81c1-24f420d50369 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:04:32 user nova-compute[103546]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:04:32 user nova-compute[103546]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)
Nov 16 04:04:32 user nova-compute[103546]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)
Nov 16 04:04:32 user nova-compute[103546]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:04:32 user nova-compute[103546]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 (non-flash)
Nov 16 04:04:32 user nova-compute[103546]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bc7f564-eb78-433b-9ffe-7aeae3546520 (non-flash)
Nov 16 04:04:32 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:04:32 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-df2e7ab7-b5d2-4a8d-81c1-24f420d50369 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:04:32 user nova-compute[103546]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:04:32 user nova-compute[103546]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)
Nov 16 04:04:32 user nova-compute[103546]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)
Nov 16 04:04:32 user nova-compute[103546]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:04:32 user nova-compute[103546]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 (non-flash)
Nov 16 04:04:32 user nova-compute[103546]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bc7f564-eb78-433b-9ffe-7aeae3546520 (non-flash)
Nov 16 04:04:32 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:04:32 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-df2e7ab7-b5d2-4a8d-81c1-24f420d50369 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1bc7f564-eb78-433b-9ffe-7aeae3546520" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.385s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:04:32 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-df2e7ab7-b5d2-4a8d-81c1-24f420d50369 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 04:04:32 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-df2e7ab7-b5d2-4a8d-81c1-24f420d50369 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] HCTL ('39', '-', '-', 0) found on session 48 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 04:04:32 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-df2e7ab7-b5d2-4a8d-81c1-24f420d50369 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 04:04:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:32 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f170a42-c8e9-4d46-8b34-71f31c5f12e3]: (4, ('- - 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:32 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-df2e7ab7-b5d2-4a8d-81c1-24f420d50369 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Searching for a device in session 48 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 04:04:32 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-df2e7ab7-b5d2-4a8d-81c1-24f420d50369 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:1bc7f564-eb78-433b-9ffe-7aeae3546520', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LdexQRBz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 04:04:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:32 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 04:04:33 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:04:33 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:04:33 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Hypervisor/Node resource view: name=user free_ram=7275MB free_disk=24.93655014038086GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=103546) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 04:04:33 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:04:33 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:04:33 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Applying migration context for instance 26ba7f48-9752-45af-ba68-8c3f70325e21 as it has an incoming, in-progress migration 34a7d1e3-efee-4564-9eaf-e8028ab5c851. Migration status is finished {{(pid=103546) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 16 04:04:33 user nova-compute[103546]: INFO nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Updating resource usage from migration 34a7d1e3-efee-4564-9eaf-e8028ab5c851
Nov 16 04:04:33 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 9a89970b-fc61-4419-8ff9-b48013dccf9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:04:33 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 04101512-7333-4581-add3-7af3821e335b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:04:33 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance fa7e5468-9dd4-407d-85ec-d45ec76f9e29 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:04:33 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 246ccf69-847c-4ab2-b709-ad1a85e81eab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:04:33 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 8d229d05-95f1-4997-8539-802ac65cff8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:04:33 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance b0a480de-e99b-4b54-bd81-36c216442137 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:04:33 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 38f7c407-3373-43ba-ac92-7eb0a43a7093 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:04:33 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance fa33f516-2ec7-4a83-ace8-f144e80d9473 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:04:33 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance d31c22d9-0691-4f24-817b-93b1a57d6ff4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:04:33 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 9a421bf0-70b6-4a2c-85da-813707619b84 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:04:33 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 271adc7b-bfc6-48c5-8700-69b2b079ce4b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:04:33 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 8c02873d-469e-41a4-b492-69f793c8a07c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:04:33 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Migration 34a7d1e3-efee-4564-9eaf-e8028ab5c851 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 16 04:04:33 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 26ba7f48-9752-45af-ba68-8c3f70325e21 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:04:33 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 04:04:33 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 04:04:33 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-df2e7ab7-b5d2-4a8d-81c1-24f420d50369 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.437s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:04:33 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-df2e7ab7-b5d2-4a8d-81c1-24f420d50369 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] <== connect_volume: return (1440ms) {'type': 'block', 'scsi_wwn': '23737383861316462', 'path': '/dev/sdh'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:04:33 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df2e7ab7-b5d2-4a8d-81c1-24f420d50369 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737383861316462', 'path': '/dev/sdh'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 04:04:33 user nova-compute[103546]: DEBUG nova.objects.instance [None req-df2e7ab7-b5d2-4a8d-81c1-24f420d50369 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lazy-loading 'flavor' on Instance uuid d31c22d9-0691-4f24-817b-93b1a57d6ff4 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:04:33 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-df2e7ab7-b5d2-4a8d-81c1-24f420d50369 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 04:04:33 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:04:33 user nova-compute[103546]:   <source dev="/dev/sdh"/>
Nov 16 04:04:33 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 04:04:33 user nova-compute[103546]:   <serial>1bc7f564-eb78-433b-9ffe-7aeae3546520</serial>
Nov 16 04:04:33 user nova-compute[103546]: </disk>
Nov 16 04:04:33 user nova-compute[103546]:  {{(pid=103546) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 04:04:33 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:04:33 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:04:33 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Compute_service record updated for user:user {{(pid=103546) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 04:04:33 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.630s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:04:33 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-df2e7ab7-b5d2-4a8d-81c1-24f420d50369 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:04:33 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-df2e7ab7-b5d2-4a8d-81c1-24f420d50369 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] No BDM found with device name vdb, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:04:33 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-df2e7ab7-b5d2-4a8d-81c1-24f420d50369 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] No VIF found with MAC fa:16:3e:7a:cf:df, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 04:04:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:04:33 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-df2e7ab7-b5d2-4a8d-81c1-24f420d50369 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "d31c22d9-0691-4f24-817b-93b1a57d6ff4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.039s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:04:34 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-dd6a8847-6b90-426e-b131-9733c01d06db tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Acquiring lock "d31c22d9-0691-4f24-817b-93b1a57d6ff4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:04:34 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-dd6a8847-6b90-426e-b131-9733c01d06db tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "d31c22d9-0691-4f24-817b-93b1a57d6ff4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:04:34 user nova-compute[103546]: INFO nova.compute.manager [None req-dd6a8847-6b90-426e-b131-9733c01d06db tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Detaching volume 1bc7f564-eb78-433b-9ffe-7aeae3546520
Nov 16 04:04:35 user nova-compute[103546]: INFO nova.virt.block_device [None req-dd6a8847-6b90-426e-b131-9733c01d06db tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Attempting to driver detach volume 1bc7f564-eb78-433b-9ffe-7aeae3546520 from mountpoint /dev/vdb
Nov 16 04:04:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-dd6a8847-6b90-426e-b131-9733c01d06db tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Attempting to detach device vdb from instance d31c22d9-0691-4f24-817b-93b1a57d6ff4 from the persistent domain config. {{(pid=103546) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 04:04:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-dd6a8847-6b90-426e-b131-9733c01d06db tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 04:04:35 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:04:35 user nova-compute[103546]:   <source dev="/dev/sdh"/>
Nov 16 04:04:35 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 04:04:35 user nova-compute[103546]:   <serial>1bc7f564-eb78-433b-9ffe-7aeae3546520</serial>
Nov 16 04:04:35 user nova-compute[103546]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 04:04:35 user nova-compute[103546]: </disk>
Nov 16 04:04:35 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 04:04:35 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-dd6a8847-6b90-426e-b131-9733c01d06db tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Successfully detached device vdb from instance d31c22d9-0691-4f24-817b-93b1a57d6ff4 from the persistent domain config.
Nov 16 04:04:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-dd6a8847-6b90-426e-b131-9733c01d06db tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d31c22d9-0691-4f24-817b-93b1a57d6ff4 from the live domain config. {{(pid=103546) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 04:04:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-dd6a8847-6b90-426e-b131-9733c01d06db tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 04:04:35 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:04:35 user nova-compute[103546]:   <source dev="/dev/sdh"/>
Nov 16 04:04:35 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 04:04:35 user nova-compute[103546]:   <serial>1bc7f564-eb78-433b-9ffe-7aeae3546520</serial>
Nov 16 04:04:35 user nova-compute[103546]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 04:04:35 user nova-compute[103546]: </disk>
Nov 16 04:04:35 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 04:04:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-dd6a8847-6b90-426e-b131-9733c01d06db tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d31c22d9-0691-4f24-817b-93b1a57d6ff4 {{(pid=103546) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 04:04:36 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:04:37 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:04:37 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Starting heal instance info cache {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 04:04:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "refresh_cache-04101512-7333-4581-add3-7af3821e335b" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:04:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquired lock "refresh_cache-04101512-7333-4581-add3-7af3821e335b" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:04:37 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 04101512-7333-4581-add3-7af3821e335b] Forcefully refreshing network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 04:04:38 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 04101512-7333-4581-add3-7af3821e335b] Updating instance_info_cache with network_info: [{"id": "20bc48cc-9db0-49c8-8dd5-246c685c6884", "address": "fa:16:3e:a5:d9:dc", "network": {"id": "fdbb2d2c-9a54-4517-b33a-cf27ce7570b1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79661471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2a38a5eb514ce8a7569c8322657eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20bc48cc-9d", "ovs_interfaceid": "20bc48cc-9db0-49c8-8dd5-246c685c6884", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:04:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Releasing lock "refresh_cache-04101512-7333-4581-add3-7af3821e335b" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:04:38 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 04101512-7333-4581-add3-7af3821e335b] Updated the network info_cache for instance {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 04:04:38 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:04:41 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:04:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:04:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:04:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:04:47 user nova-compute[103546]: DEBUG nova.compute.manager [req-cac82d86-f89a-4c46-9e1a-1670897b1b5c req-5a06b443-1bb4-46de-a43f-fc333fc35c49 service nova] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Received event network-changed-dda2828f-7054-49e9-97d4-7279c0305ea7 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:04:47 user nova-compute[103546]: DEBUG nova.compute.manager [req-cac82d86-f89a-4c46-9e1a-1670897b1b5c req-5a06b443-1bb4-46de-a43f-fc333fc35c49 service nova] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Refreshing instance network info cache due to event network-changed-dda2828f-7054-49e9-97d4-7279c0305ea7. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 04:04:47 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-cac82d86-f89a-4c46-9e1a-1670897b1b5c req-5a06b443-1bb4-46de-a43f-fc333fc35c49 service nova] Acquiring lock "refresh_cache-9a421bf0-70b6-4a2c-85da-813707619b84" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:04:47 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-cac82d86-f89a-4c46-9e1a-1670897b1b5c req-5a06b443-1bb4-46de-a43f-fc333fc35c49 service nova] Acquired lock "refresh_cache-9a421bf0-70b6-4a2c-85da-813707619b84" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:04:47 user nova-compute[103546]: DEBUG nova.network.neutron [req-cac82d86-f89a-4c46-9e1a-1670897b1b5c req-5a06b443-1bb4-46de-a43f-fc333fc35c49 service nova] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Refreshing network info cache for port dda2828f-7054-49e9-97d4-7279c0305ea7 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 04:04:48 user nova-compute[103546]: DEBUG nova.network.neutron [req-cac82d86-f89a-4c46-9e1a-1670897b1b5c req-5a06b443-1bb4-46de-a43f-fc333fc35c49 service nova] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Updated VIF entry in instance network info cache for port dda2828f-7054-49e9-97d4-7279c0305ea7. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 04:04:48 user nova-compute[103546]: DEBUG nova.network.neutron [req-cac82d86-f89a-4c46-9e1a-1670897b1b5c req-5a06b443-1bb4-46de-a43f-fc333fc35c49 service nova] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Updating instance_info_cache with network_info: [{"id": "dda2828f-7054-49e9-97d4-7279c0305ea7", "address": "fa:16:3e:17:bc:47", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda2828f-70", "ovs_interfaceid": "dda2828f-7054-49e9-97d4-7279c0305ea7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:04:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-cac82d86-f89a-4c46-9e1a-1670897b1b5c req-5a06b443-1bb4-46de-a43f-fc333fc35c49 service nova] Releasing lock "refresh_cache-9a421bf0-70b6-4a2c-85da-813707619b84" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:04:48 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:04:51 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:04:53 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-7523427c-15a1-4b6b-87f8-83ecd2c11734 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Acquiring lock "b0a480de-e99b-4b54-bd81-36c216442137" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:04:53 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-7523427c-15a1-4b6b-87f8-83ecd2c11734 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "b0a480de-e99b-4b54-bd81-36c216442137" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:04:53 user nova-compute[103546]: INFO nova.compute.manager [None req-7523427c-15a1-4b6b-87f8-83ecd2c11734 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Detaching volume cea53f8b-4d4d-4d25-99c7-1da6a373891e
Nov 16 04:04:53 user nova-compute[103546]: INFO nova.virt.block_device [None req-7523427c-15a1-4b6b-87f8-83ecd2c11734 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Attempting to driver detach volume cea53f8b-4d4d-4d25-99c7-1da6a373891e from mountpoint /dev/vdb
Nov 16 04:04:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:04:53 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-7523427c-15a1-4b6b-87f8-83ecd2c11734 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Attempting to detach device vdb from instance b0a480de-e99b-4b54-bd81-36c216442137 from the persistent domain config. {{(pid=103546) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 04:04:53 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-7523427c-15a1-4b6b-87f8-83ecd2c11734 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 04:04:53 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:04:53 user nova-compute[103546]:   <source dev="/dev/sdd"/>
Nov 16 04:04:53 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 04:04:53 user nova-compute[103546]:   <serial>cea53f8b-4d4d-4d25-99c7-1da6a373891e</serial>
Nov 16 04:04:53 user nova-compute[103546]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 04:04:53 user nova-compute[103546]: </disk>
Nov 16 04:04:53 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 04:04:53 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-7523427c-15a1-4b6b-87f8-83ecd2c11734 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Successfully detached device vdb from instance b0a480de-e99b-4b54-bd81-36c216442137 from the persistent domain config.
Nov 16 04:04:53 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-7523427c-15a1-4b6b-87f8-83ecd2c11734 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b0a480de-e99b-4b54-bd81-36c216442137 from the live domain config. {{(pid=103546) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 04:04:53 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-7523427c-15a1-4b6b-87f8-83ecd2c11734 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 04:04:53 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:04:53 user nova-compute[103546]:   <source dev="/dev/sdd"/>
Nov 16 04:04:53 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 04:04:53 user nova-compute[103546]:   <serial>cea53f8b-4d4d-4d25-99c7-1da6a373891e</serial>
Nov 16 04:04:53 user nova-compute[103546]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 04:04:53 user nova-compute[103546]: </disk>
Nov 16 04:04:53 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 04:04:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquiring lock "f5e1d075-f64c-4837-9850-5f727a1984e4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:04:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "f5e1d075-f64c-4837-9850-5f727a1984e4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:04:54 user nova-compute[103546]: DEBUG nova.compute.manager [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Starting instance... {{(pid=103546) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 04:04:54 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-7523427c-15a1-4b6b-87f8-83ecd2c11734 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b0a480de-e99b-4b54-bd81-36c216442137 {{(pid=103546) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 04:04:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:04:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:04:54 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=103546) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 04:04:54 user nova-compute[103546]: INFO nova.compute.claims [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Claim successful on node user
Nov 16 04:04:54 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:04:54 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:04:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.560s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:04:54 user nova-compute[103546]: DEBUG nova.compute.manager [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Start building networks asynchronously for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG nova.compute.manager [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Allocating IP information in the background. {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG nova.network.neutron [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] allocate_for_instance() {{(pid=103546) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 04:04:55 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 04:04:55 user nova-compute[103546]: DEBUG nova.compute.manager [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Start building block device mappings for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG nova.policy [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ab77040a7b9846d28dc08852d678d1ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ce50192a9743b59a9430163dd6a51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103546) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 04:04:55 user nova-compute[103546]: INFO nova.virt.block_device [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Booting with volume d610ae27-adfa-4047-8824-39f163296294 at /dev/vda
Nov 16 04:04:55 user nova-compute[103546]: DEBUG os_brick.utils [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5149383d-2f46-40a9-a9d4-f7652ce81492]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af5c39b14ece\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[74bbe3de-0eb4-43fb-92fa-0016b619705b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e31329d-e752-444f-878d-45491315424e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a08ca0-2876-48f9-be62-beaa6d19a57c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Running cmd (subprocess): nvme version {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] 'nvme version' failed. Not Retrying. {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] nvme not present on system {{(pid=103546) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 04:04:55 user nova-compute[103546]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 04:04:55 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a350f3-6841-4b1d-8d8d-d119d97f5787]: (4, '') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=103546) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] LIGHTOS: no hostnqn found. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG os_brick.utils [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af5c39b14ece', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG nova.virt.block_device [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Updating existing volume attachment record: 5bc93c04-d643-4180-aed4-e6c407a1be0d {{(pid=103546) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 04:04:55 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-dd6a8847-6b90-426e-b131-9733c01d06db tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d31c22d9-0691-4f24-817b-93b1a57d6ff4 is timed out.
Nov 16 04:04:55 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-dd6a8847-6b90-426e-b131-9733c01d06db tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Successfully detached device vdb from instance d31c22d9-0691-4f24-817b-93b1a57d6ff4 from the live domain config.
Nov 16 04:04:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd6a8847-6b90-426e-b131-9733c01d06db tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6a8847-6b90-426e-b131-9733c01d06db tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:1bc7f564-eb78-433b-9ffe-7aeae3546520', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LdexQRBz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:04:55 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-dd6a8847-6b90-426e-b131-9733c01d06db tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:04:55 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-dd6a8847-6b90-426e-b131-9733c01d06db tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-dd6a8847-6b90-426e-b131-9733c01d06db tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[9400b530-5529-44e0-81b1-1c4fe9334371]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1bc7f564-eb78-433b-9ffe-7aeae3546520\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6a8847-6b90-426e-b131-9733c01d06db tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 04:04:55 user nova-compute[103546]: No targets found.
Nov 16 04:04:55 user nova-compute[103546]: iSNS:
Nov 16 04:04:55 user nova-compute[103546]: No targets found.
Nov 16 04:04:55 user nova-compute[103546]: STATIC:
Nov 16 04:04:55 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e
Nov 16 04:04:55 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:04:55 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:04:55 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7
Nov 16 04:04:55 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:04:55 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:04:55 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4
Nov 16 04:04:55 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:04:55 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:04:55 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e
Nov 16 04:04:55 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:04:55 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:04:55 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67
Nov 16 04:04:55 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:04:55 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:04:55 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:1bc7f564-eb78-433b-9ffe-7aeae3546520
Nov 16 04:04:55 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:04:55 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:04:55 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf
Nov 16 04:04:55 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:04:55 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:04:55 user nova-compute[103546]: FIRMWARE:
Nov 16 04:04:55 user nova-compute[103546]: No targets found.
Nov 16 04:04:55 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6a8847-6b90-426e-b131-9733c01d06db tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 04:04:55 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 04:04:55 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6a8847-6b90-426e-b131-9733c01d06db tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1bc7f564-eb78-433b-9ffe-7aeae3546520', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b765866a-6dab-4c9a-9f42-e82bb592e278]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1bc7f564-eb78-433b-9ffe-7aeae3546520\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[55622c65-2f4c-4fb8-931f-f1ad6003f51c]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bc7f564-eb78-433b-9ffe-7aeae3546520 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6a8847-6b90-426e-b131-9733c01d06db tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:04:55 user nova-compute[103546]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:04:55 user nova-compute[103546]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)
Nov 16 04:04:55 user nova-compute[103546]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)
Nov 16 04:04:55 user nova-compute[103546]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:04:55 user nova-compute[103546]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 (non-flash)
Nov 16 04:04:55 user nova-compute[103546]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bc7f564-eb78-433b-9ffe-7aeae3546520 (non-flash)
Nov 16 04:04:55 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6a8847-6b90-426e-b131-9733c01d06db tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:04:55 user nova-compute[103546]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:04:55 user nova-compute[103546]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)
Nov 16 04:04:55 user nova-compute[103546]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)
Nov 16 04:04:55 user nova-compute[103546]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:04:55 user nova-compute[103546]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 (non-flash)
Nov 16 04:04:55 user nova-compute[103546]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bc7f564-eb78-433b-9ffe-7aeae3546520 (non-flash)
Nov 16 04:04:55 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6a8847-6b90-426e-b131-9733c01d06db tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60cc1dc1f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1bc7f564-eb78-433b-9ffe-7aeae3546520'): ({'sdh'}, set())}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-dd6a8847-6b90-426e-b131-9733c01d06db tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Removing single pathed devices sdh {{(pid=103546) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.040s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0741595-2cd9-477d-b64b-0dd1118882a3]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6950618-8ce1-4cfa-905f-7e0948d54625]: (4, ('ok\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-dd6a8847-6b90-426e-b131-9733c01d06db tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Flushing IO for device /dev/sdh {{(pid=103546) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a613399-eecc-417a-9199-f3da38eabb6e]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-dd6a8847-6b90-426e-b131-9733c01d06db tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=103546) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.031s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[59340adf-c07f-43e8-9c8b-3b0f71a23dde]: (4, ('1', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-dd6a8847-6b90-426e-b131-9733c01d06db tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-dd6a8847-6b90-426e-b131-9733c01d06db tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] SCSI volumes sdh have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6a8847-6b90-426e-b131-9733c01d06db tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1bc7f564-eb78-433b-9ffe-7aeae3546520')] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bc7f564-eb78-433b-9ffe-7aeae3546520 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bc7f564-eb78-433b-9ffe-7aeae3546520 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb71a546-eb64-4475-80e1-5bd86f88328f]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6a8847-6b90-426e-b131-9733c01d06db tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bc7f564-eb78-433b-9ffe-7aeae3546520 -p 172.16.0.220:3260 --logout {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG nova.network.neutron [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Successfully created port: 85996da5-0750-4cc6-a752-a074a4fcfc58 {{(pid=103546) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bc7f564-eb78-433b-9ffe-7aeae3546520 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c52905-8112-4cec-9ac0-4dc681361d70]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:1bc7f564-eb78-433b-9ffe-7aeae3546520, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:1bc7f564-eb78-433b-9ffe-7aeae3546520, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6a8847-6b90-426e-b131-9733c01d06db tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:1bc7f564-eb78-433b-9ffe-7aeae3546520, portal: 172.16.0.220,3260]
Nov 16 04:04:55 user nova-compute[103546]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:1bc7f564-eb78-433b-9ffe-7aeae3546520, portal: 172.16.0.220,3260] successful.
Nov 16 04:04:55 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bc7f564-eb78-433b-9ffe-7aeae3546520 -p 172.16.0.220:3260 --op delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bc7f564-eb78-433b-9ffe-7aeae3546520 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[801418d2-6b51-4ada-8bc8-1ac0295fe546]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6a8847-6b90-426e-b131-9733c01d06db tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-dd6a8847-6b90-426e-b131-9733c01d06db tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6a8847-6b90-426e-b131-9733c01d06db tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] <== disconnect_volume: return (365ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:04:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd6a8847-6b90-426e-b131-9733c01d06db tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 04:04:56 user nova-compute[103546]: DEBUG nova.network.neutron [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Successfully updated port: 85996da5-0750-4cc6-a752-a074a4fcfc58 {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 04:04:56 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquiring lock "refresh_cache-f5e1d075-f64c-4837-9850-5f727a1984e4" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:04:56 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquired lock "refresh_cache-f5e1d075-f64c-4837-9850-5f727a1984e4" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:04:56 user nova-compute[103546]: DEBUG nova.network.neutron [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 04:04:56 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:04:56 user nova-compute[103546]: DEBUG nova.compute.manager [req-2c919915-f031-4f7b-a9ff-390652d422b3 req-ffb2f8b7-c563-4093-95e0-d052f7d50624 service nova] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Received event network-changed-85996da5-0750-4cc6-a752-a074a4fcfc58 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:04:56 user nova-compute[103546]: DEBUG nova.compute.manager [req-2c919915-f031-4f7b-a9ff-390652d422b3 req-ffb2f8b7-c563-4093-95e0-d052f7d50624 service nova] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Refreshing instance network info cache due to event network-changed-85996da5-0750-4cc6-a752-a074a4fcfc58. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 04:04:56 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-2c919915-f031-4f7b-a9ff-390652d422b3 req-ffb2f8b7-c563-4093-95e0-d052f7d50624 service nova] Acquiring lock "refresh_cache-f5e1d075-f64c-4837-9850-5f727a1984e4" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:04:56 user nova-compute[103546]: DEBUG nova.network.neutron [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 04:04:56 user nova-compute[103546]: DEBUG nova.objects.instance [None req-dd6a8847-6b90-426e-b131-9733c01d06db tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lazy-loading 'flavor' on Instance uuid d31c22d9-0691-4f24-817b-93b1a57d6ff4 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:04:56 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-dd6a8847-6b90-426e-b131-9733c01d06db tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "d31c22d9-0691-4f24-817b-93b1a57d6ff4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.720s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:04:56 user nova-compute[103546]: DEBUG nova.network.neutron [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Updating instance_info_cache with network_info: [{"id": "85996da5-0750-4cc6-a752-a074a4fcfc58", "address": "fa:16:3e:06:9c:8a", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85996da5-07", "ovs_interfaceid": "85996da5-0750-4cc6-a752-a074a4fcfc58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:04:56 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Releasing lock "refresh_cache-f5e1d075-f64c-4837-9850-5f727a1984e4" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:04:56 user nova-compute[103546]: DEBUG nova.compute.manager [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Instance network_info: |[{"id": "85996da5-0750-4cc6-a752-a074a4fcfc58", "address": "fa:16:3e:06:9c:8a", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85996da5-07", "ovs_interfaceid": "85996da5-0750-4cc6-a752-a074a4fcfc58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 04:04:56 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-2c919915-f031-4f7b-a9ff-390652d422b3 req-ffb2f8b7-c563-4093-95e0-d052f7d50624 service nova] Acquired lock "refresh_cache-f5e1d075-f64c-4837-9850-5f727a1984e4" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:04:56 user nova-compute[103546]: DEBUG nova.network.neutron [req-2c919915-f031-4f7b-a9ff-390652d422b3 req-ffb2f8b7-c563-4093-95e0-d052f7d50624 service nova] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Refreshing network info cache for port 85996da5-0750-4cc6-a752-a074a4fcfc58 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 04:04:57 user nova-compute[103546]: DEBUG nova.network.neutron [req-2c919915-f031-4f7b-a9ff-390652d422b3 req-ffb2f8b7-c563-4093-95e0-d052f7d50624 service nova] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Updated VIF entry in instance network info cache for port 85996da5-0750-4cc6-a752-a074a4fcfc58. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 04:04:57 user nova-compute[103546]: DEBUG nova.network.neutron [req-2c919915-f031-4f7b-a9ff-390652d422b3 req-ffb2f8b7-c563-4093-95e0-d052f7d50624 service nova] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Updating instance_info_cache with network_info: [{"id": "85996da5-0750-4cc6-a752-a074a4fcfc58", "address": "fa:16:3e:06:9c:8a", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85996da5-07", "ovs_interfaceid": "85996da5-0750-4cc6-a752-a074a4fcfc58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:04:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-2c919915-f031-4f7b-a9ff-390652d422b3 req-ffb2f8b7-c563-4093-95e0-d052f7d50624 service nova] Releasing lock "refresh_cache-f5e1d075-f64c-4837-9850-5f727a1984e4" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:04:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG nova.compute.manager [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Start spawning the instance on the hypervisor. {{(pid=103546) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Creating instance directory {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 04:05:00 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Creating image(s)
Nov 16 04:05:00 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Did not create local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Ensure instance console log exists: /opt/stack/data/nova/instances/f5e1d075-f64c-4837-9850-5f727a1984e4/console.log {{(pid=103546) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Start _get_guest_xml network_info=[{"id": "85996da5-0750-4cc6-a752-a074a4fcfc58", "address": "fa:16:3e:06:9c:8a", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85996da5-07", "ovs_interfaceid": "85996da5-0750-4cc6-a752-a074a4fcfc58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cTmMFkup', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f5e1d075-f64c-4837-9850-5f727a1984e4', 'attached_at': '', 'detached_at': '', 'volume_id': 'd610ae27-adfa-4047-8824-39f163296294', 'serial': 'd610ae27-adfa-4047-8824-39f163296294'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': '5bc93c04-d643-4180-aed4-e6c407a1be0d', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 04:05:00 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:05:00 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:05:00 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cTmMFkup', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:05:00 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:05:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:05:00 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:05:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:05:00 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 04:05:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294 -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1bb1d1-a9b5-4424-a231-a8cbb4c37ad9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 04:05:00 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294 -p 172.16.0.220:3260 --interface default --op new {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[467e4132-749c-4099-ad51-eede4217d7ad]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294] added\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294] added
Nov 16 04:05:00 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30c9308-d622-408c-ac70-70817e1aa474]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[991943f2-3a1c-4be1-a34f-5b7e0b46875f]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cTmMFkup {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cTmMFkup" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f362386-860d-4064-bb89-3ffc9a1a96af]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cTmMFkup'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e706519-7a2a-4ce7-a9c8-3dc1a5885dd0]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[075f8c49-6b10-4e3b-b493-9307a597f215]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:05:00 user nova-compute[103546]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:05:00 user nova-compute[103546]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)
Nov 16 04:05:00 user nova-compute[103546]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)
Nov 16 04:05:00 user nova-compute[103546]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:05:00 user nova-compute[103546]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 (non-flash)
Nov 16 04:05:00 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:05:00 user nova-compute[103546]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:05:00 user nova-compute[103546]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)
Nov 16 04:05:00 user nova-compute[103546]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)
Nov 16 04:05:00 user nova-compute[103546]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:05:00 user nova-compute[103546]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 (non-flash)
Nov 16 04:05:00 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294 -p 172.16.0.220:3260 --login {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c34e7c-bb5b-46d5-8e00-0506ecd4a9b1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294, portal: 172.16.0.220,3260]
Nov 16 04:05:00 user nova-compute[103546]: Login to [iface: default, target: iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294, portal: 172.16.0.220,3260] successful.
Nov 16 04:05:00 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea9a3b1-3340-4eab-9312-8498754e2366]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f6d774-62f4-4f95-82f0-199cd4f85884]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:05:00 user nova-compute[103546]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:05:00 user nova-compute[103546]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)
Nov 16 04:05:00 user nova-compute[103546]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)
Nov 16 04:05:00 user nova-compute[103546]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:05:00 user nova-compute[103546]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 (non-flash)
Nov 16 04:05:00 user nova-compute[103546]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294 (non-flash)
Nov 16 04:05:00 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:05:00 user nova-compute[103546]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:05:00 user nova-compute[103546]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)
Nov 16 04:05:00 user nova-compute[103546]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)
Nov 16 04:05:00 user nova-compute[103546]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:05:00 user nova-compute[103546]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 (non-flash)
Nov 16 04:05:00 user nova-compute[103546]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294 (non-flash)
Nov 16 04:05:00 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] HCTL ('39', '-', '-', 0) found on session 49 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb8433c-e511-4174-9e76-25bc449a0ef7]: (4, ('- - 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Searching for a device in session 49 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 04:05:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cTmMFkup', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 04:05:01 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:01 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:05:01 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23733346533336331', 'path': '/dev/sdh'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:05:01 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733346533336331', 'path': '/dev/sdh'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 04:05:01 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:04:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1100177855',display_name='tempest-TestVolumeBootPattern-server-1100177855',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1100177855',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAUuzWuYKsux0jTpLPt6gxhC1FaUy3kEUyYKr8BxuO29MPaSGm/xG+Qeyua0CAfOtv/fD3rdnfc1wGAbEANqJwnqI370L1woOSlI3nH8Q8Ypdr+d2TMfVLtiA9YGdx0zEg==',key_name='tempest-TestVolumeBootPattern-1153098015',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40ce50192a9743b59a9430163dd6a51c',ramdisk_id='',reservation_id='r-ipn3ksyi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1283031547',owner_user_name='tempest-TestVolumeBootPattern-1283031547-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T04:04:55Z,user_data=None,user_id='ab77040a7b9846d28dc08852d678d1ed',uuid=f5e1d075-f64c-4837-9850-5f727a1984e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85996da5-0750-4cc6-a752-a074a4fcfc58", "address": "fa:16:3e:06:9c:8a", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85996da5-07", "ovs_interfaceid": "85996da5-0750-4cc6-a752-a074a4fcfc58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 04:05:01 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Converting VIF {"id": "85996da5-0750-4cc6-a752-a074a4fcfc58", "address": "fa:16:3e:06:9c:8a", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85996da5-07", "ovs_interfaceid": "85996da5-0750-4cc6-a752-a074a4fcfc58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:05:01 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:9c:8a,bridge_name='br-int',has_traffic_filtering=True,id=85996da5-0750-4cc6-a752-a074a4fcfc58,network=Network(a13f532d-a30d-4c06-83fe-760bcffae183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85996da5-07') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:05:01 user nova-compute[103546]: DEBUG nova.objects.instance [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lazy-loading 'pci_devices' on Instance uuid f5e1d075-f64c-4837-9850-5f727a1984e4 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:05:01 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] End _get_guest_xml xml=<domain type="kvm">
Nov 16 04:05:01 user nova-compute[103546]:   <uuid>f5e1d075-f64c-4837-9850-5f727a1984e4</uuid>
Nov 16 04:05:01 user nova-compute[103546]:   <name>instance-0000002a</name>
Nov 16 04:05:01 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 04:05:01 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 04:05:01 user nova-compute[103546]:   <metadata>
Nov 16 04:05:01 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 04:05:01 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 04:05:01 user nova-compute[103546]:       <nova:name>tempest-TestVolumeBootPattern-server-1100177855</nova:name>
Nov 16 04:05:01 user nova-compute[103546]:       <nova:creationTime>2023-11-16 04:05:00</nova:creationTime>
Nov 16 04:05:01 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 04:05:01 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 04:05:01 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 04:05:01 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 04:05:01 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 04:05:01 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 04:05:01 user nova-compute[103546]:       </nova:flavor>
Nov 16 04:05:01 user nova-compute[103546]:       <nova:owner>
Nov 16 04:05:01 user nova-compute[103546]:         <nova:user uuid="ab77040a7b9846d28dc08852d678d1ed">tempest-TestVolumeBootPattern-1283031547-project-member</nova:user>
Nov 16 04:05:01 user nova-compute[103546]:         <nova:project uuid="40ce50192a9743b59a9430163dd6a51c">tempest-TestVolumeBootPattern-1283031547</nova:project>
Nov 16 04:05:01 user nova-compute[103546]:       </nova:owner>
Nov 16 04:05:01 user nova-compute[103546]:       <nova:ports>
Nov 16 04:05:01 user nova-compute[103546]:         <nova:port uuid="85996da5-0750-4cc6-a752-a074a4fcfc58">
Nov 16 04:05:01 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 16 04:05:01 user nova-compute[103546]:         </nova:port>
Nov 16 04:05:01 user nova-compute[103546]:       </nova:ports>
Nov 16 04:05:01 user nova-compute[103546]:     </nova:instance>
Nov 16 04:05:01 user nova-compute[103546]:   </metadata>
Nov 16 04:05:01 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 04:05:01 user nova-compute[103546]:     <system>
Nov 16 04:05:01 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 04:05:01 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 04:05:01 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 04:05:01 user nova-compute[103546]:       <entry name="serial">f5e1d075-f64c-4837-9850-5f727a1984e4</entry>
Nov 16 04:05:01 user nova-compute[103546]:       <entry name="uuid">f5e1d075-f64c-4837-9850-5f727a1984e4</entry>
Nov 16 04:05:01 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 04:05:01 user nova-compute[103546]:     </system>
Nov 16 04:05:01 user nova-compute[103546]:   </sysinfo>
Nov 16 04:05:01 user nova-compute[103546]:   <os>
Nov 16 04:05:01 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 04:05:01 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 04:05:01 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 04:05:01 user nova-compute[103546]:   </os>
Nov 16 04:05:01 user nova-compute[103546]:   <features>
Nov 16 04:05:01 user nova-compute[103546]:     <acpi/>
Nov 16 04:05:01 user nova-compute[103546]:     <apic/>
Nov 16 04:05:01 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 04:05:01 user nova-compute[103546]:   </features>
Nov 16 04:05:01 user nova-compute[103546]:   <clock offset="utc">
Nov 16 04:05:01 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 04:05:01 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 04:05:01 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 04:05:01 user nova-compute[103546]:   </clock>
Nov 16 04:05:01 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 04:05:01 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 04:05:01 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 04:05:01 user nova-compute[103546]:   </cpu>
Nov 16 04:05:01 user nova-compute[103546]:   <devices>
Nov 16 04:05:01 user nova-compute[103546]:     <disk type="block" device="disk">
Nov 16 04:05:01 user nova-compute[103546]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:05:01 user nova-compute[103546]:       <source dev="/dev/sdh"/>
Nov 16 04:05:01 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 04:05:01 user nova-compute[103546]:       <serial>d610ae27-adfa-4047-8824-39f163296294</serial>
Nov 16 04:05:01 user nova-compute[103546]:     </disk>
Nov 16 04:05:01 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 04:05:01 user nova-compute[103546]:       <mac address="fa:16:3e:06:9c:8a"/>
Nov 16 04:05:01 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 04:05:01 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 04:05:01 user nova-compute[103546]:       <target dev="tap85996da5-07"/>
Nov 16 04:05:01 user nova-compute[103546]:     </interface>
Nov 16 04:05:01 user nova-compute[103546]:     <serial type="pty">
Nov 16 04:05:01 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/f5e1d075-f64c-4837-9850-5f727a1984e4/console.log" append="off"/>
Nov 16 04:05:01 user nova-compute[103546]:     </serial>
Nov 16 04:05:01 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 04:05:01 user nova-compute[103546]:     <video>
Nov 16 04:05:01 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 04:05:01 user nova-compute[103546]:     </video>
Nov 16 04:05:01 user nova-compute[103546]:     <rng model="virtio">
Nov 16 04:05:01 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 04:05:01 user nova-compute[103546]:     </rng>
Nov 16 04:05:01 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 04:05:01 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 04:05:01 user nova-compute[103546]:       <stats period="10"/>
Nov 16 04:05:01 user nova-compute[103546]:     </memballoon>
Nov 16 04:05:01 user nova-compute[103546]:   </devices>
Nov 16 04:05:01 user nova-compute[103546]: </domain>
Nov 16 04:05:01 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 04:05:01 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:04:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1100177855',display_name='tempest-TestVolumeBootPattern-server-1100177855',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1100177855',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAUuzWuYKsux0jTpLPt6gxhC1FaUy3kEUyYKr8BxuO29MPaSGm/xG+Qeyua0CAfOtv/fD3rdnfc1wGAbEANqJwnqI370L1woOSlI3nH8Q8Ypdr+d2TMfVLtiA9YGdx0zEg==',key_name='tempest-TestVolumeBootPattern-1153098015',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40ce50192a9743b59a9430163dd6a51c',ramdisk_id='',reservation_id='r-ipn3ksyi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1283031547',owner_user_name='tempest-TestVolumeBootPattern-1283031547-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T04:04:55Z,user_data=None,user_id='ab77040a7b9846d28dc08852d678d1ed',uuid=f5e1d075-f64c-4837-9850-5f727a1984e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85996da5-0750-4cc6-a752-a074a4fcfc58", "address": "fa:16:3e:06:9c:8a", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85996da5-07", "ovs_interfaceid": "85996da5-0750-4cc6-a752-a074a4fcfc58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 04:05:01 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Converting VIF {"id": "85996da5-0750-4cc6-a752-a074a4fcfc58", "address": "fa:16:3e:06:9c:8a", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85996da5-07", "ovs_interfaceid": "85996da5-0750-4cc6-a752-a074a4fcfc58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:05:01 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:9c:8a,bridge_name='br-int',has_traffic_filtering=True,id=85996da5-0750-4cc6-a752-a074a4fcfc58,network=Network(a13f532d-a30d-4c06-83fe-760bcffae183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85996da5-07') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:05:01 user nova-compute[103546]: DEBUG os_vif [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:9c:8a,bridge_name='br-int',has_traffic_filtering=True,id=85996da5-0750-4cc6-a752-a074a4fcfc58,network=Network(a13f532d-a30d-4c06-83fe-760bcffae183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85996da5-07') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 04:05:01 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:01 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:05:01 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 04:05:01 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:01 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd7f80a89-75c9-548b-874d-7a5868956994', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:05:01 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:01 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:05:01 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:01 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85996da5-07, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:05:01 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap85996da5-07, col_values=(('qos', UUID('ab34ed8f-90fa-43be-913c-9212ebcc3ed6')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:05:01 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap85996da5-07, col_values=(('external_ids', {'iface-id': '85996da5-0750-4cc6-a752-a074a4fcfc58', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:9c:8a', 'vm-uuid': 'f5e1d075-f64c-4837-9850-5f727a1984e4'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:05:01 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:01 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:05:01 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:01 user nova-compute[103546]: INFO os_vif [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:9c:8a,bridge_name='br-int',has_traffic_filtering=True,id=85996da5-0750-4cc6-a752-a074a4fcfc58,network=Network(a13f532d-a30d-4c06-83fe-760bcffae183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85996da5-07')
Nov 16 04:05:01 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:05:01 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] No VIF found with MAC fa:16:3e:06:9c:8a, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 04:05:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:03 user nova-compute[103546]: DEBUG nova.compute.manager [req-3f72560e-fd02-48ea-896e-e19023db0e3d req-7f0ad88a-9f10-4a46-812e-f2fe4916ad1b service nova] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Received event network-vif-plugged-85996da5-0750-4cc6-a752-a074a4fcfc58 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:05:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3f72560e-fd02-48ea-896e-e19023db0e3d req-7f0ad88a-9f10-4a46-812e-f2fe4916ad1b service nova] Acquiring lock "f5e1d075-f64c-4837-9850-5f727a1984e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:05:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3f72560e-fd02-48ea-896e-e19023db0e3d req-7f0ad88a-9f10-4a46-812e-f2fe4916ad1b service nova] Lock "f5e1d075-f64c-4837-9850-5f727a1984e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:05:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3f72560e-fd02-48ea-896e-e19023db0e3d req-7f0ad88a-9f10-4a46-812e-f2fe4916ad1b service nova] Lock "f5e1d075-f64c-4837-9850-5f727a1984e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:05:03 user nova-compute[103546]: DEBUG nova.compute.manager [req-3f72560e-fd02-48ea-896e-e19023db0e3d req-7f0ad88a-9f10-4a46-812e-f2fe4916ad1b service nova] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] No waiting events found dispatching network-vif-plugged-85996da5-0750-4cc6-a752-a074a4fcfc58 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:05:03 user nova-compute[103546]: WARNING nova.compute.manager [req-3f72560e-fd02-48ea-896e-e19023db0e3d req-7f0ad88a-9f10-4a46-812e-f2fe4916ad1b service nova] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Received unexpected event network-vif-plugged-85996da5-0750-4cc6-a752-a074a4fcfc58 for instance with vm_state building and task_state spawning.
Nov 16 04:05:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:05 user nova-compute[103546]: DEBUG nova.compute.manager [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 04:05:05 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Guest created on hypervisor {{(pid=103546) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 04:05:05 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Instance spawned successfully.
Nov 16 04:05:05 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 04:05:05 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Found default for hw_cdrom_bus of ide {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:05:05 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Found default for hw_disk_bus of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:05:05 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Found default for hw_input_bus of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:05:05 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Found default for hw_pointer_model of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:05:05 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Found default for hw_video_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:05:05 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Found default for hw_vif_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:05:05 user nova-compute[103546]: INFO nova.compute.manager [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Took 4.92 seconds to spawn the instance on the hypervisor.
Nov 16 04:05:05 user nova-compute[103546]: DEBUG nova.compute.manager [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 04:05:05 user nova-compute[103546]: DEBUG nova.compute.manager [req-12f36ece-a913-4a5b-890a-4c088b140827 req-99981c3a-e4cc-4529-9ac3-69764da4e187 service nova] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Received event network-vif-plugged-85996da5-0750-4cc6-a752-a074a4fcfc58 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:05:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-12f36ece-a913-4a5b-890a-4c088b140827 req-99981c3a-e4cc-4529-9ac3-69764da4e187 service nova] Acquiring lock "f5e1d075-f64c-4837-9850-5f727a1984e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:05:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-12f36ece-a913-4a5b-890a-4c088b140827 req-99981c3a-e4cc-4529-9ac3-69764da4e187 service nova] Lock "f5e1d075-f64c-4837-9850-5f727a1984e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:05:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-12f36ece-a913-4a5b-890a-4c088b140827 req-99981c3a-e4cc-4529-9ac3-69764da4e187 service nova] Lock "f5e1d075-f64c-4837-9850-5f727a1984e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:05:05 user nova-compute[103546]: DEBUG nova.compute.manager [req-12f36ece-a913-4a5b-890a-4c088b140827 req-99981c3a-e4cc-4529-9ac3-69764da4e187 service nova] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] No waiting events found dispatching network-vif-plugged-85996da5-0750-4cc6-a752-a074a4fcfc58 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:05:05 user nova-compute[103546]: WARNING nova.compute.manager [req-12f36ece-a913-4a5b-890a-4c088b140827 req-99981c3a-e4cc-4529-9ac3-69764da4e187 service nova] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Received unexpected event network-vif-plugged-85996da5-0750-4cc6-a752-a074a4fcfc58 for instance with vm_state building and task_state spawning.
Nov 16 04:05:05 user nova-compute[103546]: INFO nova.compute.manager [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Took 11.04 seconds to build instance.
Nov 16 04:05:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0557be21-fb93-49c0-bb46-95bc539564b2 tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "f5e1d075-f64c-4837-9850-5f727a1984e4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.134s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:05:06 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:11 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:05:14 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-7523427c-15a1-4b6b-87f8-83ecd2c11734 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b0a480de-e99b-4b54-bd81-36c216442137 is timed out.
Nov 16 04:05:14 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-7523427c-15a1-4b6b-87f8-83ecd2c11734 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Successfully detached device vdb from instance b0a480de-e99b-4b54-bd81-36c216442137 from the live domain config.
Nov 16 04:05:14 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7523427c-15a1-4b6b-87f8-83ecd2c11734 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 04:05:14 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-7523427c-15a1-4b6b-87f8-83ecd2c11734 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AprzmwSJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:05:14 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-7523427c-15a1-4b6b-87f8-83ecd2c11734 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:05:14 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-7523427c-15a1-4b6b-87f8-83ecd2c11734 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:05:14 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-7523427c-15a1-4b6b-87f8-83ecd2c11734 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:05:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:14 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[7628a881-79e7-4f55-b9e3-feb4f0bc6505]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:05:14 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-7523427c-15a1-4b6b-87f8-83ecd2c11734 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 04:05:14 user nova-compute[103546]: No targets found.
Nov 16 04:05:14 user nova-compute[103546]: iSNS:
Nov 16 04:05:14 user nova-compute[103546]: No targets found.
Nov 16 04:05:14 user nova-compute[103546]: STATIC:
Nov 16 04:05:14 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e
Nov 16 04:05:14 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:05:14 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:05:14 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294
Nov 16 04:05:14 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:05:14 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:05:14 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7
Nov 16 04:05:14 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:05:14 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:05:14 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4
Nov 16 04:05:14 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:05:14 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:05:14 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e
Nov 16 04:05:14 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:05:14 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:05:14 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67
Nov 16 04:05:14 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:05:14 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:05:14 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf
Nov 16 04:05:14 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:05:14 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:05:14 user nova-compute[103546]: FIRMWARE:
Nov 16 04:05:14 user nova-compute[103546]: No targets found.
Nov 16 04:05:14 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:05:14 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-7523427c-15a1-4b6b-87f8-83ecd2c11734 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 04:05:14 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 04:05:14 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 04:05:14 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-7523427c-15a1-4b6b-87f8-83ecd2c11734 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 04:05:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:14 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ac475c-fa74-4a7a-a51b-ca7dbf518c87]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:05:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:14 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c860b0-cce8-4278-b0ee-46deddd4a061]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:05:14 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-7523427c-15a1-4b6b-87f8-83ecd2c11734 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:05:14 user nova-compute[103546]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:05:14 user nova-compute[103546]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)
Nov 16 04:05:14 user nova-compute[103546]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)
Nov 16 04:05:14 user nova-compute[103546]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:05:14 user nova-compute[103546]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 (non-flash)
Nov 16 04:05:14 user nova-compute[103546]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294 (non-flash)
Nov 16 04:05:14 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:05:14 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-7523427c-15a1-4b6b-87f8-83ecd2c11734 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:05:14 user nova-compute[103546]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:05:14 user nova-compute[103546]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e (non-flash)
Nov 16 04:05:14 user nova-compute[103546]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)
Nov 16 04:05:14 user nova-compute[103546]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:05:14 user nova-compute[103546]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 (non-flash)
Nov 16 04:05:14 user nova-compute[103546]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294 (non-flash)
Nov 16 04:05:14 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:05:14 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-7523427c-15a1-4b6b-87f8-83ecd2c11734 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60c42601f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e'): ({'sdd'}, set())}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 04:05:14 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-7523427c-15a1-4b6b-87f8-83ecd2c11734 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Removing single pathed devices sdd {{(pid=103546) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 04:05:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:14 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bdd724c-e1b5-4839-b202-4a457fd1b335]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:05:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:14 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[9660fe08-73f8-4c5e-80e1-4e964aa0cdd5]: (4, ('ok\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:05:14 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-7523427c-15a1-4b6b-87f8-83ecd2c11734 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Flushing IO for device /dev/sdd {{(pid=103546) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 04:05:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:14 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a611bc2b-fbc8-4508-96f1-5703878cadf0]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:05:14 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-7523427c-15a1-4b6b-87f8-83ecd2c11734 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=103546) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 04:05:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:14 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[62727f77-4bb8-4238-b854-7c1ebf8dae30]: (4, ('1', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:05:14 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-7523427c-15a1-4b6b-87f8-83ecd2c11734 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 04:05:14 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-7523427c-15a1-4b6b-87f8-83ecd2c11734 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] SCSI volumes sdd have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 04:05:14 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-7523427c-15a1-4b6b-87f8-83ecd2c11734 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e')] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 04:05:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:14 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d9171a-5eda-422a-8a70-8d7bf24ad2e4]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:05:14 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-7523427c-15a1-4b6b-87f8-83ecd2c11734 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:05:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e -p 172.16.0.220:3260 --logout {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:14 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56204db-56f6-4397-8564-22664b2426eb]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:05:14 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-7523427c-15a1-4b6b-87f8-83ecd2c11734 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e, portal: 172.16.0.220,3260]
Nov 16 04:05:14 user nova-compute[103546]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e, portal: 172.16.0.220,3260] successful.
Nov 16 04:05:14 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:05:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e -p 172.16.0.220:3260 --op delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:14 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cea53f8b-4d4d-4d25-99c7-1da6a373891e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:14 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9f0b29-7690-4814-9fe1-698be0ee8fa1]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:05:14 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-7523427c-15a1-4b6b-87f8-83ecd2c11734 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:05:14 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-7523427c-15a1-4b6b-87f8-83ecd2c11734 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:05:14 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-7523427c-15a1-4b6b-87f8-83ecd2c11734 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] <== disconnect_volume: return (353ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:05:14 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7523427c-15a1-4b6b-87f8-83ecd2c11734 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 04:05:14 user nova-compute[103546]: INFO nova.compute.manager [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Rescuing
Nov 16 04:05:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Acquiring lock "refresh_cache-271adc7b-bfc6-48c5-8700-69b2b079ce4b" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:05:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Acquired lock "refresh_cache-271adc7b-bfc6-48c5-8700-69b2b079ce4b" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:05:14 user nova-compute[103546]: DEBUG nova.network.neutron [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 04:05:15 user nova-compute[103546]: DEBUG nova.network.neutron [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Updating instance_info_cache with network_info: [{"id": "30eba06b-aff6-43cf-b792-7624b1bc12a9", "address": "fa:16:3e:ae:80:8d", "network": {"id": "fdbb2d2c-9a54-4517-b33a-cf27ce7570b1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79661471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2a38a5eb514ce8a7569c8322657eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30eba06b-af", "ovs_interfaceid": "30eba06b-aff6-43cf-b792-7624b1bc12a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:05:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Releasing lock "refresh_cache-271adc7b-bfc6-48c5-8700-69b2b079ce4b" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:05:15 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:15 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:15 user nova-compute[103546]: DEBUG nova.compute.manager [req-d0415bbe-2cf2-4d01-81da-b57aa1ab5921 req-32f2c2c6-d963-4df5-a93d-9e20c25b122c service nova] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Received event network-vif-unplugged-30eba06b-aff6-43cf-b792-7624b1bc12a9 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:05:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d0415bbe-2cf2-4d01-81da-b57aa1ab5921 req-32f2c2c6-d963-4df5-a93d-9e20c25b122c service nova] Acquiring lock "271adc7b-bfc6-48c5-8700-69b2b079ce4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:05:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d0415bbe-2cf2-4d01-81da-b57aa1ab5921 req-32f2c2c6-d963-4df5-a93d-9e20c25b122c service nova] Lock "271adc7b-bfc6-48c5-8700-69b2b079ce4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:05:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d0415bbe-2cf2-4d01-81da-b57aa1ab5921 req-32f2c2c6-d963-4df5-a93d-9e20c25b122c service nova] Lock "271adc7b-bfc6-48c5-8700-69b2b079ce4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:05:15 user nova-compute[103546]: DEBUG nova.compute.manager [req-d0415bbe-2cf2-4d01-81da-b57aa1ab5921 req-32f2c2c6-d963-4df5-a93d-9e20c25b122c service nova] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] No waiting events found dispatching network-vif-unplugged-30eba06b-aff6-43cf-b792-7624b1bc12a9 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:05:15 user nova-compute[103546]: WARNING nova.compute.manager [req-d0415bbe-2cf2-4d01-81da-b57aa1ab5921 req-32f2c2c6-d963-4df5-a93d-9e20c25b122c service nova] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Received unexpected event network-vif-unplugged-30eba06b-aff6-43cf-b792-7624b1bc12a9 for instance with vm_state active and task_state rescuing.
Nov 16 04:05:15 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:15 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:15 user nova-compute[103546]: DEBUG nova.objects.instance [None req-7523427c-15a1-4b6b-87f8-83ecd2c11734 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lazy-loading 'flavor' on Instance uuid b0a480de-e99b-4b54-bd81-36c216442137 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:05:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-7523427c-15a1-4b6b-87f8-83ecd2c11734 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "b0a480de-e99b-4b54-bd81-36c216442137" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.017s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:05:15 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Instance destroyed successfully.
Nov 16 04:05:16 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Attempting a stable device rescue
Nov 16 04:05:16 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=103546) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 16 04:05:16 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Instance directory exists: not creating {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 16 04:05:16 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Creating image(s)
Nov 16 04:05:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Acquiring lock "/opt/stack/data/nova/instances/271adc7b-bfc6-48c5-8700-69b2b079ce4b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:05:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "/opt/stack/data/nova/instances/271adc7b-bfc6-48c5-8700-69b2b079ce4b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:05:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "/opt/stack/data/nova/instances/271adc7b-bfc6-48c5-8700-69b2b079ce4b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:05:16 user nova-compute[103546]: DEBUG nova.objects.instance [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lazy-loading 'trusted_certs' on Instance uuid 271adc7b-bfc6-48c5-8700-69b2b079ce4b {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:05:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Acquiring lock "abf9be852dab915566569e456598b5410a058cd5" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:05:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "abf9be852dab915566569e456598b5410a058cd5" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:05:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/abf9be852dab915566569e456598b5410a058cd5.part --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:17 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-fab8920e-4353-42c0-b8de-f6382a38d9f1 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Acquiring lock "b0a480de-e99b-4b54-bd81-36c216442137" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:05:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-fab8920e-4353-42c0-b8de-f6382a38d9f1 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "b0a480de-e99b-4b54-bd81-36c216442137" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:05:17 user nova-compute[103546]: DEBUG nova.compute.manager [None req-fab8920e-4353-42c0-b8de-f6382a38d9f1 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 04:05:17 user nova-compute[103546]: DEBUG nova.compute.manager [None req-fab8920e-4353-42c0-b8de-f6382a38d9f1 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=103546) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 16 04:05:17 user nova-compute[103546]: DEBUG nova.objects.instance [None req-fab8920e-4353-42c0-b8de-f6382a38d9f1 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lazy-loading 'flavor' on Instance uuid b0a480de-e99b-4b54-bd81-36c216442137 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:05:17 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/abf9be852dab915566569e456598b5410a058cd5.part --force-share --output=json" returned: 0 in 0.202s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:17 user nova-compute[103546]: DEBUG nova.virt.images [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] 7097ebe7-1a7d-4718-9bd1-02ff5e75c49f was qcow2, converting to raw {{(pid=103546) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 04:05:17 user nova-compute[103546]: DEBUG nova.privsep.utils [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=103546) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 04:05:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/abf9be852dab915566569e456598b5410a058cd5.part /opt/stack/data/nova/instances/_base/abf9be852dab915566569e456598b5410a058cd5.converted {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:17 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:17 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:17 user nova-compute[103546]: DEBUG nova.compute.manager [req-7630f1bf-b28d-4284-a247-c0b905e76185 req-885dda6f-47ca-4836-9cdd-6cf0159a8e52 service nova] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Received event network-vif-unplugged-804319c6-55cb-4f30-908c-71817934fb45 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:05:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-7630f1bf-b28d-4284-a247-c0b905e76185 req-885dda6f-47ca-4836-9cdd-6cf0159a8e52 service nova] Acquiring lock "b0a480de-e99b-4b54-bd81-36c216442137-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:05:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-7630f1bf-b28d-4284-a247-c0b905e76185 req-885dda6f-47ca-4836-9cdd-6cf0159a8e52 service nova] Lock "b0a480de-e99b-4b54-bd81-36c216442137-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:05:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-7630f1bf-b28d-4284-a247-c0b905e76185 req-885dda6f-47ca-4836-9cdd-6cf0159a8e52 service nova] Lock "b0a480de-e99b-4b54-bd81-36c216442137-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:05:17 user nova-compute[103546]: DEBUG nova.compute.manager [req-7630f1bf-b28d-4284-a247-c0b905e76185 req-885dda6f-47ca-4836-9cdd-6cf0159a8e52 service nova] [instance: b0a480de-e99b-4b54-bd81-36c216442137] No waiting events found dispatching network-vif-unplugged-804319c6-55cb-4f30-908c-71817934fb45 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:05:17 user nova-compute[103546]: WARNING nova.compute.manager [req-7630f1bf-b28d-4284-a247-c0b905e76185 req-885dda6f-47ca-4836-9cdd-6cf0159a8e52 service nova] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Received unexpected event network-vif-unplugged-804319c6-55cb-4f30-908c-71817934fb45 for instance with vm_state active and task_state powering-off.
Nov 16 04:05:17 user nova-compute[103546]: DEBUG nova.compute.manager [req-b5eb9dc9-3ac1-4770-8f9a-59f916f366be req-a1d19f04-be02-4acd-b32f-d34612424040 service nova] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Received event network-vif-plugged-30eba06b-aff6-43cf-b792-7624b1bc12a9 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:05:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-b5eb9dc9-3ac1-4770-8f9a-59f916f366be req-a1d19f04-be02-4acd-b32f-d34612424040 service nova] Acquiring lock "271adc7b-bfc6-48c5-8700-69b2b079ce4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:05:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-b5eb9dc9-3ac1-4770-8f9a-59f916f366be req-a1d19f04-be02-4acd-b32f-d34612424040 service nova] Lock "271adc7b-bfc6-48c5-8700-69b2b079ce4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:05:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-b5eb9dc9-3ac1-4770-8f9a-59f916f366be req-a1d19f04-be02-4acd-b32f-d34612424040 service nova] Lock "271adc7b-bfc6-48c5-8700-69b2b079ce4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:05:17 user nova-compute[103546]: DEBUG nova.compute.manager [req-b5eb9dc9-3ac1-4770-8f9a-59f916f366be req-a1d19f04-be02-4acd-b32f-d34612424040 service nova] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] No waiting events found dispatching network-vif-plugged-30eba06b-aff6-43cf-b792-7624b1bc12a9 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:05:17 user nova-compute[103546]: WARNING nova.compute.manager [req-b5eb9dc9-3ac1-4770-8f9a-59f916f366be req-a1d19f04-be02-4acd-b32f-d34612424040 service nova] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Received unexpected event network-vif-plugged-30eba06b-aff6-43cf-b792-7624b1bc12a9 for instance with vm_state active and task_state rescuing.
Nov 16 04:05:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/abf9be852dab915566569e456598b5410a058cd5.part /opt/stack/data/nova/instances/_base/abf9be852dab915566569e456598b5410a058cd5.converted" returned: 0 in 0.579s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/abf9be852dab915566569e456598b5410a058cd5.converted --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:17 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Instance destroyed successfully.
Nov 16 04:05:17 user nova-compute[103546]: DEBUG nova.compute.manager [None req-fab8920e-4353-42c0-b8de-f6382a38d9f1 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/abf9be852dab915566569e456598b5410a058cd5.converted --force-share --output=json" returned: 0 in 0.186s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-fab8920e-4353-42c0-b8de-f6382a38d9f1 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "b0a480de-e99b-4b54-bd81-36c216442137" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.935s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "abf9be852dab915566569e456598b5410a058cd5" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.955s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Acquiring lock "abf9be852dab915566569e456598b5410a058cd5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "abf9be852dab915566569e456598b5410a058cd5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/abf9be852dab915566569e456598b5410a058cd5 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/abf9be852dab915566569e456598b5410a058cd5 --force-share --output=json" returned: 0 in 0.182s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/abf9be852dab915566569e456598b5410a058cd5,backing_fmt=raw /opt/stack/data/nova/instances/271adc7b-bfc6-48c5-8700-69b2b079ce4b/disk.rescue {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/abf9be852dab915566569e456598b5410a058cd5,backing_fmt=raw /opt/stack/data/nova/instances/271adc7b-bfc6-48c5-8700-69b2b079ce4b/disk.rescue" returned: 0 in 0.055s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "abf9be852dab915566569e456598b5410a058cd5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG nova.objects.instance [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lazy-loading 'migration_context' on Instance uuid 271adc7b-bfc6-48c5-8700-69b2b079ce4b {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG nova.objects.base [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Object Instance<271adc7b-bfc6-48c5-8700-69b2b079ce4b> lazy-loaded attributes: trusted_certs,migration_context {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Created local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Start _get_guest_xml network_info=[{"id": "30eba06b-aff6-43cf-b792-7624b1bc12a9", "address": "fa:16:3e:ae:80:8d", "network": {"id": "fdbb2d2c-9a54-4517-b33a-cf27ce7570b1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79661471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-79661471-network", "vif_mac": "fa:16:3e:ae:80:8d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2a38a5eb514ce8a7569c8322657eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30eba06b-af", "ovs_interfaceid": "30eba06b-aff6-43cf-b792-7624b1bc12a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '7097ebe7-1a7d-4718-9bd1-02ff5e75c49f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TxYFhoMJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '271adc7b-bfc6-48c5-8700-69b2b079ce4b', 'attached_at': '', 'detached_at': '', 'volume_id': '6d1a0410-4f73-4d23-a8d8-d745c527cdf7', 'serial': '6d1a0410-4f73-4d23-a8d8-d745c527cdf7'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': 'baae5703-7e28-4199-b02f-e24a356b1672', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG nova.objects.instance [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lazy-loading 'resources' on Instance uuid 271adc7b-bfc6-48c5-8700-69b2b079ce4b {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG nova.objects.base [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Object Instance<271adc7b-bfc6-48c5-8700-69b2b079ce4b> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG nova.objects.instance [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lazy-loading 'numa_topology' on Instance uuid 271adc7b-bfc6-48c5-8700-69b2b079ce4b {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG nova.objects.base [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Object Instance<271adc7b-bfc6-48c5-8700-69b2b079ce4b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 04:05:18 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:05:18 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:05:18 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG nova.objects.instance [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lazy-loading 'vcpu_model' on Instance uuid 271adc7b-bfc6-48c5-8700-69b2b079ce4b {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG nova.objects.base [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Object Instance<271adc7b-bfc6-48c5-8700-69b2b079ce4b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TxYFhoMJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:05:18 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:05:18 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:05:18 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:05:18 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:05:18 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 04:05:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e871b0-8150-4f10-8809-c167a06a4d0d]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = TxYFhoMJ\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 16 04:05:18 user nova-compute[103546]: node.name = iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7
Nov 16 04:05:18 user nova-compute[103546]: node.tpgt = -1
Nov 16 04:05:18 user nova-compute[103546]: node.startup = automatic
Nov 16 04:05:18 user nova-compute[103546]: node.leading_login = No
Nov 16 04:05:18 user nova-compute[103546]: iface.iscsi_ifacename = default
Nov 16 04:05:18 user nova-compute[103546]: iface.net_ifacename = <empty>
Nov 16 04:05:18 user nova-compute[103546]: iface.ipaddress = <empty>
Nov 16 04:05:18 user nova-compute[103546]: iface.prefix_len = 0
Nov 16 04:05:18 user nova-compute[103546]: iface.hwaddress = <empty>
Nov 16 04:05:18 user nova-compute[103546]: iface.transport_name = tcp
Nov 16 04:05:18 user nova-compute[103546]: iface.initiatorname = <empty>
Nov 16 04:05:18 user nova-compute[103546]: iface.state = <empty>
Nov 16 04:05:18 user nova-compute[103546]: iface.vlan_id = 0
Nov 16 04:05:18 user nova-compute[103546]: iface.vlan_priority = 0
Nov 16 04:05:18 user nova-compute[103546]: iface.vlan_state = <empty>
Nov 16 04:05:18 user nova-compute[103546]: iface.iface_num = 0
Nov 16 04:05:18 user nova-compute[103546]: iface.mtu = 0
Nov 16 04:05:18 user nova-compute[103546]: iface.port = 0
Nov 16 04:05:18 user nova-compute[103546]: iface.bootproto = <empty>
Nov 16 04:05:18 user nova-compute[103546]: iface.subnet_mask = <empty>
Nov 16 04:05:18 user nova-compute[103546]: iface.gateway = <empty>
Nov 16 04:05:18 user nova-compute[103546]: iface.dhcp_alt_client_id_state = <empty>
Nov 16 04:05:18 user nova-compute[103546]: iface.dhcp_alt_client_id = <empty>
Nov 16 04:05:18 user nova-compute[103546]: iface.dhcp_dns = <empty>
Nov 16 04:05:18 user nova-compute[103546]: iface.dhcp_learn_iqn = <empty>
Nov 16 04:05:18 user nova-compute[103546]: iface.dhcp_req_vendor_id_state = <empty>
Nov 16 04:05:18 user nova-compute[103546]: iface.dhcp_vendor_id_state = <empty>
Nov 16 04:05:18 user nova-compute[103546]: iface.dhcp_vendor_id = <empty>
Nov 16 04:05:18 user nova-compute[103546]: iface.dhcp_slp_da = <empty>
Nov 16 04:05:18 user nova-compute[103546]: iface.fragmentation = <empty>
Nov 16 04:05:18 user nova-compute[103546]: iface.gratuitous_arp = <empty>
Nov 16 04:05:18 user nova-compute[103546]: iface.incoming_forwarding = <empty>
Nov 16 04:05:18 user nova-compute[103546]: iface.tos_state = <empty>
Nov 16 04:05:18 user nova-compute[103546]: iface.tos = 0
Nov 16 04:05:18 user nova-compute[103546]: iface.ttl = 0
Nov 16 04:05:18 user nova-compute[103546]: iface.delayed_ack = <empty>
Nov 16 04:05:18 user nova-compute[103546]: iface.tcp_nagle = <empty>
Nov 16 04:05:18 user nova-compute[103546]: iface.tcp_wsf_state = <empty>
Nov 16 04:05:18 user nova-compute[103546]: iface.tcp_wsf = 0
Nov 16 04:05:18 user nova-compute[103546]: iface.tcp_timer_scale = 0
Nov 16 04:05:18 user nova-compute[103546]: iface.tcp_timestamp = <empty>
Nov 16 04:05:18 user nova-compute[103546]: iface.redirect = <empty>
Nov 16 04:05:18 user nova-compute[103546]: iface.def_task_mgmt_timeout = 0
Nov 16 04:05:18 user nova-compute[103546]: iface.header_digest = <empty>
Nov 16 04:05:18 user nova-compute[103546]: iface.data_digest = <empty>
Nov 16 04:05:18 user nova-compute[103546]: iface.immediate_data = <empty>
Nov 16 04:05:18 user nova-compute[103546]: iface.initial_r2t = <empty>
Nov 16 04:05:18 user nova-compute[103546]: iface.data_seq_inorder = <empty>
Nov 16 04:05:18 user nova-compute[103546]: iface.data_pdu_inorder = <empty>
Nov 16 04:05:18 user nova-compute[103546]: iface.erl = 0
Nov 16 04:05:18 user nova-compute[103546]: iface.max_receive_data_len = 0
Nov 16 04:05:18 user nova-compute[103546]: iface.first_burst_len = 0
Nov 16 04:05:18 user nova-compute[103546]: iface.max_outstanding_r2t = 0
Nov 16 04:05:18 user nova-compute[103546]: iface.max_burst_len = 0
Nov 16 04:05:18 user nova-compute[103546]: iface.chap_auth = <empty>
Nov 16 04:05:18 user nova-compute[103546]: iface.bidi_chap = <empty>
Nov 16 04:05:18 user nova-compute[103546]: iface.strict_login_compliance = <empty>
Nov 16 04:05:18 user nova-compute[103546]: iface.discovery_auth = <empty>
Nov 16 04:05:18 user nova-compute[103546]: iface.discovery_logout = <empty>
Nov 16 04:05:18 user nova-compute[103546]: node.discovery_address = <empty>
Nov 16 04:05:18 user nova-compute[103546]: node.discovery_port = 0
Nov 16 04:05:18 user nova-compute[103546]: node.discovery_type = static
Nov 16 04:05:18 user nova-compute[103546]: node.session.initial_cmdsn = 0
Nov 16 04:05:18 user nova-compute[103546]: node.session.initial_login_retry_max = 8
Nov 16 04:05:18 user nova-compute[103546]: node.session.xmit_thread_priority = -20
Nov 16 04:05:18 user nova-compute[103546]: node.session.cmds_max = 128
Nov 16 04:05:18 user nova-compute[103546]: node.session.queue_depth = 32
Nov 16 04:05:18 user nova-compute[103546]: node.session.nr_sessions = 1
Nov 16 04:05:18 user nova-compute[103546]: node.session.auth.authmethod = CHAP
Nov 16 04:05:18 user nova-compute[103546]: node.session.auth.username = TxYFhoMJ
Nov 16 04:05:18 user nova-compute[103546]: node.session.auth.password = ***
Nov 16 04:05:18 user nova-compute[103546]: node.session.auth.username_in = <empty>
Nov 16 04:05:18 user nova-compute[103546]: node.session.auth.password_in = <empty>
Nov 16 04:05:18 user nova-compute[103546]: node.session.auth.chap_algs = MD5
Nov 16 04:05:18 user nova-compute[103546]: node.session.timeo.replacement_timeout = 120
Nov 16 04:05:18 user nova-compute[103546]: node.session.err_timeo.abort_timeout = 15
Nov 16 04:05:18 user nova-compute[103546]: node.session.err_timeo.lu_reset_timeout = 30
Nov 16 04:05:18 user nova-compute[103546]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 16 04:05:18 user nova-compute[103546]: node.session.err_timeo.host_reset_timeout = 60
Nov 16 04:05:18 user nova-compute[103546]: node.session.iscsi.FastAbort = Yes
Nov 16 04:05:18 user nova-compute[103546]: node.session.iscsi.InitialR2T = No
Nov 16 04:05:18 user nova-compute[103546]: node.session.iscsi.ImmediateData = Yes
Nov 16 04:05:18 user nova-compute[103546]: node.session.iscsi.FirstBurstLength = 262144
Nov 16 04:05:18 user nova-compute[103546]: node.session.iscsi.MaxBurstLength = 16776192
Nov 16 04:05:18 user nova-compute[103546]: node.session.iscsi.DefaultTime2Retain = 0
Nov 16 04:05:18 user nova-compute[103546]: node.session.iscsi.DefaultTime2Wait = 2
Nov 16 04:05:18 user nova-compute[103546]: node.session.iscsi.MaxConnections = 1
Nov 16 04:05:18 user nova-compute[103546]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 16 04:05:18 user nova-compute[103546]: node.session.iscsi.ERL = 0
Nov 16 04:05:18 user nova-compute[103546]: node.session.scan = manual
Nov 16 04:05:18 user nova-compute[103546]: node.session.reopen_max = 0
Nov 16 04:05:18 user nova-compute[103546]: node.conn[0].address = 172.16.0.220
Nov 16 04:05:18 user nova-compute[103546]: node.conn[0].port = 3260
Nov 16 04:05:18 user nova-compute[103546]: node.conn[0].startup = manual
Nov 16 04:05:18 user nova-compute[103546]: node.conn[0].tcp.window_size = 524288
Nov 16 04:05:18 user nova-compute[103546]: node.conn[0].tcp.type_of_service = 0
Nov 16 04:05:18 user nova-compute[103546]: node.conn[0].timeo.logout_timeout = 15
Nov 16 04:05:18 user nova-compute[103546]: node.conn[0].timeo.login_timeout = 15
Nov 16 04:05:18 user nova-compute[103546]: node.conn[0].timeo.auth_timeout = 45
Nov 16 04:05:18 user nova-compute[103546]: node.conn[0].timeo.noop_out_interval = 5
Nov 16 04:05:18 user nova-compute[103546]: node.conn[0].timeo.noop_out_timeout = 5
Nov 16 04:05:18 user nova-compute[103546]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 16 04:05:18 user nova-compute[103546]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 16 04:05:18 user nova-compute[103546]: node.conn[0].iscsi.HeaderDigest = None
Nov 16 04:05:18 user nova-compute[103546]: node.conn[0].iscsi.DataDigest = None
Nov 16 04:05:18 user nova-compute[103546]: node.conn[0].iscsi.IFMarker = No
Nov 16 04:05:18 user nova-compute[103546]: node.conn[0].iscsi.OFMarker = No
Nov 16 04:05:18 user nova-compute[103546]: # END RECORD
Nov 16 04:05:18 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ceab179-e471-4421-81c1-e8d1b45582a0]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d07b23-e7a9-4d3e-9a73-80019c8c7bb9]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TxYFhoMJ {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TxYFhoMJ" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[acef2e0b-e7a8-422d-ab8d-88b03ea09f3e]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TxYFhoMJ'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0240a20-566d-466f-85ff-11bd8d10f7c0]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[898c1116-a382-446f-b71d-e6369b4b50fc]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:05:18 user nova-compute[103546]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:05:18 user nova-compute[103546]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)
Nov 16 04:05:18 user nova-compute[103546]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:05:18 user nova-compute[103546]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 (non-flash)
Nov 16 04:05:18 user nova-compute[103546]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294 (non-flash)
Nov 16 04:05:18 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:05:18 user nova-compute[103546]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:05:18 user nova-compute[103546]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)
Nov 16 04:05:18 user nova-compute[103546]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:05:18 user nova-compute[103546]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 (non-flash)
Nov 16 04:05:18 user nova-compute[103546]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294 (non-flash)
Nov 16 04:05:18 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.156s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] HCTL ('36', '0', '0', 0) found on session 44 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5cc02d-0dfe-49d3-a39b-217279f83663]: (4, ('0 0 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Searching for a device in session 44 and hctl ('36', '0', '0', 0) yield: sde {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TxYFhoMJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.184s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] <== connect_volume: return (186ms) {'type': 'block', 'scsi_wwn': '23132393937343964', 'path': '/dev/sde'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23132393937343964', 'path': '/dev/sde'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:03:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2082323718',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2082323718',id=40,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T04:03:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6f2a38a5eb514ce8a7569c8322657eac',ramdisk_id='',reservation_id='r-d5wsh0km',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1634874924',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T04:03:40Z,user_data=None,user_id='e1176a2817ef428ea81e2fb18299a306',uuid=271adc7b-bfc6-48c5-8700-69b2b079ce4b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "30eba06b-aff6-43cf-b792-7624b1bc12a9", "address": "fa:16:3e:ae:80:8d", "network": {"id": "fdbb2d2c-9a54-4517-b33a-cf27ce7570b1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79661471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-79661471-network", "vif_mac": "fa:16:3e:ae:80:8d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2a38a5eb514ce8a7569c8322657eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30eba06b-af", "ovs_interfaceid": "30eba06b-aff6-43cf-b792-7624b1bc12a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Converting VIF {"id": "30eba06b-aff6-43cf-b792-7624b1bc12a9", "address": "fa:16:3e:ae:80:8d", "network": {"id": "fdbb2d2c-9a54-4517-b33a-cf27ce7570b1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79661471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-79661471-network", "vif_mac": "fa:16:3e:ae:80:8d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2a38a5eb514ce8a7569c8322657eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30eba06b-af", "ovs_interfaceid": "30eba06b-aff6-43cf-b792-7624b1bc12a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:80:8d,bridge_name='br-int',has_traffic_filtering=True,id=30eba06b-aff6-43cf-b792-7624b1bc12a9,network=Network(fdbb2d2c-9a54-4517-b33a-cf27ce7570b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30eba06b-af') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG nova.objects.instance [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lazy-loading 'pci_devices' on Instance uuid 271adc7b-bfc6-48c5-8700-69b2b079ce4b {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG nova.objects.base [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Object Instance<271adc7b-bfc6-48c5-8700-69b2b079ce4b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] End _get_guest_xml xml=<domain type="kvm">
Nov 16 04:05:18 user nova-compute[103546]:   <uuid>271adc7b-bfc6-48c5-8700-69b2b079ce4b</uuid>
Nov 16 04:05:18 user nova-compute[103546]:   <name>instance-00000028</name>
Nov 16 04:05:18 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 04:05:18 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 04:05:18 user nova-compute[103546]:   <metadata>
Nov 16 04:05:18 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 04:05:18 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 04:05:18 user nova-compute[103546]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2082323718</nova:name>
Nov 16 04:05:18 user nova-compute[103546]:       <nova:creationTime>2023-11-16 04:05:18</nova:creationTime>
Nov 16 04:05:18 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 04:05:18 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 04:05:18 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 04:05:18 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 04:05:18 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 04:05:18 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 04:05:18 user nova-compute[103546]:       </nova:flavor>
Nov 16 04:05:18 user nova-compute[103546]:       <nova:owner>
Nov 16 04:05:18 user nova-compute[103546]:         <nova:user uuid="e1176a2817ef428ea81e2fb18299a306">tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member</nova:user>
Nov 16 04:05:18 user nova-compute[103546]:         <nova:project uuid="6f2a38a5eb514ce8a7569c8322657eac">tempest-ServerBootFromVolumeStableRescueTest-1634874924</nova:project>
Nov 16 04:05:18 user nova-compute[103546]:       </nova:owner>
Nov 16 04:05:18 user nova-compute[103546]:       <nova:root type="image" uuid="5c6f539a-01e5-4478-bf8f-a14310b5d7dd"/>
Nov 16 04:05:18 user nova-compute[103546]:       <nova:ports>
Nov 16 04:05:18 user nova-compute[103546]:         <nova:port uuid="30eba06b-aff6-43cf-b792-7624b1bc12a9">
Nov 16 04:05:18 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 16 04:05:18 user nova-compute[103546]:         </nova:port>
Nov 16 04:05:18 user nova-compute[103546]:       </nova:ports>
Nov 16 04:05:18 user nova-compute[103546]:     </nova:instance>
Nov 16 04:05:18 user nova-compute[103546]:   </metadata>
Nov 16 04:05:18 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 04:05:18 user nova-compute[103546]:     <system>
Nov 16 04:05:18 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 04:05:18 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 04:05:18 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 04:05:18 user nova-compute[103546]:       <entry name="serial">271adc7b-bfc6-48c5-8700-69b2b079ce4b</entry>
Nov 16 04:05:18 user nova-compute[103546]:       <entry name="uuid">271adc7b-bfc6-48c5-8700-69b2b079ce4b</entry>
Nov 16 04:05:18 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 04:05:18 user nova-compute[103546]:     </system>
Nov 16 04:05:18 user nova-compute[103546]:   </sysinfo>
Nov 16 04:05:18 user nova-compute[103546]:   <os>
Nov 16 04:05:18 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 04:05:18 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 04:05:18 user nova-compute[103546]:   </os>
Nov 16 04:05:18 user nova-compute[103546]:   <features>
Nov 16 04:05:18 user nova-compute[103546]:     <acpi/>
Nov 16 04:05:18 user nova-compute[103546]:     <apic/>
Nov 16 04:05:18 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 04:05:18 user nova-compute[103546]:   </features>
Nov 16 04:05:18 user nova-compute[103546]:   <clock offset="utc">
Nov 16 04:05:18 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 04:05:18 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 04:05:18 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 04:05:18 user nova-compute[103546]:   </clock>
Nov 16 04:05:18 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 04:05:18 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 04:05:18 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 04:05:18 user nova-compute[103546]:   </cpu>
Nov 16 04:05:18 user nova-compute[103546]:   <devices>
Nov 16 04:05:18 user nova-compute[103546]:     <disk type="block" device="disk">
Nov 16 04:05:18 user nova-compute[103546]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:05:18 user nova-compute[103546]:       <source dev="/dev/sde"/>
Nov 16 04:05:18 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 04:05:18 user nova-compute[103546]:       <serial>6d1a0410-4f73-4d23-a8d8-d745c527cdf7</serial>
Nov 16 04:05:18 user nova-compute[103546]:     </disk>
Nov 16 04:05:18 user nova-compute[103546]:     <disk type="file" device="disk">
Nov 16 04:05:18 user nova-compute[103546]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 04:05:18 user nova-compute[103546]:       <source file="/opt/stack/data/nova/instances/271adc7b-bfc6-48c5-8700-69b2b079ce4b/disk.rescue"/>
Nov 16 04:05:18 user nova-compute[103546]:       <target dev="vdb" bus="virtio"/>
Nov 16 04:05:18 user nova-compute[103546]:       <boot order="1"/>
Nov 16 04:05:18 user nova-compute[103546]:     </disk>
Nov 16 04:05:18 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 04:05:18 user nova-compute[103546]:       <mac address="fa:16:3e:ae:80:8d"/>
Nov 16 04:05:18 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 04:05:18 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 04:05:18 user nova-compute[103546]:       <target dev="tap30eba06b-af"/>
Nov 16 04:05:18 user nova-compute[103546]:     </interface>
Nov 16 04:05:18 user nova-compute[103546]:     <serial type="pty">
Nov 16 04:05:18 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/271adc7b-bfc6-48c5-8700-69b2b079ce4b/console.log" append="off"/>
Nov 16 04:05:18 user nova-compute[103546]:     </serial>
Nov 16 04:05:18 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 04:05:18 user nova-compute[103546]:     <video>
Nov 16 04:05:18 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 04:05:18 user nova-compute[103546]:     </video>
Nov 16 04:05:18 user nova-compute[103546]:     <rng model="virtio">
Nov 16 04:05:18 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 04:05:18 user nova-compute[103546]:     </rng>
Nov 16 04:05:18 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 04:05:18 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 04:05:18 user nova-compute[103546]:       <stats period="10"/>
Nov 16 04:05:18 user nova-compute[103546]:     </memballoon>
Nov 16 04:05:18 user nova-compute[103546]:   </devices>
Nov 16 04:05:18 user nova-compute[103546]: </domain>
Nov 16 04:05:18 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 04:05:18 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Instance destroyed successfully.
Nov 16 04:05:18 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] No BDM found with device name vdb, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] No VIF found with MAC fa:16:3e:ae:80:8d, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 04:05:18 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:19 user nova-compute[103546]: DEBUG nova.compute.manager [req-2a0a50e2-faf8-4dd9-8487-2c7106551221 req-5034044f-f617-4c28-8caf-7e6258303fe4 service nova] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Received event network-vif-plugged-804319c6-55cb-4f30-908c-71817934fb45 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:05:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-2a0a50e2-faf8-4dd9-8487-2c7106551221 req-5034044f-f617-4c28-8caf-7e6258303fe4 service nova] Acquiring lock "b0a480de-e99b-4b54-bd81-36c216442137-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:05:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-2a0a50e2-faf8-4dd9-8487-2c7106551221 req-5034044f-f617-4c28-8caf-7e6258303fe4 service nova] Lock "b0a480de-e99b-4b54-bd81-36c216442137-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:05:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-2a0a50e2-faf8-4dd9-8487-2c7106551221 req-5034044f-f617-4c28-8caf-7e6258303fe4 service nova] Lock "b0a480de-e99b-4b54-bd81-36c216442137-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:05:19 user nova-compute[103546]: DEBUG nova.compute.manager [req-2a0a50e2-faf8-4dd9-8487-2c7106551221 req-5034044f-f617-4c28-8caf-7e6258303fe4 service nova] [instance: b0a480de-e99b-4b54-bd81-36c216442137] No waiting events found dispatching network-vif-plugged-804319c6-55cb-4f30-908c-71817934fb45 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:05:19 user nova-compute[103546]: WARNING nova.compute.manager [req-2a0a50e2-faf8-4dd9-8487-2c7106551221 req-5034044f-f617-4c28-8caf-7e6258303fe4 service nova] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Received unexpected event network-vif-plugged-804319c6-55cb-4f30-908c-71817934fb45 for instance with vm_state stopped and task_state None.
Nov 16 04:05:19 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:19 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:20 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:20 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:20 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:20 user nova-compute[103546]: DEBUG nova.compute.manager [req-6c104146-eaed-4716-973f-7f90a45ac348 req-a0c830e3-6ca8-448f-9a62-1bad4839273f service nova] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Received event network-vif-plugged-30eba06b-aff6-43cf-b792-7624b1bc12a9 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:05:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6c104146-eaed-4716-973f-7f90a45ac348 req-a0c830e3-6ca8-448f-9a62-1bad4839273f service nova] Acquiring lock "271adc7b-bfc6-48c5-8700-69b2b079ce4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:05:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6c104146-eaed-4716-973f-7f90a45ac348 req-a0c830e3-6ca8-448f-9a62-1bad4839273f service nova] Lock "271adc7b-bfc6-48c5-8700-69b2b079ce4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:05:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6c104146-eaed-4716-973f-7f90a45ac348 req-a0c830e3-6ca8-448f-9a62-1bad4839273f service nova] Lock "271adc7b-bfc6-48c5-8700-69b2b079ce4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:05:20 user nova-compute[103546]: DEBUG nova.compute.manager [req-6c104146-eaed-4716-973f-7f90a45ac348 req-a0c830e3-6ca8-448f-9a62-1bad4839273f service nova] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] No waiting events found dispatching network-vif-plugged-30eba06b-aff6-43cf-b792-7624b1bc12a9 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:05:20 user nova-compute[103546]: WARNING nova.compute.manager [req-6c104146-eaed-4716-973f-7f90a45ac348 req-a0c830e3-6ca8-448f-9a62-1bad4839273f service nova] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Received unexpected event network-vif-plugged-30eba06b-aff6-43cf-b792-7624b1bc12a9 for instance with vm_state active and task_state rescuing.
Nov 16 04:05:20 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:20 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:22 user nova-compute[103546]: DEBUG nova.compute.manager [req-6efb624a-1370-4765-a76e-d5f811270797 req-28259d2a-fb1e-4982-a2fe-089e39823816 service nova] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Received event network-vif-plugged-30eba06b-aff6-43cf-b792-7624b1bc12a9 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:05:22 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6efb624a-1370-4765-a76e-d5f811270797 req-28259d2a-fb1e-4982-a2fe-089e39823816 service nova] Acquiring lock "271adc7b-bfc6-48c5-8700-69b2b079ce4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:05:22 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6efb624a-1370-4765-a76e-d5f811270797 req-28259d2a-fb1e-4982-a2fe-089e39823816 service nova] Lock "271adc7b-bfc6-48c5-8700-69b2b079ce4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:05:22 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6efb624a-1370-4765-a76e-d5f811270797 req-28259d2a-fb1e-4982-a2fe-089e39823816 service nova] Lock "271adc7b-bfc6-48c5-8700-69b2b079ce4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:05:22 user nova-compute[103546]: DEBUG nova.compute.manager [req-6efb624a-1370-4765-a76e-d5f811270797 req-28259d2a-fb1e-4982-a2fe-089e39823816 service nova] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] No waiting events found dispatching network-vif-plugged-30eba06b-aff6-43cf-b792-7624b1bc12a9 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:05:22 user nova-compute[103546]: WARNING nova.compute.manager [req-6efb624a-1370-4765-a76e-d5f811270797 req-28259d2a-fb1e-4982-a2fe-089e39823816 service nova] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Received unexpected event network-vif-plugged-30eba06b-aff6-43cf-b792-7624b1bc12a9 for instance with vm_state active and task_state rescuing.
Nov 16 04:05:22 user nova-compute[103546]: DEBUG nova.compute.manager [None req-1256fcd3-fde2-4938-b8e4-a37b817857ff tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 04:05:23 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:05:23 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=103546) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 04:05:23 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:24 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:05:24 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:05:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-5eebffb5-7cac-49d3-81d9-db62be44f610 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Acquiring lock "d31c22d9-0691-4f24-817b-93b1a57d6ff4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:05:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-5eebffb5-7cac-49d3-81d9-db62be44f610 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "d31c22d9-0691-4f24-817b-93b1a57d6ff4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:05:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-5eebffb5-7cac-49d3-81d9-db62be44f610 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Acquiring lock "d31c22d9-0691-4f24-817b-93b1a57d6ff4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:05:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-5eebffb5-7cac-49d3-81d9-db62be44f610 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "d31c22d9-0691-4f24-817b-93b1a57d6ff4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:05:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-5eebffb5-7cac-49d3-81d9-db62be44f610 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "d31c22d9-0691-4f24-817b-93b1a57d6ff4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:05:25 user nova-compute[103546]: INFO nova.compute.manager [None req-5eebffb5-7cac-49d3-81d9-db62be44f610 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Terminating instance
Nov 16 04:05:25 user nova-compute[103546]: DEBUG nova.compute.manager [None req-5eebffb5-7cac-49d3-81d9-db62be44f610 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Start destroying the instance on the hypervisor. {{(pid=103546) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 04:05:25 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:25 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:25 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:25 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:25 user nova-compute[103546]: DEBUG nova.compute.manager [req-6616b814-2345-4062-9ee4-25b8fcd59ca5 req-df8fb2a7-2d8a-488d-82ea-6b9d26ffcdcf service nova] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Received event network-vif-unplugged-32d2afdc-7f04-4be3-b45c-19b2c5deabf4 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:05:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6616b814-2345-4062-9ee4-25b8fcd59ca5 req-df8fb2a7-2d8a-488d-82ea-6b9d26ffcdcf service nova] Acquiring lock "d31c22d9-0691-4f24-817b-93b1a57d6ff4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:05:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6616b814-2345-4062-9ee4-25b8fcd59ca5 req-df8fb2a7-2d8a-488d-82ea-6b9d26ffcdcf service nova] Lock "d31c22d9-0691-4f24-817b-93b1a57d6ff4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:05:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6616b814-2345-4062-9ee4-25b8fcd59ca5 req-df8fb2a7-2d8a-488d-82ea-6b9d26ffcdcf service nova] Lock "d31c22d9-0691-4f24-817b-93b1a57d6ff4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:05:25 user nova-compute[103546]: DEBUG nova.compute.manager [req-6616b814-2345-4062-9ee4-25b8fcd59ca5 req-df8fb2a7-2d8a-488d-82ea-6b9d26ffcdcf service nova] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] No waiting events found dispatching network-vif-unplugged-32d2afdc-7f04-4be3-b45c-19b2c5deabf4 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:05:25 user nova-compute[103546]: DEBUG nova.compute.manager [req-6616b814-2345-4062-9ee4-25b8fcd59ca5 req-df8fb2a7-2d8a-488d-82ea-6b9d26ffcdcf service nova] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Received event network-vif-unplugged-32d2afdc-7f04-4be3-b45c-19b2c5deabf4 for instance with task_state deleting. {{(pid=103546) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 04:05:25 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:05:25 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:25 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Instance destroyed successfully.
Nov 16 04:05:25 user nova-compute[103546]: DEBUG nova.objects.instance [None req-5eebffb5-7cac-49d3-81d9-db62be44f610 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lazy-loading 'resources' on Instance uuid d31c22d9-0691-4f24-817b-93b1a57d6ff4 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:05:25 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-5eebffb5-7cac-49d3-81d9-db62be44f610 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:02:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1492269291',display_name='tempest-AttachVolumeNegativeTest-server-1492269291',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1492269291',id=38,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0EYW4UBVsS6W0Y5qmoYSoiOUkbNsiy2qk5HkV/ssQR5IAuVPrW/mKnBd47kH5BZHLesXRDDOhAVv4gjobri4LIU2McqbfGbUNfLYLAaAc6HixXmOfv/silzBxk2WJEPA==',key_name='tempest-keypair-2004008295',keypairs=<?>,launch_index=0,launched_at=2023-11-16T04:02:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8e30b7ac9515458aa8a6eb1a34cc543a',ramdisk_id='',reservation_id='r-g38jbr3t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-64216432',owner_user_name='tempest-AttachVolumeNegativeTest-64216432-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T04:02:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d186163bddc48319b97f186f7c65e80',uuid=d31c22d9-0691-4f24-817b-93b1a57d6ff4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "32d2afdc-7f04-4be3-b45c-19b2c5deabf4", "address": "fa:16:3e:7a:cf:df", "network": {"id": "6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038318316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e30b7ac9515458aa8a6eb1a34cc543a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32d2afdc-7f", "ovs_interfaceid": "32d2afdc-7f04-4be3-b45c-19b2c5deabf4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 04:05:26 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-5eebffb5-7cac-49d3-81d9-db62be44f610 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Converting VIF {"id": "32d2afdc-7f04-4be3-b45c-19b2c5deabf4", "address": "fa:16:3e:7a:cf:df", "network": {"id": "6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038318316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e30b7ac9515458aa8a6eb1a34cc543a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32d2afdc-7f", "ovs_interfaceid": "32d2afdc-7f04-4be3-b45c-19b2c5deabf4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:05:26 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-5eebffb5-7cac-49d3-81d9-db62be44f610 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:cf:df,bridge_name='br-int',has_traffic_filtering=True,id=32d2afdc-7f04-4be3-b45c-19b2c5deabf4,network=Network(6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32d2afdc-7f') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:05:26 user nova-compute[103546]: DEBUG os_vif [None req-5eebffb5-7cac-49d3-81d9-db62be44f610 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:cf:df,bridge_name='br-int',has_traffic_filtering=True,id=32d2afdc-7f04-4be3-b45c-19b2c5deabf4,network=Network(6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32d2afdc-7f') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 04:05:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap32d2afdc-7f, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:05:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:05:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=45300e7b-fa7a-4448-9874-b36f708e9fcd) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:05:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:05:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:26 user nova-compute[103546]: INFO os_vif [None req-5eebffb5-7cac-49d3-81d9-db62be44f610 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:cf:df,bridge_name='br-int',has_traffic_filtering=True,id=32d2afdc-7f04-4be3-b45c-19b2c5deabf4,network=Network(6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32d2afdc-7f')
Nov 16 04:05:26 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-5eebffb5-7cac-49d3-81d9-db62be44f610 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Deleting instance files /opt/stack/data/nova/instances/d31c22d9-0691-4f24-817b-93b1a57d6ff4_del
Nov 16 04:05:26 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-5eebffb5-7cac-49d3-81d9-db62be44f610 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Deletion of /opt/stack/data/nova/instances/d31c22d9-0691-4f24-817b-93b1a57d6ff4_del complete
Nov 16 04:05:26 user nova-compute[103546]: INFO nova.compute.manager [None req-5eebffb5-7cac-49d3-81d9-db62be44f610 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 16 04:05:26 user nova-compute[103546]: DEBUG oslo.service.loopingcall [None req-5eebffb5-7cac-49d3-81d9-db62be44f610 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=103546) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 04:05:26 user nova-compute[103546]: DEBUG nova.compute.manager [-] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Deallocating network for instance {{(pid=103546) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 04:05:26 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] deallocate_for_instance() {{(pid=103546) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 04:05:26 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:05:26 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:05:26 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager.update_available_resource {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:05:26 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:05:26 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:05:26 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:05:26 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Auditing locally available compute resources for user (node: user) {{(pid=103546) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 04:05:26 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:05:26 user nova-compute[103546]: INFO nova.compute.manager [-] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Took 0.80 seconds to deallocate network for instance.
Nov 16 04:05:26 user nova-compute[103546]: DEBUG nova.compute.manager [req-1ec97bcc-5ecf-42c0-80d9-522811fc1a69 req-a120dc7a-1c14-490a-bf3a-64abfc11f5be service nova] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Received event network-vif-deleted-32d2afdc-7f04-4be3-b45c-19b2c5deabf4 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:05:26 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 04:05:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c02873d-469e-41a4-b492-69f793c8a07c/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-5eebffb5-7cac-49d3-81d9-db62be44f610 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:05:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-5eebffb5-7cac-49d3-81d9-db62be44f610 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:05:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c02873d-469e-41a4-b492-69f793c8a07c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c02873d-469e-41a4-b492-69f793c8a07c/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c02873d-469e-41a4-b492-69f793c8a07c/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:27 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-5eebffb5-7cac-49d3-81d9-db62be44f610 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:05:27 user nova-compute[103546]: DEBUG nova.compute.manager [req-cf396d1e-10e4-44c5-85d0-b781d3794fde req-0d82adba-e283-4c1d-8cd2-97950960d003 service nova] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Received event network-vif-plugged-32d2afdc-7f04-4be3-b45c-19b2c5deabf4 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:05:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-cf396d1e-10e4-44c5-85d0-b781d3794fde req-0d82adba-e283-4c1d-8cd2-97950960d003 service nova] Acquiring lock "d31c22d9-0691-4f24-817b-93b1a57d6ff4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:05:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-cf396d1e-10e4-44c5-85d0-b781d3794fde req-0d82adba-e283-4c1d-8cd2-97950960d003 service nova] Lock "d31c22d9-0691-4f24-817b-93b1a57d6ff4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:05:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-cf396d1e-10e4-44c5-85d0-b781d3794fde req-0d82adba-e283-4c1d-8cd2-97950960d003 service nova] Lock "d31c22d9-0691-4f24-817b-93b1a57d6ff4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:05:27 user nova-compute[103546]: DEBUG nova.compute.manager [req-cf396d1e-10e4-44c5-85d0-b781d3794fde req-0d82adba-e283-4c1d-8cd2-97950960d003 service nova] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] No waiting events found dispatching network-vif-plugged-32d2afdc-7f04-4be3-b45c-19b2c5deabf4 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:05:27 user nova-compute[103546]: WARNING nova.compute.manager [req-cf396d1e-10e4-44c5-85d0-b781d3794fde req-0d82adba-e283-4c1d-8cd2-97950960d003 service nova] [instance: d31c22d9-0691-4f24-817b-93b1a57d6ff4] Received unexpected event network-vif-plugged-32d2afdc-7f04-4be3-b45c-19b2c5deabf4 for instance with vm_state deleted and task_state None.
Nov 16 04:05:27 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-5eebffb5-7cac-49d3-81d9-db62be44f610 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:05:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-5eebffb5-7cac-49d3-81d9-db62be44f610 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.640s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:05:27 user nova-compute[103546]: INFO nova.scheduler.client.report [None req-5eebffb5-7cac-49d3-81d9-db62be44f610 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Deleted allocations for instance d31c22d9-0691-4f24-817b-93b1a57d6ff4
Nov 16 04:05:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f7c407-3373-43ba-ac92-7eb0a43a7093/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-5eebffb5-7cac-49d3-81d9-db62be44f610 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "d31c22d9-0691-4f24-817b-93b1a57d6ff4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.583s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:05:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f7c407-3373-43ba-ac92-7eb0a43a7093/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f7c407-3373-43ba-ac92-7eb0a43a7093/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f7c407-3373-43ba-ac92-7eb0a43a7093/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:28 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 04:05:28 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 04:05:28 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 04:05:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa33f516-2ec7-4a83-ace8-f144e80d9473/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:28 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa33f516-2ec7-4a83-ace8-f144e80d9473/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa33f516-2ec7-4a83-ace8-f144e80d9473/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa33f516-2ec7-4a83-ace8-f144e80d9473/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:29 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 04:05:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.rescue --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.rescue --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:30 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 04:05:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/271adc7b-bfc6-48c5-8700-69b2b079ce4b/disk.rescue --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/271adc7b-bfc6-48c5-8700-69b2b079ce4b/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/271adc7b-bfc6-48c5-8700-69b2b079ce4b/disk.rescue --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/271adc7b-bfc6-48c5-8700-69b2b079ce4b/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:31 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:31 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:05:31 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:05:31 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Hypervisor/Node resource view: name=user free_ram=7535MB free_disk=24.86599349975586GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=103546) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 04:05:31 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:05:31 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:05:31 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Applying migration context for instance 26ba7f48-9752-45af-ba68-8c3f70325e21 as it has an incoming, in-progress migration 34a7d1e3-efee-4564-9eaf-e8028ab5c851. Migration status is finished {{(pid=103546) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 16 04:05:31 user nova-compute[103546]: INFO nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Updating resource usage from migration 34a7d1e3-efee-4564-9eaf-e8028ab5c851
Nov 16 04:05:31 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 9a89970b-fc61-4419-8ff9-b48013dccf9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:05:31 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 04101512-7333-4581-add3-7af3821e335b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:05:31 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance fa7e5468-9dd4-407d-85ec-d45ec76f9e29 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:05:31 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 246ccf69-847c-4ab2-b709-ad1a85e81eab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:05:31 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 8d229d05-95f1-4997-8539-802ac65cff8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:05:31 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance b0a480de-e99b-4b54-bd81-36c216442137 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:05:31 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 38f7c407-3373-43ba-ac92-7eb0a43a7093 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:05:31 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance fa33f516-2ec7-4a83-ace8-f144e80d9473 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:05:31 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 9a421bf0-70b6-4a2c-85da-813707619b84 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:05:31 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 271adc7b-bfc6-48c5-8700-69b2b079ce4b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:05:31 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 8c02873d-469e-41a4-b492-69f793c8a07c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:05:31 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Migration 34a7d1e3-efee-4564-9eaf-e8028ab5c851 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 16 04:05:31 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 26ba7f48-9752-45af-ba68-8c3f70325e21 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:05:31 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance f5e1d075-f64c-4837-9850-5f727a1984e4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:05:31 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 04:05:31 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 04:05:31 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:05:31 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:05:31 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Compute_service record updated for user:user {{(pid=103546) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 04:05:31 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.700s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:05:32 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:05:32 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Starting heal instance info cache {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 04:05:32 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "refresh_cache-fa7e5468-9dd4-407d-85ec-d45ec76f9e29" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:05:32 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquired lock "refresh_cache-fa7e5468-9dd4-407d-85ec-d45ec76f9e29" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:05:32 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Forcefully refreshing network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 04:05:33 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Updating instance_info_cache with network_info: [{"id": "764b22e9-e899-4d39-8bc7-903ff8a7c3f6", "address": "fa:16:3e:77:63:89", "network": {"id": "fdbb2d2c-9a54-4517-b33a-cf27ce7570b1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79661471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2a38a5eb514ce8a7569c8322657eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap764b22e9-e8", "ovs_interfaceid": "764b22e9-e899-4d39-8bc7-903ff8a7c3f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:05:33 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Releasing lock "refresh_cache-fa7e5468-9dd4-407d-85ec-d45ec76f9e29" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:05:33 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Updated the network info_cache for instance {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 04:05:33 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:05:33 user nova-compute[103546]: DEBUG nova.compute.manager [req-08e0d2d9-2baf-4f6e-99a1-8b1f20c78afa req-7d97e59e-eb01-49e7-bbcf-3f99867882af service nova] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Received event network-changed-96edd323-af11-4e10-a7bb-a6e0d0ea12ff {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:05:33 user nova-compute[103546]: DEBUG nova.compute.manager [req-08e0d2d9-2baf-4f6e-99a1-8b1f20c78afa req-7d97e59e-eb01-49e7-bbcf-3f99867882af service nova] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Refreshing instance network info cache due to event network-changed-96edd323-af11-4e10-a7bb-a6e0d0ea12ff. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 04:05:33 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-08e0d2d9-2baf-4f6e-99a1-8b1f20c78afa req-7d97e59e-eb01-49e7-bbcf-3f99867882af service nova] Acquiring lock "refresh_cache-8c02873d-469e-41a4-b492-69f793c8a07c" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:05:33 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-08e0d2d9-2baf-4f6e-99a1-8b1f20c78afa req-7d97e59e-eb01-49e7-bbcf-3f99867882af service nova] Acquired lock "refresh_cache-8c02873d-469e-41a4-b492-69f793c8a07c" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:05:33 user nova-compute[103546]: DEBUG nova.network.neutron [req-08e0d2d9-2baf-4f6e-99a1-8b1f20c78afa req-7d97e59e-eb01-49e7-bbcf-3f99867882af service nova] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Refreshing network info cache for port 96edd323-af11-4e10-a7bb-a6e0d0ea12ff {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 04:05:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:33 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-269dcf0e-2575-47dd-b78d-139bc4499f24 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Acquiring lock "8c02873d-469e-41a4-b492-69f793c8a07c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:05:33 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-269dcf0e-2575-47dd-b78d-139bc4499f24 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "8c02873d-469e-41a4-b492-69f793c8a07c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:05:33 user nova-compute[103546]: DEBUG nova.objects.instance [None req-269dcf0e-2575-47dd-b78d-139bc4499f24 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lazy-loading 'flavor' on Instance uuid 8c02873d-469e-41a4-b492-69f793c8a07c {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:05:34 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-269dcf0e-2575-47dd-b78d-139bc4499f24 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "8c02873d-469e-41a4-b492-69f793c8a07c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:05:34 user nova-compute[103546]: DEBUG nova.network.neutron [req-08e0d2d9-2baf-4f6e-99a1-8b1f20c78afa req-7d97e59e-eb01-49e7-bbcf-3f99867882af service nova] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Updated VIF entry in instance network info cache for port 96edd323-af11-4e10-a7bb-a6e0d0ea12ff. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 04:05:34 user nova-compute[103546]: DEBUG nova.network.neutron [req-08e0d2d9-2baf-4f6e-99a1-8b1f20c78afa req-7d97e59e-eb01-49e7-bbcf-3f99867882af service nova] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Updating instance_info_cache with network_info: [{"id": "96edd323-af11-4e10-a7bb-a6e0d0ea12ff", "address": "fa:16:3e:5a:5c:31", "network": {"id": "337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-40560053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca049d5674dc4c59814f98478752d73d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96edd323-af", "ovs_interfaceid": "96edd323-af11-4e10-a7bb-a6e0d0ea12ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:05:34 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-08e0d2d9-2baf-4f6e-99a1-8b1f20c78afa req-7d97e59e-eb01-49e7-bbcf-3f99867882af service nova] Releasing lock "refresh_cache-8c02873d-469e-41a4-b492-69f793c8a07c" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:05:34 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-269dcf0e-2575-47dd-b78d-139bc4499f24 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Acquiring lock "8c02873d-469e-41a4-b492-69f793c8a07c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:05:34 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-269dcf0e-2575-47dd-b78d-139bc4499f24 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "8c02873d-469e-41a4-b492-69f793c8a07c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:05:34 user nova-compute[103546]: INFO nova.compute.manager [None req-269dcf0e-2575-47dd-b78d-139bc4499f24 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Attaching volume 0faa59c5-ad97-4132-85ec-1f0101db20cb to /dev/vdb
Nov 16 04:05:34 user nova-compute[103546]: DEBUG os_brick.utils [None req-269dcf0e-2575-47dd-b78d-139bc4499f24 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:05:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:34 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5cf02c9-cd66-4677-838d-c5b1727f3406]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af5c39b14ece\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:05:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:34 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccec5e2-9abe-4073-819c-b491bba50bba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:05:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:34 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[171da0bd-f487-43a1-b953-ea4e6e5d9897]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:05:34 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[629389ff-0d29-4c83-88c5-31e730735589]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:05:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-269dcf0e-2575-47dd-b78d-139bc4499f24 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Running cmd (subprocess): nvme version {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-269dcf0e-2575-47dd-b78d-139bc4499f24 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] 'nvme version' failed. Not Retrying. {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 04:05:34 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.nvmeof [None req-269dcf0e-2575-47dd-b78d-139bc4499f24 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] nvme not present on system {{(pid=103546) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 04:05:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 04:05:34 user nova-compute[103546]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 04:05:34 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41e93bd-a042-4ff3-913d-2561b985e4a8]: (4, '') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:05:34 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-269dcf0e-2575-47dd-b78d-139bc4499f24 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=103546) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 04:05:34 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-269dcf0e-2575-47dd-b78d-139bc4499f24 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 04:05:34 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-269dcf0e-2575-47dd-b78d-139bc4499f24 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] LIGHTOS: no hostnqn found. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 04:05:34 user nova-compute[103546]: DEBUG os_brick.utils [None req-269dcf0e-2575-47dd-b78d-139bc4499f24 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af5c39b14ece', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:05:34 user nova-compute[103546]: DEBUG nova.virt.block_device [None req-269dcf0e-2575-47dd-b78d-139bc4499f24 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Updating existing volume attachment record: 7beabefb-3d21-4ce3-9457-73666683835d {{(pid=103546) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 04:05:36 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:38 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:39 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-64629d2d-123b-4a37-b681-457f520cb81c tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Acquiring lock "26ba7f48-9752-45af-ba68-8c3f70325e21" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:05:39 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-64629d2d-123b-4a37-b681-457f520cb81c tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "26ba7f48-9752-45af-ba68-8c3f70325e21" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:05:39 user nova-compute[103546]: DEBUG nova.compute.manager [None req-64629d2d-123b-4a37-b681-457f520cb81c tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Going to confirm migration 2 {{(pid=103546) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 16 04:05:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-269dcf0e-2575-47dd-b78d-139bc4499f24 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 04:05:39 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-269dcf0e-2575-47dd-b78d-139bc4499f24 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VUZdLCXW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:05:39 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-269dcf0e-2575-47dd-b78d-139bc4499f24 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:05:39 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-269dcf0e-2575-47dd-b78d-139bc4499f24 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:05:39 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-269dcf0e-2575-47dd-b78d-139bc4499f24 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:05:39 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-269dcf0e-2575-47dd-b78d-139bc4499f24 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:05:39 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-269dcf0e-2575-47dd-b78d-139bc4499f24 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:05:39 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-269dcf0e-2575-47dd-b78d-139bc4499f24 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:05:39 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-269dcf0e-2575-47dd-b78d-139bc4499f24 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 04:05:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:39 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[486564fb-8bb5-4114-b434-f4a5f720523f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:05:39 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-269dcf0e-2575-47dd-b78d-139bc4499f24 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 04:05:39 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:05:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb -p 172.16.0.220:3260 --interface default --op new {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:39 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[670be650-8c15-4d6d-8fe3-f82ee9bf2a50]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb] added\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:05:39 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-269dcf0e-2575-47dd-b78d-139bc4499f24 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb] added
Nov 16 04:05:39 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:05:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:39 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e80bb8-7cfc-4504-bc11-fce70bca777e]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:05:39 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-269dcf0e-2575-47dd-b78d-139bc4499f24 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:05:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:39 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60389a2-6ffa-4c69-b26f-31d49d529c02]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:05:39 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-269dcf0e-2575-47dd-b78d-139bc4499f24 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:05:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VUZdLCXW {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VUZdLCXW" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:39 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b8c193-ef0f-4cd5-a2df-4875fbe9f20c]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:05:39 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-269dcf0e-2575-47dd-b78d-139bc4499f24 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VUZdLCXW'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:05:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:39 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d60e339-7195-4142-a65b-f43fbbe0069c]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:05:39 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-269dcf0e-2575-47dd-b78d-139bc4499f24 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:05:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:39 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6d0dfa-ce05-4d29-890a-41a1db359d88]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:05:39 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-269dcf0e-2575-47dd-b78d-139bc4499f24 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:05:39 user nova-compute[103546]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:05:39 user nova-compute[103546]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)
Nov 16 04:05:39 user nova-compute[103546]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:05:39 user nova-compute[103546]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 (non-flash)
Nov 16 04:05:39 user nova-compute[103546]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294 (non-flash)
Nov 16 04:05:39 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:05:39 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-269dcf0e-2575-47dd-b78d-139bc4499f24 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:05:39 user nova-compute[103546]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:05:39 user nova-compute[103546]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)
Nov 16 04:05:39 user nova-compute[103546]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:05:39 user nova-compute[103546]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 (non-flash)
Nov 16 04:05:39 user nova-compute[103546]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294 (non-flash)
Nov 16 04:05:39 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:05:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb -p 172.16.0.220:3260 --login {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:39 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e41f1e1b-86d1-4d66-9e60-6348ef147a7b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:05:39 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-269dcf0e-2575-47dd-b78d-139bc4499f24 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb, portal: 172.16.0.220,3260]
Nov 16 04:05:39 user nova-compute[103546]: Login to [iface: default, target: iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb, portal: 172.16.0.220,3260] successful.
Nov 16 04:05:39 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:05:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:39 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f580ba-238f-4312-abdd-933ba331956b]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:05:39 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-269dcf0e-2575-47dd-b78d-139bc4499f24 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:05:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:39 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[923d30f1-6b8a-466a-b08a-86b26089dab2]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:05:39 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-269dcf0e-2575-47dd-b78d-139bc4499f24 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:05:39 user nova-compute[103546]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:05:39 user nova-compute[103546]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)
Nov 16 04:05:39 user nova-compute[103546]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:05:39 user nova-compute[103546]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 (non-flash)
Nov 16 04:05:39 user nova-compute[103546]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294 (non-flash)
Nov 16 04:05:39 user nova-compute[103546]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb (non-flash)
Nov 16 04:05:39 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:05:39 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-269dcf0e-2575-47dd-b78d-139bc4499f24 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:05:39 user nova-compute[103546]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:05:39 user nova-compute[103546]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)
Nov 16 04:05:39 user nova-compute[103546]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:05:39 user nova-compute[103546]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 (non-flash)
Nov 16 04:05:39 user nova-compute[103546]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294 (non-flash)
Nov 16 04:05:39 user nova-compute[103546]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb (non-flash)
Nov 16 04:05:39 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:05:39 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-269dcf0e-2575-47dd-b78d-139bc4499f24 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:05:39 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-269dcf0e-2575-47dd-b78d-139bc4499f24 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 04:05:39 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-269dcf0e-2575-47dd-b78d-139bc4499f24 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] HCTL ('35', '-', '-', 0) found on session 50 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 04:05:39 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-269dcf0e-2575-47dd-b78d-139bc4499f24 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 04:05:39 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-64629d2d-123b-4a37-b681-457f520cb81c tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Acquiring lock "refresh_cache-26ba7f48-9752-45af-ba68-8c3f70325e21" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:05:39 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-64629d2d-123b-4a37-b681-457f520cb81c tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Acquired lock "refresh_cache-26ba7f48-9752-45af-ba68-8c3f70325e21" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:05:39 user nova-compute[103546]: DEBUG nova.network.neutron [None req-64629d2d-123b-4a37-b681-457f520cb81c tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 04:05:39 user nova-compute[103546]: DEBUG nova.objects.instance [None req-64629d2d-123b-4a37-b681-457f520cb81c tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lazy-loading 'info_cache' on Instance uuid 26ba7f48-9752-45af-ba68-8c3f70325e21 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:05:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:39 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7b2c08-2563-4e86-9767-197aeb9ecefb]: (4, ('- - 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:05:39 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-269dcf0e-2575-47dd-b78d-139bc4499f24 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Searching for a device in session 50 and hctl ['35', '*', '*', 0] yield: None {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 04:05:40 user nova-compute[103546]: DEBUG nova.network.neutron [None req-64629d2d-123b-4a37-b681-457f520cb81c tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Updating instance_info_cache with network_info: [{"id": "59aaf9cc-b110-4cb9-aff1-9320d79f55c0", "address": "fa:16:3e:46:16:f7", "network": {"id": "29e9620f-313d-4679-89d7-459e7cf75b38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1690634205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72b30a015db444798ee72ff6fd14c69e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59aaf9cc-b1", "ovs_interfaceid": "59aaf9cc-b110-4cb9-aff1-9320d79f55c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:05:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-64629d2d-123b-4a37-b681-457f520cb81c tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Releasing lock "refresh_cache-26ba7f48-9752-45af-ba68-8c3f70325e21" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:05:40 user nova-compute[103546]: DEBUG nova.objects.instance [None req-64629d2d-123b-4a37-b681-457f520cb81c tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lazy-loading 'migration_context' on Instance uuid 26ba7f48-9752-45af-ba68-8c3f70325e21 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:05:40 user nova-compute[103546]: DEBUG nova.objects.base [None req-64629d2d-123b-4a37-b681-457f520cb81c tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Object Instance<26ba7f48-9752-45af-ba68-8c3f70325e21> lazy-loaded attributes: info_cache,migration_context {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 04:05:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-64629d2d-123b-4a37-b681-457f520cb81c tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:05:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-64629d2d-123b-4a37-b681-457f520cb81c tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:05:40 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-64629d2d-123b-4a37-b681-457f520cb81c tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:05:40 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-64629d2d-123b-4a37-b681-457f520cb81c tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:05:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-64629d2d-123b-4a37-b681-457f520cb81c tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.454s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:05:40 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-269dcf0e-2575-47dd-b78d-139bc4499f24 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Searching for a device in session 50 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 04:05:40 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-269dcf0e-2575-47dd-b78d-139bc4499f24 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VUZdLCXW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 04:05:40 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-269dcf0e-2575-47dd-b78d-139bc4499f24 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:05:40 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-269dcf0e-2575-47dd-b78d-139bc4499f24 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '26630323236393966', 'path': '/dev/sdd'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:05:40 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-269dcf0e-2575-47dd-b78d-139bc4499f24 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630323236393966', 'path': '/dev/sdd'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 04:05:40 user nova-compute[103546]: DEBUG nova.objects.instance [None req-269dcf0e-2575-47dd-b78d-139bc4499f24 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lazy-loading 'flavor' on Instance uuid 8c02873d-469e-41a4-b492-69f793c8a07c {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:05:40 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-269dcf0e-2575-47dd-b78d-139bc4499f24 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 04:05:40 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:05:40 user nova-compute[103546]:   <source dev="/dev/sdd"/>
Nov 16 04:05:40 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 04:05:40 user nova-compute[103546]:   <serial>0faa59c5-ad97-4132-85ec-1f0101db20cb</serial>
Nov 16 04:05:40 user nova-compute[103546]: </disk>
Nov 16 04:05:40 user nova-compute[103546]:  {{(pid=103546) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 04:05:40 user nova-compute[103546]: INFO nova.scheduler.client.report [None req-64629d2d-123b-4a37-b681-457f520cb81c tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Deleted allocation for migration 34a7d1e3-efee-4564-9eaf-e8028ab5c851
Nov 16 04:05:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-64629d2d-123b-4a37-b681-457f520cb81c tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "26ba7f48-9752-45af-ba68-8c3f70325e21" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.659s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:05:41 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:41 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-269dcf0e-2575-47dd-b78d-139bc4499f24 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:05:41 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-269dcf0e-2575-47dd-b78d-139bc4499f24 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] No BDM found with device name vdb, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:05:41 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-269dcf0e-2575-47dd-b78d-139bc4499f24 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] No VIF found with MAC fa:16:3e:5a:5c:31, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 04:05:41 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-269dcf0e-2575-47dd-b78d-139bc4499f24 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "8c02873d-469e-41a4-b492-69f793c8a07c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.094s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:05:41 user nova-compute[103546]: INFO nova.compute.manager [None req-cf9d1bff-a6aa-4c50-ac5e-bc6fbf581570 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Rescuing
Nov 16 04:05:41 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cf9d1bff-a6aa-4c50-ac5e-bc6fbf581570 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Acquiring lock "refresh_cache-8c02873d-469e-41a4-b492-69f793c8a07c" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:05:41 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cf9d1bff-a6aa-4c50-ac5e-bc6fbf581570 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Acquired lock "refresh_cache-8c02873d-469e-41a4-b492-69f793c8a07c" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:05:41 user nova-compute[103546]: DEBUG nova.network.neutron [None req-cf9d1bff-a6aa-4c50-ac5e-bc6fbf581570 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 04:05:42 user nova-compute[103546]: DEBUG nova.network.neutron [None req-cf9d1bff-a6aa-4c50-ac5e-bc6fbf581570 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Updating instance_info_cache with network_info: [{"id": "96edd323-af11-4e10-a7bb-a6e0d0ea12ff", "address": "fa:16:3e:5a:5c:31", "network": {"id": "337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-40560053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca049d5674dc4c59814f98478752d73d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96edd323-af", "ovs_interfaceid": "96edd323-af11-4e10-a7bb-a6e0d0ea12ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:05:42 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cf9d1bff-a6aa-4c50-ac5e-bc6fbf581570 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Releasing lock "refresh_cache-8c02873d-469e-41a4-b492-69f793c8a07c" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:05:42 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:42 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:42 user nova-compute[103546]: DEBUG nova.compute.manager [req-83f83cd0-2f1d-47d2-be50-cf60e080a111 req-eae74170-5362-4ee6-b8e4-f58c7b6f1407 service nova] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Received event network-vif-unplugged-96edd323-af11-4e10-a7bb-a6e0d0ea12ff {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:05:42 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-83f83cd0-2f1d-47d2-be50-cf60e080a111 req-eae74170-5362-4ee6-b8e4-f58c7b6f1407 service nova] Acquiring lock "8c02873d-469e-41a4-b492-69f793c8a07c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:05:42 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-83f83cd0-2f1d-47d2-be50-cf60e080a111 req-eae74170-5362-4ee6-b8e4-f58c7b6f1407 service nova] Lock "8c02873d-469e-41a4-b492-69f793c8a07c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:05:42 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-83f83cd0-2f1d-47d2-be50-cf60e080a111 req-eae74170-5362-4ee6-b8e4-f58c7b6f1407 service nova] Lock "8c02873d-469e-41a4-b492-69f793c8a07c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:05:42 user nova-compute[103546]: DEBUG nova.compute.manager [req-83f83cd0-2f1d-47d2-be50-cf60e080a111 req-eae74170-5362-4ee6-b8e4-f58c7b6f1407 service nova] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] No waiting events found dispatching network-vif-unplugged-96edd323-af11-4e10-a7bb-a6e0d0ea12ff {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:05:42 user nova-compute[103546]: WARNING nova.compute.manager [req-83f83cd0-2f1d-47d2-be50-cf60e080a111 req-eae74170-5362-4ee6-b8e4-f58c7b6f1407 service nova] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Received unexpected event network-vif-unplugged-96edd323-af11-4e10-a7bb-a6e0d0ea12ff for instance with vm_state active and task_state rescuing.
Nov 16 04:05:42 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:42 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:43 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Instance destroyed successfully.
Nov 16 04:05:43 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-cf9d1bff-a6aa-4c50-ac5e-bc6fbf581570 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Attempting rescue
Nov 16 04:05:43 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-cf9d1bff-a6aa-4c50-ac5e-bc6fbf581570 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=103546) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 16 04:05:43 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-cf9d1bff-a6aa-4c50-ac5e-bc6fbf581570 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Instance directory exists: not creating {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 16 04:05:43 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-cf9d1bff-a6aa-4c50-ac5e-bc6fbf581570 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Creating image(s)
Nov 16 04:05:43 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cf9d1bff-a6aa-4c50-ac5e-bc6fbf581570 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Acquiring lock "/opt/stack/data/nova/instances/8c02873d-469e-41a4-b492-69f793c8a07c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:05:43 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cf9d1bff-a6aa-4c50-ac5e-bc6fbf581570 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "/opt/stack/data/nova/instances/8c02873d-469e-41a4-b492-69f793c8a07c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:05:43 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cf9d1bff-a6aa-4c50-ac5e-bc6fbf581570 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "/opt/stack/data/nova/instances/8c02873d-469e-41a4-b492-69f793c8a07c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:05:43 user nova-compute[103546]: DEBUG nova.objects.instance [None req-cf9d1bff-a6aa-4c50-ac5e-bc6fbf581570 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8c02873d-469e-41a4-b492-69f793c8a07c {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:05:43 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cf9d1bff-a6aa-4c50-ac5e-bc6fbf581570 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Acquiring lock "8c9efafb670bfe5842ba1f4ce398924612164af7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:05:43 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cf9d1bff-a6aa-4c50-ac5e-bc6fbf581570 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:05:43 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-cf9d1bff-a6aa-4c50-ac5e-bc6fbf581570 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:43 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-cf9d1bff-a6aa-4c50-ac5e-bc6fbf581570 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.176s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:43 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-cf9d1bff-a6aa-4c50-ac5e-bc6fbf581570 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/8c02873d-469e-41a4-b492-69f793c8a07c/disk.rescue {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:05:43 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-cf9d1bff-a6aa-4c50-ac5e-bc6fbf581570 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/8c02873d-469e-41a4-b492-69f793c8a07c/disk.rescue" returned: 0 in 0.060s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:05:43 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cf9d1bff-a6aa-4c50-ac5e-bc6fbf581570 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:05:43 user nova-compute[103546]: DEBUG nova.objects.instance [None req-cf9d1bff-a6aa-4c50-ac5e-bc6fbf581570 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lazy-loading 'migration_context' on Instance uuid 8c02873d-469e-41a4-b492-69f793c8a07c {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:05:43 user nova-compute[103546]: DEBUG nova.objects.base [None req-cf9d1bff-a6aa-4c50-ac5e-bc6fbf581570 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Object Instance<8c02873d-469e-41a4-b492-69f793c8a07c> lazy-loaded attributes: trusted_certs,migration_context {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 04:05:43 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-cf9d1bff-a6aa-4c50-ac5e-bc6fbf581570 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Created local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 04:05:43 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-cf9d1bff-a6aa-4c50-ac5e-bc6fbf581570 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Start _get_guest_xml network_info=[{"id": "96edd323-af11-4e10-a7bb-a6e0d0ea12ff", "address": "fa:16:3e:5a:5c:31", "network": {"id": "337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-40560053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-40560053-network", "vif_mac": "fa:16:3e:5a:5c:31"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca049d5674dc4c59814f98478752d73d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96edd323-af", "ovs_interfaceid": "96edd323-af11-4e10-a7bb-a6e0d0ea12ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '5c6f539a-01e5-4478-bf8f-a14310b5d7dd', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 04:05:43 user nova-compute[103546]: DEBUG nova.objects.instance [None req-cf9d1bff-a6aa-4c50-ac5e-bc6fbf581570 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lazy-loading 'resources' on Instance uuid 8c02873d-469e-41a4-b492-69f793c8a07c {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:05:43 user nova-compute[103546]: DEBUG nova.objects.base [None req-cf9d1bff-a6aa-4c50-ac5e-bc6fbf581570 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Object Instance<8c02873d-469e-41a4-b492-69f793c8a07c> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 04:05:43 user nova-compute[103546]: DEBUG nova.objects.instance [None req-cf9d1bff-a6aa-4c50-ac5e-bc6fbf581570 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lazy-loading 'numa_topology' on Instance uuid 8c02873d-469e-41a4-b492-69f793c8a07c {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:05:43 user nova-compute[103546]: DEBUG nova.objects.base [None req-cf9d1bff-a6aa-4c50-ac5e-bc6fbf581570 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Object Instance<8c02873d-469e-41a4-b492-69f793c8a07c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 04:05:43 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-cf9d1bff-a6aa-4c50-ac5e-bc6fbf581570 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:05:43 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-cf9d1bff-a6aa-4c50-ac5e-bc6fbf581570 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:05:43 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-cf9d1bff-a6aa-4c50-ac5e-bc6fbf581570 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 04:05:43 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-cf9d1bff-a6aa-4c50-ac5e-bc6fbf581570 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 04:05:43 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-cf9d1bff-a6aa-4c50-ac5e-bc6fbf581570 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 04:05:43 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-cf9d1bff-a6aa-4c50-ac5e-bc6fbf581570 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 04:05:43 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-cf9d1bff-a6aa-4c50-ac5e-bc6fbf581570 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 04:05:43 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-cf9d1bff-a6aa-4c50-ac5e-bc6fbf581570 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 04:05:43 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-cf9d1bff-a6aa-4c50-ac5e-bc6fbf581570 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 04:05:43 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-cf9d1bff-a6aa-4c50-ac5e-bc6fbf581570 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 04:05:43 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-cf9d1bff-a6aa-4c50-ac5e-bc6fbf581570 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 04:05:43 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-cf9d1bff-a6aa-4c50-ac5e-bc6fbf581570 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 04:05:43 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-cf9d1bff-a6aa-4c50-ac5e-bc6fbf581570 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 04:05:43 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-cf9d1bff-a6aa-4c50-ac5e-bc6fbf581570 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 04:05:43 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-cf9d1bff-a6aa-4c50-ac5e-bc6fbf581570 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 04:05:43 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-cf9d1bff-a6aa-4c50-ac5e-bc6fbf581570 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 04:05:43 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-cf9d1bff-a6aa-4c50-ac5e-bc6fbf581570 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 04:05:43 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-cf9d1bff-a6aa-4c50-ac5e-bc6fbf581570 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 04:05:43 user nova-compute[103546]: DEBUG nova.objects.instance [None req-cf9d1bff-a6aa-4c50-ac5e-bc6fbf581570 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8c02873d-469e-41a4-b492-69f793c8a07c {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:05:43 user nova-compute[103546]: DEBUG nova.objects.base [None req-cf9d1bff-a6aa-4c50-ac5e-bc6fbf581570 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Object Instance<8c02873d-469e-41a4-b492-69f793c8a07c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 04:05:43 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-cf9d1bff-a6aa-4c50-ac5e-bc6fbf581570 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:03:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-563151612',display_name='tempest-ServerRescueNegativeTestJSON-server-563151612',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-563151612',id=41,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPimoHFW0lef+vE/gmpf/A37NZe+DyQwwLeT9RTaaZRkk4sSIIvf2JY7pK9OsbSpgTcfdwXllC/ZBjX4ZD6jJMjV9YFlTmNXttYPxCshd7r/7KOHpnM6mHKwsTuNdrmBLA==',key_name='tempest-keypair-959060809',keypairs=<?>,launch_index=0,launched_at=2023-11-16T04:03:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ca049d5674dc4c59814f98478752d73d',ramdisk_id='',reservation_id='r-judr5tlu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1943614153',owner_user_name='tempest-ServerRescueNegativeTestJSON-1943614153-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T04:03:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7626749c82fb4b5c81e696e4beeed858',uuid=8c02873d-469e-41a4-b492-69f793c8a07c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96edd323-af11-4e10-a7bb-a6e0d0ea12ff", "address": "fa:16:3e:5a:5c:31", "network": {"id": "337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-40560053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-40560053-network", "vif_mac": "fa:16:3e:5a:5c:31"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca049d5674dc4c59814f98478752d73d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96edd323-af", "ovs_interfaceid": "96edd323-af11-4e10-a7bb-a6e0d0ea12ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 04:05:43 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-cf9d1bff-a6aa-4c50-ac5e-bc6fbf581570 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Converting VIF {"id": "96edd323-af11-4e10-a7bb-a6e0d0ea12ff", "address": "fa:16:3e:5a:5c:31", "network": {"id": "337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-40560053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-40560053-network", "vif_mac": "fa:16:3e:5a:5c:31"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca049d5674dc4c59814f98478752d73d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96edd323-af", "ovs_interfaceid": "96edd323-af11-4e10-a7bb-a6e0d0ea12ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:05:43 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-cf9d1bff-a6aa-4c50-ac5e-bc6fbf581570 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5a:5c:31,bridge_name='br-int',has_traffic_filtering=True,id=96edd323-af11-4e10-a7bb-a6e0d0ea12ff,network=Network(337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96edd323-af') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:05:43 user nova-compute[103546]: DEBUG nova.objects.instance [None req-cf9d1bff-a6aa-4c50-ac5e-bc6fbf581570 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lazy-loading 'pci_devices' on Instance uuid 8c02873d-469e-41a4-b492-69f793c8a07c {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:05:43 user nova-compute[103546]: DEBUG nova.objects.base [None req-cf9d1bff-a6aa-4c50-ac5e-bc6fbf581570 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Object Instance<8c02873d-469e-41a4-b492-69f793c8a07c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 04:05:43 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-cf9d1bff-a6aa-4c50-ac5e-bc6fbf581570 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] End _get_guest_xml xml=<domain type="kvm">
Nov 16 04:05:43 user nova-compute[103546]:   <uuid>8c02873d-469e-41a4-b492-69f793c8a07c</uuid>
Nov 16 04:05:43 user nova-compute[103546]:   <name>instance-00000029</name>
Nov 16 04:05:43 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 04:05:43 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 04:05:43 user nova-compute[103546]:   <metadata>
Nov 16 04:05:43 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 04:05:43 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 04:05:43 user nova-compute[103546]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-563151612</nova:name>
Nov 16 04:05:43 user nova-compute[103546]:       <nova:creationTime>2023-11-16 04:05:43</nova:creationTime>
Nov 16 04:05:43 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 04:05:43 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 04:05:43 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 04:05:43 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 04:05:43 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 04:05:43 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 04:05:43 user nova-compute[103546]:       </nova:flavor>
Nov 16 04:05:43 user nova-compute[103546]:       <nova:owner>
Nov 16 04:05:43 user nova-compute[103546]:         <nova:user uuid="7626749c82fb4b5c81e696e4beeed858">tempest-ServerRescueNegativeTestJSON-1943614153-project-member</nova:user>
Nov 16 04:05:43 user nova-compute[103546]:         <nova:project uuid="ca049d5674dc4c59814f98478752d73d">tempest-ServerRescueNegativeTestJSON-1943614153</nova:project>
Nov 16 04:05:43 user nova-compute[103546]:       </nova:owner>
Nov 16 04:05:43 user nova-compute[103546]:       <nova:root type="image" uuid="5c6f539a-01e5-4478-bf8f-a14310b5d7dd"/>
Nov 16 04:05:43 user nova-compute[103546]:       <nova:ports>
Nov 16 04:05:43 user nova-compute[103546]:         <nova:port uuid="96edd323-af11-4e10-a7bb-a6e0d0ea12ff">
Nov 16 04:05:43 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 16 04:05:43 user nova-compute[103546]:         </nova:port>
Nov 16 04:05:43 user nova-compute[103546]:       </nova:ports>
Nov 16 04:05:43 user nova-compute[103546]:     </nova:instance>
Nov 16 04:05:43 user nova-compute[103546]:   </metadata>
Nov 16 04:05:43 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 04:05:43 user nova-compute[103546]:     <system>
Nov 16 04:05:43 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 04:05:43 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 04:05:43 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 04:05:43 user nova-compute[103546]:       <entry name="serial">8c02873d-469e-41a4-b492-69f793c8a07c</entry>
Nov 16 04:05:43 user nova-compute[103546]:       <entry name="uuid">8c02873d-469e-41a4-b492-69f793c8a07c</entry>
Nov 16 04:05:43 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 04:05:43 user nova-compute[103546]:     </system>
Nov 16 04:05:43 user nova-compute[103546]:   </sysinfo>
Nov 16 04:05:43 user nova-compute[103546]:   <os>
Nov 16 04:05:43 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 04:05:43 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 04:05:43 user nova-compute[103546]:   </os>
Nov 16 04:05:43 user nova-compute[103546]:   <features>
Nov 16 04:05:43 user nova-compute[103546]:     <acpi/>
Nov 16 04:05:43 user nova-compute[103546]:     <apic/>
Nov 16 04:05:43 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 04:05:43 user nova-compute[103546]:   </features>
Nov 16 04:05:43 user nova-compute[103546]:   <clock offset="utc">
Nov 16 04:05:43 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 04:05:43 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 04:05:43 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 04:05:43 user nova-compute[103546]:   </clock>
Nov 16 04:05:43 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 04:05:43 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 04:05:43 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 04:05:43 user nova-compute[103546]:   </cpu>
Nov 16 04:05:43 user nova-compute[103546]:   <devices>
Nov 16 04:05:43 user nova-compute[103546]:     <disk type="file" device="disk">
Nov 16 04:05:43 user nova-compute[103546]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 04:05:43 user nova-compute[103546]:       <source file="/opt/stack/data/nova/instances/8c02873d-469e-41a4-b492-69f793c8a07c/disk.rescue"/>
Nov 16 04:05:43 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 04:05:43 user nova-compute[103546]:     </disk>
Nov 16 04:05:43 user nova-compute[103546]:     <disk type="file" device="disk">
Nov 16 04:05:43 user nova-compute[103546]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 04:05:43 user nova-compute[103546]:       <source file="/opt/stack/data/nova/instances/8c02873d-469e-41a4-b492-69f793c8a07c/disk"/>
Nov 16 04:05:43 user nova-compute[103546]:       <target dev="vdb" bus="virtio"/>
Nov 16 04:05:43 user nova-compute[103546]:     </disk>
Nov 16 04:05:43 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 04:05:43 user nova-compute[103546]:       <mac address="fa:16:3e:5a:5c:31"/>
Nov 16 04:05:43 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 04:05:43 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 04:05:43 user nova-compute[103546]:       <target dev="tap96edd323-af"/>
Nov 16 04:05:43 user nova-compute[103546]:     </interface>
Nov 16 04:05:43 user nova-compute[103546]:     <serial type="pty">
Nov 16 04:05:43 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/8c02873d-469e-41a4-b492-69f793c8a07c/console.log" append="off"/>
Nov 16 04:05:43 user nova-compute[103546]:     </serial>
Nov 16 04:05:43 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 04:05:43 user nova-compute[103546]:     <video>
Nov 16 04:05:43 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 04:05:43 user nova-compute[103546]:     </video>
Nov 16 04:05:43 user nova-compute[103546]:     <rng model="virtio">
Nov 16 04:05:43 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 04:05:43 user nova-compute[103546]:     </rng>
Nov 16 04:05:43 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 04:05:43 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 04:05:43 user nova-compute[103546]:       <stats period="10"/>
Nov 16 04:05:43 user nova-compute[103546]:     </memballoon>
Nov 16 04:05:43 user nova-compute[103546]:   </devices>
Nov 16 04:05:43 user nova-compute[103546]: </domain>
Nov 16 04:05:43 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 04:05:43 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Instance destroyed successfully.
Nov 16 04:05:43 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-cf9d1bff-a6aa-4c50-ac5e-bc6fbf581570 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:05:43 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-cf9d1bff-a6aa-4c50-ac5e-bc6fbf581570 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] No BDM found with device name vdb, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:05:43 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-cf9d1bff-a6aa-4c50-ac5e-bc6fbf581570 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] No VIF found with MAC fa:16:3e:5a:5c:31, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 04:05:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:44 user nova-compute[103546]: DEBUG nova.compute.manager [req-50b6ec50-28f7-40fa-964c-0f89bd380073 req-7490e76f-cfc8-48a2-9285-507f82c3d76f service nova] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Received event network-vif-plugged-96edd323-af11-4e10-a7bb-a6e0d0ea12ff {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:05:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-50b6ec50-28f7-40fa-964c-0f89bd380073 req-7490e76f-cfc8-48a2-9285-507f82c3d76f service nova] Acquiring lock "8c02873d-469e-41a4-b492-69f793c8a07c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:05:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-50b6ec50-28f7-40fa-964c-0f89bd380073 req-7490e76f-cfc8-48a2-9285-507f82c3d76f service nova] Lock "8c02873d-469e-41a4-b492-69f793c8a07c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:05:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-50b6ec50-28f7-40fa-964c-0f89bd380073 req-7490e76f-cfc8-48a2-9285-507f82c3d76f service nova] Lock "8c02873d-469e-41a4-b492-69f793c8a07c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:05:44 user nova-compute[103546]: DEBUG nova.compute.manager [req-50b6ec50-28f7-40fa-964c-0f89bd380073 req-7490e76f-cfc8-48a2-9285-507f82c3d76f service nova] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] No waiting events found dispatching network-vif-plugged-96edd323-af11-4e10-a7bb-a6e0d0ea12ff {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:05:44 user nova-compute[103546]: WARNING nova.compute.manager [req-50b6ec50-28f7-40fa-964c-0f89bd380073 req-7490e76f-cfc8-48a2-9285-507f82c3d76f service nova] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Received unexpected event network-vif-plugged-96edd323-af11-4e10-a7bb-a6e0d0ea12ff for instance with vm_state active and task_state rescuing.
Nov 16 04:05:45 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:45 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:45 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:45 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:45 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:45 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:45 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:46 user nova-compute[103546]: DEBUG nova.compute.manager [req-f1e58ddd-aead-4bc1-94f8-a696819fd540 req-f5578300-ef36-4c01-8bfc-7786b914d30f service nova] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Received event network-vif-plugged-96edd323-af11-4e10-a7bb-a6e0d0ea12ff {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:05:46 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-f1e58ddd-aead-4bc1-94f8-a696819fd540 req-f5578300-ef36-4c01-8bfc-7786b914d30f service nova] Acquiring lock "8c02873d-469e-41a4-b492-69f793c8a07c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:05:46 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-f1e58ddd-aead-4bc1-94f8-a696819fd540 req-f5578300-ef36-4c01-8bfc-7786b914d30f service nova] Lock "8c02873d-469e-41a4-b492-69f793c8a07c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:05:46 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-f1e58ddd-aead-4bc1-94f8-a696819fd540 req-f5578300-ef36-4c01-8bfc-7786b914d30f service nova] Lock "8c02873d-469e-41a4-b492-69f793c8a07c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:05:46 user nova-compute[103546]: DEBUG nova.compute.manager [req-f1e58ddd-aead-4bc1-94f8-a696819fd540 req-f5578300-ef36-4c01-8bfc-7786b914d30f service nova] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] No waiting events found dispatching network-vif-plugged-96edd323-af11-4e10-a7bb-a6e0d0ea12ff {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:05:46 user nova-compute[103546]: WARNING nova.compute.manager [req-f1e58ddd-aead-4bc1-94f8-a696819fd540 req-f5578300-ef36-4c01-8bfc-7786b914d30f service nova] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Received unexpected event network-vif-plugged-96edd323-af11-4e10-a7bb-a6e0d0ea12ff for instance with vm_state active and task_state rescuing.
Nov 16 04:05:46 user nova-compute[103546]: DEBUG nova.compute.manager [req-f1e58ddd-aead-4bc1-94f8-a696819fd540 req-f5578300-ef36-4c01-8bfc-7786b914d30f service nova] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Received event network-vif-plugged-96edd323-af11-4e10-a7bb-a6e0d0ea12ff {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:05:46 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-f1e58ddd-aead-4bc1-94f8-a696819fd540 req-f5578300-ef36-4c01-8bfc-7786b914d30f service nova] Acquiring lock "8c02873d-469e-41a4-b492-69f793c8a07c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:05:46 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-f1e58ddd-aead-4bc1-94f8-a696819fd540 req-f5578300-ef36-4c01-8bfc-7786b914d30f service nova] Lock "8c02873d-469e-41a4-b492-69f793c8a07c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:05:46 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-f1e58ddd-aead-4bc1-94f8-a696819fd540 req-f5578300-ef36-4c01-8bfc-7786b914d30f service nova] Lock "8c02873d-469e-41a4-b492-69f793c8a07c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:05:46 user nova-compute[103546]: DEBUG nova.compute.manager [req-f1e58ddd-aead-4bc1-94f8-a696819fd540 req-f5578300-ef36-4c01-8bfc-7786b914d30f service nova] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] No waiting events found dispatching network-vif-plugged-96edd323-af11-4e10-a7bb-a6e0d0ea12ff {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:05:46 user nova-compute[103546]: WARNING nova.compute.manager [req-f1e58ddd-aead-4bc1-94f8-a696819fd540 req-f5578300-ef36-4c01-8bfc-7786b914d30f service nova] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Received unexpected event network-vif-plugged-96edd323-af11-4e10-a7bb-a6e0d0ea12ff for instance with vm_state active and task_state rescuing.
Nov 16 04:05:47 user nova-compute[103546]: DEBUG nova.compute.manager [None req-cf9d1bff-a6aa-4c50-ac5e-bc6fbf581570 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 04:05:48 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:51 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:56 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:05:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:06:01 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:06:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:06:06 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:06:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:06:11 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:06:13 user nova-compute[103546]: DEBUG nova.compute.manager [req-c9b27457-e7a1-4de8-a32e-d041d840781a req-15ab41b7-6f5f-42c6-95ab-ab1ece6df7fd service nova] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Received event network-changed-bd7cede4-510c-488f-bf84-773a345198d7 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:06:13 user nova-compute[103546]: DEBUG nova.compute.manager [req-c9b27457-e7a1-4de8-a32e-d041d840781a req-15ab41b7-6f5f-42c6-95ab-ab1ece6df7fd service nova] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Refreshing instance network info cache due to event network-changed-bd7cede4-510c-488f-bf84-773a345198d7. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 04:06:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-c9b27457-e7a1-4de8-a32e-d041d840781a req-15ab41b7-6f5f-42c6-95ab-ab1ece6df7fd service nova] Acquiring lock "refresh_cache-fa33f516-2ec7-4a83-ace8-f144e80d9473" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:06:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-c9b27457-e7a1-4de8-a32e-d041d840781a req-15ab41b7-6f5f-42c6-95ab-ab1ece6df7fd service nova] Acquired lock "refresh_cache-fa33f516-2ec7-4a83-ace8-f144e80d9473" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:06:13 user nova-compute[103546]: DEBUG nova.network.neutron [req-c9b27457-e7a1-4de8-a32e-d041d840781a req-15ab41b7-6f5f-42c6-95ab-ab1ece6df7fd service nova] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Refreshing network info cache for port bd7cede4-510c-488f-bf84-773a345198d7 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 04:06:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:06:14 user nova-compute[103546]: DEBUG nova.network.neutron [req-c9b27457-e7a1-4de8-a32e-d041d840781a req-15ab41b7-6f5f-42c6-95ab-ab1ece6df7fd service nova] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Updated VIF entry in instance network info cache for port bd7cede4-510c-488f-bf84-773a345198d7. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 04:06:14 user nova-compute[103546]: DEBUG nova.network.neutron [req-c9b27457-e7a1-4de8-a32e-d041d840781a req-15ab41b7-6f5f-42c6-95ab-ab1ece6df7fd service nova] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Updating instance_info_cache with network_info: [{"id": "bd7cede4-510c-488f-bf84-773a345198d7", "address": "fa:16:3e:84:89:24", "network": {"id": "d942264a-f03e-49a2-89eb-103a12c99518", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484356505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edb839c76c0d4513b9be0ec92301707f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd7cede4-51", "ovs_interfaceid": "bd7cede4-510c-488f-bf84-773a345198d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:06:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-c9b27457-e7a1-4de8-a32e-d041d840781a req-15ab41b7-6f5f-42c6-95ab-ab1ece6df7fd service nova] Releasing lock "refresh_cache-fa33f516-2ec7-4a83-ace8-f144e80d9473" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:06:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:06:14 user nova-compute[103546]: DEBUG nova.compute.manager [req-f57b4f15-c8d2-494e-a4be-5ba110ecb476 req-f97f608c-fb51-4d13-b83b-1c37e398a8c5 service nova] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Received event network-changed-bd7cede4-510c-488f-bf84-773a345198d7 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:06:14 user nova-compute[103546]: DEBUG nova.compute.manager [req-f57b4f15-c8d2-494e-a4be-5ba110ecb476 req-f97f608c-fb51-4d13-b83b-1c37e398a8c5 service nova] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Refreshing instance network info cache due to event network-changed-bd7cede4-510c-488f-bf84-773a345198d7. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 04:06:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-f57b4f15-c8d2-494e-a4be-5ba110ecb476 req-f97f608c-fb51-4d13-b83b-1c37e398a8c5 service nova] Acquiring lock "refresh_cache-fa33f516-2ec7-4a83-ace8-f144e80d9473" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:06:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-f57b4f15-c8d2-494e-a4be-5ba110ecb476 req-f97f608c-fb51-4d13-b83b-1c37e398a8c5 service nova] Acquired lock "refresh_cache-fa33f516-2ec7-4a83-ace8-f144e80d9473" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:06:14 user nova-compute[103546]: DEBUG nova.network.neutron [req-f57b4f15-c8d2-494e-a4be-5ba110ecb476 req-f97f608c-fb51-4d13-b83b-1c37e398a8c5 service nova] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Refreshing network info cache for port bd7cede4-510c-488f-bf84-773a345198d7 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 04:06:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1fd21b2d-5b70-4218-a7fe-192095e09904 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Acquiring lock "fa33f516-2ec7-4a83-ace8-f144e80d9473" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:06:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1fd21b2d-5b70-4218-a7fe-192095e09904 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "fa33f516-2ec7-4a83-ace8-f144e80d9473" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:06:14 user nova-compute[103546]: INFO nova.compute.manager [None req-1fd21b2d-5b70-4218-a7fe-192095e09904 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Detaching volume 9afdea37-b4cf-49d2-b3a4-81bcbc9adb67
Nov 16 04:06:14 user nova-compute[103546]: INFO nova.virt.block_device [None req-1fd21b2d-5b70-4218-a7fe-192095e09904 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Attempting to driver detach volume 9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 from mountpoint /dev/vdb
Nov 16 04:06:14 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1fd21b2d-5b70-4218-a7fe-192095e09904 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Attempting to detach device vdb from instance fa33f516-2ec7-4a83-ace8-f144e80d9473 from the persistent domain config. {{(pid=103546) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 04:06:14 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-1fd21b2d-5b70-4218-a7fe-192095e09904 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 04:06:14 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:06:14 user nova-compute[103546]:   <source dev="/dev/sdg"/>
Nov 16 04:06:14 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 04:06:14 user nova-compute[103546]:   <serial>9afdea37-b4cf-49d2-b3a4-81bcbc9adb67</serial>
Nov 16 04:06:14 user nova-compute[103546]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 04:06:14 user nova-compute[103546]: </disk>
Nov 16 04:06:14 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 04:06:14 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-1fd21b2d-5b70-4218-a7fe-192095e09904 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Successfully detached device vdb from instance fa33f516-2ec7-4a83-ace8-f144e80d9473 from the persistent domain config.
Nov 16 04:06:14 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1fd21b2d-5b70-4218-a7fe-192095e09904 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fa33f516-2ec7-4a83-ace8-f144e80d9473 from the live domain config. {{(pid=103546) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 04:06:14 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-1fd21b2d-5b70-4218-a7fe-192095e09904 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 04:06:14 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:06:14 user nova-compute[103546]:   <source dev="/dev/sdg"/>
Nov 16 04:06:14 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 04:06:14 user nova-compute[103546]:   <serial>9afdea37-b4cf-49d2-b3a4-81bcbc9adb67</serial>
Nov 16 04:06:14 user nova-compute[103546]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 04:06:14 user nova-compute[103546]: </disk>
Nov 16 04:06:14 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 04:06:15 user nova-compute[103546]: DEBUG nova.network.neutron [req-f57b4f15-c8d2-494e-a4be-5ba110ecb476 req-f97f608c-fb51-4d13-b83b-1c37e398a8c5 service nova] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Updated VIF entry in instance network info cache for port bd7cede4-510c-488f-bf84-773a345198d7. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 04:06:15 user nova-compute[103546]: DEBUG nova.network.neutron [req-f57b4f15-c8d2-494e-a4be-5ba110ecb476 req-f97f608c-fb51-4d13-b83b-1c37e398a8c5 service nova] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Updating instance_info_cache with network_info: [{"id": "bd7cede4-510c-488f-bf84-773a345198d7", "address": "fa:16:3e:84:89:24", "network": {"id": "d942264a-f03e-49a2-89eb-103a12c99518", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484356505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edb839c76c0d4513b9be0ec92301707f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd7cede4-51", "ovs_interfaceid": "bd7cede4-510c-488f-bf84-773a345198d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:06:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-f57b4f15-c8d2-494e-a4be-5ba110ecb476 req-f97f608c-fb51-4d13-b83b-1c37e398a8c5 service nova] Releasing lock "refresh_cache-fa33f516-2ec7-4a83-ace8-f144e80d9473" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:06:15 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1fd21b2d-5b70-4218-a7fe-192095e09904 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fa33f516-2ec7-4a83-ace8-f144e80d9473 {{(pid=103546) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 04:06:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:06:18 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Acquiring lock "182b9697-e7da-4487-b0c1-889c1f655b95" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:06:18 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "182b9697-e7da-4487-b0c1-889c1f655b95" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:06:18 user nova-compute[103546]: DEBUG nova.compute.manager [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Starting instance... {{(pid=103546) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 04:06:18 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:06:18 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:06:18 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:06:18 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=103546) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 04:06:18 user nova-compute[103546]: INFO nova.compute.claims [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Claim successful on node user
Nov 16 04:06:19 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:06:19 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:06:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.472s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:06:19 user nova-compute[103546]: DEBUG nova.compute.manager [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Start building networks asynchronously for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 04:06:19 user nova-compute[103546]: DEBUG nova.compute.manager [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Allocating IP information in the background. {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 04:06:19 user nova-compute[103546]: DEBUG nova.network.neutron [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] allocate_for_instance() {{(pid=103546) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 04:06:19 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 04:06:19 user nova-compute[103546]: DEBUG nova.compute.manager [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Start building block device mappings for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 04:06:19 user nova-compute[103546]: DEBUG nova.policy [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9d186163bddc48319b97f186f7c65e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e30b7ac9515458aa8a6eb1a34cc543a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103546) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 04:06:19 user nova-compute[103546]: DEBUG nova.compute.manager [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Start spawning the instance on the hypervisor. {{(pid=103546) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 04:06:19 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Creating instance directory {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 04:06:19 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Creating image(s)
Nov 16 04:06:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Acquiring lock "/opt/stack/data/nova/instances/182b9697-e7da-4487-b0c1-889c1f655b95/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:06:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "/opt/stack/data/nova/instances/182b9697-e7da-4487-b0c1-889c1f655b95/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:06:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "/opt/stack/data/nova/instances/182b9697-e7da-4487-b0c1-889c1f655b95/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.012s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:06:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:06:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.174s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:06:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Acquiring lock "8c9efafb670bfe5842ba1f4ce398924612164af7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:06:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:06:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:06:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.172s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:06:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/182b9697-e7da-4487-b0c1-889c1f655b95/disk 1073741824 {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:06:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/182b9697-e7da-4487-b0c1-889c1f655b95/disk 1073741824" returned: 0 in 0.064s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:06:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:06:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:06:20 user nova-compute[103546]: DEBUG nova.network.neutron [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Successfully created port: 66a12f44-bc2f-4574-916f-722fb04e7441 {{(pid=103546) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 04:06:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.189s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:06:20 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Checking if we can resize image /opt/stack/data/nova/instances/182b9697-e7da-4487-b0c1-889c1f655b95/disk. size=1073741824 {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 04:06:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/182b9697-e7da-4487-b0c1-889c1f655b95/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:06:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/182b9697-e7da-4487-b0c1-889c1f655b95/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:06:20 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Cannot resize image /opt/stack/data/nova/instances/182b9697-e7da-4487-b0c1-889c1f655b95/disk to a smaller size. {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 04:06:20 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Created local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 04:06:20 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Ensure instance console log exists: /opt/stack/data/nova/instances/182b9697-e7da-4487-b0c1-889c1f655b95/console.log {{(pid=103546) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 04:06:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:06:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:06:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:06:20 user nova-compute[103546]: DEBUG nova.network.neutron [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Successfully updated port: 66a12f44-bc2f-4574-916f-722fb04e7441 {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 04:06:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Acquiring lock "refresh_cache-182b9697-e7da-4487-b0c1-889c1f655b95" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:06:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Acquired lock "refresh_cache-182b9697-e7da-4487-b0c1-889c1f655b95" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:06:20 user nova-compute[103546]: DEBUG nova.network.neutron [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 04:06:20 user nova-compute[103546]: DEBUG nova.compute.manager [req-e23ca9cc-4e7c-439f-9ca2-6ece04577787 req-f1bde165-e029-4c05-b8f4-b6d127ee545c service nova] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Received event network-changed-66a12f44-bc2f-4574-916f-722fb04e7441 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:06:20 user nova-compute[103546]: DEBUG nova.compute.manager [req-e23ca9cc-4e7c-439f-9ca2-6ece04577787 req-f1bde165-e029-4c05-b8f4-b6d127ee545c service nova] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Refreshing instance network info cache due to event network-changed-66a12f44-bc2f-4574-916f-722fb04e7441. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 04:06:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-e23ca9cc-4e7c-439f-9ca2-6ece04577787 req-f1bde165-e029-4c05-b8f4-b6d127ee545c service nova] Acquiring lock "refresh_cache-182b9697-e7da-4487-b0c1-889c1f655b95" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:06:20 user nova-compute[103546]: DEBUG nova.network.neutron [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 04:06:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:06:21 user nova-compute[103546]: DEBUG nova.network.neutron [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Updating instance_info_cache with network_info: [{"id": "66a12f44-bc2f-4574-916f-722fb04e7441", "address": "fa:16:3e:5e:e2:36", "network": {"id": "6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038318316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e30b7ac9515458aa8a6eb1a34cc543a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a12f44-bc", "ovs_interfaceid": "66a12f44-bc2f-4574-916f-722fb04e7441", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:06:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Releasing lock "refresh_cache-182b9697-e7da-4487-b0c1-889c1f655b95" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:06:21 user nova-compute[103546]: DEBUG nova.compute.manager [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Instance network_info: |[{"id": "66a12f44-bc2f-4574-916f-722fb04e7441", "address": "fa:16:3e:5e:e2:36", "network": {"id": "6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038318316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e30b7ac9515458aa8a6eb1a34cc543a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a12f44-bc", "ovs_interfaceid": "66a12f44-bc2f-4574-916f-722fb04e7441", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 04:06:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-e23ca9cc-4e7c-439f-9ca2-6ece04577787 req-f1bde165-e029-4c05-b8f4-b6d127ee545c service nova] Acquired lock "refresh_cache-182b9697-e7da-4487-b0c1-889c1f655b95" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:06:21 user nova-compute[103546]: DEBUG nova.network.neutron [req-e23ca9cc-4e7c-439f-9ca2-6ece04577787 req-f1bde165-e029-4c05-b8f4-b6d127ee545c service nova] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Refreshing network info cache for port 66a12f44-bc2f-4574-916f-722fb04e7441 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 04:06:21 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Start _get_guest_xml network_info=[{"id": "66a12f44-bc2f-4574-916f-722fb04e7441", "address": "fa:16:3e:5e:e2:36", "network": {"id": "6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038318316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e30b7ac9515458aa8a6eb1a34cc543a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a12f44-bc", "ovs_interfaceid": "66a12f44-bc2f-4574-916f-722fb04e7441", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '5c6f539a-01e5-4478-bf8f-a14310b5d7dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 04:06:21 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:06:21 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:06:21 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 04:06:21 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 04:06:21 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 04:06:21 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 04:06:21 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 04:06:21 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 04:06:21 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 04:06:21 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 04:06:21 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 04:06:21 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 04:06:21 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 04:06:21 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 04:06:21 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 04:06:21 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 04:06:21 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 04:06:21 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 04:06:21 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:06:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1102350148',display_name='tempest-AttachVolumeNegativeTest-server-1102350148',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1102350148',id=43,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB+y3vM7znqwgCAFgA79Sf61LdeFXccsUMLYw1EvxwZgs4Z+dN6Ep2MPXZZKftSQc0q1d9IYN8NPyJvUK3xZmCZr67rOZf5bFjo5FyzKV95MI/ijmrL5+gM/BFvIA0iMIQ==',key_name='tempest-keypair-1529737572',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8e30b7ac9515458aa8a6eb1a34cc543a',ramdisk_id='',reservation_id='r-uly08vr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-64216432',owner_user_name='tempest-AttachVolumeNegativeTest-64216432-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T04:06:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d186163bddc48319b97f186f7c65e80',uuid=182b9697-e7da-4487-b0c1-889c1f655b95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66a12f44-bc2f-4574-916f-722fb04e7441", "address": "fa:16:3e:5e:e2:36", "network": {"id": "6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038318316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e30b7ac9515458aa8a6eb1a34cc543a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a12f44-bc", "ovs_interfaceid": "66a12f44-bc2f-4574-916f-722fb04e7441", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 04:06:21 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Converting VIF {"id": "66a12f44-bc2f-4574-916f-722fb04e7441", "address": "fa:16:3e:5e:e2:36", "network": {"id": "6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038318316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e30b7ac9515458aa8a6eb1a34cc543a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a12f44-bc", "ovs_interfaceid": "66a12f44-bc2f-4574-916f-722fb04e7441", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:06:21 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:e2:36,bridge_name='br-int',has_traffic_filtering=True,id=66a12f44-bc2f-4574-916f-722fb04e7441,network=Network(6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66a12f44-bc') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:06:21 user nova-compute[103546]: DEBUG nova.objects.instance [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lazy-loading 'pci_devices' on Instance uuid 182b9697-e7da-4487-b0c1-889c1f655b95 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:06:21 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] End _get_guest_xml xml=<domain type="kvm">
Nov 16 04:06:21 user nova-compute[103546]:   <uuid>182b9697-e7da-4487-b0c1-889c1f655b95</uuid>
Nov 16 04:06:21 user nova-compute[103546]:   <name>instance-0000002b</name>
Nov 16 04:06:21 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 04:06:21 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 04:06:21 user nova-compute[103546]:   <metadata>
Nov 16 04:06:21 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 04:06:21 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 04:06:21 user nova-compute[103546]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1102350148</nova:name>
Nov 16 04:06:21 user nova-compute[103546]:       <nova:creationTime>2023-11-16 04:06:21</nova:creationTime>
Nov 16 04:06:21 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 04:06:21 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 04:06:21 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 04:06:21 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 04:06:21 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 04:06:21 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 04:06:21 user nova-compute[103546]:       </nova:flavor>
Nov 16 04:06:21 user nova-compute[103546]:       <nova:owner>
Nov 16 04:06:21 user nova-compute[103546]:         <nova:user uuid="9d186163bddc48319b97f186f7c65e80">tempest-AttachVolumeNegativeTest-64216432-project-member</nova:user>
Nov 16 04:06:21 user nova-compute[103546]:         <nova:project uuid="8e30b7ac9515458aa8a6eb1a34cc543a">tempest-AttachVolumeNegativeTest-64216432</nova:project>
Nov 16 04:06:21 user nova-compute[103546]:       </nova:owner>
Nov 16 04:06:21 user nova-compute[103546]:       <nova:root type="image" uuid="5c6f539a-01e5-4478-bf8f-a14310b5d7dd"/>
Nov 16 04:06:21 user nova-compute[103546]:       <nova:ports>
Nov 16 04:06:21 user nova-compute[103546]:         <nova:port uuid="66a12f44-bc2f-4574-916f-722fb04e7441">
Nov 16 04:06:21 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 16 04:06:21 user nova-compute[103546]:         </nova:port>
Nov 16 04:06:21 user nova-compute[103546]:       </nova:ports>
Nov 16 04:06:21 user nova-compute[103546]:     </nova:instance>
Nov 16 04:06:21 user nova-compute[103546]:   </metadata>
Nov 16 04:06:21 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 04:06:21 user nova-compute[103546]:     <system>
Nov 16 04:06:21 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 04:06:21 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 04:06:21 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 04:06:21 user nova-compute[103546]:       <entry name="serial">182b9697-e7da-4487-b0c1-889c1f655b95</entry>
Nov 16 04:06:21 user nova-compute[103546]:       <entry name="uuid">182b9697-e7da-4487-b0c1-889c1f655b95</entry>
Nov 16 04:06:21 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 04:06:21 user nova-compute[103546]:     </system>
Nov 16 04:06:21 user nova-compute[103546]:   </sysinfo>
Nov 16 04:06:21 user nova-compute[103546]:   <os>
Nov 16 04:06:21 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 04:06:21 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 04:06:21 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 04:06:21 user nova-compute[103546]:   </os>
Nov 16 04:06:21 user nova-compute[103546]:   <features>
Nov 16 04:06:21 user nova-compute[103546]:     <acpi/>
Nov 16 04:06:21 user nova-compute[103546]:     <apic/>
Nov 16 04:06:21 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 04:06:21 user nova-compute[103546]:   </features>
Nov 16 04:06:21 user nova-compute[103546]:   <clock offset="utc">
Nov 16 04:06:21 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 04:06:21 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 04:06:21 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 04:06:21 user nova-compute[103546]:   </clock>
Nov 16 04:06:21 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 04:06:21 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 04:06:21 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 04:06:21 user nova-compute[103546]:   </cpu>
Nov 16 04:06:21 user nova-compute[103546]:   <devices>
Nov 16 04:06:21 user nova-compute[103546]:     <disk type="file" device="disk">
Nov 16 04:06:21 user nova-compute[103546]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 04:06:21 user nova-compute[103546]:       <source file="/opt/stack/data/nova/instances/182b9697-e7da-4487-b0c1-889c1f655b95/disk"/>
Nov 16 04:06:21 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 04:06:21 user nova-compute[103546]:     </disk>
Nov 16 04:06:21 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 04:06:21 user nova-compute[103546]:       <mac address="fa:16:3e:5e:e2:36"/>
Nov 16 04:06:21 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 04:06:21 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 04:06:21 user nova-compute[103546]:       <target dev="tap66a12f44-bc"/>
Nov 16 04:06:21 user nova-compute[103546]:     </interface>
Nov 16 04:06:21 user nova-compute[103546]:     <serial type="pty">
Nov 16 04:06:21 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/182b9697-e7da-4487-b0c1-889c1f655b95/console.log" append="off"/>
Nov 16 04:06:21 user nova-compute[103546]:     </serial>
Nov 16 04:06:21 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 04:06:21 user nova-compute[103546]:     <video>
Nov 16 04:06:21 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 04:06:21 user nova-compute[103546]:     </video>
Nov 16 04:06:21 user nova-compute[103546]:     <rng model="virtio">
Nov 16 04:06:21 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 04:06:21 user nova-compute[103546]:     </rng>
Nov 16 04:06:21 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 04:06:21 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 04:06:21 user nova-compute[103546]:       <stats period="10"/>
Nov 16 04:06:21 user nova-compute[103546]:     </memballoon>
Nov 16 04:06:21 user nova-compute[103546]:   </devices>
Nov 16 04:06:21 user nova-compute[103546]: </domain>
Nov 16 04:06:21 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 04:06:21 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:06:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1102350148',display_name='tempest-AttachVolumeNegativeTest-server-1102350148',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1102350148',id=43,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB+y3vM7znqwgCAFgA79Sf61LdeFXccsUMLYw1EvxwZgs4Z+dN6Ep2MPXZZKftSQc0q1d9IYN8NPyJvUK3xZmCZr67rOZf5bFjo5FyzKV95MI/ijmrL5+gM/BFvIA0iMIQ==',key_name='tempest-keypair-1529737572',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8e30b7ac9515458aa8a6eb1a34cc543a',ramdisk_id='',reservation_id='r-uly08vr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-64216432',owner_user_name='tempest-AttachVolumeNegativeTest-64216432-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T04:06:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d186163bddc48319b97f186f7c65e80',uuid=182b9697-e7da-4487-b0c1-889c1f655b95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66a12f44-bc2f-4574-916f-722fb04e7441", "address": "fa:16:3e:5e:e2:36", "network": {"id": "6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038318316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e30b7ac9515458aa8a6eb1a34cc543a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a12f44-bc", "ovs_interfaceid": "66a12f44-bc2f-4574-916f-722fb04e7441", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 04:06:21 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Converting VIF {"id": "66a12f44-bc2f-4574-916f-722fb04e7441", "address": "fa:16:3e:5e:e2:36", "network": {"id": "6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038318316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e30b7ac9515458aa8a6eb1a34cc543a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a12f44-bc", "ovs_interfaceid": "66a12f44-bc2f-4574-916f-722fb04e7441", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:06:21 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:e2:36,bridge_name='br-int',has_traffic_filtering=True,id=66a12f44-bc2f-4574-916f-722fb04e7441,network=Network(6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66a12f44-bc') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:06:21 user nova-compute[103546]: DEBUG os_vif [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:e2:36,bridge_name='br-int',has_traffic_filtering=True,id=66a12f44-bc2f-4574-916f-722fb04e7441,network=Network(6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66a12f44-bc') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 04:06:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:06:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:06:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 04:06:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:06:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '13206f78-ba5c-52e5-87ed-a536dd7e9cb8', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:06:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:06:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:06:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:06:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap66a12f44-bc, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:06:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap66a12f44-bc, col_values=(('qos', UUID('b39ce813-2418-4d7b-8a90-7b46830e4dfd')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:06:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap66a12f44-bc, col_values=(('external_ids', {'iface-id': '66a12f44-bc2f-4574-916f-722fb04e7441', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:e2:36', 'vm-uuid': '182b9697-e7da-4487-b0c1-889c1f655b95'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:06:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:06:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:06:21 user nova-compute[103546]: INFO os_vif [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:e2:36,bridge_name='br-int',has_traffic_filtering=True,id=66a12f44-bc2f-4574-916f-722fb04e7441,network=Network(6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66a12f44-bc')
Nov 16 04:06:21 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:06:21 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] No VIF found with MAC fa:16:3e:5e:e2:36, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 04:06:21 user nova-compute[103546]: DEBUG nova.network.neutron [req-e23ca9cc-4e7c-439f-9ca2-6ece04577787 req-f1bde165-e029-4c05-b8f4-b6d127ee545c service nova] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Updated VIF entry in instance network info cache for port 66a12f44-bc2f-4574-916f-722fb04e7441. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 04:06:21 user nova-compute[103546]: DEBUG nova.network.neutron [req-e23ca9cc-4e7c-439f-9ca2-6ece04577787 req-f1bde165-e029-4c05-b8f4-b6d127ee545c service nova] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Updating instance_info_cache with network_info: [{"id": "66a12f44-bc2f-4574-916f-722fb04e7441", "address": "fa:16:3e:5e:e2:36", "network": {"id": "6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038318316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e30b7ac9515458aa8a6eb1a34cc543a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a12f44-bc", "ovs_interfaceid": "66a12f44-bc2f-4574-916f-722fb04e7441", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:06:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-e23ca9cc-4e7c-439f-9ca2-6ece04577787 req-f1bde165-e029-4c05-b8f4-b6d127ee545c service nova] Releasing lock "refresh_cache-182b9697-e7da-4487-b0c1-889c1f655b95" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:06:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:06:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:06:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:06:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:06:22 user nova-compute[103546]: DEBUG nova.compute.manager [req-acedc429-870b-4313-b757-9c9ce205846a req-762d5050-da1b-4fbc-9b74-c14ba1ad9ed3 service nova] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Received event network-vif-plugged-66a12f44-bc2f-4574-916f-722fb04e7441 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:06:22 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-acedc429-870b-4313-b757-9c9ce205846a req-762d5050-da1b-4fbc-9b74-c14ba1ad9ed3 service nova] Acquiring lock "182b9697-e7da-4487-b0c1-889c1f655b95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:06:22 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-acedc429-870b-4313-b757-9c9ce205846a req-762d5050-da1b-4fbc-9b74-c14ba1ad9ed3 service nova] Lock "182b9697-e7da-4487-b0c1-889c1f655b95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:06:22 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-acedc429-870b-4313-b757-9c9ce205846a req-762d5050-da1b-4fbc-9b74-c14ba1ad9ed3 service nova] Lock "182b9697-e7da-4487-b0c1-889c1f655b95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:06:22 user nova-compute[103546]: DEBUG nova.compute.manager [req-acedc429-870b-4313-b757-9c9ce205846a req-762d5050-da1b-4fbc-9b74-c14ba1ad9ed3 service nova] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] No waiting events found dispatching network-vif-plugged-66a12f44-bc2f-4574-916f-722fb04e7441 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:06:22 user nova-compute[103546]: WARNING nova.compute.manager [req-acedc429-870b-4313-b757-9c9ce205846a req-762d5050-da1b-4fbc-9b74-c14ba1ad9ed3 service nova] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Received unexpected event network-vif-plugged-66a12f44-bc2f-4574-916f-722fb04e7441 for instance with vm_state building and task_state spawning.
Nov 16 04:06:23 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:06:23 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:06:23 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:06:23 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:06:23 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:06:23 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:06:24 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:06:24 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=103546) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 04:06:24 user nova-compute[103546]: DEBUG nova.compute.manager [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 04:06:24 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Guest created on hypervisor {{(pid=103546) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 04:06:24 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Instance spawned successfully.
Nov 16 04:06:24 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 04:06:24 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Found default for hw_cdrom_bus of ide {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:06:24 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Found default for hw_disk_bus of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:06:24 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Found default for hw_input_bus of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:06:24 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Found default for hw_pointer_model of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:06:24 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Found default for hw_video_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:06:24 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Found default for hw_vif_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:06:24 user nova-compute[103546]: INFO nova.compute.manager [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Took 5.23 seconds to spawn the instance on the hypervisor.
Nov 16 04:06:24 user nova-compute[103546]: DEBUG nova.compute.manager [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 04:06:24 user nova-compute[103546]: INFO nova.compute.manager [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Took 6.02 seconds to build instance.
Nov 16 04:06:24 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-dc306c11-f932-410c-a9d5-65504985e423 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "182b9697-e7da-4487-b0c1-889c1f655b95" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.119s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:06:25 user nova-compute[103546]: DEBUG nova.compute.manager [req-772e3b2b-6fbf-4e98-a0bd-f173ffa0d641 req-ec98e4c6-ee89-4dc3-8d8d-367f61a6abd5 service nova] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Received event network-vif-plugged-66a12f44-bc2f-4574-916f-722fb04e7441 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:06:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-772e3b2b-6fbf-4e98-a0bd-f173ffa0d641 req-ec98e4c6-ee89-4dc3-8d8d-367f61a6abd5 service nova] Acquiring lock "182b9697-e7da-4487-b0c1-889c1f655b95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:06:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-772e3b2b-6fbf-4e98-a0bd-f173ffa0d641 req-ec98e4c6-ee89-4dc3-8d8d-367f61a6abd5 service nova] Lock "182b9697-e7da-4487-b0c1-889c1f655b95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:06:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-772e3b2b-6fbf-4e98-a0bd-f173ffa0d641 req-ec98e4c6-ee89-4dc3-8d8d-367f61a6abd5 service nova] Lock "182b9697-e7da-4487-b0c1-889c1f655b95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:06:25 user nova-compute[103546]: DEBUG nova.compute.manager [req-772e3b2b-6fbf-4e98-a0bd-f173ffa0d641 req-ec98e4c6-ee89-4dc3-8d8d-367f61a6abd5 service nova] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] No waiting events found dispatching network-vif-plugged-66a12f44-bc2f-4574-916f-722fb04e7441 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:06:25 user nova-compute[103546]: WARNING nova.compute.manager [req-772e3b2b-6fbf-4e98-a0bd-f173ffa0d641 req-ec98e4c6-ee89-4dc3-8d8d-367f61a6abd5 service nova] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Received unexpected event network-vif-plugged-66a12f44-bc2f-4574-916f-722fb04e7441 for instance with vm_state active and task_state None.
Nov 16 04:06:25 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:06:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:06:26 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:06:26 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:06:26 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:06:26 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:06:26 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager.update_available_resource {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:06:26 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:06:26 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:06:26 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:06:26 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Auditing locally available compute resources for user (node: user) {{(pid=103546) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 04:06:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:06:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:06:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:06:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:06:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c02873d-469e-41a4-b492-69f793c8a07c/disk.rescue --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:06:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c02873d-469e-41a4-b492-69f793c8a07c/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:06:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c02873d-469e-41a4-b492-69f793c8a07c/disk.rescue --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:06:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c02873d-469e-41a4-b492-69f793c8a07c/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:06:27 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /opt/stack/data/nova/instances/8c02873d-469e-41a4-b492-69f793c8a07c/disk (vdb) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 04:06:27 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 04:06:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f7c407-3373-43ba-ac92-7eb0a43a7093/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:06:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f7c407-3373-43ba-ac92-7eb0a43a7093/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:06:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f7c407-3373-43ba-ac92-7eb0a43a7093/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:06:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f7c407-3373-43ba-ac92-7eb0a43a7093/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:06:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:06:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:06:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:06:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:06:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/182b9697-e7da-4487-b0c1-889c1f655b95/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:06:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/182b9697-e7da-4487-b0c1-889c1f655b95/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:06:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/182b9697-e7da-4487-b0c1-889c1f655b95/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:06:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/182b9697-e7da-4487-b0c1-889c1f655b95/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:06:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:06:28 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:06:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:06:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:06:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:06:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa33f516-2ec7-4a83-ace8-f144e80d9473/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:06:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa33f516-2ec7-4a83-ace8-f144e80d9473/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:06:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa33f516-2ec7-4a83-ace8-f144e80d9473/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:06:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa33f516-2ec7-4a83-ace8-f144e80d9473/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:06:29 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 04:06:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:06:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:06:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:06:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:06:30 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 04:06:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.rescue --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:06:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:06:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.rescue --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:06:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:06:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:06:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:06:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:06:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:06:30 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 04:06:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/271adc7b-bfc6-48c5-8700-69b2b079ce4b/disk.rescue --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:06:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/271adc7b-bfc6-48c5-8700-69b2b079ce4b/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:06:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/271adc7b-bfc6-48c5-8700-69b2b079ce4b/disk.rescue --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:06:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/271adc7b-bfc6-48c5-8700-69b2b079ce4b/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:06:31 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 04:06:31 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:06:31 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:06:31 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:06:31 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Hypervisor/Node resource view: name=user free_ram=7343MB free_disk=24.853065490722656GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=103546) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 04:06:31 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:06:31 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:06:31 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 9a89970b-fc61-4419-8ff9-b48013dccf9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:06:31 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 04101512-7333-4581-add3-7af3821e335b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:06:31 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance fa7e5468-9dd4-407d-85ec-d45ec76f9e29 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:06:31 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 246ccf69-847c-4ab2-b709-ad1a85e81eab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:06:31 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 8d229d05-95f1-4997-8539-802ac65cff8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:06:31 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance b0a480de-e99b-4b54-bd81-36c216442137 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:06:31 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 38f7c407-3373-43ba-ac92-7eb0a43a7093 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:06:31 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance fa33f516-2ec7-4a83-ace8-f144e80d9473 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:06:31 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 9a421bf0-70b6-4a2c-85da-813707619b84 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:06:31 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 271adc7b-bfc6-48c5-8700-69b2b079ce4b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:06:31 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 8c02873d-469e-41a4-b492-69f793c8a07c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:06:31 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 26ba7f48-9752-45af-ba68-8c3f70325e21 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:06:31 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance f5e1d075-f64c-4837-9850-5f727a1984e4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:06:31 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 182b9697-e7da-4487-b0c1-889c1f655b95 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:06:31 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 04:06:31 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 04:06:32 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:06:32 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:06:32 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Compute_service record updated for user:user {{(pid=103546) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 04:06:32 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.643s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:06:34 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:06:34 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:06:34 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Starting heal instance info cache {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 04:06:34 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "refresh_cache-246ccf69-847c-4ab2-b709-ad1a85e81eab" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:06:34 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquired lock "refresh_cache-246ccf69-847c-4ab2-b709-ad1a85e81eab" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:06:34 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Forcefully refreshing network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 04:06:34 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Updating instance_info_cache with network_info: [{"id": "84add44b-0c93-4ebc-b45d-2f30d63d900f", "address": "fa:16:3e:13:18:5f", "network": {"id": "337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-40560053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca049d5674dc4c59814f98478752d73d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84add44b-0c", "ovs_interfaceid": "84add44b-0c93-4ebc-b45d-2f30d63d900f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:06:34 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Releasing lock "refresh_cache-246ccf69-847c-4ab2-b709-ad1a85e81eab" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:06:34 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Updated the network info_cache for instance {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 04:06:34 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:06:35 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-1fd21b2d-5b70-4218-a7fe-192095e09904 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fa33f516-2ec7-4a83-ace8-f144e80d9473 is timed out.
Nov 16 04:06:35 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-1fd21b2d-5b70-4218-a7fe-192095e09904 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Successfully detached device vdb from instance fa33f516-2ec7-4a83-ace8-f144e80d9473 from the live domain config.
Nov 16 04:06:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fd21b2d-5b70-4218-a7fe-192095e09904 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 04:06:35 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd21b2d-5b70-4218-a7fe-192095e09904 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MGChUBIZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:06:35 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-1fd21b2d-5b70-4218-a7fe-192095e09904 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:06:35 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-1fd21b2d-5b70-4218-a7fe-192095e09904 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:06:35 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-1fd21b2d-5b70-4218-a7fe-192095e09904 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:06:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:06:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:06:35 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ad3ec1-3e97-44ce-a4d1-c8ad2f7ee1d0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:06:35 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd21b2d-5b70-4218-a7fe-192095e09904 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 04:06:35 user nova-compute[103546]: No targets found.
Nov 16 04:06:35 user nova-compute[103546]: iSNS:
Nov 16 04:06:35 user nova-compute[103546]: No targets found.
Nov 16 04:06:35 user nova-compute[103546]: STATIC:
Nov 16 04:06:35 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e
Nov 16 04:06:35 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:06:35 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:06:35 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294
Nov 16 04:06:35 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:06:35 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:06:35 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7
Nov 16 04:06:35 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:06:35 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:06:35 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4
Nov 16 04:06:35 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:06:35 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:06:35 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb
Nov 16 04:06:35 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:06:35 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:06:35 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67
Nov 16 04:06:35 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:06:35 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:06:35 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf
Nov 16 04:06:35 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:06:35 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:06:35 user nova-compute[103546]: FIRMWARE:
Nov 16 04:06:35 user nova-compute[103546]: No targets found.
Nov 16 04:06:35 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:06:35 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd21b2d-5b70-4218-a7fe-192095e09904 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 04:06:35 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 04:06:35 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 04:06:35 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd21b2d-5b70-4218-a7fe-192095e09904 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 04:06:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:06:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:06:35 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a6ac08-f8be-47cc-be7a-0efdd82c17b6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:06:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:06:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:06:35 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[7efa98ad-d007-4512-a8e8-6716a01b885f]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:06:35 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd21b2d-5b70-4218-a7fe-192095e09904 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:06:35 user nova-compute[103546]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:06:35 user nova-compute[103546]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)
Nov 16 04:06:35 user nova-compute[103546]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:06:35 user nova-compute[103546]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 (non-flash)
Nov 16 04:06:35 user nova-compute[103546]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294 (non-flash)
Nov 16 04:06:35 user nova-compute[103546]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb (non-flash)
Nov 16 04:06:35 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:06:35 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd21b2d-5b70-4218-a7fe-192095e09904 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:06:35 user nova-compute[103546]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:06:35 user nova-compute[103546]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)
Nov 16 04:06:35 user nova-compute[103546]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:06:35 user nova-compute[103546]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 (non-flash)
Nov 16 04:06:35 user nova-compute[103546]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294 (non-flash)
Nov 16 04:06:35 user nova-compute[103546]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb (non-flash)
Nov 16 04:06:35 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:06:35 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd21b2d-5b70-4218-a7fe-192095e09904 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60ac48bd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67'): ({'sdg'}, set())}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 04:06:35 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-1fd21b2d-5b70-4218-a7fe-192095e09904 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Removing single pathed devices sdg {{(pid=103546) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 04:06:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:06:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:06:35 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b56b41-8e70-4502-bf85-cd13a1b65ca7]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:06:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:06:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:06:35 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f337c9b8-7bd9-4f26-81a2-f058b4d104c5]: (4, ('ok\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:06:35 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-1fd21b2d-5b70-4218-a7fe-192095e09904 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Flushing IO for device /dev/sdg {{(pid=103546) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 04:06:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:06:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:06:35 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d0c21a-166d-4968-89be-0bcbe6769cf4]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:06:35 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-1fd21b2d-5b70-4218-a7fe-192095e09904 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=103546) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 04:06:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:06:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.043s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:06:35 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[32146d40-461b-465a-a927-3deb80324c28]: (4, ('1', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:06:35 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-1fd21b2d-5b70-4218-a7fe-192095e09904 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 04:06:35 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-1fd21b2d-5b70-4218-a7fe-192095e09904 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] SCSI volumes sdg have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 04:06:35 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd21b2d-5b70-4218-a7fe-192095e09904 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67')] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 04:06:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:06:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:06:35 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d628a6-625d-4bc7-b094-6339259e714d]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:06:35 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd21b2d-5b70-4218-a7fe-192095e09904 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:06:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 -p 172.16.0.220:3260 --logout {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:06:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:06:35 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[358c8406-5d7b-4f1e-873a-f9e0d112f87f]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:06:35 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd21b2d-5b70-4218-a7fe-192095e09904 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67, portal: 172.16.0.220,3260]
Nov 16 04:06:35 user nova-compute[103546]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67, portal: 172.16.0.220,3260] successful.
Nov 16 04:06:35 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:06:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 -p 172.16.0.220:3260 --op delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:06:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9afdea37-b4cf-49d2-b3a4-81bcbc9adb67 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:06:35 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b224125-81ec-4db2-becb-7aee95226083]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:06:35 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd21b2d-5b70-4218-a7fe-192095e09904 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:06:35 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-1fd21b2d-5b70-4218-a7fe-192095e09904 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:06:35 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd21b2d-5b70-4218-a7fe-192095e09904 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] <== disconnect_volume: return (357ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:06:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fd21b2d-5b70-4218-a7fe-192095e09904 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 04:06:36 user nova-compute[103546]: DEBUG nova.objects.instance [None req-1fd21b2d-5b70-4218-a7fe-192095e09904 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lazy-loading 'flavor' on Instance uuid fa33f516-2ec7-4a83-ace8-f144e80d9473 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:06:36 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1fd21b2d-5b70-4218-a7fe-192095e09904 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "fa33f516-2ec7-4a83-ace8-f144e80d9473" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.616s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:06:36 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:06:36 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:06:36 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=103546) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 04:06:36 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:06:36 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:06:36 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:06:38 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:06:41 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:06:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:06:46 user nova-compute[103546]: DEBUG nova.compute.manager [req-6dc40472-c12e-42c7-9952-5bb308af97e0 req-e9466d69-ad72-449a-8a99-98332ea300e3 service nova] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Received event network-changed-85996da5-0750-4cc6-a752-a074a4fcfc58 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:06:46 user nova-compute[103546]: DEBUG nova.compute.manager [req-6dc40472-c12e-42c7-9952-5bb308af97e0 req-e9466d69-ad72-449a-8a99-98332ea300e3 service nova] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Refreshing instance network info cache due to event network-changed-85996da5-0750-4cc6-a752-a074a4fcfc58. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 04:06:46 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6dc40472-c12e-42c7-9952-5bb308af97e0 req-e9466d69-ad72-449a-8a99-98332ea300e3 service nova] Acquiring lock "refresh_cache-f5e1d075-f64c-4837-9850-5f727a1984e4" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:06:46 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6dc40472-c12e-42c7-9952-5bb308af97e0 req-e9466d69-ad72-449a-8a99-98332ea300e3 service nova] Acquired lock "refresh_cache-f5e1d075-f64c-4837-9850-5f727a1984e4" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:06:46 user nova-compute[103546]: DEBUG nova.network.neutron [req-6dc40472-c12e-42c7-9952-5bb308af97e0 req-e9466d69-ad72-449a-8a99-98332ea300e3 service nova] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Refreshing network info cache for port 85996da5-0750-4cc6-a752-a074a4fcfc58 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 04:06:46 user nova-compute[103546]: DEBUG nova.network.neutron [req-6dc40472-c12e-42c7-9952-5bb308af97e0 req-e9466d69-ad72-449a-8a99-98332ea300e3 service nova] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Updated VIF entry in instance network info cache for port 85996da5-0750-4cc6-a752-a074a4fcfc58. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 04:06:46 user nova-compute[103546]: DEBUG nova.network.neutron [req-6dc40472-c12e-42c7-9952-5bb308af97e0 req-e9466d69-ad72-449a-8a99-98332ea300e3 service nova] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Updating instance_info_cache with network_info: [{"id": "85996da5-0750-4cc6-a752-a074a4fcfc58", "address": "fa:16:3e:06:9c:8a", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85996da5-07", "ovs_interfaceid": "85996da5-0750-4cc6-a752-a074a4fcfc58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:06:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:06:46 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6dc40472-c12e-42c7-9952-5bb308af97e0 req-e9466d69-ad72-449a-8a99-98332ea300e3 service nova] Releasing lock "refresh_cache-f5e1d075-f64c-4837-9850-5f727a1984e4" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:06:47 user nova-compute[103546]: DEBUG nova.compute.manager [req-a94891e5-2299-4eaa-ae90-befda719f57d req-9f4943f3-1a60-4a1f-a43a-55e18f6c80d9 service nova] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Received event network-changed-85996da5-0750-4cc6-a752-a074a4fcfc58 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:06:47 user nova-compute[103546]: DEBUG nova.compute.manager [req-a94891e5-2299-4eaa-ae90-befda719f57d req-9f4943f3-1a60-4a1f-a43a-55e18f6c80d9 service nova] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Refreshing instance network info cache due to event network-changed-85996da5-0750-4cc6-a752-a074a4fcfc58. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 04:06:47 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a94891e5-2299-4eaa-ae90-befda719f57d req-9f4943f3-1a60-4a1f-a43a-55e18f6c80d9 service nova] Acquiring lock "refresh_cache-f5e1d075-f64c-4837-9850-5f727a1984e4" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:06:47 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a94891e5-2299-4eaa-ae90-befda719f57d req-9f4943f3-1a60-4a1f-a43a-55e18f6c80d9 service nova] Acquired lock "refresh_cache-f5e1d075-f64c-4837-9850-5f727a1984e4" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:06:47 user nova-compute[103546]: DEBUG nova.network.neutron [req-a94891e5-2299-4eaa-ae90-befda719f57d req-9f4943f3-1a60-4a1f-a43a-55e18f6c80d9 service nova] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Refreshing network info cache for port 85996da5-0750-4cc6-a752-a074a4fcfc58 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 04:06:47 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-3c09a59b-d59b-457f-b0a9-e4067f7908ed tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquiring lock "f5e1d075-f64c-4837-9850-5f727a1984e4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:06:47 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-3c09a59b-d59b-457f-b0a9-e4067f7908ed tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "f5e1d075-f64c-4837-9850-5f727a1984e4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:06:47 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-3c09a59b-d59b-457f-b0a9-e4067f7908ed tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquiring lock "f5e1d075-f64c-4837-9850-5f727a1984e4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:06:47 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-3c09a59b-d59b-457f-b0a9-e4067f7908ed tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "f5e1d075-f64c-4837-9850-5f727a1984e4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:06:47 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-3c09a59b-d59b-457f-b0a9-e4067f7908ed tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "f5e1d075-f64c-4837-9850-5f727a1984e4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:06:47 user nova-compute[103546]: INFO nova.compute.manager [None req-3c09a59b-d59b-457f-b0a9-e4067f7908ed tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Terminating instance
Nov 16 04:06:47 user nova-compute[103546]: DEBUG nova.compute.manager [None req-3c09a59b-d59b-457f-b0a9-e4067f7908ed tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Start destroying the instance on the hypervisor. {{(pid=103546) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 04:06:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:06:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:06:47 user nova-compute[103546]: DEBUG nova.network.neutron [req-a94891e5-2299-4eaa-ae90-befda719f57d req-9f4943f3-1a60-4a1f-a43a-55e18f6c80d9 service nova] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Updated VIF entry in instance network info cache for port 85996da5-0750-4cc6-a752-a074a4fcfc58. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 04:06:47 user nova-compute[103546]: DEBUG nova.network.neutron [req-a94891e5-2299-4eaa-ae90-befda719f57d req-9f4943f3-1a60-4a1f-a43a-55e18f6c80d9 service nova] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Updating instance_info_cache with network_info: [{"id": "85996da5-0750-4cc6-a752-a074a4fcfc58", "address": "fa:16:3e:06:9c:8a", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85996da5-07", "ovs_interfaceid": "85996da5-0750-4cc6-a752-a074a4fcfc58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:06:47 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a94891e5-2299-4eaa-ae90-befda719f57d req-9f4943f3-1a60-4a1f-a43a-55e18f6c80d9 service nova] Releasing lock "refresh_cache-f5e1d075-f64c-4837-9850-5f727a1984e4" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:06:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:06:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:06:47 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Instance destroyed successfully.
Nov 16 04:06:47 user nova-compute[103546]: DEBUG nova.objects.instance [None req-3c09a59b-d59b-457f-b0a9-e4067f7908ed tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lazy-loading 'resources' on Instance uuid f5e1d075-f64c-4837-9850-5f727a1984e4 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:06:47 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-3c09a59b-d59b-457f-b0a9-e4067f7908ed tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:04:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1100177855',display_name='tempest-TestVolumeBootPattern-server-1100177855',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1100177855',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAUuzWuYKsux0jTpLPt6gxhC1FaUy3kEUyYKr8BxuO29MPaSGm/xG+Qeyua0CAfOtv/fD3rdnfc1wGAbEANqJwnqI370L1woOSlI3nH8Q8Ypdr+d2TMfVLtiA9YGdx0zEg==',key_name='tempest-TestVolumeBootPattern-1153098015',keypairs=<?>,launch_index=0,launched_at=2023-11-16T04:05:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='40ce50192a9743b59a9430163dd6a51c',ramdisk_id='',reservation_id='r-ipn3ksyi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1283031547',owner_user_name='tempest-TestVolumeBootPattern-1283031547-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T04:05:05Z,user_data=None,user_id='ab77040a7b9846d28dc08852d678d1ed',uuid=f5e1d075-f64c-4837-9850-5f727a1984e4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85996da5-0750-4cc6-a752-a074a4fcfc58", "address": "fa:16:3e:06:9c:8a", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85996da5-07", "ovs_interfaceid": "85996da5-0750-4cc6-a752-a074a4fcfc58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 04:06:47 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-3c09a59b-d59b-457f-b0a9-e4067f7908ed tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Converting VIF {"id": "85996da5-0750-4cc6-a752-a074a4fcfc58", "address": "fa:16:3e:06:9c:8a", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85996da5-07", "ovs_interfaceid": "85996da5-0750-4cc6-a752-a074a4fcfc58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:06:47 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-3c09a59b-d59b-457f-b0a9-e4067f7908ed tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:9c:8a,bridge_name='br-int',has_traffic_filtering=True,id=85996da5-0750-4cc6-a752-a074a4fcfc58,network=Network(a13f532d-a30d-4c06-83fe-760bcffae183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85996da5-07') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:06:47 user nova-compute[103546]: DEBUG os_vif [None req-3c09a59b-d59b-457f-b0a9-e4067f7908ed tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:9c:8a,bridge_name='br-int',has_traffic_filtering=True,id=85996da5-0750-4cc6-a752-a074a4fcfc58,network=Network(a13f532d-a30d-4c06-83fe-760bcffae183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85996da5-07') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 04:06:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:06:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85996da5-07, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:06:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:06:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:06:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:06:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:06:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ab34ed8f-90fa-43be-913c-9212ebcc3ed6) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:06:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:06:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:06:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:06:48 user nova-compute[103546]: INFO os_vif [None req-3c09a59b-d59b-457f-b0a9-e4067f7908ed tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:9c:8a,bridge_name='br-int',has_traffic_filtering=True,id=85996da5-0750-4cc6-a752-a074a4fcfc58,network=Network(a13f532d-a30d-4c06-83fe-760bcffae183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85996da5-07')
Nov 16 04:06:48 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c09a59b-d59b-457f-b0a9-e4067f7908ed tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c09a59b-d59b-457f-b0a9-e4067f7908ed tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cTmMFkup', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:06:48 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-3c09a59b-d59b-457f-b0a9-e4067f7908ed tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:06:48 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-3c09a59b-d59b-457f-b0a9-e4067f7908ed tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-3c09a59b-d59b-457f-b0a9-e4067f7908ed tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0770258-5b20-4eb0-8da7-907cde85ad82]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c09a59b-d59b-457f-b0a9-e4067f7908ed tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 04:06:48 user nova-compute[103546]: No targets found.
Nov 16 04:06:48 user nova-compute[103546]: iSNS:
Nov 16 04:06:48 user nova-compute[103546]: No targets found.
Nov 16 04:06:48 user nova-compute[103546]: STATIC:
Nov 16 04:06:48 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e
Nov 16 04:06:48 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:06:48 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:06:48 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294
Nov 16 04:06:48 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:06:48 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:06:48 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7
Nov 16 04:06:48 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:06:48 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:06:48 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4
Nov 16 04:06:48 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:06:48 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:06:48 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb
Nov 16 04:06:48 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:06:48 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:06:48 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf
Nov 16 04:06:48 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:06:48 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:06:48 user nova-compute[103546]: FIRMWARE:
Nov 16 04:06:48 user nova-compute[103546]: No targets found.
Nov 16 04:06:48 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c09a59b-d59b-457f-b0a9-e4067f7908ed tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 04:06:48 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 04:06:48 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c09a59b-d59b-457f-b0a9-e4067f7908ed tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a128545-a5c5-42ea-91d9-6c08897d7f3f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7f4a65-15a1-4a48-b27e-bf603ada30f9]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c09a59b-d59b-457f-b0a9-e4067f7908ed tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:06:48 user nova-compute[103546]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:06:48 user nova-compute[103546]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)
Nov 16 04:06:48 user nova-compute[103546]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:06:48 user nova-compute[103546]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294 (non-flash)
Nov 16 04:06:48 user nova-compute[103546]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb (non-flash)
Nov 16 04:06:48 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c09a59b-d59b-457f-b0a9-e4067f7908ed tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:06:48 user nova-compute[103546]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:06:48 user nova-compute[103546]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)
Nov 16 04:06:48 user nova-compute[103546]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:06:48 user nova-compute[103546]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294 (non-flash)
Nov 16 04:06:48 user nova-compute[103546]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb (non-flash)
Nov 16 04:06:48 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c09a59b-d59b-457f-b0a9-e4067f7908ed tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60ac43d990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294'): ({'sdh'}, set())}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-3c09a59b-d59b-457f-b0a9-e4067f7908ed tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Removing single pathed devices sdh {{(pid=103546) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dcd06db-4e27-4569-99b9-68fa2164075c]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[439239ac-9530-4db9-afd4-dce4b1816122]: (4, ('ok\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-3c09a59b-d59b-457f-b0a9-e4067f7908ed tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Flushing IO for device /dev/sdh {{(pid=103546) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae009511-adad-4aec-8509-899925b0a219]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-3c09a59b-d59b-457f-b0a9-e4067f7908ed tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=103546) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.055s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13a6e21-3287-4613-9c31-46182f2f110c]: (4, ('1', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-3c09a59b-d59b-457f-b0a9-e4067f7908ed tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-3c09a59b-d59b-457f-b0a9-e4067f7908ed tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] SCSI volumes sdh have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO5b2f49ac-734e33c1cd416cb9', '/dev/disk/by-id/scsi-23733346533336331', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_5b2f49ac') {{(pid=114461) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[452984ea-e133-441e-8634-ad264dae9c94]: (4, None) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c09a59b-d59b-457f-b0a9-e4067f7908ed tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294')] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG nova.compute.manager [req-3c7d64f7-abc6-4d01-acc2-873212299f37 req-0139bfb1-0c53-4403-801f-eb07f0682410 service nova] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Received event network-vif-unplugged-85996da5-0750-4cc6-a752-a074a4fcfc58 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3c7d64f7-abc6-4d01-acc2-873212299f37 req-0139bfb1-0c53-4403-801f-eb07f0682410 service nova] Acquiring lock "f5e1d075-f64c-4837-9850-5f727a1984e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3c7d64f7-abc6-4d01-acc2-873212299f37 req-0139bfb1-0c53-4403-801f-eb07f0682410 service nova] Lock "f5e1d075-f64c-4837-9850-5f727a1984e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3c7d64f7-abc6-4d01-acc2-873212299f37 req-0139bfb1-0c53-4403-801f-eb07f0682410 service nova] Lock "f5e1d075-f64c-4837-9850-5f727a1984e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG nova.compute.manager [req-3c7d64f7-abc6-4d01-acc2-873212299f37 req-0139bfb1-0c53-4403-801f-eb07f0682410 service nova] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] No waiting events found dispatching network-vif-unplugged-85996da5-0750-4cc6-a752-a074a4fcfc58 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG nova.compute.manager [req-3c7d64f7-abc6-4d01-acc2-873212299f37 req-0139bfb1-0c53-4403-801f-eb07f0682410 service nova] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Received event network-vif-unplugged-85996da5-0750-4cc6-a752-a074a4fcfc58 for instance with task_state deleting. {{(pid=103546) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG nova.compute.manager [req-3c7d64f7-abc6-4d01-acc2-873212299f37 req-0139bfb1-0c53-4403-801f-eb07f0682410 service nova] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Received event network-vif-plugged-85996da5-0750-4cc6-a752-a074a4fcfc58 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3c7d64f7-abc6-4d01-acc2-873212299f37 req-0139bfb1-0c53-4403-801f-eb07f0682410 service nova] Acquiring lock "f5e1d075-f64c-4837-9850-5f727a1984e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3c7d64f7-abc6-4d01-acc2-873212299f37 req-0139bfb1-0c53-4403-801f-eb07f0682410 service nova] Lock "f5e1d075-f64c-4837-9850-5f727a1984e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3c7d64f7-abc6-4d01-acc2-873212299f37 req-0139bfb1-0c53-4403-801f-eb07f0682410 service nova] Lock "f5e1d075-f64c-4837-9850-5f727a1984e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG nova.compute.manager [req-3c7d64f7-abc6-4d01-acc2-873212299f37 req-0139bfb1-0c53-4403-801f-eb07f0682410 service nova] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] No waiting events found dispatching network-vif-plugged-85996da5-0750-4cc6-a752-a074a4fcfc58 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:06:48 user nova-compute[103546]: WARNING nova.compute.manager [req-3c7d64f7-abc6-4d01-acc2-873212299f37 req-0139bfb1-0c53-4403-801f-eb07f0682410 service nova] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Received unexpected event network-vif-plugged-85996da5-0750-4cc6-a752-a074a4fcfc58 for instance with vm_state active and task_state deleting.
Nov 16 04:06:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[37136820-5840-4cea-b578-38f7ec1c80f6]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c09a59b-d59b-457f-b0a9-e4067f7908ed tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294 -p 172.16.0.220:3260 --logout {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd075b7-dc91-4b87-8761-66a3827bc615]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c09a59b-d59b-457f-b0a9-e4067f7908ed tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294, portal: 172.16.0.220,3260]
Nov 16 04:06:48 user nova-compute[103546]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294, portal: 172.16.0.220,3260] successful.
Nov 16 04:06:48 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294 -p 172.16.0.220:3260 --op delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d610ae27-adfa-4047-8824-39f163296294 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ea0e0c-300d-4b89-8988-3c47621c78d3]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c09a59b-d59b-457f-b0a9-e4067f7908ed tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-3c09a59b-d59b-457f-b0a9-e4067f7908ed tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c09a59b-d59b-457f-b0a9-e4067f7908ed tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] <== disconnect_volume: return (363ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c09a59b-d59b-457f-b0a9-e4067f7908ed tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 04:06:48 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-3c09a59b-d59b-457f-b0a9-e4067f7908ed tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Deleting instance files /opt/stack/data/nova/instances/f5e1d075-f64c-4837-9850-5f727a1984e4_del
Nov 16 04:06:48 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-3c09a59b-d59b-457f-b0a9-e4067f7908ed tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Deletion of /opt/stack/data/nova/instances/f5e1d075-f64c-4837-9850-5f727a1984e4_del complete
Nov 16 04:06:48 user nova-compute[103546]: INFO nova.compute.manager [None req-3c09a59b-d59b-457f-b0a9-e4067f7908ed tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Took 1.28 seconds to destroy the instance on the hypervisor.
Nov 16 04:06:48 user nova-compute[103546]: DEBUG oslo.service.loopingcall [None req-3c09a59b-d59b-457f-b0a9-e4067f7908ed tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=103546) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG nova.compute.manager [-] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Deallocating network for instance {{(pid=103546) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] deallocate_for_instance() {{(pid=103546) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 04:06:48 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:06:48 user nova-compute[103546]: INFO nova.compute.manager [-] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Took 0.43 seconds to deallocate network for instance.
Nov 16 04:06:48 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:06:49 user nova-compute[103546]: DEBUG nova.compute.manager [req-82e5e783-64fa-4335-9670-b3c65f620878 req-4a558415-68d9-43bd-99bc-545ba15d4d05 service nova] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Received event network-vif-deleted-85996da5-0750-4cc6-a752-a074a4fcfc58 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:06:49 user nova-compute[103546]: INFO nova.compute.manager [None req-3c09a59b-d59b-457f-b0a9-e4067f7908ed tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: f5e1d075-f64c-4837-9850-5f727a1984e4] Took 0.72 seconds to detach 1 volumes for instance.
Nov 16 04:06:49 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-3c09a59b-d59b-457f-b0a9-e4067f7908ed tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:06:49 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-3c09a59b-d59b-457f-b0a9-e4067f7908ed tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:06:50 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-3c09a59b-d59b-457f-b0a9-e4067f7908ed tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:06:50 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-3c09a59b-d59b-457f-b0a9-e4067f7908ed tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:06:50 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-3c09a59b-d59b-457f-b0a9-e4067f7908ed tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.429s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:06:50 user nova-compute[103546]: INFO nova.scheduler.client.report [None req-3c09a59b-d59b-457f-b0a9-e4067f7908ed tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Deleted allocations for instance f5e1d075-f64c-4837-9850-5f727a1984e4
Nov 16 04:06:50 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-3c09a59b-d59b-457f-b0a9-e4067f7908ed tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "f5e1d075-f64c-4837-9850-5f727a1984e4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.046s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:06:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:06:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:06:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:02 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:07:05 user nova-compute[103546]: INFO nova.compute.manager [None req-0060f804-cd8f-4f8b-be64-4dd77aebf318 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Unrescuing
Nov 16 04:07:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0060f804-cd8f-4f8b-be64-4dd77aebf318 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Acquiring lock "refresh_cache-271adc7b-bfc6-48c5-8700-69b2b079ce4b" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:07:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0060f804-cd8f-4f8b-be64-4dd77aebf318 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Acquired lock "refresh_cache-271adc7b-bfc6-48c5-8700-69b2b079ce4b" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:07:05 user nova-compute[103546]: DEBUG nova.network.neutron [None req-0060f804-cd8f-4f8b-be64-4dd77aebf318 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 04:07:06 user nova-compute[103546]: DEBUG nova.network.neutron [None req-0060f804-cd8f-4f8b-be64-4dd77aebf318 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Updating instance_info_cache with network_info: [{"id": "30eba06b-aff6-43cf-b792-7624b1bc12a9", "address": "fa:16:3e:ae:80:8d", "network": {"id": "fdbb2d2c-9a54-4517-b33a-cf27ce7570b1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79661471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2a38a5eb514ce8a7569c8322657eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30eba06b-af", "ovs_interfaceid": "30eba06b-aff6-43cf-b792-7624b1bc12a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:07:06 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0060f804-cd8f-4f8b-be64-4dd77aebf318 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Releasing lock "refresh_cache-271adc7b-bfc6-48c5-8700-69b2b079ce4b" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:07:06 user nova-compute[103546]: DEBUG nova.objects.instance [None req-0060f804-cd8f-4f8b-be64-4dd77aebf318 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lazy-loading 'flavor' on Instance uuid 271adc7b-bfc6-48c5-8700-69b2b079ce4b {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:07:06 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:06 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:06 user nova-compute[103546]: DEBUG nova.compute.manager [req-5b6f7b6c-5bbc-4322-aafb-5858f5b456ec req-1602c391-a83b-40a8-a8a0-98c3ed4a3907 service nova] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Received event network-vif-unplugged-30eba06b-aff6-43cf-b792-7624b1bc12a9 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:07:06 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-5b6f7b6c-5bbc-4322-aafb-5858f5b456ec req-1602c391-a83b-40a8-a8a0-98c3ed4a3907 service nova] Acquiring lock "271adc7b-bfc6-48c5-8700-69b2b079ce4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:07:06 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-5b6f7b6c-5bbc-4322-aafb-5858f5b456ec req-1602c391-a83b-40a8-a8a0-98c3ed4a3907 service nova] Lock "271adc7b-bfc6-48c5-8700-69b2b079ce4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:07:06 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-5b6f7b6c-5bbc-4322-aafb-5858f5b456ec req-1602c391-a83b-40a8-a8a0-98c3ed4a3907 service nova] Lock "271adc7b-bfc6-48c5-8700-69b2b079ce4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:07:06 user nova-compute[103546]: DEBUG nova.compute.manager [req-5b6f7b6c-5bbc-4322-aafb-5858f5b456ec req-1602c391-a83b-40a8-a8a0-98c3ed4a3907 service nova] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] No waiting events found dispatching network-vif-unplugged-30eba06b-aff6-43cf-b792-7624b1bc12a9 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:07:06 user nova-compute[103546]: WARNING nova.compute.manager [req-5b6f7b6c-5bbc-4322-aafb-5858f5b456ec req-1602c391-a83b-40a8-a8a0-98c3ed4a3907 service nova] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Received unexpected event network-vif-unplugged-30eba06b-aff6-43cf-b792-7624b1bc12a9 for instance with vm_state rescued and task_state unrescuing.
Nov 16 04:07:06 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:06 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:06 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Instance destroyed successfully.
Nov 16 04:07:07 user nova-compute[103546]: DEBUG nova.objects.instance [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lazy-loading 'flavor' on Instance uuid b0a480de-e99b-4b54-bd81-36c216442137 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:07:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Acquiring lock "refresh_cache-b0a480de-e99b-4b54-bd81-36c216442137" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:07:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Acquired lock "refresh_cache-b0a480de-e99b-4b54-bd81-36c216442137" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:07:07 user nova-compute[103546]: DEBUG nova.network.neutron [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 04:07:07 user nova-compute[103546]: DEBUG nova.objects.instance [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lazy-loading 'info_cache' on Instance uuid b0a480de-e99b-4b54-bd81-36c216442137 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:07:07 user nova-compute[103546]: DEBUG nova.objects.base [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Object Instance<b0a480de-e99b-4b54-bd81-36c216442137> lazy-loaded attributes: flavor,info_cache {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 04:07:07 user nova-compute[103546]: DEBUG nova.network.neutron [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Updating instance_info_cache with network_info: [{"id": "804319c6-55cb-4f30-908c-71817934fb45", "address": "fa:16:3e:d5:4f:3e", "network": {"id": "23baa589-ae15-4a44-8991-d6fe8569dc8a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-464431710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f33e7eff7954fcc895f66982d7d45c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804319c6-55", "ovs_interfaceid": "804319c6-55cb-4f30-908c-71817934fb45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:07:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Releasing lock "refresh_cache-b0a480de-e99b-4b54-bd81-36c216442137" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:07:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-07c8abef-7b15-49ce-b5a6-0514fbff6703 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Acquiring lock "fa33f516-2ec7-4a83-ace8-f144e80d9473" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:07:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-07c8abef-7b15-49ce-b5a6-0514fbff6703 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "fa33f516-2ec7-4a83-ace8-f144e80d9473" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:07:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-07c8abef-7b15-49ce-b5a6-0514fbff6703 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Acquiring lock "fa33f516-2ec7-4a83-ace8-f144e80d9473-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:07:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-07c8abef-7b15-49ce-b5a6-0514fbff6703 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "fa33f516-2ec7-4a83-ace8-f144e80d9473-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:07:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-07c8abef-7b15-49ce-b5a6-0514fbff6703 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "fa33f516-2ec7-4a83-ace8-f144e80d9473-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:07:07 user nova-compute[103546]: INFO nova.compute.manager [None req-07c8abef-7b15-49ce-b5a6-0514fbff6703 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Terminating instance
Nov 16 04:07:07 user nova-compute[103546]: DEBUG nova.compute.manager [None req-07c8abef-7b15-49ce-b5a6-0514fbff6703 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Start destroying the instance on the hypervisor. {{(pid=103546) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 04:07:07 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Instance destroyed successfully.
Nov 16 04:07:07 user nova-compute[103546]: DEBUG nova.objects.instance [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lazy-loading 'resources' on Instance uuid b0a480de-e99b-4b54-bd81-36c216442137 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:07:07 user nova-compute[103546]: DEBUG nova.objects.base [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Object Instance<b0a480de-e99b-4b54-bd81-36c216442137> lazy-loaded attributes: flavor,info_cache,resources {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 04:07:07 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:59:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1194569156',display_name='tempest-AttachVolumeTestJSON-server-1194569156',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1194569156',id=33,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGulyvMv6DBB41Qe8XWF63e9B3iBHOwlSkAryW1iz72Aw6HfFs0cTFUdIe1uTx/ceIRIbAXp8f4Mb3WAscOyquzQNMRUlWLf10PNP0Nn0ZjiELMrAE3x8QFH1PXFWQSd/w==',key_name='tempest-keypair-309978137',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:59:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5f33e7eff7954fcc895f66982d7d45c8',ramdisk_id='',reservation_id='r-sa4b0m91',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1584447380',owner_user_name='tempest-AttachVolumeTestJSON-1584447380-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T04:05:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='005ffc068a19494bb5a436fc4a07aaa1',uuid=b0a480de-e99b-4b54-bd81-36c216442137,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "804319c6-55cb-4f30-908c-71817934fb45", "address": "fa:16:3e:d5:4f:3e", "network": {"id": "23baa589-ae15-4a44-8991-d6fe8569dc8a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-464431710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f33e7eff7954fcc895f66982d7d45c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804319c6-55", "ovs_interfaceid": "804319c6-55cb-4f30-908c-71817934fb45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 04:07:07 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Converting VIF {"id": "804319c6-55cb-4f30-908c-71817934fb45", "address": "fa:16:3e:d5:4f:3e", "network": {"id": "23baa589-ae15-4a44-8991-d6fe8569dc8a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-464431710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f33e7eff7954fcc895f66982d7d45c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804319c6-55", "ovs_interfaceid": "804319c6-55cb-4f30-908c-71817934fb45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:07:07 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:4f:3e,bridge_name='br-int',has_traffic_filtering=True,id=804319c6-55cb-4f30-908c-71817934fb45,network=Network(23baa589-ae15-4a44-8991-d6fe8569dc8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap804319c6-55') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:07:07 user nova-compute[103546]: DEBUG os_vif [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:4f:3e,bridge_name='br-int',has_traffic_filtering=True,id=804319c6-55cb-4f30-908c-71817934fb45,network=Network(23baa589-ae15-4a44-8991-d6fe8569dc8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap804319c6-55') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 04:07:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap804319c6-55, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:07:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:07:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=369be0e6-570b-4aa4-ae4b-a1532c7826ba) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:07:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:07:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:07 user nova-compute[103546]: INFO os_vif [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:4f:3e,bridge_name='br-int',has_traffic_filtering=True,id=804319c6-55cb-4f30-908c-71817934fb45,network=Network(23baa589-ae15-4a44-8991-d6fe8569dc8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap804319c6-55')
Nov 16 04:07:07 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Start _get_guest_xml network_info=[{"id": "804319c6-55cb-4f30-908c-71817934fb45", "address": "fa:16:3e:d5:4f:3e", "network": {"id": "23baa589-ae15-4a44-8991-d6fe8569dc8a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-464431710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f33e7eff7954fcc895f66982d7d45c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804319c6-55", "ovs_interfaceid": "804319c6-55cb-4f30-908c-71817934fb45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '5c6f539a-01e5-4478-bf8f-a14310b5d7dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 04:07:07 user nova-compute[103546]: DEBUG nova.objects.instance [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lazy-loading 'numa_topology' on Instance uuid b0a480de-e99b-4b54-bd81-36c216442137 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:07:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:07 user nova-compute[103546]: DEBUG nova.objects.base [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Object Instance<b0a480de-e99b-4b54-bd81-36c216442137> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 04:07:07 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:07:07 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:07:07 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 04:07:07 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 04:07:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:07 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 04:07:07 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 04:07:07 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 04:07:07 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 04:07:07 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 04:07:07 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 04:07:07 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 04:07:07 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 04:07:07 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 04:07:07 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 04:07:07 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 04:07:07 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 04:07:07 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 04:07:07 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 04:07:07 user nova-compute[103546]: DEBUG nova.objects.instance [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lazy-loading 'vcpu_model' on Instance uuid b0a480de-e99b-4b54-bd81-36c216442137 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:07:07 user nova-compute[103546]: DEBUG nova.objects.base [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Object Instance<b0a480de-e99b-4b54-bd81-36c216442137> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 04:07:07 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:59:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1194569156',display_name='tempest-AttachVolumeTestJSON-server-1194569156',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1194569156',id=33,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGulyvMv6DBB41Qe8XWF63e9B3iBHOwlSkAryW1iz72Aw6HfFs0cTFUdIe1uTx/ceIRIbAXp8f4Mb3WAscOyquzQNMRUlWLf10PNP0Nn0ZjiELMrAE3x8QFH1PXFWQSd/w==',key_name='tempest-keypair-309978137',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:59:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5f33e7eff7954fcc895f66982d7d45c8',ramdisk_id='',reservation_id='r-sa4b0m91',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1584447380',owner_user_name='tempest-AttachVolumeTestJSON-1584447380-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T04:05:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='005ffc068a19494bb5a436fc4a07aaa1',uuid=b0a480de-e99b-4b54-bd81-36c216442137,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "804319c6-55cb-4f30-908c-71817934fb45", "address": "fa:16:3e:d5:4f:3e", "network": {"id": "23baa589-ae15-4a44-8991-d6fe8569dc8a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-464431710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f33e7eff7954fcc895f66982d7d45c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804319c6-55", "ovs_interfaceid": "804319c6-55cb-4f30-908c-71817934fb45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 04:07:07 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Converting VIF {"id": "804319c6-55cb-4f30-908c-71817934fb45", "address": "fa:16:3e:d5:4f:3e", "network": {"id": "23baa589-ae15-4a44-8991-d6fe8569dc8a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-464431710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f33e7eff7954fcc895f66982d7d45c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804319c6-55", "ovs_interfaceid": "804319c6-55cb-4f30-908c-71817934fb45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:07:07 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:4f:3e,bridge_name='br-int',has_traffic_filtering=True,id=804319c6-55cb-4f30-908c-71817934fb45,network=Network(23baa589-ae15-4a44-8991-d6fe8569dc8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap804319c6-55') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:07:07 user nova-compute[103546]: DEBUG nova.objects.instance [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lazy-loading 'pci_devices' on Instance uuid b0a480de-e99b-4b54-bd81-36c216442137 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:07:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:07 user nova-compute[103546]: DEBUG nova.objects.base [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Object Instance<b0a480de-e99b-4b54-bd81-36c216442137> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 04:07:07 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] End _get_guest_xml xml=<domain type="kvm">
Nov 16 04:07:07 user nova-compute[103546]:   <uuid>b0a480de-e99b-4b54-bd81-36c216442137</uuid>
Nov 16 04:07:07 user nova-compute[103546]:   <name>instance-00000021</name>
Nov 16 04:07:07 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 04:07:07 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 04:07:07 user nova-compute[103546]:   <metadata>
Nov 16 04:07:07 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 04:07:07 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 04:07:07 user nova-compute[103546]:       <nova:name>tempest-AttachVolumeTestJSON-server-1194569156</nova:name>
Nov 16 04:07:07 user nova-compute[103546]:       <nova:creationTime>2023-11-16 04:07:07</nova:creationTime>
Nov 16 04:07:07 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 04:07:07 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 04:07:07 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 04:07:07 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 04:07:07 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 04:07:07 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 04:07:07 user nova-compute[103546]:       </nova:flavor>
Nov 16 04:07:07 user nova-compute[103546]:       <nova:owner>
Nov 16 04:07:07 user nova-compute[103546]:         <nova:user uuid="005ffc068a19494bb5a436fc4a07aaa1">tempest-AttachVolumeTestJSON-1584447380-project-member</nova:user>
Nov 16 04:07:07 user nova-compute[103546]:         <nova:project uuid="5f33e7eff7954fcc895f66982d7d45c8">tempest-AttachVolumeTestJSON-1584447380</nova:project>
Nov 16 04:07:07 user nova-compute[103546]:       </nova:owner>
Nov 16 04:07:07 user nova-compute[103546]:       <nova:root type="image" uuid="5c6f539a-01e5-4478-bf8f-a14310b5d7dd"/>
Nov 16 04:07:07 user nova-compute[103546]:       <nova:ports>
Nov 16 04:07:07 user nova-compute[103546]:         <nova:port uuid="804319c6-55cb-4f30-908c-71817934fb45">
Nov 16 04:07:07 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 16 04:07:07 user nova-compute[103546]:         </nova:port>
Nov 16 04:07:07 user nova-compute[103546]:       </nova:ports>
Nov 16 04:07:07 user nova-compute[103546]:     </nova:instance>
Nov 16 04:07:07 user nova-compute[103546]:   </metadata>
Nov 16 04:07:07 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 04:07:07 user nova-compute[103546]:     <system>
Nov 16 04:07:07 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 04:07:07 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 04:07:07 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 04:07:07 user nova-compute[103546]:       <entry name="serial">b0a480de-e99b-4b54-bd81-36c216442137</entry>
Nov 16 04:07:07 user nova-compute[103546]:       <entry name="uuid">b0a480de-e99b-4b54-bd81-36c216442137</entry>
Nov 16 04:07:07 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 04:07:07 user nova-compute[103546]:     </system>
Nov 16 04:07:07 user nova-compute[103546]:   </sysinfo>
Nov 16 04:07:07 user nova-compute[103546]:   <os>
Nov 16 04:07:07 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 04:07:07 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 04:07:07 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 04:07:07 user nova-compute[103546]:   </os>
Nov 16 04:07:07 user nova-compute[103546]:   <features>
Nov 16 04:07:07 user nova-compute[103546]:     <acpi/>
Nov 16 04:07:07 user nova-compute[103546]:     <apic/>
Nov 16 04:07:07 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 04:07:07 user nova-compute[103546]:   </features>
Nov 16 04:07:07 user nova-compute[103546]:   <clock offset="utc">
Nov 16 04:07:07 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 04:07:07 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 04:07:07 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 04:07:07 user nova-compute[103546]:   </clock>
Nov 16 04:07:07 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 04:07:07 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 04:07:07 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 04:07:07 user nova-compute[103546]:   </cpu>
Nov 16 04:07:07 user nova-compute[103546]:   <devices>
Nov 16 04:07:07 user nova-compute[103546]:     <disk type="file" device="disk">
Nov 16 04:07:07 user nova-compute[103546]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 04:07:07 user nova-compute[103546]:       <source file="/opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk"/>
Nov 16 04:07:07 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 04:07:07 user nova-compute[103546]:     </disk>
Nov 16 04:07:07 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 04:07:07 user nova-compute[103546]:       <mac address="fa:16:3e:d5:4f:3e"/>
Nov 16 04:07:07 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 04:07:07 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 04:07:07 user nova-compute[103546]:       <target dev="tap804319c6-55"/>
Nov 16 04:07:07 user nova-compute[103546]:     </interface>
Nov 16 04:07:07 user nova-compute[103546]:     <serial type="pty">
Nov 16 04:07:07 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/console.log" append="off"/>
Nov 16 04:07:07 user nova-compute[103546]:     </serial>
Nov 16 04:07:07 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 04:07:07 user nova-compute[103546]:     <video>
Nov 16 04:07:07 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 04:07:07 user nova-compute[103546]:     </video>
Nov 16 04:07:07 user nova-compute[103546]:     <rng model="virtio">
Nov 16 04:07:07 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 04:07:07 user nova-compute[103546]:     </rng>
Nov 16 04:07:07 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 04:07:07 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 04:07:07 user nova-compute[103546]:       <stats period="10"/>
Nov 16 04:07:07 user nova-compute[103546]:     </memballoon>
Nov 16 04:07:07 user nova-compute[103546]:   </devices>
Nov 16 04:07:07 user nova-compute[103546]: </domain>
Nov 16 04:07:07 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 04:07:07 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG nova.objects.instance [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lazy-loading 'trusted_certs' on Instance uuid b0a480de-e99b-4b54-bd81-36c216442137 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG nova.objects.base [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Object Instance<b0a480de-e99b-4b54-bd81-36c216442137> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.197s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk. size=1073741824 {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG nova.compute.manager [req-ee9e2844-9fac-45ad-905d-f0ed730a70e6 req-45e3a3f3-f3bc-4517-9dbb-09552494968b service nova] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Received event network-vif-plugged-30eba06b-aff6-43cf-b792-7624b1bc12a9 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ee9e2844-9fac-45ad-905d-f0ed730a70e6 req-45e3a3f3-f3bc-4517-9dbb-09552494968b service nova] Acquiring lock "271adc7b-bfc6-48c5-8700-69b2b079ce4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ee9e2844-9fac-45ad-905d-f0ed730a70e6 req-45e3a3f3-f3bc-4517-9dbb-09552494968b service nova] Lock "271adc7b-bfc6-48c5-8700-69b2b079ce4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ee9e2844-9fac-45ad-905d-f0ed730a70e6 req-45e3a3f3-f3bc-4517-9dbb-09552494968b service nova] Lock "271adc7b-bfc6-48c5-8700-69b2b079ce4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG nova.compute.manager [req-ee9e2844-9fac-45ad-905d-f0ed730a70e6 req-45e3a3f3-f3bc-4517-9dbb-09552494968b service nova] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] No waiting events found dispatching network-vif-plugged-30eba06b-aff6-43cf-b792-7624b1bc12a9 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:07:08 user nova-compute[103546]: WARNING nova.compute.manager [req-ee9e2844-9fac-45ad-905d-f0ed730a70e6 req-45e3a3f3-f3bc-4517-9dbb-09552494968b service nova] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Received unexpected event network-vif-plugged-30eba06b-aff6-43cf-b792-7624b1bc12a9 for instance with vm_state rescued and task_state unrescuing.
Nov 16 04:07:08 user nova-compute[103546]: DEBUG nova.compute.manager [req-ee9e2844-9fac-45ad-905d-f0ed730a70e6 req-45e3a3f3-f3bc-4517-9dbb-09552494968b service nova] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Received event network-vif-unplugged-bd7cede4-510c-488f-bf84-773a345198d7 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ee9e2844-9fac-45ad-905d-f0ed730a70e6 req-45e3a3f3-f3bc-4517-9dbb-09552494968b service nova] Acquiring lock "fa33f516-2ec7-4a83-ace8-f144e80d9473-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ee9e2844-9fac-45ad-905d-f0ed730a70e6 req-45e3a3f3-f3bc-4517-9dbb-09552494968b service nova] Lock "fa33f516-2ec7-4a83-ace8-f144e80d9473-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ee9e2844-9fac-45ad-905d-f0ed730a70e6 req-45e3a3f3-f3bc-4517-9dbb-09552494968b service nova] Lock "fa33f516-2ec7-4a83-ace8-f144e80d9473-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG nova.compute.manager [req-ee9e2844-9fac-45ad-905d-f0ed730a70e6 req-45e3a3f3-f3bc-4517-9dbb-09552494968b service nova] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] No waiting events found dispatching network-vif-unplugged-bd7cede4-510c-488f-bf84-773a345198d7 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG nova.compute.manager [req-ee9e2844-9fac-45ad-905d-f0ed730a70e6 req-45e3a3f3-f3bc-4517-9dbb-09552494968b service nova] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Received event network-vif-unplugged-bd7cede4-510c-488f-bf84-773a345198d7 for instance with task_state deleting. {{(pid=103546) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG nova.compute.manager [req-ee9e2844-9fac-45ad-905d-f0ed730a70e6 req-45e3a3f3-f3bc-4517-9dbb-09552494968b service nova] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Received event network-vif-plugged-bd7cede4-510c-488f-bf84-773a345198d7 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ee9e2844-9fac-45ad-905d-f0ed730a70e6 req-45e3a3f3-f3bc-4517-9dbb-09552494968b service nova] Acquiring lock "fa33f516-2ec7-4a83-ace8-f144e80d9473-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ee9e2844-9fac-45ad-905d-f0ed730a70e6 req-45e3a3f3-f3bc-4517-9dbb-09552494968b service nova] Lock "fa33f516-2ec7-4a83-ace8-f144e80d9473-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ee9e2844-9fac-45ad-905d-f0ed730a70e6 req-45e3a3f3-f3bc-4517-9dbb-09552494968b service nova] Lock "fa33f516-2ec7-4a83-ace8-f144e80d9473-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG nova.compute.manager [req-ee9e2844-9fac-45ad-905d-f0ed730a70e6 req-45e3a3f3-f3bc-4517-9dbb-09552494968b service nova] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] No waiting events found dispatching network-vif-plugged-bd7cede4-510c-488f-bf84-773a345198d7 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:07:08 user nova-compute[103546]: WARNING nova.compute.manager [req-ee9e2844-9fac-45ad-905d-f0ed730a70e6 req-45e3a3f3-f3bc-4517-9dbb-09552494968b service nova] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Received unexpected event network-vif-plugged-bd7cede4-510c-488f-bf84-773a345198d7 for instance with vm_state active and task_state deleting.
Nov 16 04:07:08 user nova-compute[103546]: DEBUG nova.compute.manager [req-ee9e2844-9fac-45ad-905d-f0ed730a70e6 req-45e3a3f3-f3bc-4517-9dbb-09552494968b service nova] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Received event network-vif-plugged-30eba06b-aff6-43cf-b792-7624b1bc12a9 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ee9e2844-9fac-45ad-905d-f0ed730a70e6 req-45e3a3f3-f3bc-4517-9dbb-09552494968b service nova] Acquiring lock "271adc7b-bfc6-48c5-8700-69b2b079ce4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ee9e2844-9fac-45ad-905d-f0ed730a70e6 req-45e3a3f3-f3bc-4517-9dbb-09552494968b service nova] Lock "271adc7b-bfc6-48c5-8700-69b2b079ce4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ee9e2844-9fac-45ad-905d-f0ed730a70e6 req-45e3a3f3-f3bc-4517-9dbb-09552494968b service nova] Lock "271adc7b-bfc6-48c5-8700-69b2b079ce4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG nova.compute.manager [req-ee9e2844-9fac-45ad-905d-f0ed730a70e6 req-45e3a3f3-f3bc-4517-9dbb-09552494968b service nova] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] No waiting events found dispatching network-vif-plugged-30eba06b-aff6-43cf-b792-7624b1bc12a9 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:07:08 user nova-compute[103546]: WARNING nova.compute.manager [req-ee9e2844-9fac-45ad-905d-f0ed730a70e6 req-45e3a3f3-f3bc-4517-9dbb-09552494968b service nova] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Received unexpected event network-vif-plugged-30eba06b-aff6-43cf-b792-7624b1bc12a9 for instance with vm_state rescued and task_state unrescuing.
Nov 16 04:07:08 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Cannot resize image /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk to a smaller size. {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG nova.objects.instance [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lazy-loading 'migration_context' on Instance uuid b0a480de-e99b-4b54-bd81-36c216442137 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG nova.objects.base [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Object Instance<b0a480de-e99b-4b54-bd81-36c216442137> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:59:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1194569156',display_name='tempest-AttachVolumeTestJSON-server-1194569156',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1194569156',id=33,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGulyvMv6DBB41Qe8XWF63e9B3iBHOwlSkAryW1iz72Aw6HfFs0cTFUdIe1uTx/ceIRIbAXp8f4Mb3WAscOyquzQNMRUlWLf10PNP0Nn0ZjiELMrAE3x8QFH1PXFWQSd/w==',key_name='tempest-keypair-309978137',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:59:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='5f33e7eff7954fcc895f66982d7d45c8',ramdisk_id='',reservation_id='r-sa4b0m91',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1584447380',owner_user_name='tempest-AttachVolumeTestJSON-1584447380-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T04:05:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='005ffc068a19494bb5a436fc4a07aaa1',uuid=b0a480de-e99b-4b54-bd81-36c216442137,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "804319c6-55cb-4f30-908c-71817934fb45", "address": "fa:16:3e:d5:4f:3e", "network": {"id": "23baa589-ae15-4a44-8991-d6fe8569dc8a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-464431710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f33e7eff7954fcc895f66982d7d45c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804319c6-55", "ovs_interfaceid": "804319c6-55cb-4f30-908c-71817934fb45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Converting VIF {"id": "804319c6-55cb-4f30-908c-71817934fb45", "address": "fa:16:3e:d5:4f:3e", "network": {"id": "23baa589-ae15-4a44-8991-d6fe8569dc8a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-464431710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f33e7eff7954fcc895f66982d7d45c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804319c6-55", "ovs_interfaceid": "804319c6-55cb-4f30-908c-71817934fb45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:4f:3e,bridge_name='br-int',has_traffic_filtering=True,id=804319c6-55cb-4f30-908c-71817934fb45,network=Network(23baa589-ae15-4a44-8991-d6fe8569dc8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap804319c6-55') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG os_vif [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:4f:3e,bridge_name='br-int',has_traffic_filtering=True,id=804319c6-55cb-4f30-908c-71817934fb45,network=Network(23baa589-ae15-4a44-8991-d6fe8569dc8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap804319c6-55') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '48de04b5-06ba-556b-8a0c-fe984b5b9f91', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap804319c6-55, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap804319c6-55, col_values=(('qos', UUID('815ecb50-f374-4ef5-a94f-649d8f40e89d')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap804319c6-55, col_values=(('external_ids', {'iface-id': '804319c6-55cb-4f30-908c-71817934fb45', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:4f:3e', 'vm-uuid': 'b0a480de-e99b-4b54-bd81-36c216442137'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:08 user nova-compute[103546]: INFO os_vif [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:4f:3e,bridge_name='br-int',has_traffic_filtering=True,id=804319c6-55cb-4f30-908c-71817934fb45,network=Network(23baa589-ae15-4a44-8991-d6fe8569dc8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap804319c6-55')
Nov 16 04:07:08 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Instance destroyed successfully.
Nov 16 04:07:08 user nova-compute[103546]: DEBUG nova.objects.instance [None req-07c8abef-7b15-49ce-b5a6-0514fbff6703 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lazy-loading 'resources' on Instance uuid fa33f516-2ec7-4a83-ace8-f144e80d9473 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-07c8abef-7b15-49ce-b5a6-0514fbff6703 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:02:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-709249967',display_name='tempest-TestMinimumBasicScenario-server-709249967',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-709249967',id=37,image_ref='86c537ce-7981-4390-941d-9b1ecf30cfa8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD46OWTtqlJgr04x6aVRv8hBUbSMBgUi9Q0DtKBivxbAnC1inBXyd+4fJHja3kf2qBA81MZvidHOGa042g3vmWGdjfDgRFBjel2colKkP05dlXdqCimpq+7wAT58G7LIyg==',key_name='tempest-TestMinimumBasicScenario-923881879',keypairs=<?>,launch_index=0,launched_at=2023-11-16T04:02:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='edb839c76c0d4513b9be0ec92301707f',ramdisk_id='',reservation_id='r-x0v3obzl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='86c537ce-7981-4390-941d-9b1ecf30cfa8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1416270309',owner_user_name='tempest-TestMinimumBasicScenario-1416270309-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T04:04:30Z,user_data=None,user_id='341066fb5ead4ef28e4900c085593814',uuid=fa33f516-2ec7-4a83-ace8-f144e80d9473,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd7cede4-510c-488f-bf84-773a345198d7", "address": "fa:16:3e:84:89:24", "network": {"id": "d942264a-f03e-49a2-89eb-103a12c99518", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484356505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edb839c76c0d4513b9be0ec92301707f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd7cede4-51", "ovs_interfaceid": "bd7cede4-510c-488f-bf84-773a345198d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-07c8abef-7b15-49ce-b5a6-0514fbff6703 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Converting VIF {"id": "bd7cede4-510c-488f-bf84-773a345198d7", "address": "fa:16:3e:84:89:24", "network": {"id": "d942264a-f03e-49a2-89eb-103a12c99518", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484356505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edb839c76c0d4513b9be0ec92301707f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd7cede4-51", "ovs_interfaceid": "bd7cede4-510c-488f-bf84-773a345198d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-07c8abef-7b15-49ce-b5a6-0514fbff6703 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:84:89:24,bridge_name='br-int',has_traffic_filtering=True,id=bd7cede4-510c-488f-bf84-773a345198d7,network=Network(d942264a-f03e-49a2-89eb-103a12c99518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd7cede4-51') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG os_vif [None req-07c8abef-7b15-49ce-b5a6-0514fbff6703 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:89:24,bridge_name='br-int',has_traffic_filtering=True,id=bd7cede4-510c-488f-bf84-773a345198d7,network=Network(d942264a-f03e-49a2-89eb-103a12c99518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd7cede4-51') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbd7cede4-51, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b6d6f19c-4cc2-4e5a-859c-6718b3f98773) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:08 user nova-compute[103546]: INFO os_vif [None req-07c8abef-7b15-49ce-b5a6-0514fbff6703 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:89:24,bridge_name='br-int',has_traffic_filtering=True,id=bd7cede4-510c-488f-bf84-773a345198d7,network=Network(d942264a-f03e-49a2-89eb-103a12c99518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd7cede4-51')
Nov 16 04:07:08 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-07c8abef-7b15-49ce-b5a6-0514fbff6703 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Deleting instance files /opt/stack/data/nova/instances/fa33f516-2ec7-4a83-ace8-f144e80d9473_del
Nov 16 04:07:08 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-07c8abef-7b15-49ce-b5a6-0514fbff6703 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Deletion of /opt/stack/data/nova/instances/fa33f516-2ec7-4a83-ace8-f144e80d9473_del complete
Nov 16 04:07:08 user nova-compute[103546]: INFO nova.compute.manager [None req-07c8abef-7b15-49ce-b5a6-0514fbff6703 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Took 1.33 seconds to destroy the instance on the hypervisor.
Nov 16 04:07:08 user nova-compute[103546]: DEBUG oslo.service.loopingcall [None req-07c8abef-7b15-49ce-b5a6-0514fbff6703 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=103546) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG nova.compute.manager [-] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Deallocating network for instance {{(pid=103546) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 04:07:08 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] deallocate_for_instance() {{(pid=103546) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 04:07:09 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:07:09 user nova-compute[103546]: INFO nova.compute.manager [-] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Took 0.46 seconds to deallocate network for instance.
Nov 16 04:07:09 user nova-compute[103546]: DEBUG nova.compute.manager [req-9177543e-c0ef-4f27-ac22-854c0bf93a16 req-6942cf53-c826-44c4-9cd8-147fba3bc6f8 service nova] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Received event network-vif-deleted-bd7cede4-510c-488f-bf84-773a345198d7 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:07:09 user nova-compute[103546]: INFO nova.compute.manager [req-9177543e-c0ef-4f27-ac22-854c0bf93a16 req-6942cf53-c826-44c4-9cd8-147fba3bc6f8 service nova] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Neutron deleted interface bd7cede4-510c-488f-bf84-773a345198d7; detaching it from the instance and deleting it from the info cache
Nov 16 04:07:09 user nova-compute[103546]: DEBUG nova.network.neutron [req-9177543e-c0ef-4f27-ac22-854c0bf93a16 req-6942cf53-c826-44c4-9cd8-147fba3bc6f8 service nova] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:07:09 user nova-compute[103546]: DEBUG nova.compute.manager [req-9177543e-c0ef-4f27-ac22-854c0bf93a16 req-6942cf53-c826-44c4-9cd8-147fba3bc6f8 service nova] [instance: fa33f516-2ec7-4a83-ace8-f144e80d9473] Detach interface failed, port_id=bd7cede4-510c-488f-bf84-773a345198d7, reason: Instance fa33f516-2ec7-4a83-ace8-f144e80d9473 could not be found. {{(pid=103546) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 04:07:09 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-07c8abef-7b15-49ce-b5a6-0514fbff6703 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:07:09 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-07c8abef-7b15-49ce-b5a6-0514fbff6703 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:07:09 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-07c8abef-7b15-49ce-b5a6-0514fbff6703 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:07:09 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-07c8abef-7b15-49ce-b5a6-0514fbff6703 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:07:09 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-07c8abef-7b15-49ce-b5a6-0514fbff6703 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.425s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:07:09 user nova-compute[103546]: INFO nova.scheduler.client.report [None req-07c8abef-7b15-49ce-b5a6-0514fbff6703 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Deleted allocations for instance fa33f516-2ec7-4a83-ace8-f144e80d9473
Nov 16 04:07:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-07c8abef-7b15-49ce-b5a6-0514fbff6703 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "fa33f516-2ec7-4a83-ace8-f144e80d9473" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.441s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:07:10 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:10 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:10 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:10 user nova-compute[103546]: DEBUG nova.compute.manager [req-a9d472e3-cf6d-421f-94b4-478890086a1f req-072b8b83-8917-4342-8504-2ad3e55e4503 service nova] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Received event network-vif-plugged-30eba06b-aff6-43cf-b792-7624b1bc12a9 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:07:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a9d472e3-cf6d-421f-94b4-478890086a1f req-072b8b83-8917-4342-8504-2ad3e55e4503 service nova] Acquiring lock "271adc7b-bfc6-48c5-8700-69b2b079ce4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:07:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a9d472e3-cf6d-421f-94b4-478890086a1f req-072b8b83-8917-4342-8504-2ad3e55e4503 service nova] Lock "271adc7b-bfc6-48c5-8700-69b2b079ce4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:07:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a9d472e3-cf6d-421f-94b4-478890086a1f req-072b8b83-8917-4342-8504-2ad3e55e4503 service nova] Lock "271adc7b-bfc6-48c5-8700-69b2b079ce4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:07:10 user nova-compute[103546]: DEBUG nova.compute.manager [req-a9d472e3-cf6d-421f-94b4-478890086a1f req-072b8b83-8917-4342-8504-2ad3e55e4503 service nova] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] No waiting events found dispatching network-vif-plugged-30eba06b-aff6-43cf-b792-7624b1bc12a9 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:07:10 user nova-compute[103546]: WARNING nova.compute.manager [req-a9d472e3-cf6d-421f-94b4-478890086a1f req-072b8b83-8917-4342-8504-2ad3e55e4503 service nova] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Received unexpected event network-vif-plugged-30eba06b-aff6-43cf-b792-7624b1bc12a9 for instance with vm_state rescued and task_state unrescuing.
Nov 16 04:07:10 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:10 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:10 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:10 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:11 user nova-compute[103546]: DEBUG nova.compute.manager [None req-0060f804-cd8f-4f8b-be64-4dd77aebf318 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 04:07:11 user nova-compute[103546]: DEBUG nova.compute.manager [req-7e790534-3353-41c8-b667-af08383d2e03 req-231712d7-924f-4394-a4ed-59672846c894 service nova] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Received event network-vif-plugged-804319c6-55cb-4f30-908c-71817934fb45 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:07:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-7e790534-3353-41c8-b667-af08383d2e03 req-231712d7-924f-4394-a4ed-59672846c894 service nova] Acquiring lock "b0a480de-e99b-4b54-bd81-36c216442137-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:07:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-7e790534-3353-41c8-b667-af08383d2e03 req-231712d7-924f-4394-a4ed-59672846c894 service nova] Lock "b0a480de-e99b-4b54-bd81-36c216442137-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:07:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-7e790534-3353-41c8-b667-af08383d2e03 req-231712d7-924f-4394-a4ed-59672846c894 service nova] Lock "b0a480de-e99b-4b54-bd81-36c216442137-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:07:11 user nova-compute[103546]: DEBUG nova.compute.manager [req-7e790534-3353-41c8-b667-af08383d2e03 req-231712d7-924f-4394-a4ed-59672846c894 service nova] [instance: b0a480de-e99b-4b54-bd81-36c216442137] No waiting events found dispatching network-vif-plugged-804319c6-55cb-4f30-908c-71817934fb45 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:07:11 user nova-compute[103546]: WARNING nova.compute.manager [req-7e790534-3353-41c8-b667-af08383d2e03 req-231712d7-924f-4394-a4ed-59672846c894 service nova] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Received unexpected event network-vif-plugged-804319c6-55cb-4f30-908c-71817934fb45 for instance with vm_state stopped and task_state powering-on.
Nov 16 04:07:11 user nova-compute[103546]: DEBUG nova.compute.manager [req-7e790534-3353-41c8-b667-af08383d2e03 req-231712d7-924f-4394-a4ed-59672846c894 service nova] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Received event network-vif-plugged-804319c6-55cb-4f30-908c-71817934fb45 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:07:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-7e790534-3353-41c8-b667-af08383d2e03 req-231712d7-924f-4394-a4ed-59672846c894 service nova] Acquiring lock "b0a480de-e99b-4b54-bd81-36c216442137-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:07:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-7e790534-3353-41c8-b667-af08383d2e03 req-231712d7-924f-4394-a4ed-59672846c894 service nova] Lock "b0a480de-e99b-4b54-bd81-36c216442137-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:07:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-7e790534-3353-41c8-b667-af08383d2e03 req-231712d7-924f-4394-a4ed-59672846c894 service nova] Lock "b0a480de-e99b-4b54-bd81-36c216442137-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:07:11 user nova-compute[103546]: DEBUG nova.compute.manager [req-7e790534-3353-41c8-b667-af08383d2e03 req-231712d7-924f-4394-a4ed-59672846c894 service nova] [instance: b0a480de-e99b-4b54-bd81-36c216442137] No waiting events found dispatching network-vif-plugged-804319c6-55cb-4f30-908c-71817934fb45 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:07:11 user nova-compute[103546]: WARNING nova.compute.manager [req-7e790534-3353-41c8-b667-af08383d2e03 req-231712d7-924f-4394-a4ed-59672846c894 service nova] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Received unexpected event network-vif-plugged-804319c6-55cb-4f30-908c-71817934fb45 for instance with vm_state stopped and task_state powering-on.
Nov 16 04:07:12 user nova-compute[103546]: DEBUG nova.compute.manager [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 04:07:12 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Instance rebooted successfully.
Nov 16 04:07:12 user nova-compute[103546]: DEBUG nova.compute.manager [None req-8d1da54a-48c4-41a0-b3a8-95589a0e5078 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 04:07:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:18 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:23 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:24 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:07:24 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=103546) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 04:07:26 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:07:26 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager.update_available_resource {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:07:26 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:07:26 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:07:26 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:07:26 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Auditing locally available compute resources for user (node: user) {{(pid=103546) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 04:07:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:07:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:07:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:07:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:07:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c02873d-469e-41a4-b492-69f793c8a07c/disk.rescue --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:07:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c02873d-469e-41a4-b492-69f793c8a07c/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:07:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c02873d-469e-41a4-b492-69f793c8a07c/disk.rescue --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:07:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c02873d-469e-41a4-b492-69f793c8a07c/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:07:27 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /opt/stack/data/nova/instances/8c02873d-469e-41a4-b492-69f793c8a07c/disk (vdb) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 04:07:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f7c407-3373-43ba-ac92-7eb0a43a7093/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:07:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f7c407-3373-43ba-ac92-7eb0a43a7093/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:07:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f7c407-3373-43ba-ac92-7eb0a43a7093/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:07:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f7c407-3373-43ba-ac92-7eb0a43a7093/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:07:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:07:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:07:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:07:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:07:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/182b9697-e7da-4487-b0c1-889c1f655b95/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:07:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/182b9697-e7da-4487-b0c1-889c1f655b95/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:07:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/182b9697-e7da-4487-b0c1-889c1f655b95/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:07:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/182b9697-e7da-4487-b0c1-889c1f655b95/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:07:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:07:28 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:07:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:07:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:07:28 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:07:29 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 04:07:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:07:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:07:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:07:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:07:29 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 04:07:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.rescue --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:07:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:07:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.rescue --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:07:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.rescue --force-share --output=json" returned: 0 in 0.166s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:07:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:07:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:07:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:07:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:07:30 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 04:07:30 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 04:07:30 user nova-compute[103546]: INFO nova.compute.manager [None req-cb9849e7-2b92-49f4-81cf-5e2fb3ad886b tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Get console output
Nov 16 04:07:30 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:07:30 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:07:30 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Hypervisor/Node resource view: name=user free_ram=7411MB free_disk=24.852092742919922GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=103546) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 04:07:30 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:07:30 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.003s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:07:30 user nova-compute[103546]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 16 04:07:31 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 9a89970b-fc61-4419-8ff9-b48013dccf9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:07:31 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 04101512-7333-4581-add3-7af3821e335b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:07:31 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance fa7e5468-9dd4-407d-85ec-d45ec76f9e29 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:07:31 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 246ccf69-847c-4ab2-b709-ad1a85e81eab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:07:31 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 8d229d05-95f1-4997-8539-802ac65cff8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:07:31 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance b0a480de-e99b-4b54-bd81-36c216442137 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:07:31 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 38f7c407-3373-43ba-ac92-7eb0a43a7093 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:07:31 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 9a421bf0-70b6-4a2c-85da-813707619b84 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:07:31 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 271adc7b-bfc6-48c5-8700-69b2b079ce4b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:07:31 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 8c02873d-469e-41a4-b492-69f793c8a07c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:07:31 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 26ba7f48-9752-45af-ba68-8c3f70325e21 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:07:31 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 182b9697-e7da-4487-b0c1-889c1f655b95 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:07:31 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 04:07:31 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 04:07:31 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Refreshing inventories for resource provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 04:07:31 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Updating ProviderTree inventory for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 04:07:31 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Updating inventory in ProviderTree for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 04:07:31 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Refreshing aggregate associations for resource provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a, aggregates: None {{(pid=103546) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 04:07:31 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Refreshing trait associations for resource provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=103546) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 04:07:31 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:07:31 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:07:31 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Compute_service record updated for user:user {{(pid=103546) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 04:07:31 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.962s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:07:31 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:07:31 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Cleaning up deleted instances {{(pid=103546) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 04:07:31 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] There are 0 instances to clean {{(pid=103546) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 04:07:32 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:07:32 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:07:32 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:07:32 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:07:32 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:07:32 user nova-compute[103546]: INFO nova.compute.manager [None req-a5109092-9e26-4f5d-949b-4338d3357d00 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Unrescuing
Nov 16 04:07:32 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a5109092-9e26-4f5d-949b-4338d3357d00 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Acquiring lock "refresh_cache-8c02873d-469e-41a4-b492-69f793c8a07c" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:07:32 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a5109092-9e26-4f5d-949b-4338d3357d00 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Acquired lock "refresh_cache-8c02873d-469e-41a4-b492-69f793c8a07c" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:07:32 user nova-compute[103546]: DEBUG nova.network.neutron [None req-a5109092-9e26-4f5d-949b-4338d3357d00 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 04:07:33 user nova-compute[103546]: DEBUG nova.network.neutron [None req-a5109092-9e26-4f5d-949b-4338d3357d00 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Updating instance_info_cache with network_info: [{"id": "96edd323-af11-4e10-a7bb-a6e0d0ea12ff", "address": "fa:16:3e:5a:5c:31", "network": {"id": "337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-40560053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca049d5674dc4c59814f98478752d73d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96edd323-af", "ovs_interfaceid": "96edd323-af11-4e10-a7bb-a6e0d0ea12ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:07:33 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a5109092-9e26-4f5d-949b-4338d3357d00 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Releasing lock "refresh_cache-8c02873d-469e-41a4-b492-69f793c8a07c" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:07:33 user nova-compute[103546]: DEBUG nova.objects.instance [None req-a5109092-9e26-4f5d-949b-4338d3357d00 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lazy-loading 'flavor' on Instance uuid 8c02873d-469e-41a4-b492-69f793c8a07c {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:07:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:33 user nova-compute[103546]: DEBUG nova.compute.manager [req-386c638e-7af3-4697-8d8e-ba09360e93e6 req-fd4513d0-b3b4-4183-93e0-17a88bc8ebf1 service nova] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Received event network-vif-unplugged-96edd323-af11-4e10-a7bb-a6e0d0ea12ff {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:07:33 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-386c638e-7af3-4697-8d8e-ba09360e93e6 req-fd4513d0-b3b4-4183-93e0-17a88bc8ebf1 service nova] Acquiring lock "8c02873d-469e-41a4-b492-69f793c8a07c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:07:33 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-386c638e-7af3-4697-8d8e-ba09360e93e6 req-fd4513d0-b3b4-4183-93e0-17a88bc8ebf1 service nova] Lock "8c02873d-469e-41a4-b492-69f793c8a07c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:07:33 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-386c638e-7af3-4697-8d8e-ba09360e93e6 req-fd4513d0-b3b4-4183-93e0-17a88bc8ebf1 service nova] Lock "8c02873d-469e-41a4-b492-69f793c8a07c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:07:33 user nova-compute[103546]: DEBUG nova.compute.manager [req-386c638e-7af3-4697-8d8e-ba09360e93e6 req-fd4513d0-b3b4-4183-93e0-17a88bc8ebf1 service nova] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] No waiting events found dispatching network-vif-unplugged-96edd323-af11-4e10-a7bb-a6e0d0ea12ff {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:07:33 user nova-compute[103546]: WARNING nova.compute.manager [req-386c638e-7af3-4697-8d8e-ba09360e93e6 req-fd4513d0-b3b4-4183-93e0-17a88bc8ebf1 service nova] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Received unexpected event network-vif-unplugged-96edd323-af11-4e10-a7bb-a6e0d0ea12ff for instance with vm_state rescued and task_state unrescuing.
Nov 16 04:07:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:33 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Instance destroyed successfully.
Nov 16 04:07:34 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:07:34 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Starting heal instance info cache {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 04:07:34 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "refresh_cache-8d229d05-95f1-4997-8539-802ac65cff8b" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:07:34 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquired lock "refresh_cache-8d229d05-95f1-4997-8539-802ac65cff8b" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:07:34 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Forcefully refreshing network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 04:07:35 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Updating instance_info_cache with network_info: [{"id": "5c802613-81ea-4855-a8ee-d851a4ab2ff5", "address": "fa:16:3e:01:69:11", "network": {"id": "337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-40560053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca049d5674dc4c59814f98478752d73d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c802613-81", "ovs_interfaceid": "5c802613-81ea-4855-a8ee-d851a4ab2ff5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:07:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Releasing lock "refresh_cache-8d229d05-95f1-4997-8539-802ac65cff8b" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:07:35 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Updated the network info_cache for instance {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 04:07:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:35 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:07:35 user nova-compute[103546]: DEBUG nova.compute.manager [req-8dc53fa1-4679-4613-b0bb-ce13e73b159a req-2acaea5c-5c59-4e27-8bc6-c445b3bdbb65 service nova] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Received event network-vif-plugged-96edd323-af11-4e10-a7bb-a6e0d0ea12ff {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:07:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8dc53fa1-4679-4613-b0bb-ce13e73b159a req-2acaea5c-5c59-4e27-8bc6-c445b3bdbb65 service nova] Acquiring lock "8c02873d-469e-41a4-b492-69f793c8a07c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:07:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8dc53fa1-4679-4613-b0bb-ce13e73b159a req-2acaea5c-5c59-4e27-8bc6-c445b3bdbb65 service nova] Lock "8c02873d-469e-41a4-b492-69f793c8a07c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:07:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8dc53fa1-4679-4613-b0bb-ce13e73b159a req-2acaea5c-5c59-4e27-8bc6-c445b3bdbb65 service nova] Lock "8c02873d-469e-41a4-b492-69f793c8a07c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:07:35 user nova-compute[103546]: DEBUG nova.compute.manager [req-8dc53fa1-4679-4613-b0bb-ce13e73b159a req-2acaea5c-5c59-4e27-8bc6-c445b3bdbb65 service nova] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] No waiting events found dispatching network-vif-plugged-96edd323-af11-4e10-a7bb-a6e0d0ea12ff {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:07:35 user nova-compute[103546]: WARNING nova.compute.manager [req-8dc53fa1-4679-4613-b0bb-ce13e73b159a req-2acaea5c-5c59-4e27-8bc6-c445b3bdbb65 service nova] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Received unexpected event network-vif-plugged-96edd323-af11-4e10-a7bb-a6e0d0ea12ff for instance with vm_state rescued and task_state unrescuing.
Nov 16 04:07:35 user nova-compute[103546]: DEBUG nova.compute.manager [req-8dc53fa1-4679-4613-b0bb-ce13e73b159a req-2acaea5c-5c59-4e27-8bc6-c445b3bdbb65 service nova] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Received event network-vif-plugged-96edd323-af11-4e10-a7bb-a6e0d0ea12ff {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:07:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8dc53fa1-4679-4613-b0bb-ce13e73b159a req-2acaea5c-5c59-4e27-8bc6-c445b3bdbb65 service nova] Acquiring lock "8c02873d-469e-41a4-b492-69f793c8a07c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:07:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8dc53fa1-4679-4613-b0bb-ce13e73b159a req-2acaea5c-5c59-4e27-8bc6-c445b3bdbb65 service nova] Lock "8c02873d-469e-41a4-b492-69f793c8a07c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:07:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8dc53fa1-4679-4613-b0bb-ce13e73b159a req-2acaea5c-5c59-4e27-8bc6-c445b3bdbb65 service nova] Lock "8c02873d-469e-41a4-b492-69f793c8a07c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:07:35 user nova-compute[103546]: DEBUG nova.compute.manager [req-8dc53fa1-4679-4613-b0bb-ce13e73b159a req-2acaea5c-5c59-4e27-8bc6-c445b3bdbb65 service nova] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] No waiting events found dispatching network-vif-plugged-96edd323-af11-4e10-a7bb-a6e0d0ea12ff {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:07:35 user nova-compute[103546]: WARNING nova.compute.manager [req-8dc53fa1-4679-4613-b0bb-ce13e73b159a req-2acaea5c-5c59-4e27-8bc6-c445b3bdbb65 service nova] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Received unexpected event network-vif-plugged-96edd323-af11-4e10-a7bb-a6e0d0ea12ff for instance with vm_state rescued and task_state unrescuing.
Nov 16 04:07:35 user nova-compute[103546]: DEBUG nova.compute.manager [req-8dc53fa1-4679-4613-b0bb-ce13e73b159a req-2acaea5c-5c59-4e27-8bc6-c445b3bdbb65 service nova] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Received event network-vif-plugged-96edd323-af11-4e10-a7bb-a6e0d0ea12ff {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:07:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8dc53fa1-4679-4613-b0bb-ce13e73b159a req-2acaea5c-5c59-4e27-8bc6-c445b3bdbb65 service nova] Acquiring lock "8c02873d-469e-41a4-b492-69f793c8a07c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:07:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8dc53fa1-4679-4613-b0bb-ce13e73b159a req-2acaea5c-5c59-4e27-8bc6-c445b3bdbb65 service nova] Lock "8c02873d-469e-41a4-b492-69f793c8a07c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:07:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8dc53fa1-4679-4613-b0bb-ce13e73b159a req-2acaea5c-5c59-4e27-8bc6-c445b3bdbb65 service nova] Lock "8c02873d-469e-41a4-b492-69f793c8a07c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:07:35 user nova-compute[103546]: DEBUG nova.compute.manager [req-8dc53fa1-4679-4613-b0bb-ce13e73b159a req-2acaea5c-5c59-4e27-8bc6-c445b3bdbb65 service nova] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] No waiting events found dispatching network-vif-plugged-96edd323-af11-4e10-a7bb-a6e0d0ea12ff {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:07:35 user nova-compute[103546]: WARNING nova.compute.manager [req-8dc53fa1-4679-4613-b0bb-ce13e73b159a req-2acaea5c-5c59-4e27-8bc6-c445b3bdbb65 service nova] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Received unexpected event network-vif-plugged-96edd323-af11-4e10-a7bb-a6e0d0ea12ff for instance with vm_state rescued and task_state unrescuing.
Nov 16 04:07:37 user nova-compute[103546]: DEBUG nova.compute.manager [None req-a5109092-9e26-4f5d-949b-4338d3357d00 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 04:07:38 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:38 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:42 user nova-compute[103546]: DEBUG nova.compute.manager [req-8f799c61-b877-4076-8f61-82f7d6175577 req-32d5f58e-a7f8-4bf7-88ef-4c8e60ab7d3a service nova] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Received event network-changed-dda2828f-7054-49e9-97d4-7279c0305ea7 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:07:42 user nova-compute[103546]: DEBUG nova.compute.manager [req-8f799c61-b877-4076-8f61-82f7d6175577 req-32d5f58e-a7f8-4bf7-88ef-4c8e60ab7d3a service nova] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Refreshing instance network info cache due to event network-changed-dda2828f-7054-49e9-97d4-7279c0305ea7. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 04:07:42 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8f799c61-b877-4076-8f61-82f7d6175577 req-32d5f58e-a7f8-4bf7-88ef-4c8e60ab7d3a service nova] Acquiring lock "refresh_cache-9a421bf0-70b6-4a2c-85da-813707619b84" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:07:42 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8f799c61-b877-4076-8f61-82f7d6175577 req-32d5f58e-a7f8-4bf7-88ef-4c8e60ab7d3a service nova] Acquired lock "refresh_cache-9a421bf0-70b6-4a2c-85da-813707619b84" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:07:42 user nova-compute[103546]: DEBUG nova.network.neutron [req-8f799c61-b877-4076-8f61-82f7d6175577 req-32d5f58e-a7f8-4bf7-88ef-4c8e60ab7d3a service nova] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Refreshing network info cache for port dda2828f-7054-49e9-97d4-7279c0305ea7 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 04:07:42 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-5f2c57d3-0012-40b4-b1f3-cbcb898899ea tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquiring lock "9a421bf0-70b6-4a2c-85da-813707619b84" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:07:42 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-5f2c57d3-0012-40b4-b1f3-cbcb898899ea tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "9a421bf0-70b6-4a2c-85da-813707619b84" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:07:42 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-5f2c57d3-0012-40b4-b1f3-cbcb898899ea tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquiring lock "9a421bf0-70b6-4a2c-85da-813707619b84-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:07:42 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-5f2c57d3-0012-40b4-b1f3-cbcb898899ea tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "9a421bf0-70b6-4a2c-85da-813707619b84-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:07:42 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-5f2c57d3-0012-40b4-b1f3-cbcb898899ea tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "9a421bf0-70b6-4a2c-85da-813707619b84-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:07:42 user nova-compute[103546]: INFO nova.compute.manager [None req-5f2c57d3-0012-40b4-b1f3-cbcb898899ea tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Terminating instance
Nov 16 04:07:42 user nova-compute[103546]: DEBUG nova.compute.manager [None req-5f2c57d3-0012-40b4-b1f3-cbcb898899ea tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Start destroying the instance on the hypervisor. {{(pid=103546) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 04:07:42 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:42 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:42 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:42 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG nova.network.neutron [req-8f799c61-b877-4076-8f61-82f7d6175577 req-32d5f58e-a7f8-4bf7-88ef-4c8e60ab7d3a service nova] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Updated VIF entry in instance network info cache for port dda2828f-7054-49e9-97d4-7279c0305ea7. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG nova.network.neutron [req-8f799c61-b877-4076-8f61-82f7d6175577 req-32d5f58e-a7f8-4bf7-88ef-4c8e60ab7d3a service nova] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Updating instance_info_cache with network_info: [{"id": "dda2828f-7054-49e9-97d4-7279c0305ea7", "address": "fa:16:3e:17:bc:47", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda2828f-70", "ovs_interfaceid": "dda2828f-7054-49e9-97d4-7279c0305ea7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8f799c61-b877-4076-8f61-82f7d6175577 req-32d5f58e-a7f8-4bf7-88ef-4c8e60ab7d3a service nova] Releasing lock "refresh_cache-9a421bf0-70b6-4a2c-85da-813707619b84" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:07:43 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Instance destroyed successfully.
Nov 16 04:07:43 user nova-compute[103546]: DEBUG nova.objects.instance [None req-5f2c57d3-0012-40b4-b1f3-cbcb898899ea tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lazy-loading 'resources' on Instance uuid 9a421bf0-70b6-4a2c-85da-813707619b84 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-5f2c57d3-0012-40b4-b1f3-cbcb898899ea tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:02:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2010514899',display_name='tempest-TestVolumeBootPattern-server-2010514899',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2010514899',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAUuzWuYKsux0jTpLPt6gxhC1FaUy3kEUyYKr8BxuO29MPaSGm/xG+Qeyua0CAfOtv/fD3rdnfc1wGAbEANqJwnqI370L1woOSlI3nH8Q8Ypdr+d2TMfVLtiA9YGdx0zEg==',key_name='tempest-TestVolumeBootPattern-1153098015',keypairs=<?>,launch_index=0,launched_at=2023-11-16T04:03:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='40ce50192a9743b59a9430163dd6a51c',ramdisk_id='',reservation_id='r-0x808ey7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1283031547',owner_user_name='tempest-TestVolumeBootPattern-1283031547-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T04:03:07Z,user_data=None,user_id='ab77040a7b9846d28dc08852d678d1ed',uuid=9a421bf0-70b6-4a2c-85da-813707619b84,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dda2828f-7054-49e9-97d4-7279c0305ea7", "address": "fa:16:3e:17:bc:47", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda2828f-70", "ovs_interfaceid": "dda2828f-7054-49e9-97d4-7279c0305ea7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-5f2c57d3-0012-40b4-b1f3-cbcb898899ea tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Converting VIF {"id": "dda2828f-7054-49e9-97d4-7279c0305ea7", "address": "fa:16:3e:17:bc:47", "network": {"id": "a13f532d-a30d-4c06-83fe-760bcffae183", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1813429858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40ce50192a9743b59a9430163dd6a51c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda2828f-70", "ovs_interfaceid": "dda2828f-7054-49e9-97d4-7279c0305ea7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-5f2c57d3-0012-40b4-b1f3-cbcb898899ea tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:bc:47,bridge_name='br-int',has_traffic_filtering=True,id=dda2828f-7054-49e9-97d4-7279c0305ea7,network=Network(a13f532d-a30d-4c06-83fe-760bcffae183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdda2828f-70') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG os_vif [None req-5f2c57d3-0012-40b4-b1f3-cbcb898899ea tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:bc:47,bridge_name='br-int',has_traffic_filtering=True,id=dda2828f-7054-49e9-97d4-7279c0305ea7,network=Network(a13f532d-a30d-4c06-83fe-760bcffae183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdda2828f-70') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdda2828f-70, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7c676dbb-02bc-4bb9-8c33-2acdcad3cf12) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:07:43 user nova-compute[103546]: INFO os_vif [None req-5f2c57d3-0012-40b4-b1f3-cbcb898899ea tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:bc:47,bridge_name='br-int',has_traffic_filtering=True,id=dda2828f-7054-49e9-97d4-7279c0305ea7,network=Network(a13f532d-a30d-4c06-83fe-760bcffae183),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdda2828f-70')
Nov 16 04:07:43 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f2c57d3-0012-40b4-b1f3-cbcb898899ea tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f2c57d3-0012-40b4-b1f3-cbcb898899ea tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QwVdAeaX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:07:43 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-5f2c57d3-0012-40b4-b1f3-cbcb898899ea tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:07:43 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-5f2c57d3-0012-40b4-b1f3-cbcb898899ea tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-5f2c57d3-0012-40b4-b1f3-cbcb898899ea tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf807c6-6c34-4bbb-ab51-2063387f1e2c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f2c57d3-0012-40b4-b1f3-cbcb898899ea tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 04:07:43 user nova-compute[103546]: No targets found.
Nov 16 04:07:43 user nova-compute[103546]: iSNS:
Nov 16 04:07:43 user nova-compute[103546]: No targets found.
Nov 16 04:07:43 user nova-compute[103546]: STATIC:
Nov 16 04:07:43 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e
Nov 16 04:07:43 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:07:43 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:07:43 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7
Nov 16 04:07:43 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:07:43 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:07:43 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4
Nov 16 04:07:43 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:07:43 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:07:43 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb
Nov 16 04:07:43 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:07:43 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:07:43 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf
Nov 16 04:07:43 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:07:43 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:07:43 user nova-compute[103546]: FIRMWARE:
Nov 16 04:07:43 user nova-compute[103546]: No targets found.
Nov 16 04:07:43 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f2c57d3-0012-40b4-b1f3-cbcb898899ea tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 04:07:43 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 04:07:43 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f2c57d3-0012-40b4-b1f3-cbcb898899ea tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[0421640b-9e5f-48af-b395-df97d6544ad6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee2f72f-2888-4a73-9163-bf22aeb9145b]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f2c57d3-0012-40b4-b1f3-cbcb898899ea tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:07:43 user nova-compute[103546]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:07:43 user nova-compute[103546]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)
Nov 16 04:07:43 user nova-compute[103546]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:07:43 user nova-compute[103546]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb (non-flash)
Nov 16 04:07:43 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f2c57d3-0012-40b4-b1f3-cbcb898899ea tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:07:43 user nova-compute[103546]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e (non-flash)
Nov 16 04:07:43 user nova-compute[103546]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)
Nov 16 04:07:43 user nova-compute[103546]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:07:43 user nova-compute[103546]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb (non-flash)
Nov 16 04:07:43 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f2c57d3-0012-40b4-b1f3-cbcb898899ea tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60cc13c160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e'): ({'sdc'}, set())}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-5f2c57d3-0012-40b4-b1f3-cbcb898899ea tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Removing single pathed devices sdc {{(pid=103546) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23be132-2043-4e59-a9ef-0bb157f8ebf1]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[196d480b-39b1-405a-afb0-4cbf39f486f8]: (4, ('ok\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-5f2c57d3-0012-40b4-b1f3-cbcb898899ea tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Flushing IO for device /dev/sdc {{(pid=103546) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8006219-2bb1-4ba2-a826-b24aaeda4b5d]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-5f2c57d3-0012-40b4-b1f3-cbcb898899ea tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=103546) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[035d72af-c365-47a2-87df-eafaa2c21ba5]: (4, ('1', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-5f2c57d3-0012-40b4-b1f3-cbcb898899ea tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-5f2c57d3-0012-40b4-b1f3-cbcb898899ea tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] SCSI volumes sdc have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f2c57d3-0012-40b4-b1f3-cbcb898899ea tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e')] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c85c389-3ab3-4d3a-a93d-c530d0a58b6a]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f2c57d3-0012-40b4-b1f3-cbcb898899ea tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e -p 172.16.0.220:3260 --logout {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c98f7c5-d007-4a1e-a221-7ea304a4b625]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f2c57d3-0012-40b4-b1f3-cbcb898899ea tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e, portal: 172.16.0.220,3260]
Nov 16 04:07:43 user nova-compute[103546]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e, portal: 172.16.0.220,3260] successful.
Nov 16 04:07:43 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e -p 172.16.0.220:3260 --op delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dd96488-81c4-484b-ada5-812f7adb960e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[602108ab-2b67-452d-8f72-91d08fa88d4e]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f2c57d3-0012-40b4-b1f3-cbcb898899ea tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-5f2c57d3-0012-40b4-b1f3-cbcb898899ea tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f2c57d3-0012-40b4-b1f3-cbcb898899ea tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] <== disconnect_volume: return (320ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f2c57d3-0012-40b4-b1f3-cbcb898899ea tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 04:07:43 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-5f2c57d3-0012-40b4-b1f3-cbcb898899ea tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Deleting instance files /opt/stack/data/nova/instances/9a421bf0-70b6-4a2c-85da-813707619b84_del
Nov 16 04:07:43 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-5f2c57d3-0012-40b4-b1f3-cbcb898899ea tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Deletion of /opt/stack/data/nova/instances/9a421bf0-70b6-4a2c-85da-813707619b84_del complete
Nov 16 04:07:43 user nova-compute[103546]: INFO nova.compute.manager [None req-5f2c57d3-0012-40b4-b1f3-cbcb898899ea tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Took 1.21 seconds to destroy the instance on the hypervisor.
Nov 16 04:07:43 user nova-compute[103546]: DEBUG oslo.service.loopingcall [None req-5f2c57d3-0012-40b4-b1f3-cbcb898899ea tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=103546) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG nova.compute.manager [-] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Deallocating network for instance {{(pid=103546) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] deallocate_for_instance() {{(pid=103546) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 04:07:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:44 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:07:44 user nova-compute[103546]: INFO nova.compute.manager [-] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Took 0.41 seconds to deallocate network for instance.
Nov 16 04:07:44 user nova-compute[103546]: DEBUG nova.compute.manager [req-7814a24f-2137-4ca5-8f6d-09bc5db276d4 req-16f9b8d8-4954-4807-8fb6-1c7544234400 service nova] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Received event network-vif-unplugged-dda2828f-7054-49e9-97d4-7279c0305ea7 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:07:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-7814a24f-2137-4ca5-8f6d-09bc5db276d4 req-16f9b8d8-4954-4807-8fb6-1c7544234400 service nova] Acquiring lock "9a421bf0-70b6-4a2c-85da-813707619b84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:07:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-7814a24f-2137-4ca5-8f6d-09bc5db276d4 req-16f9b8d8-4954-4807-8fb6-1c7544234400 service nova] Lock "9a421bf0-70b6-4a2c-85da-813707619b84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:07:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-7814a24f-2137-4ca5-8f6d-09bc5db276d4 req-16f9b8d8-4954-4807-8fb6-1c7544234400 service nova] Lock "9a421bf0-70b6-4a2c-85da-813707619b84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:07:44 user nova-compute[103546]: DEBUG nova.compute.manager [req-7814a24f-2137-4ca5-8f6d-09bc5db276d4 req-16f9b8d8-4954-4807-8fb6-1c7544234400 service nova] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] No waiting events found dispatching network-vif-unplugged-dda2828f-7054-49e9-97d4-7279c0305ea7 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:07:44 user nova-compute[103546]: DEBUG nova.compute.manager [req-7814a24f-2137-4ca5-8f6d-09bc5db276d4 req-16f9b8d8-4954-4807-8fb6-1c7544234400 service nova] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Received event network-vif-unplugged-dda2828f-7054-49e9-97d4-7279c0305ea7 for instance with task_state deleting. {{(pid=103546) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 04:07:44 user nova-compute[103546]: DEBUG nova.compute.manager [req-7814a24f-2137-4ca5-8f6d-09bc5db276d4 req-16f9b8d8-4954-4807-8fb6-1c7544234400 service nova] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Received event network-vif-plugged-dda2828f-7054-49e9-97d4-7279c0305ea7 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:07:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-7814a24f-2137-4ca5-8f6d-09bc5db276d4 req-16f9b8d8-4954-4807-8fb6-1c7544234400 service nova] Acquiring lock "9a421bf0-70b6-4a2c-85da-813707619b84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:07:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-7814a24f-2137-4ca5-8f6d-09bc5db276d4 req-16f9b8d8-4954-4807-8fb6-1c7544234400 service nova] Lock "9a421bf0-70b6-4a2c-85da-813707619b84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:07:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-7814a24f-2137-4ca5-8f6d-09bc5db276d4 req-16f9b8d8-4954-4807-8fb6-1c7544234400 service nova] Lock "9a421bf0-70b6-4a2c-85da-813707619b84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:07:44 user nova-compute[103546]: DEBUG nova.compute.manager [req-7814a24f-2137-4ca5-8f6d-09bc5db276d4 req-16f9b8d8-4954-4807-8fb6-1c7544234400 service nova] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] No waiting events found dispatching network-vif-plugged-dda2828f-7054-49e9-97d4-7279c0305ea7 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:07:44 user nova-compute[103546]: WARNING nova.compute.manager [req-7814a24f-2137-4ca5-8f6d-09bc5db276d4 req-16f9b8d8-4954-4807-8fb6-1c7544234400 service nova] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Received unexpected event network-vif-plugged-dda2828f-7054-49e9-97d4-7279c0305ea7 for instance with vm_state active and task_state deleting.
Nov 16 04:07:44 user nova-compute[103546]: DEBUG nova.compute.manager [req-7814a24f-2137-4ca5-8f6d-09bc5db276d4 req-16f9b8d8-4954-4807-8fb6-1c7544234400 service nova] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Received event network-vif-deleted-dda2828f-7054-49e9-97d4-7279c0305ea7 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:07:44 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:07:44 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Cleaning up deleted instances with incomplete migration  {{(pid=103546) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 04:07:44 user nova-compute[103546]: INFO nova.compute.manager [None req-5f2c57d3-0012-40b4-b1f3-cbcb898899ea tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] [instance: 9a421bf0-70b6-4a2c-85da-813707619b84] Took 0.73 seconds to detach 1 volumes for instance.
Nov 16 04:07:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-5f2c57d3-0012-40b4-b1f3-cbcb898899ea tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:07:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-5f2c57d3-0012-40b4-b1f3-cbcb898899ea tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:07:45 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-5f2c57d3-0012-40b4-b1f3-cbcb898899ea tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:07:45 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-5f2c57d3-0012-40b4-b1f3-cbcb898899ea tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:07:45 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-5f2c57d3-0012-40b4-b1f3-cbcb898899ea tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.378s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:07:45 user nova-compute[103546]: INFO nova.scheduler.client.report [None req-5f2c57d3-0012-40b4-b1f3-cbcb898899ea tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Deleted allocations for instance 9a421bf0-70b6-4a2c-85da-813707619b84
Nov 16 04:07:45 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-5f2c57d3-0012-40b4-b1f3-cbcb898899ea tempest-TestVolumeBootPattern-1283031547 tempest-TestVolumeBootPattern-1283031547-project-member] Lock "9a421bf0-70b6-4a2c-85da-813707619b84" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.908s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:07:48 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:07:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:08:01 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Acquiring lock "ce616440-9d69-4812-8910-a2d9ad58f504" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:08:01 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "ce616440-9d69-4812-8910-a2d9ad58f504" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:08:01 user nova-compute[103546]: DEBUG nova.compute.manager [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Starting instance... {{(pid=103546) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 04:08:01 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:08:01 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:08:01 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=103546) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 04:08:01 user nova-compute[103546]: INFO nova.compute.claims [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Claim successful on node user
Nov 16 04:08:01 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:08:01 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:08:02 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.474s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:08:02 user nova-compute[103546]: DEBUG nova.compute.manager [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Start building networks asynchronously for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 04:08:02 user nova-compute[103546]: DEBUG nova.compute.manager [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Allocating IP information in the background. {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 04:08:02 user nova-compute[103546]: DEBUG nova.network.neutron [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] allocate_for_instance() {{(pid=103546) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 04:08:02 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 04:08:02 user nova-compute[103546]: DEBUG nova.compute.manager [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Start building block device mappings for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 04:08:02 user nova-compute[103546]: DEBUG nova.policy [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '341066fb5ead4ef28e4900c085593814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb839c76c0d4513b9be0ec92301707f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103546) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 04:08:02 user nova-compute[103546]: DEBUG nova.compute.manager [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Start spawning the instance on the hypervisor. {{(pid=103546) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 04:08:02 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Creating instance directory {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 04:08:02 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Creating image(s)
Nov 16 04:08:02 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Acquiring lock "/opt/stack/data/nova/instances/ce616440-9d69-4812-8910-a2d9ad58f504/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:08:02 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "/opt/stack/data/nova/instances/ce616440-9d69-4812-8910-a2d9ad58f504/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:08:02 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "/opt/stack/data/nova/instances/ce616440-9d69-4812-8910-a2d9ad58f504/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:08:02 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Acquiring lock "91592c93882f514851496add737cbef0207b8c12" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:08:02 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "91592c93882f514851496add737cbef0207b8c12" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:08:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91592c93882f514851496add737cbef0207b8c12.part --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:02 user nova-compute[103546]: DEBUG nova.network.neutron [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Successfully created port: 3d061027-8dbb-48b4-bbcd-b057c196a301 {{(pid=103546) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 04:08:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91592c93882f514851496add737cbef0207b8c12.part --force-share --output=json" returned: 0 in 0.184s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:02 user nova-compute[103546]: DEBUG nova.virt.images [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] 9edde7eb-2bcc-446e-842d-e4cbb02faadd was qcow2, converting to raw {{(pid=103546) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 04:08:02 user nova-compute[103546]: DEBUG nova.privsep.utils [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=103546) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 04:08:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/91592c93882f514851496add737cbef0207b8c12.part /opt/stack/data/nova/instances/_base/91592c93882f514851496add737cbef0207b8c12.converted {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/91592c93882f514851496add737cbef0207b8c12.part /opt/stack/data/nova/instances/_base/91592c93882f514851496add737cbef0207b8c12.converted" returned: 0 in 0.280s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91592c93882f514851496add737cbef0207b8c12.converted --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:03 user nova-compute[103546]: DEBUG nova.network.neutron [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Successfully updated port: 3d061027-8dbb-48b4-bbcd-b057c196a301 {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 04:08:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91592c93882f514851496add737cbef0207b8c12.converted --force-share --output=json" returned: 0 in 0.194s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "91592c93882f514851496add737cbef0207b8c12" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.140s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:08:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91592c93882f514851496add737cbef0207b8c12 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:03 user nova-compute[103546]: DEBUG nova.compute.manager [req-8153226d-2cda-451d-a9cd-8b5ab964fa99 req-a6161194-b509-45c7-9a0f-47ddd979102c service nova] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Received event network-changed-3d061027-8dbb-48b4-bbcd-b057c196a301 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:08:03 user nova-compute[103546]: DEBUG nova.compute.manager [req-8153226d-2cda-451d-a9cd-8b5ab964fa99 req-a6161194-b509-45c7-9a0f-47ddd979102c service nova] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Refreshing instance network info cache due to event network-changed-3d061027-8dbb-48b4-bbcd-b057c196a301. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 04:08:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8153226d-2cda-451d-a9cd-8b5ab964fa99 req-a6161194-b509-45c7-9a0f-47ddd979102c service nova] Acquiring lock "refresh_cache-ce616440-9d69-4812-8910-a2d9ad58f504" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:08:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8153226d-2cda-451d-a9cd-8b5ab964fa99 req-a6161194-b509-45c7-9a0f-47ddd979102c service nova] Acquired lock "refresh_cache-ce616440-9d69-4812-8910-a2d9ad58f504" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:08:03 user nova-compute[103546]: DEBUG nova.network.neutron [req-8153226d-2cda-451d-a9cd-8b5ab964fa99 req-a6161194-b509-45c7-9a0f-47ddd979102c service nova] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Refreshing network info cache for port 3d061027-8dbb-48b4-bbcd-b057c196a301 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 04:08:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Acquiring lock "refresh_cache-ce616440-9d69-4812-8910-a2d9ad58f504" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:08:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:08:03 user nova-compute[103546]: DEBUG nova.network.neutron [req-8153226d-2cda-451d-a9cd-8b5ab964fa99 req-a6161194-b509-45c7-9a0f-47ddd979102c service nova] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 04:08:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91592c93882f514851496add737cbef0207b8c12 --force-share --output=json" returned: 0 in 0.175s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Acquiring lock "91592c93882f514851496add737cbef0207b8c12" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:08:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "91592c93882f514851496add737cbef0207b8c12" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:08:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91592c93882f514851496add737cbef0207b8c12 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:03 user nova-compute[103546]: DEBUG nova.network.neutron [req-8153226d-2cda-451d-a9cd-8b5ab964fa99 req-a6161194-b509-45c7-9a0f-47ddd979102c service nova] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:08:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8153226d-2cda-451d-a9cd-8b5ab964fa99 req-a6161194-b509-45c7-9a0f-47ddd979102c service nova] Releasing lock "refresh_cache-ce616440-9d69-4812-8910-a2d9ad58f504" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:08:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Acquired lock "refresh_cache-ce616440-9d69-4812-8910-a2d9ad58f504" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:08:03 user nova-compute[103546]: DEBUG nova.network.neutron [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 04:08:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91592c93882f514851496add737cbef0207b8c12 --force-share --output=json" returned: 0 in 0.176s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91592c93882f514851496add737cbef0207b8c12,backing_fmt=raw /opt/stack/data/nova/instances/ce616440-9d69-4812-8910-a2d9ad58f504/disk 1073741824 {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:03 user nova-compute[103546]: DEBUG nova.network.neutron [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 04:08:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91592c93882f514851496add737cbef0207b8c12,backing_fmt=raw /opt/stack/data/nova/instances/ce616440-9d69-4812-8910-a2d9ad58f504/disk 1073741824" returned: 0 in 0.049s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "91592c93882f514851496add737cbef0207b8c12" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:08:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91592c93882f514851496add737cbef0207b8c12 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91592c93882f514851496add737cbef0207b8c12 --force-share --output=json" returned: 0 in 0.177s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:03 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ce616440-9d69-4812-8910-a2d9ad58f504/disk. size=1073741824 {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 04:08:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce616440-9d69-4812-8910-a2d9ad58f504/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:08:04 user nova-compute[103546]: DEBUG nova.network.neutron [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Updating instance_info_cache with network_info: [{"id": "3d061027-8dbb-48b4-bbcd-b057c196a301", "address": "fa:16:3e:45:2b:d3", "network": {"id": "d942264a-f03e-49a2-89eb-103a12c99518", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484356505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edb839c76c0d4513b9be0ec92301707f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d061027-8d", "ovs_interfaceid": "3d061027-8dbb-48b4-bbcd-b057c196a301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:08:04 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Releasing lock "refresh_cache-ce616440-9d69-4812-8910-a2d9ad58f504" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:08:04 user nova-compute[103546]: DEBUG nova.compute.manager [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Instance network_info: |[{"id": "3d061027-8dbb-48b4-bbcd-b057c196a301", "address": "fa:16:3e:45:2b:d3", "network": {"id": "d942264a-f03e-49a2-89eb-103a12c99518", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484356505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edb839c76c0d4513b9be0ec92301707f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d061027-8d", "ovs_interfaceid": "3d061027-8dbb-48b4-bbcd-b057c196a301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 04:08:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce616440-9d69-4812-8910-a2d9ad58f504/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:04 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Cannot resize image /opt/stack/data/nova/instances/ce616440-9d69-4812-8910-a2d9ad58f504/disk to a smaller size. {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 04:08:04 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Created local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 04:08:04 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Ensure instance console log exists: /opt/stack/data/nova/instances/ce616440-9d69-4812-8910-a2d9ad58f504/console.log {{(pid=103546) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 04:08:04 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:08:04 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:08:04 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:08:04 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Start _get_guest_xml network_info=[{"id": "3d061027-8dbb-48b4-bbcd-b057c196a301", "address": "fa:16:3e:45:2b:d3", "network": {"id": "d942264a-f03e-49a2-89eb-103a12c99518", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484356505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edb839c76c0d4513b9be0ec92301707f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d061027-8d", "ovs_interfaceid": "3d061027-8dbb-48b4-bbcd-b057c196a301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T04:07:59Z,direct_url=<?>,disk_format='qcow2',id=9edde7eb-2bcc-446e-842d-e4cbb02faadd,min_disk=0,min_ram=0,name='tempest-scenario-img--1007970597',owner='edb839c76c0d4513b9be0ec92301707f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T04:08:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '9edde7eb-2bcc-446e-842d-e4cbb02faadd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 04:08:04 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:08:04 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:08:04 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 04:08:04 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 04:08:04 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 04:08:04 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 04:08:04 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 04:08:04 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T04:07:59Z,direct_url=<?>,disk_format='qcow2',id=9edde7eb-2bcc-446e-842d-e4cbb02faadd,min_disk=0,min_ram=0,name='tempest-scenario-img--1007970597',owner='edb839c76c0d4513b9be0ec92301707f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T04:08:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 04:08:04 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 04:08:04 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 04:08:04 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 04:08:04 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 04:08:04 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 04:08:04 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 04:08:04 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 04:08:04 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 04:08:04 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 04:08:04 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 04:08:04 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:08:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-829606681',display_name='tempest-TestMinimumBasicScenario-server-829606681',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-829606681',id=44,image_ref='9edde7eb-2bcc-446e-842d-e4cbb02faadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZA1+LQ3LL4xp7ktFRkByfEiyPUaRQ87nZMVkm4VlxVQfWqXvhgFsq6d9veVThqGJ8FQC6gNT+bPrYMP+KHpfUbXUr+UBlMEgwT/isovxXcR4e7zeqF8YH3w1VcrRMs4A==',key_name='tempest-TestMinimumBasicScenario-1639304563',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='edb839c76c0d4513b9be0ec92301707f',ramdisk_id='',reservation_id='r-nxzvb0yz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9edde7eb-2bcc-446e-842d-e4cbb02faadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1416270309',owner_user_name='tempest-TestMinimumBasicScenario-1416270309-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T04:08:02Z,user_data=None,user_id='341066fb5ead4ef28e4900c085593814',uuid=ce616440-9d69-4812-8910-a2d9ad58f504,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d061027-8dbb-48b4-bbcd-b057c196a301", "address": "fa:16:3e:45:2b:d3", "network": {"id": "d942264a-f03e-49a2-89eb-103a12c99518", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484356505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edb839c76c0d4513b9be0ec92301707f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d061027-8d", "ovs_interfaceid": "3d061027-8dbb-48b4-bbcd-b057c196a301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 04:08:04 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Converting VIF {"id": "3d061027-8dbb-48b4-bbcd-b057c196a301", "address": "fa:16:3e:45:2b:d3", "network": {"id": "d942264a-f03e-49a2-89eb-103a12c99518", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484356505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edb839c76c0d4513b9be0ec92301707f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d061027-8d", "ovs_interfaceid": "3d061027-8dbb-48b4-bbcd-b057c196a301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:08:04 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:2b:d3,bridge_name='br-int',has_traffic_filtering=True,id=3d061027-8dbb-48b4-bbcd-b057c196a301,network=Network(d942264a-f03e-49a2-89eb-103a12c99518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d061027-8d') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:08:04 user nova-compute[103546]: DEBUG nova.objects.instance [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lazy-loading 'pci_devices' on Instance uuid ce616440-9d69-4812-8910-a2d9ad58f504 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:08:04 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] End _get_guest_xml xml=<domain type="kvm">
Nov 16 04:08:04 user nova-compute[103546]:   <uuid>ce616440-9d69-4812-8910-a2d9ad58f504</uuid>
Nov 16 04:08:04 user nova-compute[103546]:   <name>instance-0000002c</name>
Nov 16 04:08:04 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 04:08:04 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 04:08:04 user nova-compute[103546]:   <metadata>
Nov 16 04:08:04 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 04:08:04 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 04:08:04 user nova-compute[103546]:       <nova:name>tempest-TestMinimumBasicScenario-server-829606681</nova:name>
Nov 16 04:08:04 user nova-compute[103546]:       <nova:creationTime>2023-11-16 04:08:04</nova:creationTime>
Nov 16 04:08:04 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 04:08:04 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 04:08:04 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 04:08:04 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 04:08:04 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 04:08:04 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 04:08:04 user nova-compute[103546]:       </nova:flavor>
Nov 16 04:08:04 user nova-compute[103546]:       <nova:owner>
Nov 16 04:08:04 user nova-compute[103546]:         <nova:user uuid="341066fb5ead4ef28e4900c085593814">tempest-TestMinimumBasicScenario-1416270309-project-member</nova:user>
Nov 16 04:08:04 user nova-compute[103546]:         <nova:project uuid="edb839c76c0d4513b9be0ec92301707f">tempest-TestMinimumBasicScenario-1416270309</nova:project>
Nov 16 04:08:04 user nova-compute[103546]:       </nova:owner>
Nov 16 04:08:04 user nova-compute[103546]:       <nova:root type="image" uuid="9edde7eb-2bcc-446e-842d-e4cbb02faadd"/>
Nov 16 04:08:04 user nova-compute[103546]:       <nova:ports>
Nov 16 04:08:04 user nova-compute[103546]:         <nova:port uuid="3d061027-8dbb-48b4-bbcd-b057c196a301">
Nov 16 04:08:04 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 16 04:08:04 user nova-compute[103546]:         </nova:port>
Nov 16 04:08:04 user nova-compute[103546]:       </nova:ports>
Nov 16 04:08:04 user nova-compute[103546]:     </nova:instance>
Nov 16 04:08:04 user nova-compute[103546]:   </metadata>
Nov 16 04:08:04 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 04:08:04 user nova-compute[103546]:     <system>
Nov 16 04:08:04 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 04:08:04 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 04:08:04 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 04:08:04 user nova-compute[103546]:       <entry name="serial">ce616440-9d69-4812-8910-a2d9ad58f504</entry>
Nov 16 04:08:04 user nova-compute[103546]:       <entry name="uuid">ce616440-9d69-4812-8910-a2d9ad58f504</entry>
Nov 16 04:08:04 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 04:08:04 user nova-compute[103546]:     </system>
Nov 16 04:08:04 user nova-compute[103546]:   </sysinfo>
Nov 16 04:08:04 user nova-compute[103546]:   <os>
Nov 16 04:08:04 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 04:08:04 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 04:08:04 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 04:08:04 user nova-compute[103546]:   </os>
Nov 16 04:08:04 user nova-compute[103546]:   <features>
Nov 16 04:08:04 user nova-compute[103546]:     <acpi/>
Nov 16 04:08:04 user nova-compute[103546]:     <apic/>
Nov 16 04:08:04 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 04:08:04 user nova-compute[103546]:   </features>
Nov 16 04:08:04 user nova-compute[103546]:   <clock offset="utc">
Nov 16 04:08:04 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 04:08:04 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 04:08:04 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 04:08:04 user nova-compute[103546]:   </clock>
Nov 16 04:08:04 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 04:08:04 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 04:08:04 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 04:08:04 user nova-compute[103546]:   </cpu>
Nov 16 04:08:04 user nova-compute[103546]:   <devices>
Nov 16 04:08:04 user nova-compute[103546]:     <disk type="file" device="disk">
Nov 16 04:08:04 user nova-compute[103546]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 04:08:04 user nova-compute[103546]:       <source file="/opt/stack/data/nova/instances/ce616440-9d69-4812-8910-a2d9ad58f504/disk"/>
Nov 16 04:08:04 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 04:08:04 user nova-compute[103546]:     </disk>
Nov 16 04:08:04 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 04:08:04 user nova-compute[103546]:       <mac address="fa:16:3e:45:2b:d3"/>
Nov 16 04:08:04 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 04:08:04 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 04:08:04 user nova-compute[103546]:       <target dev="tap3d061027-8d"/>
Nov 16 04:08:04 user nova-compute[103546]:     </interface>
Nov 16 04:08:04 user nova-compute[103546]:     <serial type="pty">
Nov 16 04:08:04 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/ce616440-9d69-4812-8910-a2d9ad58f504/console.log" append="off"/>
Nov 16 04:08:04 user nova-compute[103546]:     </serial>
Nov 16 04:08:04 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 04:08:04 user nova-compute[103546]:     <video>
Nov 16 04:08:04 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 04:08:04 user nova-compute[103546]:     </video>
Nov 16 04:08:04 user nova-compute[103546]:     <rng model="virtio">
Nov 16 04:08:04 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 04:08:04 user nova-compute[103546]:     </rng>
Nov 16 04:08:04 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 04:08:04 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 04:08:04 user nova-compute[103546]:       <stats period="10"/>
Nov 16 04:08:04 user nova-compute[103546]:     </memballoon>
Nov 16 04:08:04 user nova-compute[103546]:   </devices>
Nov 16 04:08:04 user nova-compute[103546]: </domain>
Nov 16 04:08:04 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 04:08:04 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:08:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-829606681',display_name='tempest-TestMinimumBasicScenario-server-829606681',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-829606681',id=44,image_ref='9edde7eb-2bcc-446e-842d-e4cbb02faadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZA1+LQ3LL4xp7ktFRkByfEiyPUaRQ87nZMVkm4VlxVQfWqXvhgFsq6d9veVThqGJ8FQC6gNT+bPrYMP+KHpfUbXUr+UBlMEgwT/isovxXcR4e7zeqF8YH3w1VcrRMs4A==',key_name='tempest-TestMinimumBasicScenario-1639304563',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='edb839c76c0d4513b9be0ec92301707f',ramdisk_id='',reservation_id='r-nxzvb0yz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9edde7eb-2bcc-446e-842d-e4cbb02faadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1416270309',owner_user_name='tempest-TestMinimumBasicScenario-1416270309-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T04:08:02Z,user_data=None,user_id='341066fb5ead4ef28e4900c085593814',uuid=ce616440-9d69-4812-8910-a2d9ad58f504,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d061027-8dbb-48b4-bbcd-b057c196a301", "address": "fa:16:3e:45:2b:d3", "network": {"id": "d942264a-f03e-49a2-89eb-103a12c99518", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484356505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edb839c76c0d4513b9be0ec92301707f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d061027-8d", "ovs_interfaceid": "3d061027-8dbb-48b4-bbcd-b057c196a301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 04:08:04 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Converting VIF {"id": "3d061027-8dbb-48b4-bbcd-b057c196a301", "address": "fa:16:3e:45:2b:d3", "network": {"id": "d942264a-f03e-49a2-89eb-103a12c99518", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484356505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edb839c76c0d4513b9be0ec92301707f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d061027-8d", "ovs_interfaceid": "3d061027-8dbb-48b4-bbcd-b057c196a301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:08:04 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:2b:d3,bridge_name='br-int',has_traffic_filtering=True,id=3d061027-8dbb-48b4-bbcd-b057c196a301,network=Network(d942264a-f03e-49a2-89eb-103a12c99518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d061027-8d') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:08:04 user nova-compute[103546]: DEBUG os_vif [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:2b:d3,bridge_name='br-int',has_traffic_filtering=True,id=3d061027-8dbb-48b4-bbcd-b057c196a301,network=Network(d942264a-f03e-49a2-89eb-103a12c99518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d061027-8d') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 04:08:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:08:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:08:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 04:08:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:08:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8f745655-e300-57c3-8efe-fea441d462b3', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:08:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:08:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:08:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d061027-8d, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:08:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3d061027-8d, col_values=(('qos', UUID('bc9dcb8a-f19e-43a2-bcae-f5e4242b469d')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:08:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3d061027-8d, col_values=(('external_ids', {'iface-id': '3d061027-8dbb-48b4-bbcd-b057c196a301', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:2b:d3', 'vm-uuid': 'ce616440-9d69-4812-8910-a2d9ad58f504'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:08:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:08:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:08:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:08:04 user nova-compute[103546]: INFO os_vif [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:2b:d3,bridge_name='br-int',has_traffic_filtering=True,id=3d061027-8dbb-48b4-bbcd-b057c196a301,network=Network(d942264a-f03e-49a2-89eb-103a12c99518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d061027-8d')
Nov 16 04:08:04 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:08:04 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] No VIF found with MAC fa:16:3e:45:2b:d3, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 04:08:05 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:08:05 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:08:05 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:08:05 user nova-compute[103546]: DEBUG nova.compute.manager [req-cb101b53-f30f-45d2-8a66-cab2ef767256 req-2e8dc3ee-0ae5-4a18-839d-8f00bf883e2d service nova] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Received event network-vif-plugged-3d061027-8dbb-48b4-bbcd-b057c196a301 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:08:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-cb101b53-f30f-45d2-8a66-cab2ef767256 req-2e8dc3ee-0ae5-4a18-839d-8f00bf883e2d service nova] Acquiring lock "ce616440-9d69-4812-8910-a2d9ad58f504-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:08:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-cb101b53-f30f-45d2-8a66-cab2ef767256 req-2e8dc3ee-0ae5-4a18-839d-8f00bf883e2d service nova] Lock "ce616440-9d69-4812-8910-a2d9ad58f504-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:08:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-cb101b53-f30f-45d2-8a66-cab2ef767256 req-2e8dc3ee-0ae5-4a18-839d-8f00bf883e2d service nova] Lock "ce616440-9d69-4812-8910-a2d9ad58f504-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:08:05 user nova-compute[103546]: DEBUG nova.compute.manager [req-cb101b53-f30f-45d2-8a66-cab2ef767256 req-2e8dc3ee-0ae5-4a18-839d-8f00bf883e2d service nova] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] No waiting events found dispatching network-vif-plugged-3d061027-8dbb-48b4-bbcd-b057c196a301 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:08:05 user nova-compute[103546]: WARNING nova.compute.manager [req-cb101b53-f30f-45d2-8a66-cab2ef767256 req-2e8dc3ee-0ae5-4a18-839d-8f00bf883e2d service nova] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Received unexpected event network-vif-plugged-3d061027-8dbb-48b4-bbcd-b057c196a301 for instance with vm_state building and task_state spawning.
Nov 16 04:08:06 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:08:06 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:08:06 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:08:06 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:08:07 user nova-compute[103546]: DEBUG nova.compute.manager [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 04:08:07 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Guest created on hypervisor {{(pid=103546) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 04:08:07 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Instance spawned successfully.
Nov 16 04:08:07 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 04:08:07 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Found default for hw_cdrom_bus of ide {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:08:07 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Found default for hw_disk_bus of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:08:07 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Found default for hw_input_bus of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:08:07 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Found default for hw_pointer_model of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:08:07 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Found default for hw_video_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:08:07 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Found default for hw_vif_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:08:07 user nova-compute[103546]: DEBUG nova.compute.manager [req-815f62e8-0aa4-43c3-88e3-2a2cb51d1f8b req-e1147f13-763f-4140-8102-248b63bdc80a service nova] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Received event network-vif-plugged-3d061027-8dbb-48b4-bbcd-b057c196a301 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:08:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-815f62e8-0aa4-43c3-88e3-2a2cb51d1f8b req-e1147f13-763f-4140-8102-248b63bdc80a service nova] Acquiring lock "ce616440-9d69-4812-8910-a2d9ad58f504-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:08:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-815f62e8-0aa4-43c3-88e3-2a2cb51d1f8b req-e1147f13-763f-4140-8102-248b63bdc80a service nova] Lock "ce616440-9d69-4812-8910-a2d9ad58f504-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:08:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-815f62e8-0aa4-43c3-88e3-2a2cb51d1f8b req-e1147f13-763f-4140-8102-248b63bdc80a service nova] Lock "ce616440-9d69-4812-8910-a2d9ad58f504-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:08:07 user nova-compute[103546]: DEBUG nova.compute.manager [req-815f62e8-0aa4-43c3-88e3-2a2cb51d1f8b req-e1147f13-763f-4140-8102-248b63bdc80a service nova] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] No waiting events found dispatching network-vif-plugged-3d061027-8dbb-48b4-bbcd-b057c196a301 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:08:07 user nova-compute[103546]: WARNING nova.compute.manager [req-815f62e8-0aa4-43c3-88e3-2a2cb51d1f8b req-e1147f13-763f-4140-8102-248b63bdc80a service nova] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Received unexpected event network-vif-plugged-3d061027-8dbb-48b4-bbcd-b057c196a301 for instance with vm_state building and task_state spawning.
Nov 16 04:08:07 user nova-compute[103546]: INFO nova.compute.manager [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Took 5.59 seconds to spawn the instance on the hypervisor.
Nov 16 04:08:07 user nova-compute[103546]: DEBUG nova.compute.manager [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 04:08:07 user nova-compute[103546]: INFO nova.compute.manager [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Took 6.43 seconds to build instance.
Nov 16 04:08:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e9802526-6a64-4da8-94a0-fa956217e137 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "ce616440-9d69-4812-8910-a2d9ad58f504" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.524s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:08:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:08:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:08:09 user nova-compute[103546]: DEBUG nova.compute.manager [req-f83f2c68-43f7-49d8-b805-06874bdc8a40 req-a333098f-d8c9-4a86-a5be-80f972dba7ae service nova] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Received event network-changed-66a12f44-bc2f-4574-916f-722fb04e7441 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:08:09 user nova-compute[103546]: DEBUG nova.compute.manager [req-f83f2c68-43f7-49d8-b805-06874bdc8a40 req-a333098f-d8c9-4a86-a5be-80f972dba7ae service nova] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Refreshing instance network info cache due to event network-changed-66a12f44-bc2f-4574-916f-722fb04e7441. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 04:08:09 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-f83f2c68-43f7-49d8-b805-06874bdc8a40 req-a333098f-d8c9-4a86-a5be-80f972dba7ae service nova] Acquiring lock "refresh_cache-182b9697-e7da-4487-b0c1-889c1f655b95" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:08:09 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-f83f2c68-43f7-49d8-b805-06874bdc8a40 req-a333098f-d8c9-4a86-a5be-80f972dba7ae service nova] Acquired lock "refresh_cache-182b9697-e7da-4487-b0c1-889c1f655b95" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:08:09 user nova-compute[103546]: DEBUG nova.network.neutron [req-f83f2c68-43f7-49d8-b805-06874bdc8a40 req-a333098f-d8c9-4a86-a5be-80f972dba7ae service nova] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Refreshing network info cache for port 66a12f44-bc2f-4574-916f-722fb04e7441 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 04:08:10 user nova-compute[103546]: DEBUG nova.network.neutron [req-f83f2c68-43f7-49d8-b805-06874bdc8a40 req-a333098f-d8c9-4a86-a5be-80f972dba7ae service nova] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Updated VIF entry in instance network info cache for port 66a12f44-bc2f-4574-916f-722fb04e7441. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 04:08:10 user nova-compute[103546]: DEBUG nova.network.neutron [req-f83f2c68-43f7-49d8-b805-06874bdc8a40 req-a333098f-d8c9-4a86-a5be-80f972dba7ae service nova] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Updating instance_info_cache with network_info: [{"id": "66a12f44-bc2f-4574-916f-722fb04e7441", "address": "fa:16:3e:5e:e2:36", "network": {"id": "6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038318316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e30b7ac9515458aa8a6eb1a34cc543a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a12f44-bc", "ovs_interfaceid": "66a12f44-bc2f-4574-916f-722fb04e7441", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:08:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-f83f2c68-43f7-49d8-b805-06874bdc8a40 req-a333098f-d8c9-4a86-a5be-80f972dba7ae service nova] Releasing lock "refresh_cache-182b9697-e7da-4487-b0c1-889c1f655b95" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:08:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-edd4e25d-a9ff-4b40-85ad-6ed2b7dcd85c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Acquiring lock "182b9697-e7da-4487-b0c1-889c1f655b95" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:08:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-edd4e25d-a9ff-4b40-85ad-6ed2b7dcd85c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "182b9697-e7da-4487-b0c1-889c1f655b95" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:08:11 user nova-compute[103546]: DEBUG nova.objects.instance [None req-edd4e25d-a9ff-4b40-85ad-6ed2b7dcd85c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lazy-loading 'flavor' on Instance uuid 182b9697-e7da-4487-b0c1-889c1f655b95 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:08:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-edd4e25d-a9ff-4b40-85ad-6ed2b7dcd85c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "182b9697-e7da-4487-b0c1-889c1f655b95" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:08:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-edd4e25d-a9ff-4b40-85ad-6ed2b7dcd85c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Acquiring lock "182b9697-e7da-4487-b0c1-889c1f655b95" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:08:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-edd4e25d-a9ff-4b40-85ad-6ed2b7dcd85c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "182b9697-e7da-4487-b0c1-889c1f655b95" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:08:11 user nova-compute[103546]: INFO nova.compute.manager [None req-edd4e25d-a9ff-4b40-85ad-6ed2b7dcd85c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Attaching volume 1781b2ed-7680-4604-8f99-4b8e5348eac7 to /dev/vdb
Nov 16 04:08:11 user nova-compute[103546]: DEBUG os_brick.utils [None req-edd4e25d-a9ff-4b40-85ad-6ed2b7dcd85c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:08:11 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:11 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:11 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f29c989-2082-48a0-b3e7-f955caf44ecb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af5c39b14ece\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:08:11 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:11 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:11 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc6bbc0-e55e-4e34-ab80-0376f8078764]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:08:11 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:11 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:11 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49197ce-21f4-4a8d-8a5d-ea6a3bca1f1f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:08:11 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2036b9-68f1-4621-aac3-149e68e783a1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:08:11 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-edd4e25d-a9ff-4b40-85ad-6ed2b7dcd85c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Running cmd (subprocess): nvme version {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:11 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-edd4e25d-a9ff-4b40-85ad-6ed2b7dcd85c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] 'nvme version' failed. Not Retrying. {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 04:08:11 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.nvmeof [None req-edd4e25d-a9ff-4b40-85ad-6ed2b7dcd85c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] nvme not present on system {{(pid=103546) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 04:08:11 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:11 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 04:08:11 user nova-compute[103546]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 04:08:11 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[decd8c72-6fc5-4706-8103-62095c4ef2f1]: (4, '') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:08:11 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-edd4e25d-a9ff-4b40-85ad-6ed2b7dcd85c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=103546) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 04:08:11 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-edd4e25d-a9ff-4b40-85ad-6ed2b7dcd85c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 04:08:11 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-edd4e25d-a9ff-4b40-85ad-6ed2b7dcd85c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] LIGHTOS: no hostnqn found. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 04:08:11 user nova-compute[103546]: DEBUG os_brick.utils [None req-edd4e25d-a9ff-4b40-85ad-6ed2b7dcd85c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af5c39b14ece', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:08:11 user nova-compute[103546]: DEBUG nova.virt.block_device [None req-edd4e25d-a9ff-4b40-85ad-6ed2b7dcd85c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Updating existing volume attachment record: cf007762-22cf-4b6c-81b2-d616b7aecdef {{(pid=103546) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 04:08:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:08:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:08:16 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edd4e25d-a9ff-4b40-85ad-6ed2b7dcd85c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 04:08:16 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd4e25d-a9ff-4b40-85ad-6ed2b7dcd85c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1781b2ed-7680-4604-8f99-4b8e5348eac7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WpZNYtAF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:08:16 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-edd4e25d-a9ff-4b40-85ad-6ed2b7dcd85c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:08:16 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-edd4e25d-a9ff-4b40-85ad-6ed2b7dcd85c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:08:16 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-edd4e25d-a9ff-4b40-85ad-6ed2b7dcd85c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:08:16 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-edd4e25d-a9ff-4b40-85ad-6ed2b7dcd85c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:08:16 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-edd4e25d-a9ff-4b40-85ad-6ed2b7dcd85c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1781b2ed-7680-4604-8f99-4b8e5348eac7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:08:16 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-edd4e25d-a9ff-4b40-85ad-6ed2b7dcd85c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1781b2ed-7680-4604-8f99-4b8e5348eac7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:08:16 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-edd4e25d-a9ff-4b40-85ad-6ed2b7dcd85c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 04:08:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1781b2ed-7680-4604-8f99-4b8e5348eac7 -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1781b2ed-7680-4604-8f99-4b8e5348eac7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:16 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[7624f8d3-ff70-4857-9aaa-df59777f23d7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:08:16 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd4e25d-a9ff-4b40-85ad-6ed2b7dcd85c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 04:08:16 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:08:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1781b2ed-7680-4604-8f99-4b8e5348eac7 -p 172.16.0.220:3260 --interface default --op new {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1781b2ed-7680-4604-8f99-4b8e5348eac7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:16 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6069cc-77f3-441d-b60d-ab3b1b0351d5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1781b2ed-7680-4604-8f99-4b8e5348eac7] added\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:08:16 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd4e25d-a9ff-4b40-85ad-6ed2b7dcd85c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1781b2ed-7680-4604-8f99-4b8e5348eac7] added
Nov 16 04:08:16 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:08:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1781b2ed-7680-4604-8f99-4b8e5348eac7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1781b2ed-7680-4604-8f99-4b8e5348eac7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:16 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b60399b-3952-4d61-ac80-24da2f1ec8e5]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:08:16 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd4e25d-a9ff-4b40-85ad-6ed2b7dcd85c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:08:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1781b2ed-7680-4604-8f99-4b8e5348eac7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1781b2ed-7680-4604-8f99-4b8e5348eac7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:16 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[67387206-e919-4434-a37b-8eea778a08dc]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:08:16 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd4e25d-a9ff-4b40-85ad-6ed2b7dcd85c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:08:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1781b2ed-7680-4604-8f99-4b8e5348eac7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WpZNYtAF {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1781b2ed-7680-4604-8f99-4b8e5348eac7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WpZNYtAF" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:16 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[155f24ec-4bb1-4311-99e3-84d37ce75e3c]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:08:16 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd4e25d-a9ff-4b40-85ad-6ed2b7dcd85c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WpZNYtAF'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:08:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1781b2ed-7680-4604-8f99-4b8e5348eac7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1781b2ed-7680-4604-8f99-4b8e5348eac7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:16 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3d887a-84fa-4932-9b67-445f889bc495]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:08:16 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd4e25d-a9ff-4b40-85ad-6ed2b7dcd85c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:08:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:16 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1733a2d-2595-44cc-93c8-8b28bf0ebef2]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:08:16 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd4e25d-a9ff-4b40-85ad-6ed2b7dcd85c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:08:16 user nova-compute[103546]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)
Nov 16 04:08:16 user nova-compute[103546]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:08:16 user nova-compute[103546]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb (non-flash)
Nov 16 04:08:16 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:08:16 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd4e25d-a9ff-4b40-85ad-6ed2b7dcd85c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:08:16 user nova-compute[103546]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)
Nov 16 04:08:16 user nova-compute[103546]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:08:16 user nova-compute[103546]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb (non-flash)
Nov 16 04:08:16 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:08:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1781b2ed-7680-4604-8f99-4b8e5348eac7 -p 172.16.0.220:3260 --login {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1781b2ed-7680-4604-8f99-4b8e5348eac7 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:16 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa77e2b-8bea-4897-b2bc-d85787f2d061]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1781b2ed-7680-4604-8f99-4b8e5348eac7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1781b2ed-7680-4604-8f99-4b8e5348eac7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:08:16 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd4e25d-a9ff-4b40-85ad-6ed2b7dcd85c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1781b2ed-7680-4604-8f99-4b8e5348eac7, portal: 172.16.0.220,3260]
Nov 16 04:08:16 user nova-compute[103546]: Login to [iface: default, target: iqn.2010-10.org.openstack:1781b2ed-7680-4604-8f99-4b8e5348eac7, portal: 172.16.0.220,3260] successful.
Nov 16 04:08:16 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:08:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1781b2ed-7680-4604-8f99-4b8e5348eac7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1781b2ed-7680-4604-8f99-4b8e5348eac7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:16 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8e09e2-9803-4577-8d45-96235013db93]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:08:16 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd4e25d-a9ff-4b40-85ad-6ed2b7dcd85c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:08:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:16 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[8741a6ad-9b70-4c03-8b8f-4c7db4e35484]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1781b2ed-7680-4604-8f99-4b8e5348eac7 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:08:16 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd4e25d-a9ff-4b40-85ad-6ed2b7dcd85c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:08:16 user nova-compute[103546]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)
Nov 16 04:08:16 user nova-compute[103546]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:08:16 user nova-compute[103546]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb (non-flash)
Nov 16 04:08:16 user nova-compute[103546]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1781b2ed-7680-4604-8f99-4b8e5348eac7 (non-flash)
Nov 16 04:08:16 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:08:16 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd4e25d-a9ff-4b40-85ad-6ed2b7dcd85c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:08:16 user nova-compute[103546]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)
Nov 16 04:08:16 user nova-compute[103546]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:08:16 user nova-compute[103546]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb (non-flash)
Nov 16 04:08:16 user nova-compute[103546]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1781b2ed-7680-4604-8f99-4b8e5348eac7 (non-flash)
Nov 16 04:08:16 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:08:16 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-edd4e25d-a9ff-4b40-85ad-6ed2b7dcd85c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1781b2ed-7680-4604-8f99-4b8e5348eac7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:08:16 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd4e25d-a9ff-4b40-85ad-6ed2b7dcd85c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 04:08:16 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-edd4e25d-a9ff-4b40-85ad-6ed2b7dcd85c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 04:08:16 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-edd4e25d-a9ff-4b40-85ad-6ed2b7dcd85c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 04:08:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.101s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:16 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0f29d8-9eff-4ebd-b5a1-507862fd202b]: (4, ('- - 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:08:16 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-edd4e25d-a9ff-4b40-85ad-6ed2b7dcd85c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 04:08:16 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd4e25d-a9ff-4b40-85ad-6ed2b7dcd85c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1781b2ed-7680-4604-8f99-4b8e5348eac7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WpZNYtAF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 04:08:17 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-edd4e25d-a9ff-4b40-85ad-6ed2b7dcd85c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.411s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:08:17 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-edd4e25d-a9ff-4b40-85ad-6ed2b7dcd85c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] <== connect_volume: return (1413ms) {'type': 'block', 'scsi_wwn': '23264363339613063', 'path': '/dev/sdc'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:08:17 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edd4e25d-a9ff-4b40-85ad-6ed2b7dcd85c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264363339613063', 'path': '/dev/sdc'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 04:08:17 user nova-compute[103546]: DEBUG nova.objects.instance [None req-edd4e25d-a9ff-4b40-85ad-6ed2b7dcd85c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lazy-loading 'flavor' on Instance uuid 182b9697-e7da-4487-b0c1-889c1f655b95 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:08:17 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-edd4e25d-a9ff-4b40-85ad-6ed2b7dcd85c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 04:08:17 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:08:17 user nova-compute[103546]:   <source dev="/dev/sdc"/>
Nov 16 04:08:17 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 04:08:17 user nova-compute[103546]:   <serial>1781b2ed-7680-4604-8f99-4b8e5348eac7</serial>
Nov 16 04:08:17 user nova-compute[103546]: </disk>
Nov 16 04:08:17 user nova-compute[103546]:  {{(pid=103546) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 04:08:18 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-edd4e25d-a9ff-4b40-85ad-6ed2b7dcd85c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:08:18 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-edd4e25d-a9ff-4b40-85ad-6ed2b7dcd85c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] No BDM found with device name vdb, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:08:18 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-edd4e25d-a9ff-4b40-85ad-6ed2b7dcd85c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] No VIF found with MAC fa:16:3e:5e:e2:36, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 04:08:18 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-edd4e25d-a9ff-4b40-85ad-6ed2b7dcd85c tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "182b9697-e7da-4487-b0c1-889c1f655b95" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.030s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:08:18 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:08:19 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:08:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-5884baa4-7961-4c37-a70d-d717d4d72821 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Acquiring lock "182b9697-e7da-4487-b0c1-889c1f655b95" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:08:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-5884baa4-7961-4c37-a70d-d717d4d72821 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "182b9697-e7da-4487-b0c1-889c1f655b95" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:08:19 user nova-compute[103546]: INFO nova.compute.manager [None req-5884baa4-7961-4c37-a70d-d717d4d72821 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Detaching volume 1781b2ed-7680-4604-8f99-4b8e5348eac7
Nov 16 04:08:19 user nova-compute[103546]: INFO nova.virt.block_device [None req-5884baa4-7961-4c37-a70d-d717d4d72821 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Attempting to driver detach volume 1781b2ed-7680-4604-8f99-4b8e5348eac7 from mountpoint /dev/vdb
Nov 16 04:08:19 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-5884baa4-7961-4c37-a70d-d717d4d72821 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Attempting to detach device vdb from instance 182b9697-e7da-4487-b0c1-889c1f655b95 from the persistent domain config. {{(pid=103546) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 04:08:19 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-5884baa4-7961-4c37-a70d-d717d4d72821 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 04:08:19 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:08:19 user nova-compute[103546]:   <source dev="/dev/sdc"/>
Nov 16 04:08:19 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 04:08:19 user nova-compute[103546]:   <serial>1781b2ed-7680-4604-8f99-4b8e5348eac7</serial>
Nov 16 04:08:19 user nova-compute[103546]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 04:08:19 user nova-compute[103546]: </disk>
Nov 16 04:08:19 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 04:08:19 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-5884baa4-7961-4c37-a70d-d717d4d72821 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Successfully detached device vdb from instance 182b9697-e7da-4487-b0c1-889c1f655b95 from the persistent domain config.
Nov 16 04:08:19 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-5884baa4-7961-4c37-a70d-d717d4d72821 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 182b9697-e7da-4487-b0c1-889c1f655b95 from the live domain config. {{(pid=103546) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 04:08:19 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-5884baa4-7961-4c37-a70d-d717d4d72821 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 04:08:19 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:08:19 user nova-compute[103546]:   <source dev="/dev/sdc"/>
Nov 16 04:08:19 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 04:08:19 user nova-compute[103546]:   <serial>1781b2ed-7680-4604-8f99-4b8e5348eac7</serial>
Nov 16 04:08:19 user nova-compute[103546]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 04:08:19 user nova-compute[103546]: </disk>
Nov 16 04:08:19 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 04:08:19 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-5884baa4-7961-4c37-a70d-d717d4d72821 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 182b9697-e7da-4487-b0c1-889c1f655b95 {{(pid=103546) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 04:08:23 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:08:24 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:08:26 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:08:26 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:08:26 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=103546) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 04:08:27 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager.update_available_resource {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:08:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:08:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:08:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:08:27 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Auditing locally available compute resources for user (node: user) {{(pid=103546) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 04:08:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c02873d-469e-41a4-b492-69f793c8a07c/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c02873d-469e-41a4-b492-69f793c8a07c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c02873d-469e-41a4-b492-69f793c8a07c/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c02873d-469e-41a4-b492-69f793c8a07c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:28 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 04:08:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce616440-9d69-4812-8910-a2d9ad58f504/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce616440-9d69-4812-8910-a2d9ad58f504/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce616440-9d69-4812-8910-a2d9ad58f504/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:28 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:08:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce616440-9d69-4812-8910-a2d9ad58f504/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f7c407-3373-43ba-ac92-7eb0a43a7093/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f7c407-3373-43ba-ac92-7eb0a43a7093/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f7c407-3373-43ba-ac92-7eb0a43a7093/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:08:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f7c407-3373-43ba-ac92-7eb0a43a7093/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/182b9697-e7da-4487-b0c1-889c1f655b95/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/182b9697-e7da-4487-b0c1-889c1f655b95/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/182b9697-e7da-4487-b0c1-889c1f655b95/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/182b9697-e7da-4487-b0c1-889c1f655b95/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:30 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 04:08:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:30 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 04:08:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.rescue --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.rescue --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:31 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 04:08:31 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-08c882e1-df2b-45a2-9449-b65978605435 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Acquiring lock "26ba7f48-9752-45af-ba68-8c3f70325e21" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:08:31 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-08c882e1-df2b-45a2-9449-b65978605435 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "26ba7f48-9752-45af-ba68-8c3f70325e21" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:08:31 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-08c882e1-df2b-45a2-9449-b65978605435 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Acquiring lock "26ba7f48-9752-45af-ba68-8c3f70325e21-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:08:31 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-08c882e1-df2b-45a2-9449-b65978605435 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "26ba7f48-9752-45af-ba68-8c3f70325e21-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:08:31 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-08c882e1-df2b-45a2-9449-b65978605435 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "26ba7f48-9752-45af-ba68-8c3f70325e21-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:08:31 user nova-compute[103546]: INFO nova.compute.manager [None req-08c882e1-df2b-45a2-9449-b65978605435 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Terminating instance
Nov 16 04:08:31 user nova-compute[103546]: DEBUG nova.compute.manager [None req-08c882e1-df2b-45a2-9449-b65978605435 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Start destroying the instance on the hypervisor. {{(pid=103546) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 04:08:32 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:08:32 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:08:32 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Hypervisor/Node resource view: name=user free_ram=7494MB free_disk=24.801342010498047GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=103546) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 04:08:32 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:08:32 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:08:32 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:08:32 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:08:32 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 9a89970b-fc61-4419-8ff9-b48013dccf9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:08:32 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 04101512-7333-4581-add3-7af3821e335b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:08:32 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance fa7e5468-9dd4-407d-85ec-d45ec76f9e29 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:08:32 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 246ccf69-847c-4ab2-b709-ad1a85e81eab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:08:32 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 8d229d05-95f1-4997-8539-802ac65cff8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:08:32 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance b0a480de-e99b-4b54-bd81-36c216442137 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:08:32 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 38f7c407-3373-43ba-ac92-7eb0a43a7093 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:08:32 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 271adc7b-bfc6-48c5-8700-69b2b079ce4b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:08:32 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 8c02873d-469e-41a4-b492-69f793c8a07c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:08:32 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 26ba7f48-9752-45af-ba68-8c3f70325e21 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:08:32 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 182b9697-e7da-4487-b0c1-889c1f655b95 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:08:32 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance ce616440-9d69-4812-8910-a2d9ad58f504 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:08:32 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 04:08:32 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 04:08:32 user nova-compute[103546]: DEBUG nova.compute.manager [req-adf39ad5-7f15-4df8-bc5b-5b455b1836d1 req-1282d9d8-6f9f-47ad-815e-c9ec9910af6c service nova] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Received event network-vif-unplugged-59aaf9cc-b110-4cb9-aff1-9320d79f55c0 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:08:32 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-adf39ad5-7f15-4df8-bc5b-5b455b1836d1 req-1282d9d8-6f9f-47ad-815e-c9ec9910af6c service nova] Acquiring lock "26ba7f48-9752-45af-ba68-8c3f70325e21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:08:32 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-adf39ad5-7f15-4df8-bc5b-5b455b1836d1 req-1282d9d8-6f9f-47ad-815e-c9ec9910af6c service nova] Lock "26ba7f48-9752-45af-ba68-8c3f70325e21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:08:32 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-adf39ad5-7f15-4df8-bc5b-5b455b1836d1 req-1282d9d8-6f9f-47ad-815e-c9ec9910af6c service nova] Lock "26ba7f48-9752-45af-ba68-8c3f70325e21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:08:32 user nova-compute[103546]: DEBUG nova.compute.manager [req-adf39ad5-7f15-4df8-bc5b-5b455b1836d1 req-1282d9d8-6f9f-47ad-815e-c9ec9910af6c service nova] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] No waiting events found dispatching network-vif-unplugged-59aaf9cc-b110-4cb9-aff1-9320d79f55c0 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:08:32 user nova-compute[103546]: DEBUG nova.compute.manager [req-adf39ad5-7f15-4df8-bc5b-5b455b1836d1 req-1282d9d8-6f9f-47ad-815e-c9ec9910af6c service nova] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Received event network-vif-unplugged-59aaf9cc-b110-4cb9-aff1-9320d79f55c0 for instance with task_state deleting. {{(pid=103546) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 04:08:32 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:08:32 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:08:32 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:08:32 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:08:32 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Compute_service record updated for user:user {{(pid=103546) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 04:08:32 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.631s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:08:32 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Instance destroyed successfully.
Nov 16 04:08:32 user nova-compute[103546]: DEBUG nova.objects.instance [None req-08c882e1-df2b-45a2-9449-b65978605435 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lazy-loading 'resources' on Instance uuid 26ba7f48-9752-45af-ba68-8c3f70325e21 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-08c882e1-df2b-45a2-9449-b65978605435 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:01:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1703728033',display_name='tempest-ServerActionsTestOtherA-server-1703728033',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1703728033',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJeuDielSI+1QllPRU8TUZPfRtLhxXlgqD+oFHNsy0a0jxMp9PNqxCpWdXKas+7wQ5fSoPylsuLGE6eRSK8cr/wsGQFy4MbHJizJ+GnVBc6KD3RZeGBoD7tDLXSKWjtJbw==',key_name='tempest-keypair-205381596',keypairs=<?>,launch_index=0,launched_at=2023-11-16T04:04:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72b30a015db444798ee72ff6fd14c69e',ramdisk_id='',reservation_id='r-ahsozgnl',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1488667220',owner_user_name='tempest-ServerActionsTestOtherA-1488667220-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T04:05:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e471c69657c745bbbdfc82307a49946f',uuid=26ba7f48-9752-45af-ba68-8c3f70325e21,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "59aaf9cc-b110-4cb9-aff1-9320d79f55c0", "address": "fa:16:3e:46:16:f7", "network": {"id": "29e9620f-313d-4679-89d7-459e7cf75b38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1690634205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72b30a015db444798ee72ff6fd14c69e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59aaf9cc-b1", "ovs_interfaceid": "59aaf9cc-b110-4cb9-aff1-9320d79f55c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-08c882e1-df2b-45a2-9449-b65978605435 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Converting VIF {"id": "59aaf9cc-b110-4cb9-aff1-9320d79f55c0", "address": "fa:16:3e:46:16:f7", "network": {"id": "29e9620f-313d-4679-89d7-459e7cf75b38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1690634205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72b30a015db444798ee72ff6fd14c69e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59aaf9cc-b1", "ovs_interfaceid": "59aaf9cc-b110-4cb9-aff1-9320d79f55c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-08c882e1-df2b-45a2-9449-b65978605435 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:16:f7,bridge_name='br-int',has_traffic_filtering=True,id=59aaf9cc-b110-4cb9-aff1-9320d79f55c0,network=Network(29e9620f-313d-4679-89d7-459e7cf75b38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59aaf9cc-b1') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG os_vif [None req-08c882e1-df2b-45a2-9449-b65978605435 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:16:f7,bridge_name='br-int',has_traffic_filtering=True,id=59aaf9cc-b110-4cb9-aff1-9320d79f55c0,network=Network(29e9620f-313d-4679-89d7-459e7cf75b38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59aaf9cc-b1') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap59aaf9cc-b1, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4b694dee-b932-4ed3-8650-d9d91b1036c7) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:08:33 user nova-compute[103546]: INFO os_vif [None req-08c882e1-df2b-45a2-9449-b65978605435 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:16:f7,bridge_name='br-int',has_traffic_filtering=True,id=59aaf9cc-b110-4cb9-aff1-9320d79f55c0,network=Network(29e9620f-313d-4679-89d7-459e7cf75b38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59aaf9cc-b1')
Nov 16 04:08:33 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08c882e1-df2b-45a2-9449-b65978605435 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c882e1-df2b-45a2-9449-b65978605435 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AJewqSDp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:08:33 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-08c882e1-df2b-45a2-9449-b65978605435 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:08:33 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-08c882e1-df2b-45a2-9449-b65978605435 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-08c882e1-df2b-45a2-9449-b65978605435 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e7d98d-67b8-48d3-a742-17f305f646de]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1781b2ed-7680-4604-8f99-4b8e5348eac7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c882e1-df2b-45a2-9449-b65978605435 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 04:08:33 user nova-compute[103546]: No targets found.
Nov 16 04:08:33 user nova-compute[103546]: iSNS:
Nov 16 04:08:33 user nova-compute[103546]: No targets found.
Nov 16 04:08:33 user nova-compute[103546]: STATIC:
Nov 16 04:08:33 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:1781b2ed-7680-4604-8f99-4b8e5348eac7
Nov 16 04:08:33 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:08:33 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:08:33 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7
Nov 16 04:08:33 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:08:33 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:08:33 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4
Nov 16 04:08:33 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:08:33 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:08:33 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb
Nov 16 04:08:33 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:08:33 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:08:33 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf
Nov 16 04:08:33 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:08:33 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:08:33 user nova-compute[103546]: FIRMWARE:
Nov 16 04:08:33 user nova-compute[103546]: No targets found.
Nov 16 04:08:33 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c882e1-df2b-45a2-9449-b65978605435 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 04:08:33 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 04:08:33 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c882e1-df2b-45a2-9449-b65978605435 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d22edf3-71d9-4485-8482-c688c662bfef]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1781b2ed-7680-4604-8f99-4b8e5348eac7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1eab446-88e4-48b7-94d1-45c9c003e737]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1781b2ed-7680-4604-8f99-4b8e5348eac7 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c882e1-df2b-45a2-9449-b65978605435 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:08:33 user nova-compute[103546]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)
Nov 16 04:08:33 user nova-compute[103546]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:08:33 user nova-compute[103546]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb (non-flash)
Nov 16 04:08:33 user nova-compute[103546]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1781b2ed-7680-4604-8f99-4b8e5348eac7 (non-flash)
Nov 16 04:08:33 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c882e1-df2b-45a2-9449-b65978605435 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:08:33 user nova-compute[103546]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)
Nov 16 04:08:33 user nova-compute[103546]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf (non-flash)
Nov 16 04:08:33 user nova-compute[103546]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb (non-flash)
Nov 16 04:08:33 user nova-compute[103546]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1781b2ed-7680-4604-8f99-4b8e5348eac7 (non-flash)
Nov 16 04:08:33 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c882e1-df2b-45a2-9449-b65978605435 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60ac212e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf'): ({'sdf'}, set())}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-08c882e1-df2b-45a2-9449-b65978605435 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Removing single pathed devices sdf {{(pid=103546) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b617e3-c239-439c-b36f-739694c2b5cf]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[97cc1f27-98df-43f8-bfd4-6006875b4c48]: (4, ('ok\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-08c882e1-df2b-45a2-9449-b65978605435 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Flushing IO for device /dev/sdf {{(pid=103546) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c060a069-e342-418c-bec7-3f041ce3c71c]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-08c882e1-df2b-45a2-9449-b65978605435 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=103546) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c550a1-de3c-4562-9a3e-934db2166a53]: (4, ('1', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-08c882e1-df2b-45a2-9449-b65978605435 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-08c882e1-df2b-45a2-9449-b65978605435 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] SCSI volumes sdf have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO56009a9a-248e44d55a698fd7', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_56009a9a', '/dev/disk/by-id/scsi-23234386534346435') {{(pid=114461) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21270f9-a170-44a2-9a35-ceb4aa73275e]: (4, None) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c882e1-df2b-45a2-9449-b65978605435 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf')] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c784f1a8-dc3f-4ddd-8860-ef10d0c12c6b]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c882e1-df2b-45a2-9449-b65978605435 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf -p 172.16.0.220:3260 --logout {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[6888a35e-a629-409d-9180-96849120517b]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c882e1-df2b-45a2-9449-b65978605435 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf, portal: 172.16.0.220,3260]
Nov 16 04:08:33 user nova-compute[103546]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf, portal: 172.16.0.220,3260] successful.
Nov 16 04:08:33 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf -p 172.16.0.220:3260 --op delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ccf88b-7590-48b4-acc3-89388b6257bf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[006e3508-ab30-44c0-bc0a-65f7f78c485f]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c882e1-df2b-45a2-9449-b65978605435 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-08c882e1-df2b-45a2-9449-b65978605435 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c882e1-df2b-45a2-9449-b65978605435 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] <== disconnect_volume: return (320ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08c882e1-df2b-45a2-9449-b65978605435 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 04:08:33 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-08c882e1-df2b-45a2-9449-b65978605435 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Deleting instance files /opt/stack/data/nova/instances/26ba7f48-9752-45af-ba68-8c3f70325e21_del
Nov 16 04:08:33 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-08c882e1-df2b-45a2-9449-b65978605435 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Deletion of /opt/stack/data/nova/instances/26ba7f48-9752-45af-ba68-8c3f70325e21_del complete
Nov 16 04:08:33 user nova-compute[103546]: INFO nova.compute.manager [None req-08c882e1-df2b-45a2-9449-b65978605435 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Took 1.70 seconds to destroy the instance on the hypervisor.
Nov 16 04:08:33 user nova-compute[103546]: DEBUG oslo.service.loopingcall [None req-08c882e1-df2b-45a2-9449-b65978605435 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=103546) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG nova.compute.manager [-] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Deallocating network for instance {{(pid=103546) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] deallocate_for_instance() {{(pid=103546) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:08:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:08:34 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:08:34 user nova-compute[103546]: INFO nova.compute.manager [-] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Took 1.01 seconds to deallocate network for instance.
Nov 16 04:08:34 user nova-compute[103546]: DEBUG nova.compute.manager [req-964272c2-8562-428c-8341-eb8547d01b34 req-d863f3e8-c6c8-4edb-94ec-a81cd5a83508 service nova] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Received event network-vif-plugged-59aaf9cc-b110-4cb9-aff1-9320d79f55c0 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:08:34 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-964272c2-8562-428c-8341-eb8547d01b34 req-d863f3e8-c6c8-4edb-94ec-a81cd5a83508 service nova] Acquiring lock "26ba7f48-9752-45af-ba68-8c3f70325e21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:08:34 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-964272c2-8562-428c-8341-eb8547d01b34 req-d863f3e8-c6c8-4edb-94ec-a81cd5a83508 service nova] Lock "26ba7f48-9752-45af-ba68-8c3f70325e21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:08:34 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-964272c2-8562-428c-8341-eb8547d01b34 req-d863f3e8-c6c8-4edb-94ec-a81cd5a83508 service nova] Lock "26ba7f48-9752-45af-ba68-8c3f70325e21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:08:34 user nova-compute[103546]: DEBUG nova.compute.manager [req-964272c2-8562-428c-8341-eb8547d01b34 req-d863f3e8-c6c8-4edb-94ec-a81cd5a83508 service nova] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] No waiting events found dispatching network-vif-plugged-59aaf9cc-b110-4cb9-aff1-9320d79f55c0 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:08:34 user nova-compute[103546]: WARNING nova.compute.manager [req-964272c2-8562-428c-8341-eb8547d01b34 req-d863f3e8-c6c8-4edb-94ec-a81cd5a83508 service nova] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Received unexpected event network-vif-plugged-59aaf9cc-b110-4cb9-aff1-9320d79f55c0 for instance with vm_state active and task_state deleting.
Nov 16 04:08:34 user nova-compute[103546]: DEBUG nova.compute.manager [req-964272c2-8562-428c-8341-eb8547d01b34 req-d863f3e8-c6c8-4edb-94ec-a81cd5a83508 service nova] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Received event network-vif-deleted-59aaf9cc-b110-4cb9-aff1-9320d79f55c0 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:08:36 user nova-compute[103546]: INFO nova.compute.manager [None req-08c882e1-df2b-45a2-9449-b65978605435 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Took 1.72 seconds to detach 1 volumes for instance.
Nov 16 04:08:36 user nova-compute[103546]: DEBUG nova.compute.manager [None req-08c882e1-df2b-45a2-9449-b65978605435 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 26ba7f48-9752-45af-ba68-8c3f70325e21] Deleting volume: 43ccf88b-7590-48b4-acc3-89388b6257bf {{(pid=103546) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 16 04:08:36 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-08c882e1-df2b-45a2-9449-b65978605435 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:08:36 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-08c882e1-df2b-45a2-9449-b65978605435 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:08:36 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-08c882e1-df2b-45a2-9449-b65978605435 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:08:36 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-08c882e1-df2b-45a2-9449-b65978605435 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:08:36 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-08c882e1-df2b-45a2-9449-b65978605435 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.395s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:08:36 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:08:36 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Starting heal instance info cache {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 04:08:36 user nova-compute[103546]: INFO nova.scheduler.client.report [None req-08c882e1-df2b-45a2-9449-b65978605435 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Deleted allocations for instance 26ba7f48-9752-45af-ba68-8c3f70325e21
Nov 16 04:08:36 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "refresh_cache-b0a480de-e99b-4b54-bd81-36c216442137" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:08:36 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquired lock "refresh_cache-b0a480de-e99b-4b54-bd81-36c216442137" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:08:36 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Forcefully refreshing network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 04:08:36 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-08c882e1-df2b-45a2-9449-b65978605435 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "26ba7f48-9752-45af-ba68-8c3f70325e21" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.120s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:08:37 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Updating instance_info_cache with network_info: [{"id": "804319c6-55cb-4f30-908c-71817934fb45", "address": "fa:16:3e:d5:4f:3e", "network": {"id": "23baa589-ae15-4a44-8991-d6fe8569dc8a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-464431710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f33e7eff7954fcc895f66982d7d45c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804319c6-55", "ovs_interfaceid": "804319c6-55cb-4f30-908c-71817934fb45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:08:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Releasing lock "refresh_cache-b0a480de-e99b-4b54-bd81-36c216442137" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:08:37 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Updated the network info_cache for instance {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 04:08:38 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:08:38 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:08:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:08:39 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-5884baa4-7961-4c37-a70d-d717d4d72821 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 182b9697-e7da-4487-b0c1-889c1f655b95 is timed out.
Nov 16 04:08:39 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-5884baa4-7961-4c37-a70d-d717d4d72821 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Successfully detached device vdb from instance 182b9697-e7da-4487-b0c1-889c1f655b95 from the live domain config.
Nov 16 04:08:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5884baa4-7961-4c37-a70d-d717d4d72821 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 04:08:39 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-5884baa4-7961-4c37-a70d-d717d4d72821 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:1781b2ed-7680-4604-8f99-4b8e5348eac7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WpZNYtAF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:08:39 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-5884baa4-7961-4c37-a70d-d717d4d72821 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:08:39 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-5884baa4-7961-4c37-a70d-d717d4d72821 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:08:39 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-5884baa4-7961-4c37-a70d-d717d4d72821 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:08:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:39 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c943597e-d460-456e-ba2d-70c10f8443c0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1781b2ed-7680-4604-8f99-4b8e5348eac7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:08:39 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-5884baa4-7961-4c37-a70d-d717d4d72821 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 04:08:39 user nova-compute[103546]: No targets found.
Nov 16 04:08:39 user nova-compute[103546]: iSNS:
Nov 16 04:08:39 user nova-compute[103546]: No targets found.
Nov 16 04:08:39 user nova-compute[103546]: STATIC:
Nov 16 04:08:39 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:1781b2ed-7680-4604-8f99-4b8e5348eac7
Nov 16 04:08:39 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:08:39 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:08:39 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7
Nov 16 04:08:39 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:08:39 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:08:39 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4
Nov 16 04:08:39 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:08:39 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:08:39 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb
Nov 16 04:08:39 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:08:39 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:08:39 user nova-compute[103546]: FIRMWARE:
Nov 16 04:08:39 user nova-compute[103546]: No targets found.
Nov 16 04:08:39 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:08:39 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-5884baa4-7961-4c37-a70d-d717d4d72821 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 04:08:39 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 04:08:39 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 04:08:39 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-5884baa4-7961-4c37-a70d-d717d4d72821 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1781b2ed-7680-4604-8f99-4b8e5348eac7', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 04:08:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:39 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ca5866-5037-48db-bf35-5d55b34153e4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1781b2ed-7680-4604-8f99-4b8e5348eac7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:08:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:39 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a31d2c-b787-49d5-a340-0255cb248cfb]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1781b2ed-7680-4604-8f99-4b8e5348eac7 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:08:39 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-5884baa4-7961-4c37-a70d-d717d4d72821 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:08:39 user nova-compute[103546]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)
Nov 16 04:08:39 user nova-compute[103546]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb (non-flash)
Nov 16 04:08:39 user nova-compute[103546]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1781b2ed-7680-4604-8f99-4b8e5348eac7 (non-flash)
Nov 16 04:08:39 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:08:39 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-5884baa4-7961-4c37-a70d-d717d4d72821 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:08:39 user nova-compute[103546]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)
Nov 16 04:08:39 user nova-compute[103546]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb (non-flash)
Nov 16 04:08:39 user nova-compute[103546]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1781b2ed-7680-4604-8f99-4b8e5348eac7 (non-flash)
Nov 16 04:08:39 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:08:39 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-5884baa4-7961-4c37-a70d-d717d4d72821 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60ac325240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1781b2ed-7680-4604-8f99-4b8e5348eac7'): ({'sdc'}, set())}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 04:08:39 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-5884baa4-7961-4c37-a70d-d717d4d72821 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Removing single pathed devices sdc {{(pid=103546) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 04:08:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:39 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[75df2af0-e4ea-4257-812f-2ba6aca475e3]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:08:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:39 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[762f1d05-975b-4e9c-8d14-f5fb6e666070]: (4, ('ok\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:08:39 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-5884baa4-7961-4c37-a70d-d717d4d72821 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Flushing IO for device /dev/sdc {{(pid=103546) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 04:08:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:39 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[06aac062-b15a-4520-8d8e-cd8ba78c5fcd]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:08:39 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-5884baa4-7961-4c37-a70d-d717d4d72821 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=103546) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 04:08:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.034s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:39 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[af564e78-2c32-4af0-abf5-071ebd7e348b]: (4, ('1', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:08:39 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-5884baa4-7961-4c37-a70d-d717d4d72821 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 04:08:39 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-5884baa4-7961-4c37-a70d-d717d4d72821 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] SCSI volumes sdc have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 04:08:39 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-5884baa4-7961-4c37-a70d-d717d4d72821 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1781b2ed-7680-4604-8f99-4b8e5348eac7')] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 04:08:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1781b2ed-7680-4604-8f99-4b8e5348eac7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1781b2ed-7680-4604-8f99-4b8e5348eac7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:39 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[732e56fd-13de-4c04-a63e-e9606e641966]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:08:39 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-5884baa4-7961-4c37-a70d-d717d4d72821 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:08:40 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1781b2ed-7680-4604-8f99-4b8e5348eac7 -p 172.16.0.220:3260 --logout {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:40 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1781b2ed-7680-4604-8f99-4b8e5348eac7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:40 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[7982a6bc-2bbd-4176-8564-1887ea18e1aa]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:1781b2ed-7680-4604-8f99-4b8e5348eac7, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:1781b2ed-7680-4604-8f99-4b8e5348eac7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:08:40 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-5884baa4-7961-4c37-a70d-d717d4d72821 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:1781b2ed-7680-4604-8f99-4b8e5348eac7, portal: 172.16.0.220,3260]
Nov 16 04:08:40 user nova-compute[103546]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:1781b2ed-7680-4604-8f99-4b8e5348eac7, portal: 172.16.0.220,3260] successful.
Nov 16 04:08:40 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:08:40 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1781b2ed-7680-4604-8f99-4b8e5348eac7 -p 172.16.0.220:3260 --op delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:40 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1781b2ed-7680-4604-8f99-4b8e5348eac7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:40 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2565117-ed5f-43c4-af30-99e5cfab4a81]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:08:40 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-5884baa4-7961-4c37-a70d-d717d4d72821 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:08:40 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-5884baa4-7961-4c37-a70d-d717d4d72821 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:08:40 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-5884baa4-7961-4c37-a70d-d717d4d72821 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] <== disconnect_volume: return (291ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:08:40 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5884baa4-7961-4c37-a70d-d717d4d72821 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 04:08:40 user nova-compute[103546]: DEBUG nova.objects.instance [None req-5884baa4-7961-4c37-a70d-d717d4d72821 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lazy-loading 'flavor' on Instance uuid 182b9697-e7da-4487-b0c1-889c1f655b95 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:08:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-5884baa4-7961-4c37-a70d-d717d4d72821 tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "182b9697-e7da-4487-b0c1-889c1f655b95" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.594s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:08:41 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:08:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:08:44 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:08:48 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:08:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:08:56 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-62bcc0a8-531b-4589-a279-b3de833947f5 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Acquiring lock "271adc7b-bfc6-48c5-8700-69b2b079ce4b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:08:56 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-62bcc0a8-531b-4589-a279-b3de833947f5 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "271adc7b-bfc6-48c5-8700-69b2b079ce4b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:08:56 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-62bcc0a8-531b-4589-a279-b3de833947f5 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Acquiring lock "271adc7b-bfc6-48c5-8700-69b2b079ce4b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:08:56 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-62bcc0a8-531b-4589-a279-b3de833947f5 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "271adc7b-bfc6-48c5-8700-69b2b079ce4b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:08:56 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-62bcc0a8-531b-4589-a279-b3de833947f5 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "271adc7b-bfc6-48c5-8700-69b2b079ce4b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:08:56 user nova-compute[103546]: INFO nova.compute.manager [None req-62bcc0a8-531b-4589-a279-b3de833947f5 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Terminating instance
Nov 16 04:08:56 user nova-compute[103546]: DEBUG nova.compute.manager [None req-62bcc0a8-531b-4589-a279-b3de833947f5 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Start destroying the instance on the hypervisor. {{(pid=103546) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 04:08:56 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:08:56 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:08:56 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:08:56 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:08:56 user nova-compute[103546]: DEBUG nova.compute.manager [req-d4380c82-9237-4e0d-9bf2-2112e2f2b15f req-29b3263e-4990-4ce6-886d-19ee92a49a44 service nova] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Received event network-vif-unplugged-30eba06b-aff6-43cf-b792-7624b1bc12a9 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:08:56 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d4380c82-9237-4e0d-9bf2-2112e2f2b15f req-29b3263e-4990-4ce6-886d-19ee92a49a44 service nova] Acquiring lock "271adc7b-bfc6-48c5-8700-69b2b079ce4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:08:56 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d4380c82-9237-4e0d-9bf2-2112e2f2b15f req-29b3263e-4990-4ce6-886d-19ee92a49a44 service nova] Lock "271adc7b-bfc6-48c5-8700-69b2b079ce4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:08:56 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d4380c82-9237-4e0d-9bf2-2112e2f2b15f req-29b3263e-4990-4ce6-886d-19ee92a49a44 service nova] Lock "271adc7b-bfc6-48c5-8700-69b2b079ce4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:08:56 user nova-compute[103546]: DEBUG nova.compute.manager [req-d4380c82-9237-4e0d-9bf2-2112e2f2b15f req-29b3263e-4990-4ce6-886d-19ee92a49a44 service nova] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] No waiting events found dispatching network-vif-unplugged-30eba06b-aff6-43cf-b792-7624b1bc12a9 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:08:56 user nova-compute[103546]: DEBUG nova.compute.manager [req-d4380c82-9237-4e0d-9bf2-2112e2f2b15f req-29b3263e-4990-4ce6-886d-19ee92a49a44 service nova] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Received event network-vif-unplugged-30eba06b-aff6-43cf-b792-7624b1bc12a9 for instance with task_state deleting. {{(pid=103546) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 04:08:57 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Instance destroyed successfully.
Nov 16 04:08:57 user nova-compute[103546]: DEBUG nova.objects.instance [None req-62bcc0a8-531b-4589-a279-b3de833947f5 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lazy-loading 'resources' on Instance uuid 271adc7b-bfc6-48c5-8700-69b2b079ce4b {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-62bcc0a8-531b-4589-a279-b3de833947f5 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:03:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2082323718',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2082323718',id=40,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T04:05:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6f2a38a5eb514ce8a7569c8322657eac',ramdisk_id='',reservation_id='r-d5wsh0km',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1634874924',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T04:07:12Z,user_data=None,user_id='e1176a2817ef428ea81e2fb18299a306',uuid=271adc7b-bfc6-48c5-8700-69b2b079ce4b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "30eba06b-aff6-43cf-b792-7624b1bc12a9", "address": "fa:16:3e:ae:80:8d", "network": {"id": "fdbb2d2c-9a54-4517-b33a-cf27ce7570b1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79661471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2a38a5eb514ce8a7569c8322657eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30eba06b-af", "ovs_interfaceid": "30eba06b-aff6-43cf-b792-7624b1bc12a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-62bcc0a8-531b-4589-a279-b3de833947f5 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Converting VIF {"id": "30eba06b-aff6-43cf-b792-7624b1bc12a9", "address": "fa:16:3e:ae:80:8d", "network": {"id": "fdbb2d2c-9a54-4517-b33a-cf27ce7570b1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79661471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2a38a5eb514ce8a7569c8322657eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30eba06b-af", "ovs_interfaceid": "30eba06b-aff6-43cf-b792-7624b1bc12a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-62bcc0a8-531b-4589-a279-b3de833947f5 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:80:8d,bridge_name='br-int',has_traffic_filtering=True,id=30eba06b-aff6-43cf-b792-7624b1bc12a9,network=Network(fdbb2d2c-9a54-4517-b33a-cf27ce7570b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30eba06b-af') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG os_vif [None req-62bcc0a8-531b-4589-a279-b3de833947f5 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:80:8d,bridge_name='br-int',has_traffic_filtering=True,id=30eba06b-aff6-43cf-b792-7624b1bc12a9,network=Network(fdbb2d2c-9a54-4517-b33a-cf27ce7570b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30eba06b-af') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap30eba06b-af, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c8ab4ca6-334f-43fa-b3f8-14c82801b800) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:08:57 user nova-compute[103546]: INFO os_vif [None req-62bcc0a8-531b-4589-a279-b3de833947f5 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:80:8d,bridge_name='br-int',has_traffic_filtering=True,id=30eba06b-aff6-43cf-b792-7624b1bc12a9,network=Network(fdbb2d2c-9a54-4517-b33a-cf27ce7570b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30eba06b-af')
Nov 16 04:08:57 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62bcc0a8-531b-4589-a279-b3de833947f5 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bcc0a8-531b-4589-a279-b3de833947f5 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TxYFhoMJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:08:57 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-62bcc0a8-531b-4589-a279-b3de833947f5 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:08:57 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-62bcc0a8-531b-4589-a279-b3de833947f5 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-62bcc0a8-531b-4589-a279-b3de833947f5 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f56fd3-51f0-422b-b81e-551894bcfe71]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bcc0a8-531b-4589-a279-b3de833947f5 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 04:08:57 user nova-compute[103546]: No targets found.
Nov 16 04:08:57 user nova-compute[103546]: iSNS:
Nov 16 04:08:57 user nova-compute[103546]: No targets found.
Nov 16 04:08:57 user nova-compute[103546]: STATIC:
Nov 16 04:08:57 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7
Nov 16 04:08:57 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:08:57 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:08:57 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4
Nov 16 04:08:57 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:08:57 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:08:57 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb
Nov 16 04:08:57 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:08:57 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:08:57 user nova-compute[103546]: FIRMWARE:
Nov 16 04:08:57 user nova-compute[103546]: No targets found.
Nov 16 04:08:57 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bcc0a8-531b-4589-a279-b3de833947f5 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 04:08:57 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 04:08:57 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bcc0a8-531b-4589-a279-b3de833947f5 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e26634a-c20a-4354-9954-923ca10068b3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3cad312-7f23-48da-b9c0-97cc7ab22abc]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bcc0a8-531b-4589-a279-b3de833947f5 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:08:57 user nova-compute[103546]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)
Nov 16 04:08:57 user nova-compute[103546]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb (non-flash)
Nov 16 04:08:57 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bcc0a8-531b-4589-a279-b3de833947f5 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:08:57 user nova-compute[103546]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 (non-flash)
Nov 16 04:08:57 user nova-compute[103546]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb (non-flash)
Nov 16 04:08:57 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bcc0a8-531b-4589-a279-b3de833947f5 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60ac302200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7'): ({'sde'}, set())}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-62bcc0a8-531b-4589-a279-b3de833947f5 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Removing single pathed devices sde {{(pid=103546) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb350dce-7525-4385-8963-2d35f2495c59]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35a8e5e-a815-4495-8fde-010f4b2a978d]: (4, ('ok\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-62bcc0a8-531b-4589-a279-b3de833947f5 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Flushing IO for device /dev/sde {{(pid=103546) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b504716-28e2-4e4c-96da-d651ca4c7a7d]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-62bcc0a8-531b-4589-a279-b3de833947f5 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=103546) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.051s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95d5c6a-956d-495b-a9d1-2189be3208b1]: (4, ('1', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-62bcc0a8-531b-4589-a279-b3de833947f5 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-62bcc0a8-531b-4589-a279-b3de833947f5 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] SCSI volumes sde have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bcc0a8-531b-4589-a279-b3de833947f5 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7')] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[7206ca88-2d50-4f40-9278-8cc05cbf496a]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bcc0a8-531b-4589-a279-b3de833947f5 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 -p 172.16.0.220:3260 --logout {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ac087a-83e2-44b2-a033-e16d4a24d2d3]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bcc0a8-531b-4589-a279-b3de833947f5 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7, portal: 172.16.0.220,3260]
Nov 16 04:08:57 user nova-compute[103546]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7, portal: 172.16.0.220,3260] successful.
Nov 16 04:08:57 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 -p 172.16.0.220:3260 --op delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d1a0410-4f73-4d23-a8d8-d745c527cdf7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[27337df0-d331-4b29-b5ed-22f257acb2bf]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bcc0a8-531b-4589-a279-b3de833947f5 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-62bcc0a8-531b-4589-a279-b3de833947f5 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-62bcc0a8-531b-4589-a279-b3de833947f5 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] <== disconnect_volume: return (328ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62bcc0a8-531b-4589-a279-b3de833947f5 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 04:08:57 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-62bcc0a8-531b-4589-a279-b3de833947f5 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Deleting instance files /opt/stack/data/nova/instances/271adc7b-bfc6-48c5-8700-69b2b079ce4b_del
Nov 16 04:08:57 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-62bcc0a8-531b-4589-a279-b3de833947f5 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Deletion of /opt/stack/data/nova/instances/271adc7b-bfc6-48c5-8700-69b2b079ce4b_del complete
Nov 16 04:08:57 user nova-compute[103546]: INFO nova.compute.manager [None req-62bcc0a8-531b-4589-a279-b3de833947f5 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 16 04:08:57 user nova-compute[103546]: DEBUG oslo.service.loopingcall [None req-62bcc0a8-531b-4589-a279-b3de833947f5 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=103546) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG nova.compute.manager [-] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Deallocating network for instance {{(pid=103546) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] deallocate_for_instance() {{(pid=103546) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 04:08:57 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:08:57 user nova-compute[103546]: INFO nova.compute.manager [-] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Took 0.44 seconds to deallocate network for instance.
Nov 16 04:08:58 user nova-compute[103546]: DEBUG nova.compute.manager [req-80711457-ea80-4e13-9fc6-e1c592b78de5 req-2dd33a6a-f14f-476a-9ee1-619f8aaccde1 service nova] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Received event network-vif-deleted-30eba06b-aff6-43cf-b792-7624b1bc12a9 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:08:58 user nova-compute[103546]: INFO nova.compute.manager [req-80711457-ea80-4e13-9fc6-e1c592b78de5 req-2dd33a6a-f14f-476a-9ee1-619f8aaccde1 service nova] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Neutron deleted interface 30eba06b-aff6-43cf-b792-7624b1bc12a9; detaching it from the instance and deleting it from the info cache
Nov 16 04:08:58 user nova-compute[103546]: DEBUG nova.network.neutron [req-80711457-ea80-4e13-9fc6-e1c592b78de5 req-2dd33a6a-f14f-476a-9ee1-619f8aaccde1 service nova] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:08:58 user nova-compute[103546]: DEBUG nova.compute.manager [req-80711457-ea80-4e13-9fc6-e1c592b78de5 req-2dd33a6a-f14f-476a-9ee1-619f8aaccde1 service nova] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Detach interface failed, port_id=30eba06b-aff6-43cf-b792-7624b1bc12a9, reason: Instance 271adc7b-bfc6-48c5-8700-69b2b079ce4b could not be found. {{(pid=103546) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 04:08:58 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-7fe26077-d129-4695-994c-e896a84dad42 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Acquiring lock "b0a480de-e99b-4b54-bd81-36c216442137" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:08:58 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-7fe26077-d129-4695-994c-e896a84dad42 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "b0a480de-e99b-4b54-bd81-36c216442137" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:08:58 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-7fe26077-d129-4695-994c-e896a84dad42 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Acquiring lock "b0a480de-e99b-4b54-bd81-36c216442137-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:08:58 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-7fe26077-d129-4695-994c-e896a84dad42 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "b0a480de-e99b-4b54-bd81-36c216442137-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:08:58 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-7fe26077-d129-4695-994c-e896a84dad42 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "b0a480de-e99b-4b54-bd81-36c216442137-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:08:58 user nova-compute[103546]: INFO nova.compute.manager [None req-7fe26077-d129-4695-994c-e896a84dad42 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Terminating instance
Nov 16 04:08:58 user nova-compute[103546]: DEBUG nova.compute.manager [None req-7fe26077-d129-4695-994c-e896a84dad42 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Start destroying the instance on the hypervisor. {{(pid=103546) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 04:08:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:08:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:08:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:08:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:08:58 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Instance destroyed successfully.
Nov 16 04:08:58 user nova-compute[103546]: DEBUG nova.objects.instance [None req-7fe26077-d129-4695-994c-e896a84dad42 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lazy-loading 'resources' on Instance uuid b0a480de-e99b-4b54-bd81-36c216442137 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:08:58 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-7fe26077-d129-4695-994c-e896a84dad42 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:59:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1194569156',display_name='tempest-AttachVolumeTestJSON-server-1194569156',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1194569156',id=33,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGulyvMv6DBB41Qe8XWF63e9B3iBHOwlSkAryW1iz72Aw6HfFs0cTFUdIe1uTx/ceIRIbAXp8f4Mb3WAscOyquzQNMRUlWLf10PNP0Nn0ZjiELMrAE3x8QFH1PXFWQSd/w==',key_name='tempest-keypair-309978137',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:59:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f33e7eff7954fcc895f66982d7d45c8',ramdisk_id='',reservation_id='r-sa4b0m91',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1584447380',owner_user_name='tempest-AttachVolumeTestJSON-1584447380-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T04:07:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='005ffc068a19494bb5a436fc4a07aaa1',uuid=b0a480de-e99b-4b54-bd81-36c216442137,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "804319c6-55cb-4f30-908c-71817934fb45", "address": "fa:16:3e:d5:4f:3e", "network": {"id": "23baa589-ae15-4a44-8991-d6fe8569dc8a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-464431710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f33e7eff7954fcc895f66982d7d45c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804319c6-55", "ovs_interfaceid": "804319c6-55cb-4f30-908c-71817934fb45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 04:08:58 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-7fe26077-d129-4695-994c-e896a84dad42 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Converting VIF {"id": "804319c6-55cb-4f30-908c-71817934fb45", "address": "fa:16:3e:d5:4f:3e", "network": {"id": "23baa589-ae15-4a44-8991-d6fe8569dc8a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-464431710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f33e7eff7954fcc895f66982d7d45c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804319c6-55", "ovs_interfaceid": "804319c6-55cb-4f30-908c-71817934fb45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:08:58 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-7fe26077-d129-4695-994c-e896a84dad42 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:4f:3e,bridge_name='br-int',has_traffic_filtering=True,id=804319c6-55cb-4f30-908c-71817934fb45,network=Network(23baa589-ae15-4a44-8991-d6fe8569dc8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap804319c6-55') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:08:58 user nova-compute[103546]: DEBUG os_vif [None req-7fe26077-d129-4695-994c-e896a84dad42 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:4f:3e,bridge_name='br-int',has_traffic_filtering=True,id=804319c6-55cb-4f30-908c-71817934fb45,network=Network(23baa589-ae15-4a44-8991-d6fe8569dc8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap804319c6-55') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 04:08:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:08:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap804319c6-55, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:08:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:08:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:08:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:08:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=815ecb50-f374-4ef5-a94f-649d8f40e89d) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:08:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:08:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:08:58 user nova-compute[103546]: INFO os_vif [None req-7fe26077-d129-4695-994c-e896a84dad42 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:4f:3e,bridge_name='br-int',has_traffic_filtering=True,id=804319c6-55cb-4f30-908c-71817934fb45,network=Network(23baa589-ae15-4a44-8991-d6fe8569dc8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap804319c6-55')
Nov 16 04:08:58 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-7fe26077-d129-4695-994c-e896a84dad42 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Deleting instance files /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137_del
Nov 16 04:08:58 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-7fe26077-d129-4695-994c-e896a84dad42 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Deletion of /opt/stack/data/nova/instances/b0a480de-e99b-4b54-bd81-36c216442137_del complete
Nov 16 04:08:58 user nova-compute[103546]: INFO nova.compute.manager [None req-7fe26077-d129-4695-994c-e896a84dad42 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Took 0.67 seconds to destroy the instance on the hypervisor.
Nov 16 04:08:58 user nova-compute[103546]: DEBUG oslo.service.loopingcall [None req-7fe26077-d129-4695-994c-e896a84dad42 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=103546) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 04:08:58 user nova-compute[103546]: DEBUG nova.compute.manager [-] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Deallocating network for instance {{(pid=103546) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 04:08:58 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: b0a480de-e99b-4b54-bd81-36c216442137] deallocate_for_instance() {{(pid=103546) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 04:08:58 user nova-compute[103546]: INFO nova.compute.manager [None req-62bcc0a8-531b-4589-a279-b3de833947f5 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Took 0.82 seconds to detach 1 volumes for instance.
Nov 16 04:08:58 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-62bcc0a8-531b-4589-a279-b3de833947f5 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:08:58 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-62bcc0a8-531b-4589-a279-b3de833947f5 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:08:58 user nova-compute[103546]: DEBUG nova.compute.manager [req-d416ed29-542d-42dd-8ab8-61be7ee66d06 req-7af2d952-b4f4-4e01-8697-395c81ad8288 service nova] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Received event network-vif-plugged-30eba06b-aff6-43cf-b792-7624b1bc12a9 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:08:58 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d416ed29-542d-42dd-8ab8-61be7ee66d06 req-7af2d952-b4f4-4e01-8697-395c81ad8288 service nova] Acquiring lock "271adc7b-bfc6-48c5-8700-69b2b079ce4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:08:58 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d416ed29-542d-42dd-8ab8-61be7ee66d06 req-7af2d952-b4f4-4e01-8697-395c81ad8288 service nova] Lock "271adc7b-bfc6-48c5-8700-69b2b079ce4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:08:58 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d416ed29-542d-42dd-8ab8-61be7ee66d06 req-7af2d952-b4f4-4e01-8697-395c81ad8288 service nova] Lock "271adc7b-bfc6-48c5-8700-69b2b079ce4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:08:58 user nova-compute[103546]: DEBUG nova.compute.manager [req-d416ed29-542d-42dd-8ab8-61be7ee66d06 req-7af2d952-b4f4-4e01-8697-395c81ad8288 service nova] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] No waiting events found dispatching network-vif-plugged-30eba06b-aff6-43cf-b792-7624b1bc12a9 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:08:58 user nova-compute[103546]: WARNING nova.compute.manager [req-d416ed29-542d-42dd-8ab8-61be7ee66d06 req-7af2d952-b4f4-4e01-8697-395c81ad8288 service nova] [instance: 271adc7b-bfc6-48c5-8700-69b2b079ce4b] Received unexpected event network-vif-plugged-30eba06b-aff6-43cf-b792-7624b1bc12a9 for instance with vm_state deleted and task_state None.
Nov 16 04:08:59 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:08:59 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-62bcc0a8-531b-4589-a279-b3de833947f5 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:08:59 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-62bcc0a8-531b-4589-a279-b3de833947f5 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:08:59 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-62bcc0a8-531b-4589-a279-b3de833947f5 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.336s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:08:59 user nova-compute[103546]: INFO nova.scheduler.client.report [None req-62bcc0a8-531b-4589-a279-b3de833947f5 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Deleted allocations for instance 271adc7b-bfc6-48c5-8700-69b2b079ce4b
Nov 16 04:08:59 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-62bcc0a8-531b-4589-a279-b3de833947f5 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "271adc7b-bfc6-48c5-8700-69b2b079ce4b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.957s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:08:59 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:08:59 user nova-compute[103546]: INFO nova.compute.manager [-] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Took 0.67 seconds to deallocate network for instance.
Nov 16 04:08:59 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-7fe26077-d129-4695-994c-e896a84dad42 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:08:59 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-7fe26077-d129-4695-994c-e896a84dad42 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:08:59 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-7fe26077-d129-4695-994c-e896a84dad42 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:08:59 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-7fe26077-d129-4695-994c-e896a84dad42 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:08:59 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-7fe26077-d129-4695-994c-e896a84dad42 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.337s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:08:59 user nova-compute[103546]: INFO nova.scheduler.client.report [None req-7fe26077-d129-4695-994c-e896a84dad42 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Deleted allocations for instance b0a480de-e99b-4b54-bd81-36c216442137
Nov 16 04:08:59 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-7fe26077-d129-4695-994c-e896a84dad42 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "b0a480de-e99b-4b54-bd81-36c216442137" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.856s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:09:00 user nova-compute[103546]: DEBUG nova.compute.manager [req-485ae130-893a-4c5b-ba90-76d55ecfd202 req-5d924cdc-e4a3-474b-9e29-f6730399a20d service nova] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Received event network-vif-unplugged-804319c6-55cb-4f30-908c-71817934fb45 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:09:00 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-485ae130-893a-4c5b-ba90-76d55ecfd202 req-5d924cdc-e4a3-474b-9e29-f6730399a20d service nova] Acquiring lock "b0a480de-e99b-4b54-bd81-36c216442137-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:09:00 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-485ae130-893a-4c5b-ba90-76d55ecfd202 req-5d924cdc-e4a3-474b-9e29-f6730399a20d service nova] Lock "b0a480de-e99b-4b54-bd81-36c216442137-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:09:00 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-485ae130-893a-4c5b-ba90-76d55ecfd202 req-5d924cdc-e4a3-474b-9e29-f6730399a20d service nova] Lock "b0a480de-e99b-4b54-bd81-36c216442137-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:09:00 user nova-compute[103546]: DEBUG nova.compute.manager [req-485ae130-893a-4c5b-ba90-76d55ecfd202 req-5d924cdc-e4a3-474b-9e29-f6730399a20d service nova] [instance: b0a480de-e99b-4b54-bd81-36c216442137] No waiting events found dispatching network-vif-unplugged-804319c6-55cb-4f30-908c-71817934fb45 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:09:00 user nova-compute[103546]: WARNING nova.compute.manager [req-485ae130-893a-4c5b-ba90-76d55ecfd202 req-5d924cdc-e4a3-474b-9e29-f6730399a20d service nova] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Received unexpected event network-vif-unplugged-804319c6-55cb-4f30-908c-71817934fb45 for instance with vm_state deleted and task_state None.
Nov 16 04:09:00 user nova-compute[103546]: DEBUG nova.compute.manager [req-485ae130-893a-4c5b-ba90-76d55ecfd202 req-5d924cdc-e4a3-474b-9e29-f6730399a20d service nova] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Received event network-vif-plugged-804319c6-55cb-4f30-908c-71817934fb45 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:09:00 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-485ae130-893a-4c5b-ba90-76d55ecfd202 req-5d924cdc-e4a3-474b-9e29-f6730399a20d service nova] Acquiring lock "b0a480de-e99b-4b54-bd81-36c216442137-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:09:00 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-485ae130-893a-4c5b-ba90-76d55ecfd202 req-5d924cdc-e4a3-474b-9e29-f6730399a20d service nova] Lock "b0a480de-e99b-4b54-bd81-36c216442137-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:09:00 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-485ae130-893a-4c5b-ba90-76d55ecfd202 req-5d924cdc-e4a3-474b-9e29-f6730399a20d service nova] Lock "b0a480de-e99b-4b54-bd81-36c216442137-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:09:00 user nova-compute[103546]: DEBUG nova.compute.manager [req-485ae130-893a-4c5b-ba90-76d55ecfd202 req-5d924cdc-e4a3-474b-9e29-f6730399a20d service nova] [instance: b0a480de-e99b-4b54-bd81-36c216442137] No waiting events found dispatching network-vif-plugged-804319c6-55cb-4f30-908c-71817934fb45 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:09:00 user nova-compute[103546]: WARNING nova.compute.manager [req-485ae130-893a-4c5b-ba90-76d55ecfd202 req-5d924cdc-e4a3-474b-9e29-f6730399a20d service nova] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Received unexpected event network-vif-plugged-804319c6-55cb-4f30-908c-71817934fb45 for instance with vm_state deleted and task_state None.
Nov 16 04:09:00 user nova-compute[103546]: DEBUG nova.compute.manager [req-485ae130-893a-4c5b-ba90-76d55ecfd202 req-5d924cdc-e4a3-474b-9e29-f6730399a20d service nova] [instance: b0a480de-e99b-4b54-bd81-36c216442137] Received event network-vif-deleted-804319c6-55cb-4f30-908c-71817934fb45 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:09:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:09:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:09:09 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-25b78948-c1e4-450d-90d2-61996727657f tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Acquiring lock "182b9697-e7da-4487-b0c1-889c1f655b95" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:09:09 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-25b78948-c1e4-450d-90d2-61996727657f tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "182b9697-e7da-4487-b0c1-889c1f655b95" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:09:09 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-25b78948-c1e4-450d-90d2-61996727657f tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Acquiring lock "182b9697-e7da-4487-b0c1-889c1f655b95-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:09:09 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-25b78948-c1e4-450d-90d2-61996727657f tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "182b9697-e7da-4487-b0c1-889c1f655b95-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:09:09 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-25b78948-c1e4-450d-90d2-61996727657f tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "182b9697-e7da-4487-b0c1-889c1f655b95-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:09:09 user nova-compute[103546]: INFO nova.compute.manager [None req-25b78948-c1e4-450d-90d2-61996727657f tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Terminating instance
Nov 16 04:09:09 user nova-compute[103546]: DEBUG nova.compute.manager [None req-25b78948-c1e4-450d-90d2-61996727657f tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Start destroying the instance on the hypervisor. {{(pid=103546) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 04:09:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:09:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:09:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:09:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:09:09 user nova-compute[103546]: DEBUG nova.compute.manager [req-7bacc0e4-5b08-40e5-9a01-f231e5374f7b req-a25037f9-76f4-4a1e-9f5f-0fee0dad469c service nova] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Received event network-vif-unplugged-66a12f44-bc2f-4574-916f-722fb04e7441 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:09:09 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-7bacc0e4-5b08-40e5-9a01-f231e5374f7b req-a25037f9-76f4-4a1e-9f5f-0fee0dad469c service nova] Acquiring lock "182b9697-e7da-4487-b0c1-889c1f655b95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:09:09 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-7bacc0e4-5b08-40e5-9a01-f231e5374f7b req-a25037f9-76f4-4a1e-9f5f-0fee0dad469c service nova] Lock "182b9697-e7da-4487-b0c1-889c1f655b95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:09:09 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-7bacc0e4-5b08-40e5-9a01-f231e5374f7b req-a25037f9-76f4-4a1e-9f5f-0fee0dad469c service nova] Lock "182b9697-e7da-4487-b0c1-889c1f655b95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:09:09 user nova-compute[103546]: DEBUG nova.compute.manager [req-7bacc0e4-5b08-40e5-9a01-f231e5374f7b req-a25037f9-76f4-4a1e-9f5f-0fee0dad469c service nova] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] No waiting events found dispatching network-vif-unplugged-66a12f44-bc2f-4574-916f-722fb04e7441 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:09:09 user nova-compute[103546]: DEBUG nova.compute.manager [req-7bacc0e4-5b08-40e5-9a01-f231e5374f7b req-a25037f9-76f4-4a1e-9f5f-0fee0dad469c service nova] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Received event network-vif-unplugged-66a12f44-bc2f-4574-916f-722fb04e7441 for instance with task_state deleting. {{(pid=103546) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 04:09:10 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:09:10 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:09:10 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:09:10 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Instance destroyed successfully.
Nov 16 04:09:10 user nova-compute[103546]: DEBUG nova.objects.instance [None req-25b78948-c1e4-450d-90d2-61996727657f tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lazy-loading 'resources' on Instance uuid 182b9697-e7da-4487-b0c1-889c1f655b95 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:09:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-25b78948-c1e4-450d-90d2-61996727657f tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:06:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1102350148',display_name='tempest-AttachVolumeNegativeTest-server-1102350148',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1102350148',id=43,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB+y3vM7znqwgCAFgA79Sf61LdeFXccsUMLYw1EvxwZgs4Z+dN6Ep2MPXZZKftSQc0q1d9IYN8NPyJvUK3xZmCZr67rOZf5bFjo5FyzKV95MI/ijmrL5+gM/BFvIA0iMIQ==',key_name='tempest-keypair-1529737572',keypairs=<?>,launch_index=0,launched_at=2023-11-16T04:06:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8e30b7ac9515458aa8a6eb1a34cc543a',ramdisk_id='',reservation_id='r-uly08vr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-64216432',owner_user_name='tempest-AttachVolumeNegativeTest-64216432-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T04:06:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d186163bddc48319b97f186f7c65e80',uuid=182b9697-e7da-4487-b0c1-889c1f655b95,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "66a12f44-bc2f-4574-916f-722fb04e7441", "address": "fa:16:3e:5e:e2:36", "network": {"id": "6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038318316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e30b7ac9515458aa8a6eb1a34cc543a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a12f44-bc", "ovs_interfaceid": "66a12f44-bc2f-4574-916f-722fb04e7441", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 04:09:10 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-25b78948-c1e4-450d-90d2-61996727657f tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Converting VIF {"id": "66a12f44-bc2f-4574-916f-722fb04e7441", "address": "fa:16:3e:5e:e2:36", "network": {"id": "6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038318316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e30b7ac9515458aa8a6eb1a34cc543a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a12f44-bc", "ovs_interfaceid": "66a12f44-bc2f-4574-916f-722fb04e7441", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:09:10 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-25b78948-c1e4-450d-90d2-61996727657f tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:e2:36,bridge_name='br-int',has_traffic_filtering=True,id=66a12f44-bc2f-4574-916f-722fb04e7441,network=Network(6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66a12f44-bc') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:09:10 user nova-compute[103546]: DEBUG os_vif [None req-25b78948-c1e4-450d-90d2-61996727657f tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:e2:36,bridge_name='br-int',has_traffic_filtering=True,id=66a12f44-bc2f-4574-916f-722fb04e7441,network=Network(6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66a12f44-bc') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 04:09:10 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:09:10 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap66a12f44-bc, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:09:10 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:09:10 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:09:10 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:09:10 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b39ce813-2418-4d7b-8a90-7b46830e4dfd) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:09:10 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:09:10 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:09:10 user nova-compute[103546]: INFO os_vif [None req-25b78948-c1e4-450d-90d2-61996727657f tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:e2:36,bridge_name='br-int',has_traffic_filtering=True,id=66a12f44-bc2f-4574-916f-722fb04e7441,network=Network(6ec6fdd0-c5b5-49b9-a71f-8c7fc726f800),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66a12f44-bc')
Nov 16 04:09:10 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-25b78948-c1e4-450d-90d2-61996727657f tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Deleting instance files /opt/stack/data/nova/instances/182b9697-e7da-4487-b0c1-889c1f655b95_del
Nov 16 04:09:10 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-25b78948-c1e4-450d-90d2-61996727657f tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Deletion of /opt/stack/data/nova/instances/182b9697-e7da-4487-b0c1-889c1f655b95_del complete
Nov 16 04:09:10 user nova-compute[103546]: INFO nova.compute.manager [None req-25b78948-c1e4-450d-90d2-61996727657f tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 16 04:09:10 user nova-compute[103546]: DEBUG oslo.service.loopingcall [None req-25b78948-c1e4-450d-90d2-61996727657f tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=103546) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 04:09:10 user nova-compute[103546]: DEBUG nova.compute.manager [-] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Deallocating network for instance {{(pid=103546) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 04:09:10 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] deallocate_for_instance() {{(pid=103546) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 04:09:10 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:09:10 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:09:10 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:09:11 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:09:11 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:09:11 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:09:11 user nova-compute[103546]: INFO nova.compute.manager [-] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Took 1.13 seconds to deallocate network for instance.
Nov 16 04:09:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-25b78948-c1e4-450d-90d2-61996727657f tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:09:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-25b78948-c1e4-450d-90d2-61996727657f tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:09:11 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-25b78948-c1e4-450d-90d2-61996727657f tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:09:11 user nova-compute[103546]: DEBUG nova.compute.manager [req-00fafdc1-5434-4581-b7f0-c7f27085fc41 req-0f535763-202b-49c6-a0e0-7a4813808a46 service nova] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Received event network-vif-plugged-66a12f44-bc2f-4574-916f-722fb04e7441 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:09:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-00fafdc1-5434-4581-b7f0-c7f27085fc41 req-0f535763-202b-49c6-a0e0-7a4813808a46 service nova] Acquiring lock "182b9697-e7da-4487-b0c1-889c1f655b95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:09:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-00fafdc1-5434-4581-b7f0-c7f27085fc41 req-0f535763-202b-49c6-a0e0-7a4813808a46 service nova] Lock "182b9697-e7da-4487-b0c1-889c1f655b95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:09:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-00fafdc1-5434-4581-b7f0-c7f27085fc41 req-0f535763-202b-49c6-a0e0-7a4813808a46 service nova] Lock "182b9697-e7da-4487-b0c1-889c1f655b95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:09:11 user nova-compute[103546]: DEBUG nova.compute.manager [req-00fafdc1-5434-4581-b7f0-c7f27085fc41 req-0f535763-202b-49c6-a0e0-7a4813808a46 service nova] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] No waiting events found dispatching network-vif-plugged-66a12f44-bc2f-4574-916f-722fb04e7441 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:09:11 user nova-compute[103546]: WARNING nova.compute.manager [req-00fafdc1-5434-4581-b7f0-c7f27085fc41 req-0f535763-202b-49c6-a0e0-7a4813808a46 service nova] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Received unexpected event network-vif-plugged-66a12f44-bc2f-4574-916f-722fb04e7441 for instance with vm_state deleted and task_state None.
Nov 16 04:09:11 user nova-compute[103546]: DEBUG nova.compute.manager [req-00fafdc1-5434-4581-b7f0-c7f27085fc41 req-0f535763-202b-49c6-a0e0-7a4813808a46 service nova] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Received event network-vif-plugged-66a12f44-bc2f-4574-916f-722fb04e7441 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:09:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-00fafdc1-5434-4581-b7f0-c7f27085fc41 req-0f535763-202b-49c6-a0e0-7a4813808a46 service nova] Acquiring lock "182b9697-e7da-4487-b0c1-889c1f655b95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:09:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-00fafdc1-5434-4581-b7f0-c7f27085fc41 req-0f535763-202b-49c6-a0e0-7a4813808a46 service nova] Lock "182b9697-e7da-4487-b0c1-889c1f655b95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:09:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-00fafdc1-5434-4581-b7f0-c7f27085fc41 req-0f535763-202b-49c6-a0e0-7a4813808a46 service nova] Lock "182b9697-e7da-4487-b0c1-889c1f655b95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:09:11 user nova-compute[103546]: DEBUG nova.compute.manager [req-00fafdc1-5434-4581-b7f0-c7f27085fc41 req-0f535763-202b-49c6-a0e0-7a4813808a46 service nova] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] No waiting events found dispatching network-vif-plugged-66a12f44-bc2f-4574-916f-722fb04e7441 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:09:11 user nova-compute[103546]: WARNING nova.compute.manager [req-00fafdc1-5434-4581-b7f0-c7f27085fc41 req-0f535763-202b-49c6-a0e0-7a4813808a46 service nova] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Received unexpected event network-vif-plugged-66a12f44-bc2f-4574-916f-722fb04e7441 for instance with vm_state deleted and task_state None.
Nov 16 04:09:11 user nova-compute[103546]: DEBUG nova.compute.manager [req-00fafdc1-5434-4581-b7f0-c7f27085fc41 req-0f535763-202b-49c6-a0e0-7a4813808a46 service nova] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Received event network-vif-plugged-66a12f44-bc2f-4574-916f-722fb04e7441 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:09:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-00fafdc1-5434-4581-b7f0-c7f27085fc41 req-0f535763-202b-49c6-a0e0-7a4813808a46 service nova] Acquiring lock "182b9697-e7da-4487-b0c1-889c1f655b95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:09:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-00fafdc1-5434-4581-b7f0-c7f27085fc41 req-0f535763-202b-49c6-a0e0-7a4813808a46 service nova] Lock "182b9697-e7da-4487-b0c1-889c1f655b95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:09:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-00fafdc1-5434-4581-b7f0-c7f27085fc41 req-0f535763-202b-49c6-a0e0-7a4813808a46 service nova] Lock "182b9697-e7da-4487-b0c1-889c1f655b95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:09:11 user nova-compute[103546]: DEBUG nova.compute.manager [req-00fafdc1-5434-4581-b7f0-c7f27085fc41 req-0f535763-202b-49c6-a0e0-7a4813808a46 service nova] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] No waiting events found dispatching network-vif-plugged-66a12f44-bc2f-4574-916f-722fb04e7441 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:09:11 user nova-compute[103546]: WARNING nova.compute.manager [req-00fafdc1-5434-4581-b7f0-c7f27085fc41 req-0f535763-202b-49c6-a0e0-7a4813808a46 service nova] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Received unexpected event network-vif-plugged-66a12f44-bc2f-4574-916f-722fb04e7441 for instance with vm_state deleted and task_state None.
Nov 16 04:09:11 user nova-compute[103546]: DEBUG nova.compute.manager [req-00fafdc1-5434-4581-b7f0-c7f27085fc41 req-0f535763-202b-49c6-a0e0-7a4813808a46 service nova] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Received event network-vif-unplugged-66a12f44-bc2f-4574-916f-722fb04e7441 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:09:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-00fafdc1-5434-4581-b7f0-c7f27085fc41 req-0f535763-202b-49c6-a0e0-7a4813808a46 service nova] Acquiring lock "182b9697-e7da-4487-b0c1-889c1f655b95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:09:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-00fafdc1-5434-4581-b7f0-c7f27085fc41 req-0f535763-202b-49c6-a0e0-7a4813808a46 service nova] Lock "182b9697-e7da-4487-b0c1-889c1f655b95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:09:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-00fafdc1-5434-4581-b7f0-c7f27085fc41 req-0f535763-202b-49c6-a0e0-7a4813808a46 service nova] Lock "182b9697-e7da-4487-b0c1-889c1f655b95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:09:11 user nova-compute[103546]: DEBUG nova.compute.manager [req-00fafdc1-5434-4581-b7f0-c7f27085fc41 req-0f535763-202b-49c6-a0e0-7a4813808a46 service nova] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] No waiting events found dispatching network-vif-unplugged-66a12f44-bc2f-4574-916f-722fb04e7441 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:09:11 user nova-compute[103546]: WARNING nova.compute.manager [req-00fafdc1-5434-4581-b7f0-c7f27085fc41 req-0f535763-202b-49c6-a0e0-7a4813808a46 service nova] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Received unexpected event network-vif-unplugged-66a12f44-bc2f-4574-916f-722fb04e7441 for instance with vm_state deleted and task_state None.
Nov 16 04:09:11 user nova-compute[103546]: DEBUG nova.compute.manager [req-00fafdc1-5434-4581-b7f0-c7f27085fc41 req-0f535763-202b-49c6-a0e0-7a4813808a46 service nova] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Received event network-vif-plugged-66a12f44-bc2f-4574-916f-722fb04e7441 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:09:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-00fafdc1-5434-4581-b7f0-c7f27085fc41 req-0f535763-202b-49c6-a0e0-7a4813808a46 service nova] Acquiring lock "182b9697-e7da-4487-b0c1-889c1f655b95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:09:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-00fafdc1-5434-4581-b7f0-c7f27085fc41 req-0f535763-202b-49c6-a0e0-7a4813808a46 service nova] Lock "182b9697-e7da-4487-b0c1-889c1f655b95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:09:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-00fafdc1-5434-4581-b7f0-c7f27085fc41 req-0f535763-202b-49c6-a0e0-7a4813808a46 service nova] Lock "182b9697-e7da-4487-b0c1-889c1f655b95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:09:11 user nova-compute[103546]: DEBUG nova.compute.manager [req-00fafdc1-5434-4581-b7f0-c7f27085fc41 req-0f535763-202b-49c6-a0e0-7a4813808a46 service nova] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] No waiting events found dispatching network-vif-plugged-66a12f44-bc2f-4574-916f-722fb04e7441 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:09:11 user nova-compute[103546]: WARNING nova.compute.manager [req-00fafdc1-5434-4581-b7f0-c7f27085fc41 req-0f535763-202b-49c6-a0e0-7a4813808a46 service nova] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Received unexpected event network-vif-plugged-66a12f44-bc2f-4574-916f-722fb04e7441 for instance with vm_state deleted and task_state None.
Nov 16 04:09:11 user nova-compute[103546]: DEBUG nova.compute.manager [req-00fafdc1-5434-4581-b7f0-c7f27085fc41 req-0f535763-202b-49c6-a0e0-7a4813808a46 service nova] [instance: 182b9697-e7da-4487-b0c1-889c1f655b95] Received event network-vif-deleted-66a12f44-bc2f-4574-916f-722fb04e7441 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:09:11 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-25b78948-c1e4-450d-90d2-61996727657f tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:09:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-25b78948-c1e4-450d-90d2-61996727657f tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.306s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:09:12 user nova-compute[103546]: INFO nova.scheduler.client.report [None req-25b78948-c1e4-450d-90d2-61996727657f tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Deleted allocations for instance 182b9697-e7da-4487-b0c1-889c1f655b95
Nov 16 04:09:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-25b78948-c1e4-450d-90d2-61996727657f tempest-AttachVolumeNegativeTest-64216432 tempest-AttachVolumeNegativeTest-64216432-project-member] Lock "182b9697-e7da-4487-b0c1-889c1f655b95" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.502s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:09:15 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:09:20 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:09:24 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-5c167a51-5e87-427a-9762-51e639f5c754 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Acquiring lock "9a89970b-fc61-4419-8ff9-b48013dccf9f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:09:24 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-5c167a51-5e87-427a-9762-51e639f5c754 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "9a89970b-fc61-4419-8ff9-b48013dccf9f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:09:24 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-5c167a51-5e87-427a-9762-51e639f5c754 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Acquiring lock "9a89970b-fc61-4419-8ff9-b48013dccf9f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:09:24 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-5c167a51-5e87-427a-9762-51e639f5c754 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "9a89970b-fc61-4419-8ff9-b48013dccf9f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:09:24 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-5c167a51-5e87-427a-9762-51e639f5c754 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "9a89970b-fc61-4419-8ff9-b48013dccf9f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:09:24 user nova-compute[103546]: INFO nova.compute.manager [None req-5c167a51-5e87-427a-9762-51e639f5c754 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Terminating instance
Nov 16 04:09:24 user nova-compute[103546]: DEBUG nova.compute.manager [None req-5c167a51-5e87-427a-9762-51e639f5c754 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Start destroying the instance on the hypervisor. {{(pid=103546) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 04:09:24 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:09:24 user nova-compute[103546]: DEBUG nova.compute.manager [req-e400999d-d5a9-4292-9036-fec7d4e0bc9a req-d3e92b7f-b4b7-4ecd-a17c-96bd7e9bc639 service nova] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Received event network-changed-96edd323-af11-4e10-a7bb-a6e0d0ea12ff {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:09:24 user nova-compute[103546]: DEBUG nova.compute.manager [req-e400999d-d5a9-4292-9036-fec7d4e0bc9a req-d3e92b7f-b4b7-4ecd-a17c-96bd7e9bc639 service nova] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Refreshing instance network info cache due to event network-changed-96edd323-af11-4e10-a7bb-a6e0d0ea12ff. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 04:09:24 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-e400999d-d5a9-4292-9036-fec7d4e0bc9a req-d3e92b7f-b4b7-4ecd-a17c-96bd7e9bc639 service nova] Acquiring lock "refresh_cache-8c02873d-469e-41a4-b492-69f793c8a07c" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:09:24 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-e400999d-d5a9-4292-9036-fec7d4e0bc9a req-d3e92b7f-b4b7-4ecd-a17c-96bd7e9bc639 service nova] Acquired lock "refresh_cache-8c02873d-469e-41a4-b492-69f793c8a07c" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:09:24 user nova-compute[103546]: DEBUG nova.network.neutron [req-e400999d-d5a9-4292-9036-fec7d4e0bc9a req-d3e92b7f-b4b7-4ecd-a17c-96bd7e9bc639 service nova] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Refreshing network info cache for port 96edd323-af11-4e10-a7bb-a6e0d0ea12ff {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 04:09:24 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:09:24 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:09:24 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:09:24 user nova-compute[103546]: DEBUG nova.compute.manager [req-37a607d8-45aa-4825-9369-353222bcb295 req-0aae1831-d8cb-4ea7-ab27-f0cfe443ef61 service nova] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Received event network-vif-unplugged-5f4e3564-4185-44d2-93f6-2e3803aaf0f8 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:09:24 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-37a607d8-45aa-4825-9369-353222bcb295 req-0aae1831-d8cb-4ea7-ab27-f0cfe443ef61 service nova] Acquiring lock "9a89970b-fc61-4419-8ff9-b48013dccf9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:09:24 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-37a607d8-45aa-4825-9369-353222bcb295 req-0aae1831-d8cb-4ea7-ab27-f0cfe443ef61 service nova] Lock "9a89970b-fc61-4419-8ff9-b48013dccf9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:09:24 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-37a607d8-45aa-4825-9369-353222bcb295 req-0aae1831-d8cb-4ea7-ab27-f0cfe443ef61 service nova] Lock "9a89970b-fc61-4419-8ff9-b48013dccf9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:09:24 user nova-compute[103546]: DEBUG nova.compute.manager [req-37a607d8-45aa-4825-9369-353222bcb295 req-0aae1831-d8cb-4ea7-ab27-f0cfe443ef61 service nova] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] No waiting events found dispatching network-vif-unplugged-5f4e3564-4185-44d2-93f6-2e3803aaf0f8 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:09:24 user nova-compute[103546]: DEBUG nova.compute.manager [req-37a607d8-45aa-4825-9369-353222bcb295 req-0aae1831-d8cb-4ea7-ab27-f0cfe443ef61 service nova] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Received event network-vif-unplugged-5f4e3564-4185-44d2-93f6-2e3803aaf0f8 for instance with task_state deleting. {{(pid=103546) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 04:09:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e8382d6d-eefd-4689-88bb-c120de272fc1 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Acquiring lock "8c02873d-469e-41a4-b492-69f793c8a07c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:09:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e8382d6d-eefd-4689-88bb-c120de272fc1 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "8c02873d-469e-41a4-b492-69f793c8a07c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:09:25 user nova-compute[103546]: INFO nova.compute.manager [None req-e8382d6d-eefd-4689-88bb-c120de272fc1 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Detaching volume 0faa59c5-ad97-4132-85ec-1f0101db20cb
Nov 16 04:09:25 user nova-compute[103546]: INFO nova.virt.block_device [None req-e8382d6d-eefd-4689-88bb-c120de272fc1 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Attempting to driver detach volume 0faa59c5-ad97-4132-85ec-1f0101db20cb from mountpoint /dev/vdb
Nov 16 04:09:25 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-e8382d6d-eefd-4689-88bb-c120de272fc1 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Attempting to detach device vdb from instance 8c02873d-469e-41a4-b492-69f793c8a07c from the persistent domain config. {{(pid=103546) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 04:09:25 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-e8382d6d-eefd-4689-88bb-c120de272fc1 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 04:09:25 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:09:25 user nova-compute[103546]:   <source dev="/dev/sdd"/>
Nov 16 04:09:25 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 04:09:25 user nova-compute[103546]:   <serial>0faa59c5-ad97-4132-85ec-1f0101db20cb</serial>
Nov 16 04:09:25 user nova-compute[103546]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 04:09:25 user nova-compute[103546]: </disk>
Nov 16 04:09:25 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 04:09:25 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-e8382d6d-eefd-4689-88bb-c120de272fc1 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Successfully detached device vdb from instance 8c02873d-469e-41a4-b492-69f793c8a07c from the persistent domain config.
Nov 16 04:09:25 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-e8382d6d-eefd-4689-88bb-c120de272fc1 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8c02873d-469e-41a4-b492-69f793c8a07c from the live domain config. {{(pid=103546) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 04:09:25 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-e8382d6d-eefd-4689-88bb-c120de272fc1 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 04:09:25 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:09:25 user nova-compute[103546]:   <source dev="/dev/sdd"/>
Nov 16 04:09:25 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 04:09:25 user nova-compute[103546]:   <serial>0faa59c5-ad97-4132-85ec-1f0101db20cb</serial>
Nov 16 04:09:25 user nova-compute[103546]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 04:09:25 user nova-compute[103546]: </disk>
Nov 16 04:09:25 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 04:09:25 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Instance destroyed successfully.
Nov 16 04:09:25 user nova-compute[103546]: DEBUG nova.objects.instance [None req-5c167a51-5e87-427a-9762-51e639f5c754 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lazy-loading 'resources' on Instance uuid 9a89970b-fc61-4419-8ff9-b48013dccf9f {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:09:25 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-5c167a51-5e87-427a-9762-51e639f5c754 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:50:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-935129415',display_name='tempest-ServerActionsTestOtherA-server-935129415',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-935129415',id=14,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJeuDielSI+1QllPRU8TUZPfRtLhxXlgqD+oFHNsy0a0jxMp9PNqxCpWdXKas+7wQ5fSoPylsuLGE6eRSK8cr/wsGQFy4MbHJizJ+GnVBc6KD3RZeGBoD7tDLXSKWjtJbw==',key_name='tempest-keypair-205381596',keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:50:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72b30a015db444798ee72ff6fd14c69e',ramdisk_id='',reservation_id='r-1550z15x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1488667220',owner_user_name='tempest-ServerActionsTestOtherA-1488667220-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T03:50:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e471c69657c745bbbdfc82307a49946f',uuid=9a89970b-fc61-4419-8ff9-b48013dccf9f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f4e3564-4185-44d2-93f6-2e3803aaf0f8", "address": "fa:16:3e:56:e2:fb", "network": {"id": "29e9620f-313d-4679-89d7-459e7cf75b38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1690634205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72b30a015db444798ee72ff6fd14c69e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f4e3564-41", "ovs_interfaceid": "5f4e3564-4185-44d2-93f6-2e3803aaf0f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 04:09:25 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-5c167a51-5e87-427a-9762-51e639f5c754 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Converting VIF {"id": "5f4e3564-4185-44d2-93f6-2e3803aaf0f8", "address": "fa:16:3e:56:e2:fb", "network": {"id": "29e9620f-313d-4679-89d7-459e7cf75b38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1690634205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72b30a015db444798ee72ff6fd14c69e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f4e3564-41", "ovs_interfaceid": "5f4e3564-4185-44d2-93f6-2e3803aaf0f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:09:25 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-5c167a51-5e87-427a-9762-51e639f5c754 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:56:e2:fb,bridge_name='br-int',has_traffic_filtering=True,id=5f4e3564-4185-44d2-93f6-2e3803aaf0f8,network=Network(29e9620f-313d-4679-89d7-459e7cf75b38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f4e3564-41') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:09:25 user nova-compute[103546]: DEBUG os_vif [None req-5c167a51-5e87-427a-9762-51e639f5c754 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:e2:fb,bridge_name='br-int',has_traffic_filtering=True,id=5f4e3564-4185-44d2-93f6-2e3803aaf0f8,network=Network(29e9620f-313d-4679-89d7-459e7cf75b38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f4e3564-41') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 04:09:25 user nova-compute[103546]: DEBUG nova.network.neutron [req-e400999d-d5a9-4292-9036-fec7d4e0bc9a req-d3e92b7f-b4b7-4ecd-a17c-96bd7e9bc639 service nova] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Updated VIF entry in instance network info cache for port 96edd323-af11-4e10-a7bb-a6e0d0ea12ff. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 04:09:25 user nova-compute[103546]: DEBUG nova.network.neutron [req-e400999d-d5a9-4292-9036-fec7d4e0bc9a req-d3e92b7f-b4b7-4ecd-a17c-96bd7e9bc639 service nova] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Updating instance_info_cache with network_info: [{"id": "96edd323-af11-4e10-a7bb-a6e0d0ea12ff", "address": "fa:16:3e:5a:5c:31", "network": {"id": "337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-40560053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca049d5674dc4c59814f98478752d73d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96edd323-af", "ovs_interfaceid": "96edd323-af11-4e10-a7bb-a6e0d0ea12ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:09:25 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:09:25 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5f4e3564-41, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:09:25 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:09:25 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:09:25 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=52967c1d-4507-4228-9ee2-585b5f4fff71) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:09:25 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:09:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-e400999d-d5a9-4292-9036-fec7d4e0bc9a req-d3e92b7f-b4b7-4ecd-a17c-96bd7e9bc639 service nova] Releasing lock "refresh_cache-8c02873d-469e-41a4-b492-69f793c8a07c" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:09:25 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:09:25 user nova-compute[103546]: INFO os_vif [None req-5c167a51-5e87-427a-9762-51e639f5c754 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:e2:fb,bridge_name='br-int',has_traffic_filtering=True,id=5f4e3564-4185-44d2-93f6-2e3803aaf0f8,network=Network(29e9620f-313d-4679-89d7-459e7cf75b38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f4e3564-41')
Nov 16 04:09:25 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-5c167a51-5e87-427a-9762-51e639f5c754 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Deleting instance files /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f_del
Nov 16 04:09:25 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-5c167a51-5e87-427a-9762-51e639f5c754 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Deletion of /opt/stack/data/nova/instances/9a89970b-fc61-4419-8ff9-b48013dccf9f_del complete
Nov 16 04:09:25 user nova-compute[103546]: INFO nova.compute.manager [None req-5c167a51-5e87-427a-9762-51e639f5c754 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 16 04:09:25 user nova-compute[103546]: DEBUG oslo.service.loopingcall [None req-5c167a51-5e87-427a-9762-51e639f5c754 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=103546) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 04:09:25 user nova-compute[103546]: DEBUG nova.compute.manager [-] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Deallocating network for instance {{(pid=103546) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 04:09:25 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] deallocate_for_instance() {{(pid=103546) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 04:09:25 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-e8382d6d-eefd-4689-88bb-c120de272fc1 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8c02873d-469e-41a4-b492-69f793c8a07c {{(pid=103546) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 04:09:25 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:09:25 user nova-compute[103546]: INFO nova.compute.manager [-] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Took 0.42 seconds to deallocate network for instance.
Nov 16 04:09:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-5c167a51-5e87-427a-9762-51e639f5c754 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:09:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-5c167a51-5e87-427a-9762-51e639f5c754 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:09:26 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-5c167a51-5e87-427a-9762-51e639f5c754 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:09:26 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-5c167a51-5e87-427a-9762-51e639f5c754 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:09:26 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-5c167a51-5e87-427a-9762-51e639f5c754 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.271s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:09:26 user nova-compute[103546]: INFO nova.scheduler.client.report [None req-5c167a51-5e87-427a-9762-51e639f5c754 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Deleted allocations for instance 9a89970b-fc61-4419-8ff9-b48013dccf9f
Nov 16 04:09:26 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-5c167a51-5e87-427a-9762-51e639f5c754 tempest-ServerActionsTestOtherA-1488667220 tempest-ServerActionsTestOtherA-1488667220-project-member] Lock "9a89970b-fc61-4419-8ff9-b48013dccf9f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.756s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:09:26 user nova-compute[103546]: DEBUG nova.compute.manager [req-a527f286-f0fb-4ed7-8696-9a3c70922ceb req-6ca32434-8747-4a90-9d56-98151bff7fb4 service nova] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Received event network-changed-96edd323-af11-4e10-a7bb-a6e0d0ea12ff {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:09:26 user nova-compute[103546]: DEBUG nova.compute.manager [req-a527f286-f0fb-4ed7-8696-9a3c70922ceb req-6ca32434-8747-4a90-9d56-98151bff7fb4 service nova] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Refreshing instance network info cache due to event network-changed-96edd323-af11-4e10-a7bb-a6e0d0ea12ff. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 04:09:26 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a527f286-f0fb-4ed7-8696-9a3c70922ceb req-6ca32434-8747-4a90-9d56-98151bff7fb4 service nova] Acquiring lock "refresh_cache-8c02873d-469e-41a4-b492-69f793c8a07c" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:09:26 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a527f286-f0fb-4ed7-8696-9a3c70922ceb req-6ca32434-8747-4a90-9d56-98151bff7fb4 service nova] Acquired lock "refresh_cache-8c02873d-469e-41a4-b492-69f793c8a07c" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:09:26 user nova-compute[103546]: DEBUG nova.network.neutron [req-a527f286-f0fb-4ed7-8696-9a3c70922ceb req-6ca32434-8747-4a90-9d56-98151bff7fb4 service nova] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Refreshing network info cache for port 96edd323-af11-4e10-a7bb-a6e0d0ea12ff {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 04:09:26 user nova-compute[103546]: DEBUG nova.compute.manager [req-24255b92-d9af-4f46-ba66-51e663058e70 req-7eee37b7-3538-4997-b590-c4efcdbf2161 service nova] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Received event network-vif-plugged-5f4e3564-4185-44d2-93f6-2e3803aaf0f8 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:09:26 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-24255b92-d9af-4f46-ba66-51e663058e70 req-7eee37b7-3538-4997-b590-c4efcdbf2161 service nova] Acquiring lock "9a89970b-fc61-4419-8ff9-b48013dccf9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:09:26 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-24255b92-d9af-4f46-ba66-51e663058e70 req-7eee37b7-3538-4997-b590-c4efcdbf2161 service nova] Lock "9a89970b-fc61-4419-8ff9-b48013dccf9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:09:26 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-24255b92-d9af-4f46-ba66-51e663058e70 req-7eee37b7-3538-4997-b590-c4efcdbf2161 service nova] Lock "9a89970b-fc61-4419-8ff9-b48013dccf9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:09:26 user nova-compute[103546]: DEBUG nova.compute.manager [req-24255b92-d9af-4f46-ba66-51e663058e70 req-7eee37b7-3538-4997-b590-c4efcdbf2161 service nova] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] No waiting events found dispatching network-vif-plugged-5f4e3564-4185-44d2-93f6-2e3803aaf0f8 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:09:26 user nova-compute[103546]: WARNING nova.compute.manager [req-24255b92-d9af-4f46-ba66-51e663058e70 req-7eee37b7-3538-4997-b590-c4efcdbf2161 service nova] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Received unexpected event network-vif-plugged-5f4e3564-4185-44d2-93f6-2e3803aaf0f8 for instance with vm_state deleted and task_state None.
Nov 16 04:09:27 user nova-compute[103546]: DEBUG nova.compute.manager [req-24255b92-d9af-4f46-ba66-51e663058e70 req-7eee37b7-3538-4997-b590-c4efcdbf2161 service nova] [instance: 9a89970b-fc61-4419-8ff9-b48013dccf9f] Received event network-vif-deleted-5f4e3564-4185-44d2-93f6-2e3803aaf0f8 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:09:27 user nova-compute[103546]: DEBUG nova.network.neutron [req-a527f286-f0fb-4ed7-8696-9a3c70922ceb req-6ca32434-8747-4a90-9d56-98151bff7fb4 service nova] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Updated VIF entry in instance network info cache for port 96edd323-af11-4e10-a7bb-a6e0d0ea12ff. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 04:09:27 user nova-compute[103546]: DEBUG nova.network.neutron [req-a527f286-f0fb-4ed7-8696-9a3c70922ceb req-6ca32434-8747-4a90-9d56-98151bff7fb4 service nova] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Updating instance_info_cache with network_info: [{"id": "96edd323-af11-4e10-a7bb-a6e0d0ea12ff", "address": "fa:16:3e:5a:5c:31", "network": {"id": "337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-40560053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca049d5674dc4c59814f98478752d73d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96edd323-af", "ovs_interfaceid": "96edd323-af11-4e10-a7bb-a6e0d0ea12ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:09:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a527f286-f0fb-4ed7-8696-9a3c70922ceb req-6ca32434-8747-4a90-9d56-98151bff7fb4 service nova] Releasing lock "refresh_cache-8c02873d-469e-41a4-b492-69f793c8a07c" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:09:27 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager.update_available_resource {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:09:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:09:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:09:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:09:27 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Auditing locally available compute resources for user (node: user) {{(pid=103546) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 04:09:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:09:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:09:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:09:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:09:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f7c407-3373-43ba-ac92-7eb0a43a7093/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:09:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f7c407-3373-43ba-ac92-7eb0a43a7093/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:09:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f7c407-3373-43ba-ac92-7eb0a43a7093/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:09:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f7c407-3373-43ba-ac92-7eb0a43a7093/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:09:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:09:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:09:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:09:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:09:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.rescue --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:09:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:09:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.rescue --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:09:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:09:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:09:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:09:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:09:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:09:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:09:29 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 04:09:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce616440-9d69-4812-8910-a2d9ad58f504/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:09:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce616440-9d69-4812-8910-a2d9ad58f504/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:09:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce616440-9d69-4812-8910-a2d9ad58f504/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:09:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce616440-9d69-4812-8910-a2d9ad58f504/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:09:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c02873d-469e-41a4-b492-69f793c8a07c/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:09:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c02873d-469e-41a4-b492-69f793c8a07c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:09:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c02873d-469e-41a4-b492-69f793c8a07c/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:09:30 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:09:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c02873d-469e-41a4-b492-69f793c8a07c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:09:30 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:09:30 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:09:30 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Hypervisor/Node resource view: name=user free_ram=8189MB free_disk=24.873580932617188GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=103546) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 04:09:30 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:09:30 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:09:30 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 04101512-7333-4581-add3-7af3821e335b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:09:30 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance fa7e5468-9dd4-407d-85ec-d45ec76f9e29 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:09:30 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 246ccf69-847c-4ab2-b709-ad1a85e81eab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:09:30 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 8d229d05-95f1-4997-8539-802ac65cff8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:09:30 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 38f7c407-3373-43ba-ac92-7eb0a43a7093 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:09:30 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 8c02873d-469e-41a4-b492-69f793c8a07c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:09:30 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance ce616440-9d69-4812-8910-a2d9ad58f504 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:09:30 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 04:09:30 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 04:09:31 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:09:31 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:09:31 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Compute_service record updated for user:user {{(pid=103546) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 04:09:31 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.427s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:09:32 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:09:32 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:09:32 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:09:32 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:09:32 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:09:32 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:09:32 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=103546) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 04:09:34 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:09:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:09:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:09:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=103546) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 04:09:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:09:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:09:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:09:36 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:09:36 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Starting heal instance info cache {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 04:09:36 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "refresh_cache-38f7c407-3373-43ba-ac92-7eb0a43a7093" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:09:36 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquired lock "refresh_cache-38f7c407-3373-43ba-ac92-7eb0a43a7093" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:09:36 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Forcefully refreshing network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 04:09:37 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Updating instance_info_cache with network_info: [{"id": "25f18a73-4153-41e2-a4e9-f5ce77367363", "address": "fa:16:3e:34:b9:ff", "network": {"id": "fdbb2d2c-9a54-4517-b33a-cf27ce7570b1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79661471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2a38a5eb514ce8a7569c8322657eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f18a73-41", "ovs_interfaceid": "25f18a73-4153-41e2-a4e9-f5ce77367363", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:09:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Releasing lock "refresh_cache-38f7c407-3373-43ba-ac92-7eb0a43a7093" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:09:37 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Updated the network info_cache for instance {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 04:09:40 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:09:45 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:09:45 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:09:45 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=103546) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 04:09:45 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:09:45 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:09:45 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:09:45 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-e8382d6d-eefd-4689-88bb-c120de272fc1 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8c02873d-469e-41a4-b492-69f793c8a07c is timed out.
Nov 16 04:09:45 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-e8382d6d-eefd-4689-88bb-c120de272fc1 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Successfully detached device vdb from instance 8c02873d-469e-41a4-b492-69f793c8a07c from the live domain config.
Nov 16 04:09:45 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8382d6d-eefd-4689-88bb-c120de272fc1 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 04:09:45 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8382d6d-eefd-4689-88bb-c120de272fc1 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VUZdLCXW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:09:45 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-e8382d6d-eefd-4689-88bb-c120de272fc1 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:09:45 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-e8382d6d-eefd-4689-88bb-c120de272fc1 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:09:45 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-e8382d6d-eefd-4689-88bb-c120de272fc1 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:09:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:09:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:09:45 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3388a965-c1c8-4a65-aa91-095c8270ca98]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:09:45 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8382d6d-eefd-4689-88bb-c120de272fc1 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 04:09:45 user nova-compute[103546]: No targets found.
Nov 16 04:09:45 user nova-compute[103546]: iSNS:
Nov 16 04:09:45 user nova-compute[103546]: No targets found.
Nov 16 04:09:45 user nova-compute[103546]: STATIC:
Nov 16 04:09:45 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4
Nov 16 04:09:45 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:09:45 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:09:45 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb
Nov 16 04:09:45 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:09:45 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:09:45 user nova-compute[103546]: FIRMWARE:
Nov 16 04:09:45 user nova-compute[103546]: No targets found.
Nov 16 04:09:45 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:09:45 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8382d6d-eefd-4689-88bb-c120de272fc1 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 04:09:45 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 04:09:45 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 04:09:45 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8382d6d-eefd-4689-88bb-c120de272fc1 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 04:09:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:09:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:09:45 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ced1227-033e-49d2-927f-c3fd7c45363a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:09:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:09:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:09:45 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd356593-fdf9-4094-8b51-42de3baef30d]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:09:45 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8382d6d-eefd-4689-88bb-c120de272fc1 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:09:45 user nova-compute[103546]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb (non-flash)
Nov 16 04:09:45 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:09:45 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8382d6d-eefd-4689-88bb-c120de272fc1 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:09:45 user nova-compute[103546]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb (non-flash)
Nov 16 04:09:45 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:09:45 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8382d6d-eefd-4689-88bb-c120de272fc1 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60d02bef80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb'): ({'sdd'}, set())}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 04:09:45 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-e8382d6d-eefd-4689-88bb-c120de272fc1 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Removing single pathed devices sdd {{(pid=103546) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 04:09:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:09:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:09:45 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5115d7a-1b2a-4188-8a0e-697ee2849b80]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:09:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:09:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:09:45 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[34346ac9-4486-4a2e-96e4-9d3c891a9ab9]: (4, ('ok\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:09:45 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-e8382d6d-eefd-4689-88bb-c120de272fc1 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Flushing IO for device /dev/sdd {{(pid=103546) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 04:09:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:09:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:09:45 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2aa5ee3-d0f2-4e9f-bfbf-cb16c2fdaa64]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:09:45 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-e8382d6d-eefd-4689-88bb-c120de272fc1 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=103546) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 04:09:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:09:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:09:45 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b8c8a3-690c-4072-8e16-486ea28e919c]: (4, ('1', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:09:45 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-e8382d6d-eefd-4689-88bb-c120de272fc1 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 04:09:45 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-e8382d6d-eefd-4689-88bb-c120de272fc1 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] SCSI volumes sdd have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 04:09:45 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8382d6d-eefd-4689-88bb-c120de272fc1 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb')] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 04:09:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:09:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:09:45 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4193eb1-b1ea-4cd4-8031-0e7de0e719c0]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:09:45 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8382d6d-eefd-4689-88bb-c120de272fc1 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:09:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb -p 172.16.0.220:3260 --logout {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:09:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:09:45 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[7412d3dc-c8b6-4223-9f71-d3e02ed92d15]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:09:45 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8382d6d-eefd-4689-88bb-c120de272fc1 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb, portal: 172.16.0.220,3260]
Nov 16 04:09:45 user nova-compute[103546]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb, portal: 172.16.0.220,3260] successful.
Nov 16 04:09:45 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:09:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb -p 172.16.0.220:3260 --op delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:09:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0faa59c5-ad97-4132-85ec-1f0101db20cb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:09:45 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3136dc1a-123f-48c1-8902-f79e2669e1a2]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:09:45 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8382d6d-eefd-4689-88bb-c120de272fc1 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:09:45 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-e8382d6d-eefd-4689-88bb-c120de272fc1 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:09:45 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8382d6d-eefd-4689-88bb-c120de272fc1 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] <== disconnect_volume: return (281ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:09:45 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8382d6d-eefd-4689-88bb-c120de272fc1 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 04:09:46 user nova-compute[103546]: DEBUG nova.objects.instance [None req-e8382d6d-eefd-4689-88bb-c120de272fc1 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lazy-loading 'flavor' on Instance uuid 8c02873d-469e-41a4-b492-69f793c8a07c {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:09:46 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e8382d6d-eefd-4689-88bb-c120de272fc1 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "8c02873d-469e-41a4-b492-69f793c8a07c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.607s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:09:47 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-8f469182-6f27-431c-b3dc-5c9221e0b2fb tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Acquiring lock "38f7c407-3373-43ba-ac92-7eb0a43a7093" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:09:47 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-8f469182-6f27-431c-b3dc-5c9221e0b2fb tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "38f7c407-3373-43ba-ac92-7eb0a43a7093" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:09:47 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-8f469182-6f27-431c-b3dc-5c9221e0b2fb tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Acquiring lock "38f7c407-3373-43ba-ac92-7eb0a43a7093-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:09:47 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-8f469182-6f27-431c-b3dc-5c9221e0b2fb tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "38f7c407-3373-43ba-ac92-7eb0a43a7093-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:09:47 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-8f469182-6f27-431c-b3dc-5c9221e0b2fb tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "38f7c407-3373-43ba-ac92-7eb0a43a7093-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:09:47 user nova-compute[103546]: INFO nova.compute.manager [None req-8f469182-6f27-431c-b3dc-5c9221e0b2fb tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Terminating instance
Nov 16 04:09:47 user nova-compute[103546]: DEBUG nova.compute.manager [None req-8f469182-6f27-431c-b3dc-5c9221e0b2fb tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Start destroying the instance on the hypervisor. {{(pid=103546) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 04:09:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:09:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:09:47 user nova-compute[103546]: DEBUG nova.compute.manager [req-08fce2c7-009f-4cc2-aa17-4838028a10f0 req-7ef6de1f-a0aa-4e37-b152-6af952cf8dbb service nova] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Received event network-vif-unplugged-25f18a73-4153-41e2-a4e9-f5ce77367363 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:09:47 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-08fce2c7-009f-4cc2-aa17-4838028a10f0 req-7ef6de1f-a0aa-4e37-b152-6af952cf8dbb service nova] Acquiring lock "38f7c407-3373-43ba-ac92-7eb0a43a7093-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:09:47 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-08fce2c7-009f-4cc2-aa17-4838028a10f0 req-7ef6de1f-a0aa-4e37-b152-6af952cf8dbb service nova] Lock "38f7c407-3373-43ba-ac92-7eb0a43a7093-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:09:47 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-08fce2c7-009f-4cc2-aa17-4838028a10f0 req-7ef6de1f-a0aa-4e37-b152-6af952cf8dbb service nova] Lock "38f7c407-3373-43ba-ac92-7eb0a43a7093-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:09:47 user nova-compute[103546]: DEBUG nova.compute.manager [req-08fce2c7-009f-4cc2-aa17-4838028a10f0 req-7ef6de1f-a0aa-4e37-b152-6af952cf8dbb service nova] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] No waiting events found dispatching network-vif-unplugged-25f18a73-4153-41e2-a4e9-f5ce77367363 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:09:47 user nova-compute[103546]: DEBUG nova.compute.manager [req-08fce2c7-009f-4cc2-aa17-4838028a10f0 req-7ef6de1f-a0aa-4e37-b152-6af952cf8dbb service nova] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Received event network-vif-unplugged-25f18a73-4153-41e2-a4e9-f5ce77367363 for instance with task_state deleting. {{(pid=103546) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 04:09:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:09:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:09:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:09:47 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Instance destroyed successfully.
Nov 16 04:09:47 user nova-compute[103546]: DEBUG nova.objects.instance [None req-8f469182-6f27-431c-b3dc-5c9221e0b2fb tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lazy-loading 'resources' on Instance uuid 38f7c407-3373-43ba-ac92-7eb0a43a7093 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:09:47 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-8f469182-6f27-431c-b3dc-5c9221e0b2fb tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:59:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1175423654',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1175423654',id=34,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:59:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6f2a38a5eb514ce8a7569c8322657eac',ramdisk_id='',reservation_id='r-q94f02i7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1634874924',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T04:01:32Z,user_data=None,user_id='e1176a2817ef428ea81e2fb18299a306',uuid=38f7c407-3373-43ba-ac92-7eb0a43a7093,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25f18a73-4153-41e2-a4e9-f5ce77367363", "address": "fa:16:3e:34:b9:ff", "network": {"id": "fdbb2d2c-9a54-4517-b33a-cf27ce7570b1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79661471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2a38a5eb514ce8a7569c8322657eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f18a73-41", "ovs_interfaceid": "25f18a73-4153-41e2-a4e9-f5ce77367363", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 04:09:47 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-8f469182-6f27-431c-b3dc-5c9221e0b2fb tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Converting VIF {"id": "25f18a73-4153-41e2-a4e9-f5ce77367363", "address": "fa:16:3e:34:b9:ff", "network": {"id": "fdbb2d2c-9a54-4517-b33a-cf27ce7570b1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79661471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2a38a5eb514ce8a7569c8322657eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f18a73-41", "ovs_interfaceid": "25f18a73-4153-41e2-a4e9-f5ce77367363", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:09:47 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-8f469182-6f27-431c-b3dc-5c9221e0b2fb tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:b9:ff,bridge_name='br-int',has_traffic_filtering=True,id=25f18a73-4153-41e2-a4e9-f5ce77367363,network=Network(fdbb2d2c-9a54-4517-b33a-cf27ce7570b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25f18a73-41') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:09:47 user nova-compute[103546]: DEBUG os_vif [None req-8f469182-6f27-431c-b3dc-5c9221e0b2fb tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:b9:ff,bridge_name='br-int',has_traffic_filtering=True,id=25f18a73-4153-41e2-a4e9-f5ce77367363,network=Network(fdbb2d2c-9a54-4517-b33a-cf27ce7570b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25f18a73-41') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 04:09:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:09:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap25f18a73-41, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:09:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:09:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:09:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0d6f2075-d8eb-4096-98f6-ee2a31425e4c) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:09:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:09:47 user nova-compute[103546]: INFO os_vif [None req-8f469182-6f27-431c-b3dc-5c9221e0b2fb tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:b9:ff,bridge_name='br-int',has_traffic_filtering=True,id=25f18a73-4153-41e2-a4e9-f5ce77367363,network=Network(fdbb2d2c-9a54-4517-b33a-cf27ce7570b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25f18a73-41')
Nov 16 04:09:47 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-8f469182-6f27-431c-b3dc-5c9221e0b2fb tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Deleting instance files /opt/stack/data/nova/instances/38f7c407-3373-43ba-ac92-7eb0a43a7093_del
Nov 16 04:09:47 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-8f469182-6f27-431c-b3dc-5c9221e0b2fb tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Deletion of /opt/stack/data/nova/instances/38f7c407-3373-43ba-ac92-7eb0a43a7093_del complete
Nov 16 04:09:47 user nova-compute[103546]: INFO nova.compute.manager [None req-8f469182-6f27-431c-b3dc-5c9221e0b2fb tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Took 0.70 seconds to destroy the instance on the hypervisor.
Nov 16 04:09:47 user nova-compute[103546]: DEBUG oslo.service.loopingcall [None req-8f469182-6f27-431c-b3dc-5c9221e0b2fb tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=103546) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 04:09:47 user nova-compute[103546]: DEBUG nova.compute.manager [-] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Deallocating network for instance {{(pid=103546) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 04:09:47 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] deallocate_for_instance() {{(pid=103546) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 04:09:48 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:09:48 user nova-compute[103546]: INFO nova.compute.manager [-] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Took 0.73 seconds to deallocate network for instance.
Nov 16 04:09:48 user nova-compute[103546]: DEBUG nova.compute.manager [req-2251ab79-15fb-40d7-a022-8d174c84b372 req-a572880b-2dba-4f03-bf27-b6e42bbb1742 service nova] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Received event network-vif-deleted-25f18a73-4153-41e2-a4e9-f5ce77367363 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:09:48 user nova-compute[103546]: INFO nova.compute.manager [req-2251ab79-15fb-40d7-a022-8d174c84b372 req-a572880b-2dba-4f03-bf27-b6e42bbb1742 service nova] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Neutron deleted interface 25f18a73-4153-41e2-a4e9-f5ce77367363; detaching it from the instance and deleting it from the info cache
Nov 16 04:09:48 user nova-compute[103546]: DEBUG nova.network.neutron [req-2251ab79-15fb-40d7-a022-8d174c84b372 req-a572880b-2dba-4f03-bf27-b6e42bbb1742 service nova] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:09:48 user nova-compute[103546]: DEBUG nova.compute.manager [req-2251ab79-15fb-40d7-a022-8d174c84b372 req-a572880b-2dba-4f03-bf27-b6e42bbb1742 service nova] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Detach interface failed, port_id=25f18a73-4153-41e2-a4e9-f5ce77367363, reason: Instance 38f7c407-3373-43ba-ac92-7eb0a43a7093 could not be found. {{(pid=103546) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 04:09:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-8f469182-6f27-431c-b3dc-5c9221e0b2fb tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:09:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-8f469182-6f27-431c-b3dc-5c9221e0b2fb tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:09:48 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-8f469182-6f27-431c-b3dc-5c9221e0b2fb tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:09:48 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-8f469182-6f27-431c-b3dc-5c9221e0b2fb tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:09:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-8f469182-6f27-431c-b3dc-5c9221e0b2fb tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.298s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:09:49 user nova-compute[103546]: INFO nova.scheduler.client.report [None req-8f469182-6f27-431c-b3dc-5c9221e0b2fb tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Deleted allocations for instance 38f7c407-3373-43ba-ac92-7eb0a43a7093
Nov 16 04:09:49 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-8f469182-6f27-431c-b3dc-5c9221e0b2fb tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "38f7c407-3373-43ba-ac92-7eb0a43a7093" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.942s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:09:49 user nova-compute[103546]: DEBUG nova.compute.manager [req-a3e839ab-4540-4ad9-aca4-a2aa588e7965 req-1ec75115-019a-4a78-9fef-a6a21ef04e9a service nova] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Received event network-vif-plugged-25f18a73-4153-41e2-a4e9-f5ce77367363 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:09:49 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a3e839ab-4540-4ad9-aca4-a2aa588e7965 req-1ec75115-019a-4a78-9fef-a6a21ef04e9a service nova] Acquiring lock "38f7c407-3373-43ba-ac92-7eb0a43a7093-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:09:49 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a3e839ab-4540-4ad9-aca4-a2aa588e7965 req-1ec75115-019a-4a78-9fef-a6a21ef04e9a service nova] Lock "38f7c407-3373-43ba-ac92-7eb0a43a7093-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:09:49 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a3e839ab-4540-4ad9-aca4-a2aa588e7965 req-1ec75115-019a-4a78-9fef-a6a21ef04e9a service nova] Lock "38f7c407-3373-43ba-ac92-7eb0a43a7093-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:09:49 user nova-compute[103546]: DEBUG nova.compute.manager [req-a3e839ab-4540-4ad9-aca4-a2aa588e7965 req-1ec75115-019a-4a78-9fef-a6a21ef04e9a service nova] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] No waiting events found dispatching network-vif-plugged-25f18a73-4153-41e2-a4e9-f5ce77367363 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:09:49 user nova-compute[103546]: WARNING nova.compute.manager [req-a3e839ab-4540-4ad9-aca4-a2aa588e7965 req-1ec75115-019a-4a78-9fef-a6a21ef04e9a service nova] [instance: 38f7c407-3373-43ba-ac92-7eb0a43a7093] Received unexpected event network-vif-plugged-25f18a73-4153-41e2-a4e9-f5ce77367363 for instance with vm_state deleted and task_state None.
Nov 16 04:09:51 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Acquiring lock "0ba82fe3-33e6-4ae4-8716-2efbe66a6f06" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:09:51 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "0ba82fe3-33e6-4ae4-8716-2efbe66a6f06" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:09:51 user nova-compute[103546]: DEBUG nova.compute.manager [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Starting instance... {{(pid=103546) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 04:09:52 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:09:52 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:09:52 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=103546) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 04:09:52 user nova-compute[103546]: INFO nova.compute.claims [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Claim successful on node user
Nov 16 04:09:52 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:09:52 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:09:52 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.385s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:09:52 user nova-compute[103546]: DEBUG nova.compute.manager [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Start building networks asynchronously for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 04:09:52 user nova-compute[103546]: DEBUG nova.compute.manager [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Allocating IP information in the background. {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 04:09:52 user nova-compute[103546]: DEBUG nova.network.neutron [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] allocate_for_instance() {{(pid=103546) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 04:09:52 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 04:09:52 user nova-compute[103546]: DEBUG nova.compute.manager [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Start building block device mappings for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 04:09:52 user nova-compute[103546]: DEBUG nova.policy [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '005ffc068a19494bb5a436fc4a07aaa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f33e7eff7954fcc895f66982d7d45c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103546) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 04:09:52 user nova-compute[103546]: DEBUG nova.compute.manager [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Start spawning the instance on the hypervisor. {{(pid=103546) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 04:09:52 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Creating instance directory {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 04:09:52 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Creating image(s)
Nov 16 04:09:52 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Acquiring lock "/opt/stack/data/nova/instances/0ba82fe3-33e6-4ae4-8716-2efbe66a6f06/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:09:52 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "/opt/stack/data/nova/instances/0ba82fe3-33e6-4ae4-8716-2efbe66a6f06/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:09:52 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "/opt/stack/data/nova/instances/0ba82fe3-33e6-4ae4-8716-2efbe66a6f06/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:09:52 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:09:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:09:52 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.180s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:09:52 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Acquiring lock "8c9efafb670bfe5842ba1f4ce398924612164af7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:09:52 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:09:52 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:09:53 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.210s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:09:53 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/0ba82fe3-33e6-4ae4-8716-2efbe66a6f06/disk 1073741824 {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:09:53 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/0ba82fe3-33e6-4ae4-8716-2efbe66a6f06/disk 1073741824" returned: 0 in 0.062s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:09:53 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:09:53 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:09:53 user nova-compute[103546]: DEBUG nova.network.neutron [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Successfully created port: a64e3b5a-f0ee-4b9c-8736-84e4e4c9a1b3 {{(pid=103546) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 04:09:53 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.188s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:09:53 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0ba82fe3-33e6-4ae4-8716-2efbe66a6f06/disk. size=1073741824 {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 04:09:53 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba82fe3-33e6-4ae4-8716-2efbe66a6f06/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:09:53 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba82fe3-33e6-4ae4-8716-2efbe66a6f06/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:09:53 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Cannot resize image /opt/stack/data/nova/instances/0ba82fe3-33e6-4ae4-8716-2efbe66a6f06/disk to a smaller size. {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 04:09:53 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Created local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 04:09:53 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Ensure instance console log exists: /opt/stack/data/nova/instances/0ba82fe3-33e6-4ae4-8716-2efbe66a6f06/console.log {{(pid=103546) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 04:09:53 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:09:53 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:09:53 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:09:53 user nova-compute[103546]: DEBUG nova.network.neutron [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Successfully updated port: a64e3b5a-f0ee-4b9c-8736-84e4e4c9a1b3 {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 04:09:53 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Acquiring lock "refresh_cache-0ba82fe3-33e6-4ae4-8716-2efbe66a6f06" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:09:53 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Acquired lock "refresh_cache-0ba82fe3-33e6-4ae4-8716-2efbe66a6f06" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:09:53 user nova-compute[103546]: DEBUG nova.network.neutron [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 04:09:53 user nova-compute[103546]: DEBUG nova.compute.manager [req-b69e5709-db06-478b-ad1a-484e77972a80 req-62c7ee81-f8c5-4f83-bebe-8e62445d5050 service nova] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Received event network-changed-a64e3b5a-f0ee-4b9c-8736-84e4e4c9a1b3 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:09:53 user nova-compute[103546]: DEBUG nova.compute.manager [req-b69e5709-db06-478b-ad1a-484e77972a80 req-62c7ee81-f8c5-4f83-bebe-8e62445d5050 service nova] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Refreshing instance network info cache due to event network-changed-a64e3b5a-f0ee-4b9c-8736-84e4e4c9a1b3. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 04:09:53 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-b69e5709-db06-478b-ad1a-484e77972a80 req-62c7ee81-f8c5-4f83-bebe-8e62445d5050 service nova] Acquiring lock "refresh_cache-0ba82fe3-33e6-4ae4-8716-2efbe66a6f06" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:09:54 user nova-compute[103546]: DEBUG nova.network.neutron [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 04:09:54 user nova-compute[103546]: DEBUG nova.network.neutron [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Updating instance_info_cache with network_info: [{"id": "a64e3b5a-f0ee-4b9c-8736-84e4e4c9a1b3", "address": "fa:16:3e:86:b7:f6", "network": {"id": "23baa589-ae15-4a44-8991-d6fe8569dc8a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-464431710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f33e7eff7954fcc895f66982d7d45c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64e3b5a-f0", "ovs_interfaceid": "a64e3b5a-f0ee-4b9c-8736-84e4e4c9a1b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:09:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Releasing lock "refresh_cache-0ba82fe3-33e6-4ae4-8716-2efbe66a6f06" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:09:54 user nova-compute[103546]: DEBUG nova.compute.manager [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Instance network_info: |[{"id": "a64e3b5a-f0ee-4b9c-8736-84e4e4c9a1b3", "address": "fa:16:3e:86:b7:f6", "network": {"id": "23baa589-ae15-4a44-8991-d6fe8569dc8a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-464431710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f33e7eff7954fcc895f66982d7d45c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64e3b5a-f0", "ovs_interfaceid": "a64e3b5a-f0ee-4b9c-8736-84e4e4c9a1b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 04:09:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-b69e5709-db06-478b-ad1a-484e77972a80 req-62c7ee81-f8c5-4f83-bebe-8e62445d5050 service nova] Acquired lock "refresh_cache-0ba82fe3-33e6-4ae4-8716-2efbe66a6f06" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:09:54 user nova-compute[103546]: DEBUG nova.network.neutron [req-b69e5709-db06-478b-ad1a-484e77972a80 req-62c7ee81-f8c5-4f83-bebe-8e62445d5050 service nova] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Refreshing network info cache for port a64e3b5a-f0ee-4b9c-8736-84e4e4c9a1b3 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 04:09:54 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Start _get_guest_xml network_info=[{"id": "a64e3b5a-f0ee-4b9c-8736-84e4e4c9a1b3", "address": "fa:16:3e:86:b7:f6", "network": {"id": "23baa589-ae15-4a44-8991-d6fe8569dc8a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-464431710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f33e7eff7954fcc895f66982d7d45c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64e3b5a-f0", "ovs_interfaceid": "a64e3b5a-f0ee-4b9c-8736-84e4e4c9a1b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '5c6f539a-01e5-4478-bf8f-a14310b5d7dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 04:09:54 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:09:54 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:09:54 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 04:09:54 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 04:09:54 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 04:09:54 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 04:09:54 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 04:09:54 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 04:09:54 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 04:09:54 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 04:09:54 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 04:09:54 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 04:09:54 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 04:09:54 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 04:09:54 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 04:09:54 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 04:09:54 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 04:09:54 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 04:09:54 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:09:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1992494703',display_name='tempest-AttachVolumeTestJSON-server-1992494703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1992494703',id=45,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDGcVKSTsR+Zc6tO7e5zGbXF+jcqBx1XZIYJe/oabs/6MpPezPv1ZSLbIBIpzCiejSjIE7n7xce696/H4ktZNIFAxmhwjZKMVcmdnV3DEcIuHDaiUTNVKKuK3vM26XPjhg==',key_name='tempest-keypair-268007081',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f33e7eff7954fcc895f66982d7d45c8',ramdisk_id='',reservation_id='r-ha6a0jmj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1584447380',owner_user_name='tempest-AttachVolumeTestJSON-1584447380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T04:09:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='005ffc068a19494bb5a436fc4a07aaa1',uuid=0ba82fe3-33e6-4ae4-8716-2efbe66a6f06,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a64e3b5a-f0ee-4b9c-8736-84e4e4c9a1b3", "address": "fa:16:3e:86:b7:f6", "network": {"id": "23baa589-ae15-4a44-8991-d6fe8569dc8a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-464431710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f33e7eff7954fcc895f66982d7d45c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64e3b5a-f0", "ovs_interfaceid": "a64e3b5a-f0ee-4b9c-8736-84e4e4c9a1b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 04:09:54 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Converting VIF {"id": "a64e3b5a-f0ee-4b9c-8736-84e4e4c9a1b3", "address": "fa:16:3e:86:b7:f6", "network": {"id": "23baa589-ae15-4a44-8991-d6fe8569dc8a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-464431710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f33e7eff7954fcc895f66982d7d45c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64e3b5a-f0", "ovs_interfaceid": "a64e3b5a-f0ee-4b9c-8736-84e4e4c9a1b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:09:54 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:b7:f6,bridge_name='br-int',has_traffic_filtering=True,id=a64e3b5a-f0ee-4b9c-8736-84e4e4c9a1b3,network=Network(23baa589-ae15-4a44-8991-d6fe8569dc8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa64e3b5a-f0') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:09:54 user nova-compute[103546]: DEBUG nova.objects.instance [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:09:54 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] End _get_guest_xml xml=<domain type="kvm">
Nov 16 04:09:54 user nova-compute[103546]:   <uuid>0ba82fe3-33e6-4ae4-8716-2efbe66a6f06</uuid>
Nov 16 04:09:54 user nova-compute[103546]:   <name>instance-0000002d</name>
Nov 16 04:09:54 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 04:09:54 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 04:09:54 user nova-compute[103546]:   <metadata>
Nov 16 04:09:54 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 04:09:54 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 04:09:54 user nova-compute[103546]:       <nova:name>tempest-AttachVolumeTestJSON-server-1992494703</nova:name>
Nov 16 04:09:54 user nova-compute[103546]:       <nova:creationTime>2023-11-16 04:09:54</nova:creationTime>
Nov 16 04:09:54 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 04:09:54 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 04:09:54 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 04:09:54 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 04:09:54 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 04:09:54 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 04:09:54 user nova-compute[103546]:       </nova:flavor>
Nov 16 04:09:54 user nova-compute[103546]:       <nova:owner>
Nov 16 04:09:54 user nova-compute[103546]:         <nova:user uuid="005ffc068a19494bb5a436fc4a07aaa1">tempest-AttachVolumeTestJSON-1584447380-project-member</nova:user>
Nov 16 04:09:54 user nova-compute[103546]:         <nova:project uuid="5f33e7eff7954fcc895f66982d7d45c8">tempest-AttachVolumeTestJSON-1584447380</nova:project>
Nov 16 04:09:54 user nova-compute[103546]:       </nova:owner>
Nov 16 04:09:54 user nova-compute[103546]:       <nova:root type="image" uuid="5c6f539a-01e5-4478-bf8f-a14310b5d7dd"/>
Nov 16 04:09:54 user nova-compute[103546]:       <nova:ports>
Nov 16 04:09:54 user nova-compute[103546]:         <nova:port uuid="a64e3b5a-f0ee-4b9c-8736-84e4e4c9a1b3">
Nov 16 04:09:54 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 16 04:09:54 user nova-compute[103546]:         </nova:port>
Nov 16 04:09:54 user nova-compute[103546]:       </nova:ports>
Nov 16 04:09:54 user nova-compute[103546]:     </nova:instance>
Nov 16 04:09:54 user nova-compute[103546]:   </metadata>
Nov 16 04:09:54 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 04:09:54 user nova-compute[103546]:     <system>
Nov 16 04:09:54 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 04:09:54 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 04:09:54 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 04:09:54 user nova-compute[103546]:       <entry name="serial">0ba82fe3-33e6-4ae4-8716-2efbe66a6f06</entry>
Nov 16 04:09:54 user nova-compute[103546]:       <entry name="uuid">0ba82fe3-33e6-4ae4-8716-2efbe66a6f06</entry>
Nov 16 04:09:54 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 04:09:54 user nova-compute[103546]:     </system>
Nov 16 04:09:54 user nova-compute[103546]:   </sysinfo>
Nov 16 04:09:54 user nova-compute[103546]:   <os>
Nov 16 04:09:54 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 04:09:54 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 04:09:54 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 04:09:54 user nova-compute[103546]:   </os>
Nov 16 04:09:54 user nova-compute[103546]:   <features>
Nov 16 04:09:54 user nova-compute[103546]:     <acpi/>
Nov 16 04:09:54 user nova-compute[103546]:     <apic/>
Nov 16 04:09:54 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 04:09:54 user nova-compute[103546]:   </features>
Nov 16 04:09:54 user nova-compute[103546]:   <clock offset="utc">
Nov 16 04:09:54 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 04:09:54 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 04:09:54 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 04:09:54 user nova-compute[103546]:   </clock>
Nov 16 04:09:54 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 04:09:54 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 04:09:54 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 04:09:54 user nova-compute[103546]:   </cpu>
Nov 16 04:09:54 user nova-compute[103546]:   <devices>
Nov 16 04:09:54 user nova-compute[103546]:     <disk type="file" device="disk">
Nov 16 04:09:54 user nova-compute[103546]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 04:09:54 user nova-compute[103546]:       <source file="/opt/stack/data/nova/instances/0ba82fe3-33e6-4ae4-8716-2efbe66a6f06/disk"/>
Nov 16 04:09:54 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 04:09:54 user nova-compute[103546]:     </disk>
Nov 16 04:09:54 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 04:09:54 user nova-compute[103546]:       <mac address="fa:16:3e:86:b7:f6"/>
Nov 16 04:09:54 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 04:09:54 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 04:09:54 user nova-compute[103546]:       <target dev="tapa64e3b5a-f0"/>
Nov 16 04:09:54 user nova-compute[103546]:     </interface>
Nov 16 04:09:54 user nova-compute[103546]:     <serial type="pty">
Nov 16 04:09:54 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/0ba82fe3-33e6-4ae4-8716-2efbe66a6f06/console.log" append="off"/>
Nov 16 04:09:54 user nova-compute[103546]:     </serial>
Nov 16 04:09:54 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 04:09:54 user nova-compute[103546]:     <video>
Nov 16 04:09:54 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 04:09:54 user nova-compute[103546]:     </video>
Nov 16 04:09:54 user nova-compute[103546]:     <rng model="virtio">
Nov 16 04:09:54 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 04:09:54 user nova-compute[103546]:     </rng>
Nov 16 04:09:54 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 04:09:54 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 04:09:54 user nova-compute[103546]:       <stats period="10"/>
Nov 16 04:09:54 user nova-compute[103546]:     </memballoon>
Nov 16 04:09:54 user nova-compute[103546]:   </devices>
Nov 16 04:09:54 user nova-compute[103546]: </domain>
Nov 16 04:09:54 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 04:09:54 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:09:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1992494703',display_name='tempest-AttachVolumeTestJSON-server-1992494703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1992494703',id=45,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDGcVKSTsR+Zc6tO7e5zGbXF+jcqBx1XZIYJe/oabs/6MpPezPv1ZSLbIBIpzCiejSjIE7n7xce696/H4ktZNIFAxmhwjZKMVcmdnV3DEcIuHDaiUTNVKKuK3vM26XPjhg==',key_name='tempest-keypair-268007081',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f33e7eff7954fcc895f66982d7d45c8',ramdisk_id='',reservation_id='r-ha6a0jmj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1584447380',owner_user_name='tempest-AttachVolumeTestJSON-1584447380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T04:09:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='005ffc068a19494bb5a436fc4a07aaa1',uuid=0ba82fe3-33e6-4ae4-8716-2efbe66a6f06,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a64e3b5a-f0ee-4b9c-8736-84e4e4c9a1b3", "address": "fa:16:3e:86:b7:f6", "network": {"id": "23baa589-ae15-4a44-8991-d6fe8569dc8a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-464431710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f33e7eff7954fcc895f66982d7d45c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64e3b5a-f0", "ovs_interfaceid": "a64e3b5a-f0ee-4b9c-8736-84e4e4c9a1b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 04:09:54 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Converting VIF {"id": "a64e3b5a-f0ee-4b9c-8736-84e4e4c9a1b3", "address": "fa:16:3e:86:b7:f6", "network": {"id": "23baa589-ae15-4a44-8991-d6fe8569dc8a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-464431710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f33e7eff7954fcc895f66982d7d45c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64e3b5a-f0", "ovs_interfaceid": "a64e3b5a-f0ee-4b9c-8736-84e4e4c9a1b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:09:54 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:b7:f6,bridge_name='br-int',has_traffic_filtering=True,id=a64e3b5a-f0ee-4b9c-8736-84e4e4c9a1b3,network=Network(23baa589-ae15-4a44-8991-d6fe8569dc8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa64e3b5a-f0') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:09:54 user nova-compute[103546]: DEBUG os_vif [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:b7:f6,bridge_name='br-int',has_traffic_filtering=True,id=a64e3b5a-f0ee-4b9c-8736-84e4e4c9a1b3,network=Network(23baa589-ae15-4a44-8991-d6fe8569dc8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa64e3b5a-f0') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 04:09:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:09:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:09:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 04:09:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:09:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4301f638-d69d-5cc6-a980-46264e6c1ff3', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:09:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:09:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:09:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:09:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa64e3b5a-f0, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:09:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa64e3b5a-f0, col_values=(('qos', UUID('dbe23727-acd8-4871-a81b-487679dbc334')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:09:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa64e3b5a-f0, col_values=(('external_ids', {'iface-id': 'a64e3b5a-f0ee-4b9c-8736-84e4e4c9a1b3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:b7:f6', 'vm-uuid': '0ba82fe3-33e6-4ae4-8716-2efbe66a6f06'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:09:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:09:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:09:54 user nova-compute[103546]: INFO os_vif [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:b7:f6,bridge_name='br-int',has_traffic_filtering=True,id=a64e3b5a-f0ee-4b9c-8736-84e4e4c9a1b3,network=Network(23baa589-ae15-4a44-8991-d6fe8569dc8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa64e3b5a-f0')
Nov 16 04:09:54 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:09:54 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] No VIF found with MAC fa:16:3e:86:b7:f6, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 04:09:54 user nova-compute[103546]: DEBUG nova.network.neutron [req-b69e5709-db06-478b-ad1a-484e77972a80 req-62c7ee81-f8c5-4f83-bebe-8e62445d5050 service nova] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Updated VIF entry in instance network info cache for port a64e3b5a-f0ee-4b9c-8736-84e4e4c9a1b3. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 04:09:54 user nova-compute[103546]: DEBUG nova.network.neutron [req-b69e5709-db06-478b-ad1a-484e77972a80 req-62c7ee81-f8c5-4f83-bebe-8e62445d5050 service nova] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Updating instance_info_cache with network_info: [{"id": "a64e3b5a-f0ee-4b9c-8736-84e4e4c9a1b3", "address": "fa:16:3e:86:b7:f6", "network": {"id": "23baa589-ae15-4a44-8991-d6fe8569dc8a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-464431710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f33e7eff7954fcc895f66982d7d45c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64e3b5a-f0", "ovs_interfaceid": "a64e3b5a-f0ee-4b9c-8736-84e4e4c9a1b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:09:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-871f4c72-5516-41ff-ae96-a58b8621e1cd tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Acquiring lock "ce616440-9d69-4812-8910-a2d9ad58f504" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:09:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-871f4c72-5516-41ff-ae96-a58b8621e1cd tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "ce616440-9d69-4812-8910-a2d9ad58f504" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:09:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-b69e5709-db06-478b-ad1a-484e77972a80 req-62c7ee81-f8c5-4f83-bebe-8e62445d5050 service nova] Releasing lock "refresh_cache-0ba82fe3-33e6-4ae4-8716-2efbe66a6f06" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:09:54 user nova-compute[103546]: DEBUG nova.objects.instance [None req-871f4c72-5516-41ff-ae96-a58b8621e1cd tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lazy-loading 'flavor' on Instance uuid ce616440-9d69-4812-8910-a2d9ad58f504 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:09:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-871f4c72-5516-41ff-ae96-a58b8621e1cd tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "ce616440-9d69-4812-8910-a2d9ad58f504" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:09:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-871f4c72-5516-41ff-ae96-a58b8621e1cd tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Acquiring lock "ce616440-9d69-4812-8910-a2d9ad58f504" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:09:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-871f4c72-5516-41ff-ae96-a58b8621e1cd tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "ce616440-9d69-4812-8910-a2d9ad58f504" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:09:54 user nova-compute[103546]: INFO nova.compute.manager [None req-871f4c72-5516-41ff-ae96-a58b8621e1cd tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Attaching volume 9d28e72a-a41e-4b84-9c3a-5af173b4f098 to /dev/vdb
Nov 16 04:09:54 user nova-compute[103546]: DEBUG os_brick.utils [None req-871f4c72-5516-41ff-ae96-a58b8621e1cd tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:09:54 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:09:54 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:09:54 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d128591-22c7-40fc-8ee2-de936f8fbf02]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af5c39b14ece\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:09:54 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:09:54 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:09:54 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdbbae96-ad48-4758-8cf3-8258575f1186]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:09:54 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:09:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:09:55 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9cf2a46-ff39-4e58-b660-61eb96b859da]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:09:55 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e72c9849-a599-4330-b9e1-4b976665aff2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:09:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-871f4c72-5516-41ff-ae96-a58b8621e1cd tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Running cmd (subprocess): nvme version {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:09:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-871f4c72-5516-41ff-ae96-a58b8621e1cd tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] 'nvme version' failed. Not Retrying. {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 04:09:55 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.nvmeof [None req-871f4c72-5516-41ff-ae96-a58b8621e1cd tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] nvme not present on system {{(pid=103546) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 04:09:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:09:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 04:09:55 user nova-compute[103546]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 04:09:55 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d10134-15da-40e5-869c-2b21c5d3c46d]: (4, '') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:09:55 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-871f4c72-5516-41ff-ae96-a58b8621e1cd tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=103546) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 04:09:55 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-871f4c72-5516-41ff-ae96-a58b8621e1cd tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 04:09:55 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-871f4c72-5516-41ff-ae96-a58b8621e1cd tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] LIGHTOS: no hostnqn found. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 04:09:55 user nova-compute[103546]: DEBUG os_brick.utils [None req-871f4c72-5516-41ff-ae96-a58b8621e1cd tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af5c39b14ece', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:09:55 user nova-compute[103546]: DEBUG nova.virt.block_device [None req-871f4c72-5516-41ff-ae96-a58b8621e1cd tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Updating existing volume attachment record: d6a30b2e-1bc3-4c7c-85c6-ead1ff1c4b21 {{(pid=103546) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 04:09:55 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:09:55 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:09:55 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:09:56 user nova-compute[103546]: DEBUG nova.compute.manager [req-f3df3e10-4d04-43ee-9d2b-7c0dd0ea3edf req-c05512fd-9488-4b7e-9b9a-45128f6cfe77 service nova] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Received event network-vif-plugged-a64e3b5a-f0ee-4b9c-8736-84e4e4c9a1b3 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:09:56 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-f3df3e10-4d04-43ee-9d2b-7c0dd0ea3edf req-c05512fd-9488-4b7e-9b9a-45128f6cfe77 service nova] Acquiring lock "0ba82fe3-33e6-4ae4-8716-2efbe66a6f06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:09:56 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-f3df3e10-4d04-43ee-9d2b-7c0dd0ea3edf req-c05512fd-9488-4b7e-9b9a-45128f6cfe77 service nova] Lock "0ba82fe3-33e6-4ae4-8716-2efbe66a6f06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:09:56 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-f3df3e10-4d04-43ee-9d2b-7c0dd0ea3edf req-c05512fd-9488-4b7e-9b9a-45128f6cfe77 service nova] Lock "0ba82fe3-33e6-4ae4-8716-2efbe66a6f06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:09:56 user nova-compute[103546]: DEBUG nova.compute.manager [req-f3df3e10-4d04-43ee-9d2b-7c0dd0ea3edf req-c05512fd-9488-4b7e-9b9a-45128f6cfe77 service nova] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] No waiting events found dispatching network-vif-plugged-a64e3b5a-f0ee-4b9c-8736-84e4e4c9a1b3 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:09:56 user nova-compute[103546]: WARNING nova.compute.manager [req-f3df3e10-4d04-43ee-9d2b-7c0dd0ea3edf req-c05512fd-9488-4b7e-9b9a-45128f6cfe77 service nova] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Received unexpected event network-vif-plugged-a64e3b5a-f0ee-4b9c-8736-84e4e4c9a1b3 for instance with vm_state building and task_state spawning.
Nov 16 04:09:56 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:09:56 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:09:56 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:09:57 user nova-compute[103546]: DEBUG nova.compute.manager [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 04:09:57 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Guest created on hypervisor {{(pid=103546) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 04:09:57 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Instance spawned successfully.
Nov 16 04:09:57 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 04:09:57 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Found default for hw_cdrom_bus of ide {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:09:57 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Found default for hw_disk_bus of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:09:57 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Found default for hw_input_bus of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:09:57 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Found default for hw_pointer_model of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:09:57 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Found default for hw_video_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:09:57 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Found default for hw_vif_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:09:58 user nova-compute[103546]: INFO nova.compute.manager [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Took 5.31 seconds to spawn the instance on the hypervisor.
Nov 16 04:09:58 user nova-compute[103546]: DEBUG nova.compute.manager [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 04:09:58 user nova-compute[103546]: DEBUG nova.compute.manager [req-4a6f0a89-48d7-4b38-af37-d6bf81b2bd31 req-e54b9594-84fd-4301-a295-4c5b8436404c service nova] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Received event network-vif-plugged-a64e3b5a-f0ee-4b9c-8736-84e4e4c9a1b3 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:09:58 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-4a6f0a89-48d7-4b38-af37-d6bf81b2bd31 req-e54b9594-84fd-4301-a295-4c5b8436404c service nova] Acquiring lock "0ba82fe3-33e6-4ae4-8716-2efbe66a6f06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:09:58 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-4a6f0a89-48d7-4b38-af37-d6bf81b2bd31 req-e54b9594-84fd-4301-a295-4c5b8436404c service nova] Lock "0ba82fe3-33e6-4ae4-8716-2efbe66a6f06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:09:58 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-4a6f0a89-48d7-4b38-af37-d6bf81b2bd31 req-e54b9594-84fd-4301-a295-4c5b8436404c service nova] Lock "0ba82fe3-33e6-4ae4-8716-2efbe66a6f06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:09:58 user nova-compute[103546]: DEBUG nova.compute.manager [req-4a6f0a89-48d7-4b38-af37-d6bf81b2bd31 req-e54b9594-84fd-4301-a295-4c5b8436404c service nova] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] No waiting events found dispatching network-vif-plugged-a64e3b5a-f0ee-4b9c-8736-84e4e4c9a1b3 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:09:58 user nova-compute[103546]: WARNING nova.compute.manager [req-4a6f0a89-48d7-4b38-af37-d6bf81b2bd31 req-e54b9594-84fd-4301-a295-4c5b8436404c service nova] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Received unexpected event network-vif-plugged-a64e3b5a-f0ee-4b9c-8736-84e4e4c9a1b3 for instance with vm_state building and task_state spawning.
Nov 16 04:09:58 user nova-compute[103546]: INFO nova.compute.manager [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Took 6.12 seconds to build instance.
Nov 16 04:09:58 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-33d299a9-11f8-4fdf-ba64-e1286f901ab3 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "0ba82fe3-33e6-4ae4-8716-2efbe66a6f06" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.225s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:09:59 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:09:59 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:09:59 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-871f4c72-5516-41ff-ae96-a58b8621e1cd tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 04:09:59 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-871f4c72-5516-41ff-ae96-a58b8621e1cd tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cQiRzHwN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:09:59 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-871f4c72-5516-41ff-ae96-a58b8621e1cd tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:09:59 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-871f4c72-5516-41ff-ae96-a58b8621e1cd tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:09:59 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-871f4c72-5516-41ff-ae96-a58b8621e1cd tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:09:59 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-871f4c72-5516-41ff-ae96-a58b8621e1cd tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:09:59 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-871f4c72-5516-41ff-ae96-a58b8621e1cd tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:09:59 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-871f4c72-5516-41ff-ae96-a58b8621e1cd tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:09:59 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-871f4c72-5516-41ff-ae96-a58b8621e1cd tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 04:09:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098 -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:09:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:09:59 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b92a63-479c-404b-b853-0f0f1b23e537]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:09:59 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-871f4c72-5516-41ff-ae96-a58b8621e1cd tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 04:09:59 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:09:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098 -p 172.16.0.220:3260 --interface default --op new {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:09:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:09:59 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ec0758-a66f-41a9-b44a-b88008dd7ba5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098] added\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:09:59 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-871f4c72-5516-41ff-ae96-a58b8621e1cd tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098] added
Nov 16 04:09:59 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:09:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:09:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:09:59 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[41097a70-451d-4a1f-ba4c-0013461bed73]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:09:59 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-871f4c72-5516-41ff-ae96-a58b8621e1cd tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:09:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:09:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:09:59 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[513e144c-1da4-4111-a995-c794d4ea1445]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:09:59 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-871f4c72-5516-41ff-ae96-a58b8621e1cd tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:09:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cQiRzHwN {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:09:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cQiRzHwN" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:09:59 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0d8b4f-f9bf-42b6-accf-c7e9bfa7135e]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:09:59 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-871f4c72-5516-41ff-ae96-a58b8621e1cd tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cQiRzHwN'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:09:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:09:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:09:59 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c38943-7c10-43d0-bf0a-6a92b2070d0b]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:09:59 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-871f4c72-5516-41ff-ae96-a58b8621e1cd tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:10:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:10:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:10:00 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc5c0ad-9cf9-4df2-8204-d30ed40f4904]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:10:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-871f4c72-5516-41ff-ae96-a58b8621e1cd tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:10:00 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:10:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-871f4c72-5516-41ff-ae96-a58b8621e1cd tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:10:00 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:10:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098 -p 172.16.0.220:3260 --login {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:10:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:10:00 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a38715-08b9-45b3-aa21-1fde67413375]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:10:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-871f4c72-5516-41ff-ae96-a58b8621e1cd tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098, portal: 172.16.0.220,3260]
Nov 16 04:10:00 user nova-compute[103546]: Login to [iface: default, target: iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098, portal: 172.16.0.220,3260] successful.
Nov 16 04:10:00 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:10:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:10:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:10:00 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c19c3f-3f0f-438f-8136-ca242180a03d]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:10:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-871f4c72-5516-41ff-ae96-a58b8621e1cd tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:10:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:10:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:10:00 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[023e1955-8862-4c8b-a1d3-8f30ea52728d]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:10:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-871f4c72-5516-41ff-ae96-a58b8621e1cd tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:10:00 user nova-compute[103546]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098 (non-flash)
Nov 16 04:10:00 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:10:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-871f4c72-5516-41ff-ae96-a58b8621e1cd tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:10:00 user nova-compute[103546]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098 (non-flash)
Nov 16 04:10:00 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:10:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-871f4c72-5516-41ff-ae96-a58b8621e1cd tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:10:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-871f4c72-5516-41ff-ae96-a58b8621e1cd tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 04:10:00 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-871f4c72-5516-41ff-ae96-a58b8621e1cd tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 04:10:00 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-871f4c72-5516-41ff-ae96-a58b8621e1cd tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 04:10:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:10:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:10:00 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d989617d-527a-40e7-a5d5-e01e28d87f58]: (4, ('- - 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:10:00 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-871f4c72-5516-41ff-ae96-a58b8621e1cd tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: None {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 04:10:01 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-871f4c72-5516-41ff-ae96-a58b8621e1cd tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 04:10:01 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-871f4c72-5516-41ff-ae96-a58b8621e1cd tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cQiRzHwN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 04:10:01 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-871f4c72-5516-41ff-ae96-a58b8621e1cd tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:10:01 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-871f4c72-5516-41ff-ae96-a58b8621e1cd tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23363333261383933', 'path': '/dev/sdc'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:10:01 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-871f4c72-5516-41ff-ae96-a58b8621e1cd tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363333261383933', 'path': '/dev/sdc'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 04:10:01 user nova-compute[103546]: DEBUG nova.objects.instance [None req-871f4c72-5516-41ff-ae96-a58b8621e1cd tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lazy-loading 'flavor' on Instance uuid ce616440-9d69-4812-8910-a2d9ad58f504 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:10:01 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-871f4c72-5516-41ff-ae96-a58b8621e1cd tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 04:10:01 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:10:01 user nova-compute[103546]:   <source dev="/dev/sdc"/>
Nov 16 04:10:01 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 04:10:01 user nova-compute[103546]:   <serial>9d28e72a-a41e-4b84-9c3a-5af173b4f098</serial>
Nov 16 04:10:01 user nova-compute[103546]: </disk>
Nov 16 04:10:01 user nova-compute[103546]:  {{(pid=103546) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 04:10:01 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-871f4c72-5516-41ff-ae96-a58b8621e1cd tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:10:01 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-871f4c72-5516-41ff-ae96-a58b8621e1cd tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] No BDM found with device name vdb, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:10:01 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-871f4c72-5516-41ff-ae96-a58b8621e1cd tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] No VIF found with MAC fa:16:3e:45:2b:d3, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 04:10:01 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-871f4c72-5516-41ff-ae96-a58b8621e1cd tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "ce616440-9d69-4812-8910-a2d9ad58f504" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.920s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:10:04 user nova-compute[103546]: DEBUG nova.compute.manager [req-090fbcda-a0f1-4c97-9b7c-e6de5463767e req-54851809-acfe-411e-9972-667b5b7cad1b service nova] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Received event network-changed-3d061027-8dbb-48b4-bbcd-b057c196a301 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:10:04 user nova-compute[103546]: DEBUG nova.compute.manager [req-090fbcda-a0f1-4c97-9b7c-e6de5463767e req-54851809-acfe-411e-9972-667b5b7cad1b service nova] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Refreshing instance network info cache due to event network-changed-3d061027-8dbb-48b4-bbcd-b057c196a301. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 04:10:04 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-090fbcda-a0f1-4c97-9b7c-e6de5463767e req-54851809-acfe-411e-9972-667b5b7cad1b service nova] Acquiring lock "refresh_cache-ce616440-9d69-4812-8910-a2d9ad58f504" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:10:04 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-090fbcda-a0f1-4c97-9b7c-e6de5463767e req-54851809-acfe-411e-9972-667b5b7cad1b service nova] Acquired lock "refresh_cache-ce616440-9d69-4812-8910-a2d9ad58f504" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:10:04 user nova-compute[103546]: DEBUG nova.network.neutron [req-090fbcda-a0f1-4c97-9b7c-e6de5463767e req-54851809-acfe-411e-9972-667b5b7cad1b service nova] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Refreshing network info cache for port 3d061027-8dbb-48b4-bbcd-b057c196a301 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 04:10:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:04 user nova-compute[103546]: DEBUG nova.network.neutron [req-090fbcda-a0f1-4c97-9b7c-e6de5463767e req-54851809-acfe-411e-9972-667b5b7cad1b service nova] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Updated VIF entry in instance network info cache for port 3d061027-8dbb-48b4-bbcd-b057c196a301. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 04:10:04 user nova-compute[103546]: DEBUG nova.network.neutron [req-090fbcda-a0f1-4c97-9b7c-e6de5463767e req-54851809-acfe-411e-9972-667b5b7cad1b service nova] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Updating instance_info_cache with network_info: [{"id": "3d061027-8dbb-48b4-bbcd-b057c196a301", "address": "fa:16:3e:45:2b:d3", "network": {"id": "d942264a-f03e-49a2-89eb-103a12c99518", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484356505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edb839c76c0d4513b9be0ec92301707f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d061027-8d", "ovs_interfaceid": "3d061027-8dbb-48b4-bbcd-b057c196a301", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:10:04 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-090fbcda-a0f1-4c97-9b7c-e6de5463767e req-54851809-acfe-411e-9972-667b5b7cad1b service nova] Releasing lock "refresh_cache-ce616440-9d69-4812-8910-a2d9ad58f504" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:10:06 user nova-compute[103546]: DEBUG nova.compute.manager [req-8b3e1e19-9d07-4d70-a93b-c37cfcfff4d3 req-06005974-1b76-458a-b79e-6c8b994e3dd5 service nova] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Received event network-changed-3d061027-8dbb-48b4-bbcd-b057c196a301 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:10:06 user nova-compute[103546]: DEBUG nova.compute.manager [req-8b3e1e19-9d07-4d70-a93b-c37cfcfff4d3 req-06005974-1b76-458a-b79e-6c8b994e3dd5 service nova] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Refreshing instance network info cache due to event network-changed-3d061027-8dbb-48b4-bbcd-b057c196a301. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 04:10:06 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8b3e1e19-9d07-4d70-a93b-c37cfcfff4d3 req-06005974-1b76-458a-b79e-6c8b994e3dd5 service nova] Acquiring lock "refresh_cache-ce616440-9d69-4812-8910-a2d9ad58f504" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:10:06 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8b3e1e19-9d07-4d70-a93b-c37cfcfff4d3 req-06005974-1b76-458a-b79e-6c8b994e3dd5 service nova] Acquired lock "refresh_cache-ce616440-9d69-4812-8910-a2d9ad58f504" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:10:06 user nova-compute[103546]: DEBUG nova.network.neutron [req-8b3e1e19-9d07-4d70-a93b-c37cfcfff4d3 req-06005974-1b76-458a-b79e-6c8b994e3dd5 service nova] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Refreshing network info cache for port 3d061027-8dbb-48b4-bbcd-b057c196a301 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 04:10:07 user nova-compute[103546]: DEBUG nova.network.neutron [req-8b3e1e19-9d07-4d70-a93b-c37cfcfff4d3 req-06005974-1b76-458a-b79e-6c8b994e3dd5 service nova] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Updated VIF entry in instance network info cache for port 3d061027-8dbb-48b4-bbcd-b057c196a301. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 04:10:07 user nova-compute[103546]: DEBUG nova.network.neutron [req-8b3e1e19-9d07-4d70-a93b-c37cfcfff4d3 req-06005974-1b76-458a-b79e-6c8b994e3dd5 service nova] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Updating instance_info_cache with network_info: [{"id": "3d061027-8dbb-48b4-bbcd-b057c196a301", "address": "fa:16:3e:45:2b:d3", "network": {"id": "d942264a-f03e-49a2-89eb-103a12c99518", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484356505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edb839c76c0d4513b9be0ec92301707f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d061027-8d", "ovs_interfaceid": "3d061027-8dbb-48b4-bbcd-b057c196a301", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:10:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8b3e1e19-9d07-4d70-a93b-c37cfcfff4d3 req-06005974-1b76-458a-b79e-6c8b994e3dd5 service nova] Releasing lock "refresh_cache-ce616440-9d69-4812-8910-a2d9ad58f504" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:10:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-94dc59bf-0796-4826-8169-56568434ceaf tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Acquiring lock "ce616440-9d69-4812-8910-a2d9ad58f504" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:10:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-94dc59bf-0796-4826-8169-56568434ceaf tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "ce616440-9d69-4812-8910-a2d9ad58f504" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:10:07 user nova-compute[103546]: INFO nova.compute.manager [None req-94dc59bf-0796-4826-8169-56568434ceaf tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Rebooting instance
Nov 16 04:10:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-94dc59bf-0796-4826-8169-56568434ceaf tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Acquiring lock "refresh_cache-ce616440-9d69-4812-8910-a2d9ad58f504" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:10:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-94dc59bf-0796-4826-8169-56568434ceaf tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Acquired lock "refresh_cache-ce616440-9d69-4812-8910-a2d9ad58f504" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:10:07 user nova-compute[103546]: DEBUG nova.network.neutron [None req-94dc59bf-0796-4826-8169-56568434ceaf tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 04:10:07 user nova-compute[103546]: DEBUG nova.network.neutron [None req-94dc59bf-0796-4826-8169-56568434ceaf tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Updating instance_info_cache with network_info: [{"id": "3d061027-8dbb-48b4-bbcd-b057c196a301", "address": "fa:16:3e:45:2b:d3", "network": {"id": "d942264a-f03e-49a2-89eb-103a12c99518", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484356505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edb839c76c0d4513b9be0ec92301707f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d061027-8d", "ovs_interfaceid": "3d061027-8dbb-48b4-bbcd-b057c196a301", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:10:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-94dc59bf-0796-4826-8169-56568434ceaf tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Releasing lock "refresh_cache-ce616440-9d69-4812-8910-a2d9ad58f504" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:10:07 user nova-compute[103546]: DEBUG nova.compute.manager [None req-94dc59bf-0796-4826-8169-56568434ceaf tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 04:10:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:10 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:10 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:10 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:10 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:10 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:10 user nova-compute[103546]: DEBUG nova.compute.manager [req-7c02ea29-9370-4115-a23c-a58eb9519088 req-f6a3680a-5e23-4f0f-b5ec-35559c0722af service nova] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Received event network-vif-unplugged-3d061027-8dbb-48b4-bbcd-b057c196a301 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:10:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-7c02ea29-9370-4115-a23c-a58eb9519088 req-f6a3680a-5e23-4f0f-b5ec-35559c0722af service nova] Acquiring lock "ce616440-9d69-4812-8910-a2d9ad58f504-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:10:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-7c02ea29-9370-4115-a23c-a58eb9519088 req-f6a3680a-5e23-4f0f-b5ec-35559c0722af service nova] Lock "ce616440-9d69-4812-8910-a2d9ad58f504-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:10:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-7c02ea29-9370-4115-a23c-a58eb9519088 req-f6a3680a-5e23-4f0f-b5ec-35559c0722af service nova] Lock "ce616440-9d69-4812-8910-a2d9ad58f504-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:10:10 user nova-compute[103546]: DEBUG nova.compute.manager [req-7c02ea29-9370-4115-a23c-a58eb9519088 req-f6a3680a-5e23-4f0f-b5ec-35559c0722af service nova] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] No waiting events found dispatching network-vif-unplugged-3d061027-8dbb-48b4-bbcd-b057c196a301 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:10:10 user nova-compute[103546]: WARNING nova.compute.manager [req-7c02ea29-9370-4115-a23c-a58eb9519088 req-f6a3680a-5e23-4f0f-b5ec-35559c0722af service nova] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Received unexpected event network-vif-unplugged-3d061027-8dbb-48b4-bbcd-b057c196a301 for instance with vm_state active and task_state reboot_started.
Nov 16 04:10:10 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:10 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:10 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:10 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:10 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:11 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-94dc59bf-0796-4826-8169-56568434ceaf tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Instance shutdown successfully.
Nov 16 04:10:11 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:11 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:11 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:11 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:11 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:11 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:11 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:12 user nova-compute[103546]: DEBUG nova.compute.manager [req-6dadadae-e016-458a-8c08-166a38b8f0ff req-94094332-9d6f-4b51-8be3-0639d8d5342e service nova] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Received event network-vif-plugged-3d061027-8dbb-48b4-bbcd-b057c196a301 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:10:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6dadadae-e016-458a-8c08-166a38b8f0ff req-94094332-9d6f-4b51-8be3-0639d8d5342e service nova] Acquiring lock "ce616440-9d69-4812-8910-a2d9ad58f504-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:10:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6dadadae-e016-458a-8c08-166a38b8f0ff req-94094332-9d6f-4b51-8be3-0639d8d5342e service nova] Lock "ce616440-9d69-4812-8910-a2d9ad58f504-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:10:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6dadadae-e016-458a-8c08-166a38b8f0ff req-94094332-9d6f-4b51-8be3-0639d8d5342e service nova] Lock "ce616440-9d69-4812-8910-a2d9ad58f504-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:10:12 user nova-compute[103546]: DEBUG nova.compute.manager [req-6dadadae-e016-458a-8c08-166a38b8f0ff req-94094332-9d6f-4b51-8be3-0639d8d5342e service nova] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] No waiting events found dispatching network-vif-plugged-3d061027-8dbb-48b4-bbcd-b057c196a301 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:10:12 user nova-compute[103546]: WARNING nova.compute.manager [req-6dadadae-e016-458a-8c08-166a38b8f0ff req-94094332-9d6f-4b51-8be3-0639d8d5342e service nova] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Received unexpected event network-vif-plugged-3d061027-8dbb-48b4-bbcd-b057c196a301 for instance with vm_state active and task_state reboot_started.
Nov 16 04:10:12 user nova-compute[103546]: DEBUG nova.compute.manager [req-6dadadae-e016-458a-8c08-166a38b8f0ff req-94094332-9d6f-4b51-8be3-0639d8d5342e service nova] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Received event network-vif-plugged-3d061027-8dbb-48b4-bbcd-b057c196a301 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:10:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6dadadae-e016-458a-8c08-166a38b8f0ff req-94094332-9d6f-4b51-8be3-0639d8d5342e service nova] Acquiring lock "ce616440-9d69-4812-8910-a2d9ad58f504-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:10:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6dadadae-e016-458a-8c08-166a38b8f0ff req-94094332-9d6f-4b51-8be3-0639d8d5342e service nova] Lock "ce616440-9d69-4812-8910-a2d9ad58f504-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:10:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6dadadae-e016-458a-8c08-166a38b8f0ff req-94094332-9d6f-4b51-8be3-0639d8d5342e service nova] Lock "ce616440-9d69-4812-8910-a2d9ad58f504-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:10:12 user nova-compute[103546]: DEBUG nova.compute.manager [req-6dadadae-e016-458a-8c08-166a38b8f0ff req-94094332-9d6f-4b51-8be3-0639d8d5342e service nova] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] No waiting events found dispatching network-vif-plugged-3d061027-8dbb-48b4-bbcd-b057c196a301 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:10:12 user nova-compute[103546]: WARNING nova.compute.manager [req-6dadadae-e016-458a-8c08-166a38b8f0ff req-94094332-9d6f-4b51-8be3-0639d8d5342e service nova] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Received unexpected event network-vif-plugged-3d061027-8dbb-48b4-bbcd-b057c196a301 for instance with vm_state active and task_state reboot_started.
Nov 16 04:10:12 user nova-compute[103546]: DEBUG nova.compute.manager [req-6dadadae-e016-458a-8c08-166a38b8f0ff req-94094332-9d6f-4b51-8be3-0639d8d5342e service nova] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Received event network-vif-plugged-3d061027-8dbb-48b4-bbcd-b057c196a301 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:10:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6dadadae-e016-458a-8c08-166a38b8f0ff req-94094332-9d6f-4b51-8be3-0639d8d5342e service nova] Acquiring lock "ce616440-9d69-4812-8910-a2d9ad58f504-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:10:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6dadadae-e016-458a-8c08-166a38b8f0ff req-94094332-9d6f-4b51-8be3-0639d8d5342e service nova] Lock "ce616440-9d69-4812-8910-a2d9ad58f504-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:10:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6dadadae-e016-458a-8c08-166a38b8f0ff req-94094332-9d6f-4b51-8be3-0639d8d5342e service nova] Lock "ce616440-9d69-4812-8910-a2d9ad58f504-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:10:12 user nova-compute[103546]: DEBUG nova.compute.manager [req-6dadadae-e016-458a-8c08-166a38b8f0ff req-94094332-9d6f-4b51-8be3-0639d8d5342e service nova] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] No waiting events found dispatching network-vif-plugged-3d061027-8dbb-48b4-bbcd-b057c196a301 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:10:12 user nova-compute[103546]: WARNING nova.compute.manager [req-6dadadae-e016-458a-8c08-166a38b8f0ff req-94094332-9d6f-4b51-8be3-0639d8d5342e service nova] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Received unexpected event network-vif-plugged-3d061027-8dbb-48b4-bbcd-b057c196a301 for instance with vm_state active and task_state reboot_started.
Nov 16 04:10:12 user nova-compute[103546]: DEBUG nova.compute.manager [req-6dadadae-e016-458a-8c08-166a38b8f0ff req-94094332-9d6f-4b51-8be3-0639d8d5342e service nova] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Received event network-vif-unplugged-3d061027-8dbb-48b4-bbcd-b057c196a301 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:10:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6dadadae-e016-458a-8c08-166a38b8f0ff req-94094332-9d6f-4b51-8be3-0639d8d5342e service nova] Acquiring lock "ce616440-9d69-4812-8910-a2d9ad58f504-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:10:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6dadadae-e016-458a-8c08-166a38b8f0ff req-94094332-9d6f-4b51-8be3-0639d8d5342e service nova] Lock "ce616440-9d69-4812-8910-a2d9ad58f504-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:10:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6dadadae-e016-458a-8c08-166a38b8f0ff req-94094332-9d6f-4b51-8be3-0639d8d5342e service nova] Lock "ce616440-9d69-4812-8910-a2d9ad58f504-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:10:12 user nova-compute[103546]: DEBUG nova.compute.manager [req-6dadadae-e016-458a-8c08-166a38b8f0ff req-94094332-9d6f-4b51-8be3-0639d8d5342e service nova] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] No waiting events found dispatching network-vif-unplugged-3d061027-8dbb-48b4-bbcd-b057c196a301 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:10:12 user nova-compute[103546]: WARNING nova.compute.manager [req-6dadadae-e016-458a-8c08-166a38b8f0ff req-94094332-9d6f-4b51-8be3-0639d8d5342e service nova] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Received unexpected event network-vif-unplugged-3d061027-8dbb-48b4-bbcd-b057c196a301 for instance with vm_state active and task_state reboot_started.
Nov 16 04:10:12 user nova-compute[103546]: DEBUG nova.compute.manager [req-6dadadae-e016-458a-8c08-166a38b8f0ff req-94094332-9d6f-4b51-8be3-0639d8d5342e service nova] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Received event network-vif-plugged-3d061027-8dbb-48b4-bbcd-b057c196a301 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:10:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6dadadae-e016-458a-8c08-166a38b8f0ff req-94094332-9d6f-4b51-8be3-0639d8d5342e service nova] Acquiring lock "ce616440-9d69-4812-8910-a2d9ad58f504-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:10:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6dadadae-e016-458a-8c08-166a38b8f0ff req-94094332-9d6f-4b51-8be3-0639d8d5342e service nova] Lock "ce616440-9d69-4812-8910-a2d9ad58f504-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:10:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6dadadae-e016-458a-8c08-166a38b8f0ff req-94094332-9d6f-4b51-8be3-0639d8d5342e service nova] Lock "ce616440-9d69-4812-8910-a2d9ad58f504-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:10:12 user nova-compute[103546]: DEBUG nova.compute.manager [req-6dadadae-e016-458a-8c08-166a38b8f0ff req-94094332-9d6f-4b51-8be3-0639d8d5342e service nova] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] No waiting events found dispatching network-vif-plugged-3d061027-8dbb-48b4-bbcd-b057c196a301 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:10:12 user nova-compute[103546]: WARNING nova.compute.manager [req-6dadadae-e016-458a-8c08-166a38b8f0ff req-94094332-9d6f-4b51-8be3-0639d8d5342e service nova] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Received unexpected event network-vif-plugged-3d061027-8dbb-48b4-bbcd-b057c196a301 for instance with vm_state active and task_state reboot_started.
Nov 16 04:10:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:14 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Instance running successfully.
Nov 16 04:10:14 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-94dc59bf-0796-4826-8169-56568434ceaf tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Instance soft rebooted successfully.
Nov 16 04:10:14 user nova-compute[103546]: DEBUG nova.compute.manager [None req-94dc59bf-0796-4826-8169-56568434ceaf tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 04:10:14 user nova-compute[103546]: DEBUG nova.compute.manager [req-2c4f7a58-c00d-44f1-be31-0e8622636cf0 req-fafbbece-8271-4784-a902-fa6a22c911ba service nova] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Received event network-vif-plugged-3d061027-8dbb-48b4-bbcd-b057c196a301 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:10:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-2c4f7a58-c00d-44f1-be31-0e8622636cf0 req-fafbbece-8271-4784-a902-fa6a22c911ba service nova] Acquiring lock "ce616440-9d69-4812-8910-a2d9ad58f504-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:10:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-2c4f7a58-c00d-44f1-be31-0e8622636cf0 req-fafbbece-8271-4784-a902-fa6a22c911ba service nova] Lock "ce616440-9d69-4812-8910-a2d9ad58f504-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:10:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-2c4f7a58-c00d-44f1-be31-0e8622636cf0 req-fafbbece-8271-4784-a902-fa6a22c911ba service nova] Lock "ce616440-9d69-4812-8910-a2d9ad58f504-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:10:14 user nova-compute[103546]: DEBUG nova.compute.manager [req-2c4f7a58-c00d-44f1-be31-0e8622636cf0 req-fafbbece-8271-4784-a902-fa6a22c911ba service nova] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] No waiting events found dispatching network-vif-plugged-3d061027-8dbb-48b4-bbcd-b057c196a301 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:10:14 user nova-compute[103546]: WARNING nova.compute.manager [req-2c4f7a58-c00d-44f1-be31-0e8622636cf0 req-fafbbece-8271-4784-a902-fa6a22c911ba service nova] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Received unexpected event network-vif-plugged-3d061027-8dbb-48b4-bbcd-b057c196a301 for instance with vm_state active and task_state reboot_started.
Nov 16 04:10:14 user nova-compute[103546]: DEBUG nova.compute.manager [req-2c4f7a58-c00d-44f1-be31-0e8622636cf0 req-fafbbece-8271-4784-a902-fa6a22c911ba service nova] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Received event network-vif-plugged-3d061027-8dbb-48b4-bbcd-b057c196a301 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:10:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-2c4f7a58-c00d-44f1-be31-0e8622636cf0 req-fafbbece-8271-4784-a902-fa6a22c911ba service nova] Acquiring lock "ce616440-9d69-4812-8910-a2d9ad58f504-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:10:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-2c4f7a58-c00d-44f1-be31-0e8622636cf0 req-fafbbece-8271-4784-a902-fa6a22c911ba service nova] Lock "ce616440-9d69-4812-8910-a2d9ad58f504-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:10:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-2c4f7a58-c00d-44f1-be31-0e8622636cf0 req-fafbbece-8271-4784-a902-fa6a22c911ba service nova] Lock "ce616440-9d69-4812-8910-a2d9ad58f504-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:10:14 user nova-compute[103546]: DEBUG nova.compute.manager [req-2c4f7a58-c00d-44f1-be31-0e8622636cf0 req-fafbbece-8271-4784-a902-fa6a22c911ba service nova] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] No waiting events found dispatching network-vif-plugged-3d061027-8dbb-48b4-bbcd-b057c196a301 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:10:14 user nova-compute[103546]: WARNING nova.compute.manager [req-2c4f7a58-c00d-44f1-be31-0e8622636cf0 req-fafbbece-8271-4784-a902-fa6a22c911ba service nova] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Received unexpected event network-vif-plugged-3d061027-8dbb-48b4-bbcd-b057c196a301 for instance with vm_state active and task_state reboot_started.
Nov 16 04:10:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-94dc59bf-0796-4826-8169-56568434ceaf tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "ce616440-9d69-4812-8910-a2d9ad58f504" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.145s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:10:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b2e538b9-23ad-4039-91b1-086222874bb1 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Acquiring lock "8c02873d-469e-41a4-b492-69f793c8a07c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:10:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b2e538b9-23ad-4039-91b1-086222874bb1 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "8c02873d-469e-41a4-b492-69f793c8a07c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:10:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b2e538b9-23ad-4039-91b1-086222874bb1 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Acquiring lock "8c02873d-469e-41a4-b492-69f793c8a07c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:10:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b2e538b9-23ad-4039-91b1-086222874bb1 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "8c02873d-469e-41a4-b492-69f793c8a07c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:10:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b2e538b9-23ad-4039-91b1-086222874bb1 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "8c02873d-469e-41a4-b492-69f793c8a07c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:10:15 user nova-compute[103546]: INFO nova.compute.manager [None req-b2e538b9-23ad-4039-91b1-086222874bb1 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Terminating instance
Nov 16 04:10:15 user nova-compute[103546]: DEBUG nova.compute.manager [None req-b2e538b9-23ad-4039-91b1-086222874bb1 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Start destroying the instance on the hypervisor. {{(pid=103546) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 04:10:15 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:15 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:15 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:15 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:16 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Instance destroyed successfully.
Nov 16 04:10:16 user nova-compute[103546]: DEBUG nova.objects.instance [None req-b2e538b9-23ad-4039-91b1-086222874bb1 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lazy-loading 'resources' on Instance uuid 8c02873d-469e-41a4-b492-69f793c8a07c {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:10:16 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-b2e538b9-23ad-4039-91b1-086222874bb1 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:03:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-563151612',display_name='tempest-ServerRescueNegativeTestJSON-server-563151612',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-563151612',id=41,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPimoHFW0lef+vE/gmpf/A37NZe+DyQwwLeT9RTaaZRkk4sSIIvf2JY7pK9OsbSpgTcfdwXllC/ZBjX4ZD6jJMjV9YFlTmNXttYPxCshd7r/7KOHpnM6mHKwsTuNdrmBLA==',key_name='tempest-keypair-959060809',keypairs=<?>,launch_index=0,launched_at=2023-11-16T04:05:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ca049d5674dc4c59814f98478752d73d',ramdisk_id='',reservation_id='r-judr5tlu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1943614153',owner_user_name='tempest-ServerRescueNegativeTestJSON-1943614153-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T04:07:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7626749c82fb4b5c81e696e4beeed858',uuid=8c02873d-469e-41a4-b492-69f793c8a07c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96edd323-af11-4e10-a7bb-a6e0d0ea12ff", "address": "fa:16:3e:5a:5c:31", "network": {"id": "337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-40560053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca049d5674dc4c59814f98478752d73d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96edd323-af", "ovs_interfaceid": "96edd323-af11-4e10-a7bb-a6e0d0ea12ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 04:10:16 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-b2e538b9-23ad-4039-91b1-086222874bb1 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Converting VIF {"id": "96edd323-af11-4e10-a7bb-a6e0d0ea12ff", "address": "fa:16:3e:5a:5c:31", "network": {"id": "337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-40560053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca049d5674dc4c59814f98478752d73d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96edd323-af", "ovs_interfaceid": "96edd323-af11-4e10-a7bb-a6e0d0ea12ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:10:16 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-b2e538b9-23ad-4039-91b1-086222874bb1 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5a:5c:31,bridge_name='br-int',has_traffic_filtering=True,id=96edd323-af11-4e10-a7bb-a6e0d0ea12ff,network=Network(337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96edd323-af') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:10:16 user nova-compute[103546]: DEBUG os_vif [None req-b2e538b9-23ad-4039-91b1-086222874bb1 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:5c:31,bridge_name='br-int',has_traffic_filtering=True,id=96edd323-af11-4e10-a7bb-a6e0d0ea12ff,network=Network(337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96edd323-af') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 04:10:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96edd323-af, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:10:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:10:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c8101188-88fe-414c-b1dd-65e40d4c42d5) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:10:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:10:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:16 user nova-compute[103546]: INFO os_vif [None req-b2e538b9-23ad-4039-91b1-086222874bb1 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:5c:31,bridge_name='br-int',has_traffic_filtering=True,id=96edd323-af11-4e10-a7bb-a6e0d0ea12ff,network=Network(337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96edd323-af')
Nov 16 04:10:16 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-b2e538b9-23ad-4039-91b1-086222874bb1 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Deleting instance files /opt/stack/data/nova/instances/8c02873d-469e-41a4-b492-69f793c8a07c_del
Nov 16 04:10:16 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-b2e538b9-23ad-4039-91b1-086222874bb1 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Deletion of /opt/stack/data/nova/instances/8c02873d-469e-41a4-b492-69f793c8a07c_del complete
Nov 16 04:10:16 user nova-compute[103546]: INFO nova.compute.manager [None req-b2e538b9-23ad-4039-91b1-086222874bb1 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 16 04:10:16 user nova-compute[103546]: DEBUG oslo.service.loopingcall [None req-b2e538b9-23ad-4039-91b1-086222874bb1 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=103546) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 04:10:16 user nova-compute[103546]: DEBUG nova.compute.manager [-] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Deallocating network for instance {{(pid=103546) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 04:10:16 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] deallocate_for_instance() {{(pid=103546) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 04:10:16 user nova-compute[103546]: DEBUG nova.compute.manager [req-910d7b32-6cce-4c82-99ff-4d5fa504ae01 req-29ba072a-63e6-436f-8a81-626e610d9492 service nova] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Received event network-vif-unplugged-96edd323-af11-4e10-a7bb-a6e0d0ea12ff {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:10:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-910d7b32-6cce-4c82-99ff-4d5fa504ae01 req-29ba072a-63e6-436f-8a81-626e610d9492 service nova] Acquiring lock "8c02873d-469e-41a4-b492-69f793c8a07c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:10:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-910d7b32-6cce-4c82-99ff-4d5fa504ae01 req-29ba072a-63e6-436f-8a81-626e610d9492 service nova] Lock "8c02873d-469e-41a4-b492-69f793c8a07c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:10:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-910d7b32-6cce-4c82-99ff-4d5fa504ae01 req-29ba072a-63e6-436f-8a81-626e610d9492 service nova] Lock "8c02873d-469e-41a4-b492-69f793c8a07c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:10:16 user nova-compute[103546]: DEBUG nova.compute.manager [req-910d7b32-6cce-4c82-99ff-4d5fa504ae01 req-29ba072a-63e6-436f-8a81-626e610d9492 service nova] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] No waiting events found dispatching network-vif-unplugged-96edd323-af11-4e10-a7bb-a6e0d0ea12ff {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:10:16 user nova-compute[103546]: DEBUG nova.compute.manager [req-910d7b32-6cce-4c82-99ff-4d5fa504ae01 req-29ba072a-63e6-436f-8a81-626e610d9492 service nova] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Received event network-vif-unplugged-96edd323-af11-4e10-a7bb-a6e0d0ea12ff for instance with task_state deleting. {{(pid=103546) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 04:10:16 user nova-compute[103546]: DEBUG nova.compute.manager [req-910d7b32-6cce-4c82-99ff-4d5fa504ae01 req-29ba072a-63e6-436f-8a81-626e610d9492 service nova] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Received event network-vif-plugged-96edd323-af11-4e10-a7bb-a6e0d0ea12ff {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:10:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-910d7b32-6cce-4c82-99ff-4d5fa504ae01 req-29ba072a-63e6-436f-8a81-626e610d9492 service nova] Acquiring lock "8c02873d-469e-41a4-b492-69f793c8a07c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:10:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-910d7b32-6cce-4c82-99ff-4d5fa504ae01 req-29ba072a-63e6-436f-8a81-626e610d9492 service nova] Lock "8c02873d-469e-41a4-b492-69f793c8a07c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:10:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-910d7b32-6cce-4c82-99ff-4d5fa504ae01 req-29ba072a-63e6-436f-8a81-626e610d9492 service nova] Lock "8c02873d-469e-41a4-b492-69f793c8a07c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:10:16 user nova-compute[103546]: DEBUG nova.compute.manager [req-910d7b32-6cce-4c82-99ff-4d5fa504ae01 req-29ba072a-63e6-436f-8a81-626e610d9492 service nova] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] No waiting events found dispatching network-vif-plugged-96edd323-af11-4e10-a7bb-a6e0d0ea12ff {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:10:16 user nova-compute[103546]: WARNING nova.compute.manager [req-910d7b32-6cce-4c82-99ff-4d5fa504ae01 req-29ba072a-63e6-436f-8a81-626e610d9492 service nova] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Received unexpected event network-vif-plugged-96edd323-af11-4e10-a7bb-a6e0d0ea12ff for instance with vm_state active and task_state deleting.
Nov 16 04:10:17 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:10:17 user nova-compute[103546]: INFO nova.compute.manager [-] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Took 1.05 seconds to deallocate network for instance.
Nov 16 04:10:17 user nova-compute[103546]: DEBUG nova.compute.manager [req-5958a588-975f-4e9c-a913-a9a31462bc8c req-44468327-0abd-4484-b0e5-4184c3659a61 service nova] [instance: 8c02873d-469e-41a4-b492-69f793c8a07c] Received event network-vif-deleted-96edd323-af11-4e10-a7bb-a6e0d0ea12ff {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:10:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b2e538b9-23ad-4039-91b1-086222874bb1 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:10:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b2e538b9-23ad-4039-91b1-086222874bb1 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:10:17 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-b2e538b9-23ad-4039-91b1-086222874bb1 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:10:17 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-b2e538b9-23ad-4039-91b1-086222874bb1 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:10:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b2e538b9-23ad-4039-91b1-086222874bb1 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.281s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:10:17 user nova-compute[103546]: INFO nova.scheduler.client.report [None req-b2e538b9-23ad-4039-91b1-086222874bb1 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Deleted allocations for instance 8c02873d-469e-41a4-b492-69f793c8a07c
Nov 16 04:10:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b2e538b9-23ad-4039-91b1-086222874bb1 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "8c02873d-469e-41a4-b492-69f793c8a07c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.499s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:10:18 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:19 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:23 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:24 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:25 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:28 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Acquiring lock "2fdca5a2-7e02-4c4a-96ae-cc61547232c1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:10:28 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Lock "2fdca5a2-7e02-4c4a-96ae-cc61547232c1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:10:29 user nova-compute[103546]: DEBUG nova.compute.manager [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Starting instance... {{(pid=103546) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 04:10:29 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:10:29 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:10:29 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=103546) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 04:10:29 user nova-compute[103546]: INFO nova.compute.claims [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Claim successful on node user
Nov 16 04:10:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:29 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:10:29 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:10:29 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.349s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:10:29 user nova-compute[103546]: DEBUG nova.compute.manager [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Start building networks asynchronously for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 04:10:29 user nova-compute[103546]: DEBUG nova.compute.manager [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Allocating IP information in the background. {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 04:10:29 user nova-compute[103546]: DEBUG nova.network.neutron [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] allocate_for_instance() {{(pid=103546) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 04:10:29 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 04:10:29 user nova-compute[103546]: DEBUG nova.compute.manager [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Start building block device mappings for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 04:10:29 user nova-compute[103546]: DEBUG nova.policy [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd8d2d54f82e5409d8c45166c3379b08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a17119476d4eea9a39078a48af5a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103546) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 04:10:29 user nova-compute[103546]: DEBUG nova.compute.manager [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Start spawning the instance on the hypervisor. {{(pid=103546) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 04:10:29 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Creating instance directory {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 04:10:29 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Creating image(s)
Nov 16 04:10:29 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Acquiring lock "/opt/stack/data/nova/instances/2fdca5a2-7e02-4c4a-96ae-cc61547232c1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:10:29 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Lock "/opt/stack/data/nova/instances/2fdca5a2-7e02-4c4a-96ae-cc61547232c1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:10:29 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Lock "/opt/stack/data/nova/instances/2fdca5a2-7e02-4c4a-96ae-cc61547232c1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:10:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:10:29 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:10:29 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=103546) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 04:10:29 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager.update_available_resource {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:10:29 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:10:29 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:10:29 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:10:29 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Auditing locally available compute resources for user (node: user) {{(pid=103546) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 04:10:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.463s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:10:30 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Acquiring lock "8c9efafb670bfe5842ba1f4ce398924612164af7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:10:30 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:10:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:10:30 user nova-compute[103546]: DEBUG nova.network.neutron [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Successfully created port: 9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a {{(pid=103546) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 04:10:30 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Acquiring lock "061acca0-e5a9-4eb0-bf5c-d81472ec4b83" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:10:30 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Lock "061acca0-e5a9-4eb0-bf5c-d81472ec4b83" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:10:30 user nova-compute[103546]: DEBUG nova.compute.manager [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] [instance: 061acca0-e5a9-4eb0-bf5c-d81472ec4b83] Starting instance... {{(pid=103546) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 04:10:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:10:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.234s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:10:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/2fdca5a2-7e02-4c4a-96ae-cc61547232c1/disk 1073741824 {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:10:30 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:10:30 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:10:30 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=103546) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 04:10:30 user nova-compute[103546]: INFO nova.compute.claims [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] [instance: 061acca0-e5a9-4eb0-bf5c-d81472ec4b83] Claim successful on node user
Nov 16 04:10:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/2fdca5a2-7e02-4c4a-96ae-cc61547232c1/disk 1073741824" returned: 0 in 0.068s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:10:30 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.307s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:10:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:10:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:10:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:10:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.196s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:10:30 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2fdca5a2-7e02-4c4a-96ae-cc61547232c1/disk. size=1073741824 {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 04:10:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fdca5a2-7e02-4c4a-96ae-cc61547232c1/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:10:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:10:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba82fe3-33e6-4ae4-8716-2efbe66a6f06/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:10:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fdca5a2-7e02-4c4a-96ae-cc61547232c1/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:10:30 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Cannot resize image /opt/stack/data/nova/instances/2fdca5a2-7e02-4c4a-96ae-cc61547232c1/disk to a smaller size. {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 04:10:30 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Created local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 04:10:30 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Ensure instance console log exists: /opt/stack/data/nova/instances/2fdca5a2-7e02-4c4a-96ae-cc61547232c1/console.log {{(pid=103546) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 04:10:30 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:10:30 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:10:30 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:10:30 user nova-compute[103546]: DEBUG nova.network.neutron [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Successfully updated port: 9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 04:10:30 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Acquiring lock "refresh_cache-2fdca5a2-7e02-4c4a-96ae-cc61547232c1" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:10:30 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Acquired lock "refresh_cache-2fdca5a2-7e02-4c4a-96ae-cc61547232c1" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:10:30 user nova-compute[103546]: DEBUG nova.network.neutron [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 04:10:30 user nova-compute[103546]: DEBUG nova.compute.manager [req-7c58a9b2-e811-49c7-a55e-ea108bc2f2eb req-db054a0b-7d38-4c9e-a7dd-9eb09bc733df service nova] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Received event network-changed-9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:10:30 user nova-compute[103546]: DEBUG nova.compute.manager [req-7c58a9b2-e811-49c7-a55e-ea108bc2f2eb req-db054a0b-7d38-4c9e-a7dd-9eb09bc733df service nova] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Refreshing instance network info cache due to event network-changed-9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 04:10:30 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-7c58a9b2-e811-49c7-a55e-ea108bc2f2eb req-db054a0b-7d38-4c9e-a7dd-9eb09bc733df service nova] Acquiring lock "refresh_cache-2fdca5a2-7e02-4c4a-96ae-cc61547232c1" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:10:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba82fe3-33e6-4ae4-8716-2efbe66a6f06/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:10:30 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba82fe3-33e6-4ae4-8716-2efbe66a6f06/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:10:30 user nova-compute[103546]: DEBUG nova.network.neutron [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 04:10:30 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:10:30 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.596s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG nova.compute.manager [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] [instance: 061acca0-e5a9-4eb0-bf5c-d81472ec4b83] Start building networks asynchronously for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG nova.compute.manager [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] [instance: 061acca0-e5a9-4eb0-bf5c-d81472ec4b83] Allocating IP information in the background. {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG nova.network.neutron [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] [instance: 061acca0-e5a9-4eb0-bf5c-d81472ec4b83] allocate_for_instance() {{(pid=103546) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba82fe3-33e6-4ae4-8716-2efbe66a6f06/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:10:31 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] [instance: 061acca0-e5a9-4eb0-bf5c-d81472ec4b83] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 04:10:31 user nova-compute[103546]: DEBUG nova.compute.manager [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] [instance: 061acca0-e5a9-4eb0-bf5c-d81472ec4b83] Start building block device mappings for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG nova.network.neutron [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Updating instance_info_cache with network_info: [{"id": "9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a", "address": "fa:16:3e:f0:c5:13", "network": {"id": "5f10f091-8358-4c8c-92bb-999d989f26b0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-513865819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18a17119476d4eea9a39078a48af5a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a11f3f3-1a", "ovs_interfaceid": "9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG nova.policy [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '79f4ff3a7d6d47949f664d17e1d64a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ab3113e86994ad1928990adae464bd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103546) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Releasing lock "refresh_cache-2fdca5a2-7e02-4c4a-96ae-cc61547232c1" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG nova.compute.manager [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Instance network_info: |[{"id": "9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a", "address": "fa:16:3e:f0:c5:13", "network": {"id": "5f10f091-8358-4c8c-92bb-999d989f26b0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-513865819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18a17119476d4eea9a39078a48af5a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a11f3f3-1a", "ovs_interfaceid": "9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-7c58a9b2-e811-49c7-a55e-ea108bc2f2eb req-db054a0b-7d38-4c9e-a7dd-9eb09bc733df service nova] Acquired lock "refresh_cache-2fdca5a2-7e02-4c4a-96ae-cc61547232c1" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG nova.network.neutron [req-7c58a9b2-e811-49c7-a55e-ea108bc2f2eb req-db054a0b-7d38-4c9e-a7dd-9eb09bc733df service nova] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Refreshing network info cache for port 9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Start _get_guest_xml network_info=[{"id": "9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a", "address": "fa:16:3e:f0:c5:13", "network": {"id": "5f10f091-8358-4c8c-92bb-999d989f26b0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-513865819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18a17119476d4eea9a39078a48af5a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a11f3f3-1a", "ovs_interfaceid": "9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '5c6f539a-01e5-4478-bf8f-a14310b5d7dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 04:10:31 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:10:31 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:10:31 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:10:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1044774600',display_name='tempest-ServerStableDeviceRescueTest-server-1044774600',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1044774600',id=46,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNj1JcuBCA8b1ASnZxEflVqxgwfGpOs0NT6q9GQ5ZSTNz5RgrGMdfc/dVQXXiVOxcYts+JD3hMifKvk9y98rW6TatUxDOWAmZ3/8ty/1zZeWm+ytAI6z5EPvdNn6qG4xhQ==',key_name='tempest-keypair-218434465',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18a17119476d4eea9a39078a48af5a56',ramdisk_id='',reservation_id='r-tkm2shtw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-195956273',owner_user_name='tempest-ServerStableDeviceRescueTest-195956273-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T04:10:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8d2d54f82e5409d8c45166c3379b08f',uuid=2fdca5a2-7e02-4c4a-96ae-cc61547232c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a", "address": "fa:16:3e:f0:c5:13", "network": {"id": "5f10f091-8358-4c8c-92bb-999d989f26b0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-513865819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18a17119476d4eea9a39078a48af5a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a11f3f3-1a", "ovs_interfaceid": "9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Converting VIF {"id": "9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a", "address": "fa:16:3e:f0:c5:13", "network": {"id": "5f10f091-8358-4c8c-92bb-999d989f26b0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-513865819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18a17119476d4eea9a39078a48af5a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a11f3f3-1a", "ovs_interfaceid": "9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:c5:13,bridge_name='br-int',has_traffic_filtering=True,id=9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a,network=Network(5f10f091-8358-4c8c-92bb-999d989f26b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a11f3f3-1a') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG nova.objects.instance [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Lazy-loading 'pci_devices' on Instance uuid 2fdca5a2-7e02-4c4a-96ae-cc61547232c1 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG nova.compute.manager [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] [instance: 061acca0-e5a9-4eb0-bf5c-d81472ec4b83] Start spawning the instance on the hypervisor. {{(pid=103546) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] [instance: 061acca0-e5a9-4eb0-bf5c-d81472ec4b83] Creating instance directory {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 04:10:31 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] [instance: 061acca0-e5a9-4eb0-bf5c-d81472ec4b83] Creating image(s)
Nov 16 04:10:31 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Acquiring lock "/opt/stack/data/nova/instances/061acca0-e5a9-4eb0-bf5c-d81472ec4b83/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Lock "/opt/stack/data/nova/instances/061acca0-e5a9-4eb0-bf5c-d81472ec4b83/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Lock "/opt/stack/data/nova/instances/061acca0-e5a9-4eb0-bf5c-d81472ec4b83/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] End _get_guest_xml xml=<domain type="kvm">
Nov 16 04:10:31 user nova-compute[103546]:   <uuid>2fdca5a2-7e02-4c4a-96ae-cc61547232c1</uuid>
Nov 16 04:10:31 user nova-compute[103546]:   <name>instance-0000002e</name>
Nov 16 04:10:31 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 04:10:31 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 04:10:31 user nova-compute[103546]:   <metadata>
Nov 16 04:10:31 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 04:10:31 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 04:10:31 user nova-compute[103546]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1044774600</nova:name>
Nov 16 04:10:31 user nova-compute[103546]:       <nova:creationTime>2023-11-16 04:10:31</nova:creationTime>
Nov 16 04:10:31 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 04:10:31 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 04:10:31 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 04:10:31 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 04:10:31 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 04:10:31 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 04:10:31 user nova-compute[103546]:       </nova:flavor>
Nov 16 04:10:31 user nova-compute[103546]:       <nova:owner>
Nov 16 04:10:31 user nova-compute[103546]:         <nova:user uuid="d8d2d54f82e5409d8c45166c3379b08f">tempest-ServerStableDeviceRescueTest-195956273-project-member</nova:user>
Nov 16 04:10:31 user nova-compute[103546]:         <nova:project uuid="18a17119476d4eea9a39078a48af5a56">tempest-ServerStableDeviceRescueTest-195956273</nova:project>
Nov 16 04:10:31 user nova-compute[103546]:       </nova:owner>
Nov 16 04:10:31 user nova-compute[103546]:       <nova:root type="image" uuid="5c6f539a-01e5-4478-bf8f-a14310b5d7dd"/>
Nov 16 04:10:31 user nova-compute[103546]:       <nova:ports>
Nov 16 04:10:31 user nova-compute[103546]:         <nova:port uuid="9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a">
Nov 16 04:10:31 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 04:10:31 user nova-compute[103546]:         </nova:port>
Nov 16 04:10:31 user nova-compute[103546]:       </nova:ports>
Nov 16 04:10:31 user nova-compute[103546]:     </nova:instance>
Nov 16 04:10:31 user nova-compute[103546]:   </metadata>
Nov 16 04:10:31 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 04:10:31 user nova-compute[103546]:     <system>
Nov 16 04:10:31 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 04:10:31 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 04:10:31 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 04:10:31 user nova-compute[103546]:       <entry name="serial">2fdca5a2-7e02-4c4a-96ae-cc61547232c1</entry>
Nov 16 04:10:31 user nova-compute[103546]:       <entry name="uuid">2fdca5a2-7e02-4c4a-96ae-cc61547232c1</entry>
Nov 16 04:10:31 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 04:10:31 user nova-compute[103546]:     </system>
Nov 16 04:10:31 user nova-compute[103546]:   </sysinfo>
Nov 16 04:10:31 user nova-compute[103546]:   <os>
Nov 16 04:10:31 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 04:10:31 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 04:10:31 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 04:10:31 user nova-compute[103546]:   </os>
Nov 16 04:10:31 user nova-compute[103546]:   <features>
Nov 16 04:10:31 user nova-compute[103546]:     <acpi/>
Nov 16 04:10:31 user nova-compute[103546]:     <apic/>
Nov 16 04:10:31 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 04:10:31 user nova-compute[103546]:   </features>
Nov 16 04:10:31 user nova-compute[103546]:   <clock offset="utc">
Nov 16 04:10:31 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 04:10:31 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 04:10:31 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 04:10:31 user nova-compute[103546]:   </clock>
Nov 16 04:10:31 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 04:10:31 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 04:10:31 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 04:10:31 user nova-compute[103546]:   </cpu>
Nov 16 04:10:31 user nova-compute[103546]:   <devices>
Nov 16 04:10:31 user nova-compute[103546]:     <disk type="file" device="disk">
Nov 16 04:10:31 user nova-compute[103546]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 04:10:31 user nova-compute[103546]:       <source file="/opt/stack/data/nova/instances/2fdca5a2-7e02-4c4a-96ae-cc61547232c1/disk"/>
Nov 16 04:10:31 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 04:10:31 user nova-compute[103546]:     </disk>
Nov 16 04:10:31 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 04:10:31 user nova-compute[103546]:       <mac address="fa:16:3e:f0:c5:13"/>
Nov 16 04:10:31 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 04:10:31 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 04:10:31 user nova-compute[103546]:       <target dev="tap9a11f3f3-1a"/>
Nov 16 04:10:31 user nova-compute[103546]:     </interface>
Nov 16 04:10:31 user nova-compute[103546]:     <serial type="pty">
Nov 16 04:10:31 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/2fdca5a2-7e02-4c4a-96ae-cc61547232c1/console.log" append="off"/>
Nov 16 04:10:31 user nova-compute[103546]:     </serial>
Nov 16 04:10:31 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 04:10:31 user nova-compute[103546]:     <video>
Nov 16 04:10:31 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 04:10:31 user nova-compute[103546]:     </video>
Nov 16 04:10:31 user nova-compute[103546]:     <rng model="virtio">
Nov 16 04:10:31 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 04:10:31 user nova-compute[103546]:     </rng>
Nov 16 04:10:31 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 04:10:31 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 04:10:31 user nova-compute[103546]:       <stats period="10"/>
Nov 16 04:10:31 user nova-compute[103546]:     </memballoon>
Nov 16 04:10:31 user nova-compute[103546]:   </devices>
Nov 16 04:10:31 user nova-compute[103546]: </domain>
Nov 16 04:10:31 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:10:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1044774600',display_name='tempest-ServerStableDeviceRescueTest-server-1044774600',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1044774600',id=46,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNj1JcuBCA8b1ASnZxEflVqxgwfGpOs0NT6q9GQ5ZSTNz5RgrGMdfc/dVQXXiVOxcYts+JD3hMifKvk9y98rW6TatUxDOWAmZ3/8ty/1zZeWm+ytAI6z5EPvdNn6qG4xhQ==',key_name='tempest-keypair-218434465',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18a17119476d4eea9a39078a48af5a56',ramdisk_id='',reservation_id='r-tkm2shtw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-195956273',owner_user_name='tempest-ServerStableDeviceRescueTest-195956273-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T04:10:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8d2d54f82e5409d8c45166c3379b08f',uuid=2fdca5a2-7e02-4c4a-96ae-cc61547232c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a", "address": "fa:16:3e:f0:c5:13", "network": {"id": "5f10f091-8358-4c8c-92bb-999d989f26b0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-513865819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18a17119476d4eea9a39078a48af5a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a11f3f3-1a", "ovs_interfaceid": "9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Converting VIF {"id": "9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a", "address": "fa:16:3e:f0:c5:13", "network": {"id": "5f10f091-8358-4c8c-92bb-999d989f26b0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-513865819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18a17119476d4eea9a39078a48af5a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a11f3f3-1a", "ovs_interfaceid": "9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:c5:13,bridge_name='br-int',has_traffic_filtering=True,id=9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a,network=Network(5f10f091-8358-4c8c-92bb-999d989f26b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a11f3f3-1a') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG os_vif [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:c5:13,bridge_name='br-int',has_traffic_filtering=True,id=9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a,network=Network(5f10f091-8358-4c8c-92bb-999d989f26b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a11f3f3-1a') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fdcef5f4-6dd8-5aec-b548-604dd1f041a3', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9a11f3f3-1a, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9a11f3f3-1a, col_values=(('qos', UUID('f493e2b4-36bb-4d95-b9b9-ef9f02c4a7b6')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9a11f3f3-1a, col_values=(('external_ids', {'iface-id': '9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:c5:13', 'vm-uuid': '2fdca5a2-7e02-4c4a-96ae-cc61547232c1'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:10:31 user nova-compute[103546]: INFO os_vif [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:c5:13,bridge_name='br-int',has_traffic_filtering=True,id=9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a,network=Network(5f10f091-8358-4c8c-92bb-999d989f26b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a11f3f3-1a')
Nov 16 04:10:31 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] No VIF found with MAC fa:16:3e:f0:c5:13, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.rescue --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.273s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Acquiring lock "8c9efafb670bfe5842ba1f4ce398924612164af7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.206s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/061acca0-e5a9-4eb0-bf5c-d81472ec4b83/disk 1073741824 {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.rescue --force-share --output=json" returned: 0 in 0.305s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG nova.network.neutron [req-7c58a9b2-e811-49c7-a55e-ea108bc2f2eb req-db054a0b-7d38-4c9e-a7dd-9eb09bc733df service nova] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Updated VIF entry in instance network info cache for port 9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG nova.network.neutron [req-7c58a9b2-e811-49c7-a55e-ea108bc2f2eb req-db054a0b-7d38-4c9e-a7dd-9eb09bc733df service nova] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Updating instance_info_cache with network_info: [{"id": "9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a", "address": "fa:16:3e:f0:c5:13", "network": {"id": "5f10f091-8358-4c8c-92bb-999d989f26b0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-513865819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18a17119476d4eea9a39078a48af5a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a11f3f3-1a", "ovs_interfaceid": "9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:10:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.rescue --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:10:32 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-7c58a9b2-e811-49c7-a55e-ea108bc2f2eb req-db054a0b-7d38-4c9e-a7dd-9eb09bc733df service nova] Releasing lock "refresh_cache-2fdca5a2-7e02-4c4a-96ae-cc61547232c1" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:10:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/061acca0-e5a9-4eb0-bf5c-d81472ec4b83/disk 1073741824" returned: 0 in 0.112s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:10:32 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.325s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:10:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:10:32 user nova-compute[103546]: DEBUG nova.network.neutron [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] [instance: 061acca0-e5a9-4eb0-bf5c-d81472ec4b83] Successfully created port: a80152d0-325a-4285-89b6-db143d556ed6 {{(pid=103546) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 04:10:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk.rescue --force-share --output=json" returned: 0 in 0.251s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:10:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:10:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.234s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:10:32 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Checking if we can resize image /opt/stack/data/nova/instances/061acca0-e5a9-4eb0-bf5c-d81472ec4b83/disk. size=1073741824 {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 04:10:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061acca0-e5a9-4eb0-bf5c-d81472ec4b83/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:10:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:10:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:10:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061acca0-e5a9-4eb0-bf5c-d81472ec4b83/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:10:32 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Cannot resize image /opt/stack/data/nova/instances/061acca0-e5a9-4eb0-bf5c-d81472ec4b83/disk to a smaller size. {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 04:10:32 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] [instance: 061acca0-e5a9-4eb0-bf5c-d81472ec4b83] Created local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 04:10:32 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] [instance: 061acca0-e5a9-4eb0-bf5c-d81472ec4b83] Ensure instance console log exists: /opt/stack/data/nova/instances/061acca0-e5a9-4eb0-bf5c-d81472ec4b83/console.log {{(pid=103546) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 04:10:32 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:10:32 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:10:32 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:10:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:10:32 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 04:10:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce616440-9d69-4812-8910-a2d9ad58f504/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:10:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce616440-9d69-4812-8910-a2d9ad58f504/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:10:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce616440-9d69-4812-8910-a2d9ad58f504/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:10:32 user nova-compute[103546]: DEBUG nova.network.neutron [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] [instance: 061acca0-e5a9-4eb0-bf5c-d81472ec4b83] Successfully updated port: a80152d0-325a-4285-89b6-db143d556ed6 {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 04:10:32 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Acquiring lock "refresh_cache-061acca0-e5a9-4eb0-bf5c-d81472ec4b83" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:10:32 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Acquired lock "refresh_cache-061acca0-e5a9-4eb0-bf5c-d81472ec4b83" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:10:32 user nova-compute[103546]: DEBUG nova.network.neutron [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] [instance: 061acca0-e5a9-4eb0-bf5c-d81472ec4b83] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 04:10:32 user nova-compute[103546]: DEBUG nova.compute.manager [req-51eea32c-4517-4417-8419-78218d84c4ff req-8505d75f-e9f1-472c-bdef-8fb31ccc70b0 service nova] [instance: 061acca0-e5a9-4eb0-bf5c-d81472ec4b83] Received event network-changed-a80152d0-325a-4285-89b6-db143d556ed6 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:10:32 user nova-compute[103546]: DEBUG nova.compute.manager [req-51eea32c-4517-4417-8419-78218d84c4ff req-8505d75f-e9f1-472c-bdef-8fb31ccc70b0 service nova] [instance: 061acca0-e5a9-4eb0-bf5c-d81472ec4b83] Refreshing instance network info cache due to event network-changed-a80152d0-325a-4285-89b6-db143d556ed6. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 04:10:32 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-51eea32c-4517-4417-8419-78218d84c4ff req-8505d75f-e9f1-472c-bdef-8fb31ccc70b0 service nova] Acquiring lock "refresh_cache-061acca0-e5a9-4eb0-bf5c-d81472ec4b83" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:10:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce616440-9d69-4812-8910-a2d9ad58f504/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:10:33 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG nova.network.neutron [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] [instance: 061acca0-e5a9-4eb0-bf5c-d81472ec4b83] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG nova.compute.manager [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Guest created on hypervisor {{(pid=103546) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG nova.compute.manager [req-d728b890-59f4-4e7d-948b-749ce58650d1 req-bf7b96bd-ce53-4490-86d5-0d70a280b7af service nova] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Received event network-vif-plugged-9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d728b890-59f4-4e7d-948b-749ce58650d1 req-bf7b96bd-ce53-4490-86d5-0d70a280b7af service nova] Acquiring lock "2fdca5a2-7e02-4c4a-96ae-cc61547232c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d728b890-59f4-4e7d-948b-749ce58650d1 req-bf7b96bd-ce53-4490-86d5-0d70a280b7af service nova] Lock "2fdca5a2-7e02-4c4a-96ae-cc61547232c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d728b890-59f4-4e7d-948b-749ce58650d1 req-bf7b96bd-ce53-4490-86d5-0d70a280b7af service nova] Lock "2fdca5a2-7e02-4c4a-96ae-cc61547232c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG nova.compute.manager [req-d728b890-59f4-4e7d-948b-749ce58650d1 req-bf7b96bd-ce53-4490-86d5-0d70a280b7af service nova] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] No waiting events found dispatching network-vif-plugged-9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:10:35 user nova-compute[103546]: WARNING nova.compute.manager [req-d728b890-59f4-4e7d-948b-749ce58650d1 req-bf7b96bd-ce53-4490-86d5-0d70a280b7af service nova] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Received unexpected event network-vif-plugged-9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a for instance with vm_state building and task_state spawning.
Nov 16 04:10:35 user nova-compute[103546]: DEBUG nova.compute.manager [req-57c29df9-72a6-4dbe-8604-4ad9640fcac6 req-c8c6a3f2-0bc3-44bc-bc1e-57611393d20c service nova] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Received event network-vif-plugged-9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-57c29df9-72a6-4dbe-8604-4ad9640fcac6 req-c8c6a3f2-0bc3-44bc-bc1e-57611393d20c service nova] Acquiring lock "2fdca5a2-7e02-4c4a-96ae-cc61547232c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-57c29df9-72a6-4dbe-8604-4ad9640fcac6 req-c8c6a3f2-0bc3-44bc-bc1e-57611393d20c service nova] Lock "2fdca5a2-7e02-4c4a-96ae-cc61547232c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-57c29df9-72a6-4dbe-8604-4ad9640fcac6 req-c8c6a3f2-0bc3-44bc-bc1e-57611393d20c service nova] Lock "2fdca5a2-7e02-4c4a-96ae-cc61547232c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG nova.compute.manager [req-57c29df9-72a6-4dbe-8604-4ad9640fcac6 req-c8c6a3f2-0bc3-44bc-bc1e-57611393d20c service nova] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] No waiting events found dispatching network-vif-plugged-9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:10:35 user nova-compute[103546]: WARNING nova.compute.manager [req-57c29df9-72a6-4dbe-8604-4ad9640fcac6 req-c8c6a3f2-0bc3-44bc-bc1e-57611393d20c service nova] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Received unexpected event network-vif-plugged-9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a for instance with vm_state building and task_state spawning.
Nov 16 04:10:35 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:10:35 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:10:35 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Hypervisor/Node resource view: name=user free_ram=8226MB free_disk=24.99317169189453GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=103546) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:10:35 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Instance spawned successfully.
Nov 16 04:10:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Found default for hw_cdrom_bus of ide {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Found default for hw_disk_bus of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Found default for hw_input_bus of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Found default for hw_pointer_model of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Found default for hw_video_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Found default for hw_vif_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:10:35 user nova-compute[103546]: INFO nova.compute.manager [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Took 5.96 seconds to spawn the instance on the hypervisor.
Nov 16 04:10:35 user nova-compute[103546]: DEBUG nova.compute.manager [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 04101512-7333-4581-add3-7af3821e335b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance fa7e5468-9dd4-407d-85ec-d45ec76f9e29 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 246ccf69-847c-4ab2-b709-ad1a85e81eab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 8d229d05-95f1-4997-8539-802ac65cff8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance ce616440-9d69-4812-8910-a2d9ad58f504 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 2fdca5a2-7e02-4c4a-96ae-cc61547232c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 061acca0-e5a9-4eb0-bf5c-d81472ec4b83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG nova.network.neutron [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] [instance: 061acca0-e5a9-4eb0-bf5c-d81472ec4b83] Updating instance_info_cache with network_info: [{"id": "a80152d0-325a-4285-89b6-db143d556ed6", "address": "fa:16:3e:1c:66:07", "network": {"id": "f710b8fb-f648-48dc-aa6e-60de8f5d2d7c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6f027778eecb4af282f5bb7ebd069be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa80152d0-32", "ovs_interfaceid": "a80152d0-325a-4285-89b6-db143d556ed6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Releasing lock "refresh_cache-061acca0-e5a9-4eb0-bf5c-d81472ec4b83" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG nova.compute.manager [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] [instance: 061acca0-e5a9-4eb0-bf5c-d81472ec4b83] Instance network_info: |[{"id": "a80152d0-325a-4285-89b6-db143d556ed6", "address": "fa:16:3e:1c:66:07", "network": {"id": "f710b8fb-f648-48dc-aa6e-60de8f5d2d7c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6f027778eecb4af282f5bb7ebd069be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa80152d0-32", "ovs_interfaceid": "a80152d0-325a-4285-89b6-db143d556ed6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 04:10:35 user nova-compute[103546]: INFO nova.compute.manager [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Took 6.72 seconds to build instance.
Nov 16 04:10:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-51eea32c-4517-4417-8419-78218d84c4ff req-8505d75f-e9f1-472c-bdef-8fb31ccc70b0 service nova] Acquired lock "refresh_cache-061acca0-e5a9-4eb0-bf5c-d81472ec4b83" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG nova.network.neutron [req-51eea32c-4517-4417-8419-78218d84c4ff req-8505d75f-e9f1-472c-bdef-8fb31ccc70b0 service nova] [instance: 061acca0-e5a9-4eb0-bf5c-d81472ec4b83] Refreshing network info cache for port a80152d0-325a-4285-89b6-db143d556ed6 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] [instance: 061acca0-e5a9-4eb0-bf5c-d81472ec4b83] Start _get_guest_xml network_info=[{"id": "a80152d0-325a-4285-89b6-db143d556ed6", "address": "fa:16:3e:1c:66:07", "network": {"id": "f710b8fb-f648-48dc-aa6e-60de8f5d2d7c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6f027778eecb4af282f5bb7ebd069be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa80152d0-32", "ovs_interfaceid": "a80152d0-325a-4285-89b6-db143d556ed6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '5c6f539a-01e5-4478-bf8f-a14310b5d7dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-63cb87f6-d38d-4ec4-a16d-1328926e6b8e tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Lock "2fdca5a2-7e02-4c4a-96ae-cc61547232c1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.840s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:10:35 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:10:35 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:10:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:10:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1321892363',display_name='tempest-VolumesNegativeTest-instance-1321892363',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1321892363',id=47,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6ab3113e86994ad1928990adae464bd7',ramdisk_id='',reservation_id='r-mca9rsus',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1099470511',owner_user_name='tempest-VolumesNegativeTest-1099470511-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T04:10:31Z,user_data=None,user_id='79f4ff3a7d6d47949f664d17e1d64a64',uuid=061acca0-e5a9-4eb0-bf5c-d81472ec4b83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a80152d0-325a-4285-89b6-db143d556ed6", "address": "fa:16:3e:1c:66:07", "network": {"id": "f710b8fb-f648-48dc-aa6e-60de8f5d2d7c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6f027778eecb4af282f5bb7ebd069be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa80152d0-32", "ovs_interfaceid": "a80152d0-325a-4285-89b6-db143d556ed6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Converting VIF {"id": "a80152d0-325a-4285-89b6-db143d556ed6", "address": "fa:16:3e:1c:66:07", "network": {"id": "f710b8fb-f648-48dc-aa6e-60de8f5d2d7c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6f027778eecb4af282f5bb7ebd069be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa80152d0-32", "ovs_interfaceid": "a80152d0-325a-4285-89b6-db143d556ed6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:66:07,bridge_name='br-int',has_traffic_filtering=True,id=a80152d0-325a-4285-89b6-db143d556ed6,network=Network(f710b8fb-f648-48dc-aa6e-60de8f5d2d7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa80152d0-32') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG nova.objects.instance [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Lazy-loading 'pci_devices' on Instance uuid 061acca0-e5a9-4eb0-bf5c-d81472ec4b83 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] [instance: 061acca0-e5a9-4eb0-bf5c-d81472ec4b83] End _get_guest_xml xml=<domain type="kvm">
Nov 16 04:10:35 user nova-compute[103546]:   <uuid>061acca0-e5a9-4eb0-bf5c-d81472ec4b83</uuid>
Nov 16 04:10:35 user nova-compute[103546]:   <name>instance-0000002f</name>
Nov 16 04:10:35 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 04:10:35 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 04:10:35 user nova-compute[103546]:   <metadata>
Nov 16 04:10:35 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 04:10:35 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 04:10:35 user nova-compute[103546]:       <nova:name>tempest-VolumesNegativeTest-instance-1321892363</nova:name>
Nov 16 04:10:35 user nova-compute[103546]:       <nova:creationTime>2023-11-16 04:10:35</nova:creationTime>
Nov 16 04:10:35 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 04:10:35 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 04:10:35 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 04:10:35 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 04:10:35 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 04:10:35 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 04:10:35 user nova-compute[103546]:       </nova:flavor>
Nov 16 04:10:35 user nova-compute[103546]:       <nova:owner>
Nov 16 04:10:35 user nova-compute[103546]:         <nova:user uuid="79f4ff3a7d6d47949f664d17e1d64a64">tempest-VolumesNegativeTest-1099470511-project-member</nova:user>
Nov 16 04:10:35 user nova-compute[103546]:         <nova:project uuid="6ab3113e86994ad1928990adae464bd7">tempest-VolumesNegativeTest-1099470511</nova:project>
Nov 16 04:10:35 user nova-compute[103546]:       </nova:owner>
Nov 16 04:10:35 user nova-compute[103546]:       <nova:root type="image" uuid="5c6f539a-01e5-4478-bf8f-a14310b5d7dd"/>
Nov 16 04:10:35 user nova-compute[103546]:       <nova:ports>
Nov 16 04:10:35 user nova-compute[103546]:         <nova:port uuid="a80152d0-325a-4285-89b6-db143d556ed6">
Nov 16 04:10:35 user nova-compute[103546]:           <nova:ip type="fixed" address="192.168.233.88" ipVersion="4"/>
Nov 16 04:10:35 user nova-compute[103546]:         </nova:port>
Nov 16 04:10:35 user nova-compute[103546]:       </nova:ports>
Nov 16 04:10:35 user nova-compute[103546]:     </nova:instance>
Nov 16 04:10:35 user nova-compute[103546]:   </metadata>
Nov 16 04:10:35 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 04:10:35 user nova-compute[103546]:     <system>
Nov 16 04:10:35 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 04:10:35 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 04:10:35 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 04:10:35 user nova-compute[103546]:       <entry name="serial">061acca0-e5a9-4eb0-bf5c-d81472ec4b83</entry>
Nov 16 04:10:35 user nova-compute[103546]:       <entry name="uuid">061acca0-e5a9-4eb0-bf5c-d81472ec4b83</entry>
Nov 16 04:10:35 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 04:10:35 user nova-compute[103546]:     </system>
Nov 16 04:10:35 user nova-compute[103546]:   </sysinfo>
Nov 16 04:10:35 user nova-compute[103546]:   <os>
Nov 16 04:10:35 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 04:10:35 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 04:10:35 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 04:10:35 user nova-compute[103546]:   </os>
Nov 16 04:10:35 user nova-compute[103546]:   <features>
Nov 16 04:10:35 user nova-compute[103546]:     <acpi/>
Nov 16 04:10:35 user nova-compute[103546]:     <apic/>
Nov 16 04:10:35 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 04:10:35 user nova-compute[103546]:   </features>
Nov 16 04:10:35 user nova-compute[103546]:   <clock offset="utc">
Nov 16 04:10:35 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 04:10:35 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 04:10:35 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 04:10:35 user nova-compute[103546]:   </clock>
Nov 16 04:10:35 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 04:10:35 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 04:10:35 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 04:10:35 user nova-compute[103546]:   </cpu>
Nov 16 04:10:35 user nova-compute[103546]:   <devices>
Nov 16 04:10:35 user nova-compute[103546]:     <disk type="file" device="disk">
Nov 16 04:10:35 user nova-compute[103546]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 04:10:35 user nova-compute[103546]:       <source file="/opt/stack/data/nova/instances/061acca0-e5a9-4eb0-bf5c-d81472ec4b83/disk"/>
Nov 16 04:10:35 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 04:10:35 user nova-compute[103546]:     </disk>
Nov 16 04:10:35 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 04:10:35 user nova-compute[103546]:       <mac address="fa:16:3e:1c:66:07"/>
Nov 16 04:10:35 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 04:10:35 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 04:10:35 user nova-compute[103546]:       <target dev="tapa80152d0-32"/>
Nov 16 04:10:35 user nova-compute[103546]:     </interface>
Nov 16 04:10:35 user nova-compute[103546]:     <serial type="pty">
Nov 16 04:10:35 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/061acca0-e5a9-4eb0-bf5c-d81472ec4b83/console.log" append="off"/>
Nov 16 04:10:35 user nova-compute[103546]:     </serial>
Nov 16 04:10:35 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 04:10:35 user nova-compute[103546]:     <video>
Nov 16 04:10:35 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 04:10:35 user nova-compute[103546]:     </video>
Nov 16 04:10:35 user nova-compute[103546]:     <rng model="virtio">
Nov 16 04:10:35 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 04:10:35 user nova-compute[103546]:     </rng>
Nov 16 04:10:35 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 04:10:35 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 04:10:35 user nova-compute[103546]:       <stats period="10"/>
Nov 16 04:10:35 user nova-compute[103546]:     </memballoon>
Nov 16 04:10:35 user nova-compute[103546]:   </devices>
Nov 16 04:10:35 user nova-compute[103546]: </domain>
Nov 16 04:10:35 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:10:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1321892363',display_name='tempest-VolumesNegativeTest-instance-1321892363',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1321892363',id=47,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6ab3113e86994ad1928990adae464bd7',ramdisk_id='',reservation_id='r-mca9rsus',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1099470511',owner_user_name='tempest-VolumesNegativeTest-1099470511-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T04:10:31Z,user_data=None,user_id='79f4ff3a7d6d47949f664d17e1d64a64',uuid=061acca0-e5a9-4eb0-bf5c-d81472ec4b83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a80152d0-325a-4285-89b6-db143d556ed6", "address": "fa:16:3e:1c:66:07", "network": {"id": "f710b8fb-f648-48dc-aa6e-60de8f5d2d7c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6f027778eecb4af282f5bb7ebd069be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa80152d0-32", "ovs_interfaceid": "a80152d0-325a-4285-89b6-db143d556ed6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Converting VIF {"id": "a80152d0-325a-4285-89b6-db143d556ed6", "address": "fa:16:3e:1c:66:07", "network": {"id": "f710b8fb-f648-48dc-aa6e-60de8f5d2d7c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6f027778eecb4af282f5bb7ebd069be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa80152d0-32", "ovs_interfaceid": "a80152d0-325a-4285-89b6-db143d556ed6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:66:07,bridge_name='br-int',has_traffic_filtering=True,id=a80152d0-325a-4285-89b6-db143d556ed6,network=Network(f710b8fb-f648-48dc-aa6e-60de8f5d2d7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa80152d0-32') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG os_vif [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:66:07,bridge_name='br-int',has_traffic_filtering=True,id=a80152d0-325a-4285-89b6-db143d556ed6,network=Network(f710b8fb-f648-48dc-aa6e-60de8f5d2d7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa80152d0-32') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '505aaa8c-7518-5dfd-be24-97dcfecca0a8', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa80152d0-32, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa80152d0-32, col_values=(('qos', UUID('48dfe316-68e7-4d3f-ace4-f2bd96d25e73')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa80152d0-32, col_values=(('external_ids', {'iface-id': 'a80152d0-325a-4285-89b6-db143d556ed6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:66:07', 'vm-uuid': '061acca0-e5a9-4eb0-bf5c-d81472ec4b83'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:10:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:35 user nova-compute[103546]: INFO os_vif [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:66:07,bridge_name='br-int',has_traffic_filtering=True,id=a80152d0-325a-4285-89b6-db143d556ed6,network=Network(f710b8fb-f648-48dc-aa6e-60de8f5d2d7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa80152d0-32')
Nov 16 04:10:35 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:10:36 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:10:36 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Compute_service record updated for user:user {{(pid=103546) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 04:10:36 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.528s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:10:36 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:10:36 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] No VIF found with MAC fa:16:3e:1c:66:07, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 04:10:36 user nova-compute[103546]: DEBUG nova.network.neutron [req-51eea32c-4517-4417-8419-78218d84c4ff req-8505d75f-e9f1-472c-bdef-8fb31ccc70b0 service nova] [instance: 061acca0-e5a9-4eb0-bf5c-d81472ec4b83] Updated VIF entry in instance network info cache for port a80152d0-325a-4285-89b6-db143d556ed6. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 04:10:36 user nova-compute[103546]: DEBUG nova.network.neutron [req-51eea32c-4517-4417-8419-78218d84c4ff req-8505d75f-e9f1-472c-bdef-8fb31ccc70b0 service nova] [instance: 061acca0-e5a9-4eb0-bf5c-d81472ec4b83] Updating instance_info_cache with network_info: [{"id": "a80152d0-325a-4285-89b6-db143d556ed6", "address": "fa:16:3e:1c:66:07", "network": {"id": "f710b8fb-f648-48dc-aa6e-60de8f5d2d7c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6f027778eecb4af282f5bb7ebd069be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa80152d0-32", "ovs_interfaceid": "a80152d0-325a-4285-89b6-db143d556ed6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:10:36 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-51eea32c-4517-4417-8419-78218d84c4ff req-8505d75f-e9f1-472c-bdef-8fb31ccc70b0 service nova] Releasing lock "refresh_cache-061acca0-e5a9-4eb0-bf5c-d81472ec4b83" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:10:37 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:10:37 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:10:37 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:10:37 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:10:37 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:10:37 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:10:37 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:10:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:37 user nova-compute[103546]: DEBUG nova.compute.manager [req-bea19cee-96f2-43c3-af4d-25737c19c088 req-5056576e-0d9c-49ce-84df-14588cc2a027 service nova] [instance: 061acca0-e5a9-4eb0-bf5c-d81472ec4b83] Received event network-vif-plugged-a80152d0-325a-4285-89b6-db143d556ed6 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:10:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-bea19cee-96f2-43c3-af4d-25737c19c088 req-5056576e-0d9c-49ce-84df-14588cc2a027 service nova] Acquiring lock "061acca0-e5a9-4eb0-bf5c-d81472ec4b83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:10:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-bea19cee-96f2-43c3-af4d-25737c19c088 req-5056576e-0d9c-49ce-84df-14588cc2a027 service nova] Lock "061acca0-e5a9-4eb0-bf5c-d81472ec4b83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:10:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-bea19cee-96f2-43c3-af4d-25737c19c088 req-5056576e-0d9c-49ce-84df-14588cc2a027 service nova] Lock "061acca0-e5a9-4eb0-bf5c-d81472ec4b83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:10:37 user nova-compute[103546]: DEBUG nova.compute.manager [req-bea19cee-96f2-43c3-af4d-25737c19c088 req-5056576e-0d9c-49ce-84df-14588cc2a027 service nova] [instance: 061acca0-e5a9-4eb0-bf5c-d81472ec4b83] No waiting events found dispatching network-vif-plugged-a80152d0-325a-4285-89b6-db143d556ed6 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:10:37 user nova-compute[103546]: WARNING nova.compute.manager [req-bea19cee-96f2-43c3-af4d-25737c19c088 req-5056576e-0d9c-49ce-84df-14588cc2a027 service nova] [instance: 061acca0-e5a9-4eb0-bf5c-d81472ec4b83] Received unexpected event network-vif-plugged-a80152d0-325a-4285-89b6-db143d556ed6 for instance with vm_state building and task_state spawning.
Nov 16 04:10:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d4ad34ab-1c19-4c67-b335-228c55956c56 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Acquiring lock "fa7e5468-9dd4-407d-85ec-d45ec76f9e29" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:10:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d4ad34ab-1c19-4c67-b335-228c55956c56 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "fa7e5468-9dd4-407d-85ec-d45ec76f9e29" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:10:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d4ad34ab-1c19-4c67-b335-228c55956c56 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Acquiring lock "fa7e5468-9dd4-407d-85ec-d45ec76f9e29-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:10:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d4ad34ab-1c19-4c67-b335-228c55956c56 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "fa7e5468-9dd4-407d-85ec-d45ec76f9e29-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:10:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d4ad34ab-1c19-4c67-b335-228c55956c56 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "fa7e5468-9dd4-407d-85ec-d45ec76f9e29-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:10:37 user nova-compute[103546]: INFO nova.compute.manager [None req-d4ad34ab-1c19-4c67-b335-228c55956c56 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Terminating instance
Nov 16 04:10:37 user nova-compute[103546]: DEBUG nova.compute.manager [None req-d4ad34ab-1c19-4c67-b335-228c55956c56 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Start destroying the instance on the hypervisor. {{(pid=103546) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 04:10:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG nova.compute.manager [req-fec6fe9c-e684-485d-991a-e3f72be12705 req-c42a2958-2315-49b6-8889-e528b12d5c3a service nova] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Received event network-vif-unplugged-764b22e9-e899-4d39-8bc7-903ff8a7c3f6 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-fec6fe9c-e684-485d-991a-e3f72be12705 req-c42a2958-2315-49b6-8889-e528b12d5c3a service nova] Acquiring lock "fa7e5468-9dd4-407d-85ec-d45ec76f9e29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-fec6fe9c-e684-485d-991a-e3f72be12705 req-c42a2958-2315-49b6-8889-e528b12d5c3a service nova] Lock "fa7e5468-9dd4-407d-85ec-d45ec76f9e29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-fec6fe9c-e684-485d-991a-e3f72be12705 req-c42a2958-2315-49b6-8889-e528b12d5c3a service nova] Lock "fa7e5468-9dd4-407d-85ec-d45ec76f9e29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG nova.compute.manager [req-fec6fe9c-e684-485d-991a-e3f72be12705 req-c42a2958-2315-49b6-8889-e528b12d5c3a service nova] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] No waiting events found dispatching network-vif-unplugged-764b22e9-e899-4d39-8bc7-903ff8a7c3f6 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG nova.compute.manager [req-fec6fe9c-e684-485d-991a-e3f72be12705 req-c42a2958-2315-49b6-8889-e528b12d5c3a service nova] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Received event network-vif-unplugged-764b22e9-e899-4d39-8bc7-903ff8a7c3f6 for instance with task_state deleting. {{(pid=103546) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:38 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Instance destroyed successfully.
Nov 16 04:10:38 user nova-compute[103546]: DEBUG nova.objects.instance [None req-d4ad34ab-1c19-4c67-b335-228c55956c56 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lazy-loading 'resources' on Instance uuid fa7e5468-9dd4-407d-85ec-d45ec76f9e29 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-d4ad34ab-1c19-4c67-b335-228c55956c56 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:54:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1633576482',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1633576482',id=23,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:56:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6f2a38a5eb514ce8a7569c8322657eac',ramdisk_id='',reservation_id='r-zp4ivzie',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1634874924',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T03:57:49Z,user_data=None,user_id='e1176a2817ef428ea81e2fb18299a306',uuid=fa7e5468-9dd4-407d-85ec-d45ec76f9e29,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "764b22e9-e899-4d39-8bc7-903ff8a7c3f6", "address": "fa:16:3e:77:63:89", "network": {"id": "fdbb2d2c-9a54-4517-b33a-cf27ce7570b1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79661471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2a38a5eb514ce8a7569c8322657eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap764b22e9-e8", "ovs_interfaceid": "764b22e9-e899-4d39-8bc7-903ff8a7c3f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-d4ad34ab-1c19-4c67-b335-228c55956c56 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Converting VIF {"id": "764b22e9-e899-4d39-8bc7-903ff8a7c3f6", "address": "fa:16:3e:77:63:89", "network": {"id": "fdbb2d2c-9a54-4517-b33a-cf27ce7570b1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79661471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2a38a5eb514ce8a7569c8322657eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap764b22e9-e8", "ovs_interfaceid": "764b22e9-e899-4d39-8bc7-903ff8a7c3f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-d4ad34ab-1c19-4c67-b335-228c55956c56 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:77:63:89,bridge_name='br-int',has_traffic_filtering=True,id=764b22e9-e899-4d39-8bc7-903ff8a7c3f6,network=Network(fdbb2d2c-9a54-4517-b33a-cf27ce7570b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap764b22e9-e8') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG os_vif [None req-d4ad34ab-1c19-4c67-b335-228c55956c56 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:63:89,bridge_name='br-int',has_traffic_filtering=True,id=764b22e9-e899-4d39-8bc7-903ff8a7c3f6,network=Network(fdbb2d2c-9a54-4517-b33a-cf27ce7570b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap764b22e9-e8') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap764b22e9-e8, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ec63cb60-e2fb-419d-a2c8-95b71761cc2a) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:38 user nova-compute[103546]: INFO os_vif [None req-d4ad34ab-1c19-4c67-b335-228c55956c56 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:63:89,bridge_name='br-int',has_traffic_filtering=True,id=764b22e9-e899-4d39-8bc7-903ff8a7c3f6,network=Network(fdbb2d2c-9a54-4517-b33a-cf27ce7570b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap764b22e9-e8')
Nov 16 04:10:38 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4ad34ab-1c19-4c67-b335-228c55956c56 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ad34ab-1c19-4c67-b335-228c55956c56 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iCqEsNVr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:10:38 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-d4ad34ab-1c19-4c67-b335-228c55956c56 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:10:38 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-d4ad34ab-1c19-4c67-b335-228c55956c56 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-d4ad34ab-1c19-4c67-b335-228c55956c56 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3227ffdf-7f29-4503-8f2a-5975d625c949]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ad34ab-1c19-4c67-b335-228c55956c56 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 04:10:38 user nova-compute[103546]: No targets found.
Nov 16 04:10:38 user nova-compute[103546]: iSNS:
Nov 16 04:10:38 user nova-compute[103546]: No targets found.
Nov 16 04:10:38 user nova-compute[103546]: STATIC:
Nov 16 04:10:38 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098
Nov 16 04:10:38 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:10:38 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:10:38 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4
Nov 16 04:10:38 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:10:38 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:10:38 user nova-compute[103546]: FIRMWARE:
Nov 16 04:10:38 user nova-compute[103546]: No targets found.
Nov 16 04:10:38 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ad34ab-1c19-4c67-b335-228c55956c56 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 04:10:38 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 04:10:38 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ad34ab-1c19-4c67-b335-228c55956c56 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fab622f-4552-43da-aea7-631097e75c42]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e7df76-4c6c-4178-9238-593be95ac725]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ad34ab-1c19-4c67-b335-228c55956c56 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:10:38 user nova-compute[103546]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098 (non-flash)
Nov 16 04:10:38 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ad34ab-1c19-4c67-b335-228c55956c56 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 (non-flash)
Nov 16 04:10:38 user nova-compute[103546]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098 (non-flash)
Nov 16 04:10:38 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ad34ab-1c19-4c67-b335-228c55956c56 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60ac61b130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4'): ({'sdb'}, set())}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-d4ad34ab-1c19-4c67-b335-228c55956c56 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Removing single pathed devices sdb {{(pid=103546) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5315293a-1d0f-4dac-a66a-0dff08821b05]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Starting heal instance info cache {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5b3304-8d01-46a8-a139-d48a9200183c]: (4, ('ok\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-d4ad34ab-1c19-4c67-b335-228c55956c56 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Flushing IO for device /dev/sdb {{(pid=103546) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[6371e5c0-70db-4b6c-8712-bca77059cfe9]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-d4ad34ab-1c19-4c67-b335-228c55956c56 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=103546) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Didn't find any instances for network info cache update. {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f302e30c-2388-4c76-82f4-a209c315a65d]: (4, ('1', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-d4ad34ab-1c19-4c67-b335-228c55956c56 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-d4ad34ab-1c19-4c67-b335-228c55956c56 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] SCSI volumes sdb have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ad34ab-1c19-4c67-b335-228c55956c56 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4')] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[56de0b8d-65da-4fc0-b9e5-be8e8ecb9331]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ad34ab-1c19-4c67-b335-228c55956c56 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 -p 172.16.0.220:3260 --logout {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a170d1a-e09e-4cae-a79f-eed76a90e966]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ad34ab-1c19-4c67-b335-228c55956c56 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4, portal: 172.16.0.220,3260]
Nov 16 04:10:38 user nova-compute[103546]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4, portal: 172.16.0.220,3260] successful.
Nov 16 04:10:38 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 -p 172.16.0.220:3260 --op delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e5eaa2-fe85-49ac-bbac-868f460052c4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06f7068-81c5-455d-a17a-df2dd15be182]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ad34ab-1c19-4c67-b335-228c55956c56 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-d4ad34ab-1c19-4c67-b335-228c55956c56 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ad34ab-1c19-4c67-b335-228c55956c56 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] <== disconnect_volume: return (331ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4ad34ab-1c19-4c67-b335-228c55956c56 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 04:10:38 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-d4ad34ab-1c19-4c67-b335-228c55956c56 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Deleting instance files /opt/stack/data/nova/instances/fa7e5468-9dd4-407d-85ec-d45ec76f9e29_del
Nov 16 04:10:38 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-d4ad34ab-1c19-4c67-b335-228c55956c56 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Deletion of /opt/stack/data/nova/instances/fa7e5468-9dd4-407d-85ec-d45ec76f9e29_del complete
Nov 16 04:10:38 user nova-compute[103546]: INFO nova.compute.manager [None req-d4ad34ab-1c19-4c67-b335-228c55956c56 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Took 1.23 seconds to destroy the instance on the hypervisor.
Nov 16 04:10:38 user nova-compute[103546]: DEBUG oslo.service.loopingcall [None req-d4ad34ab-1c19-4c67-b335-228c55956c56 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=103546) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG nova.compute.manager [-] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Deallocating network for instance {{(pid=103546) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 04:10:38 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] deallocate_for_instance() {{(pid=103546) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 04:10:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:39 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:10:39 user nova-compute[103546]: INFO nova.compute.manager [-] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Took 0.40 seconds to deallocate network for instance.
Nov 16 04:10:39 user nova-compute[103546]: DEBUG nova.compute.manager [req-81ef5f10-de2f-4ab5-9fe4-aa6b8b6d2c98 req-77172e36-5fb8-40c3-b8e7-0a5fe599118a service nova] [instance: 061acca0-e5a9-4eb0-bf5c-d81472ec4b83] Received event network-vif-plugged-a80152d0-325a-4285-89b6-db143d556ed6 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:10:39 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-81ef5f10-de2f-4ab5-9fe4-aa6b8b6d2c98 req-77172e36-5fb8-40c3-b8e7-0a5fe599118a service nova] Acquiring lock "061acca0-e5a9-4eb0-bf5c-d81472ec4b83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:10:39 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-81ef5f10-de2f-4ab5-9fe4-aa6b8b6d2c98 req-77172e36-5fb8-40c3-b8e7-0a5fe599118a service nova] Lock "061acca0-e5a9-4eb0-bf5c-d81472ec4b83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:10:39 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-81ef5f10-de2f-4ab5-9fe4-aa6b8b6d2c98 req-77172e36-5fb8-40c3-b8e7-0a5fe599118a service nova] Lock "061acca0-e5a9-4eb0-bf5c-d81472ec4b83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:10:39 user nova-compute[103546]: DEBUG nova.compute.manager [req-81ef5f10-de2f-4ab5-9fe4-aa6b8b6d2c98 req-77172e36-5fb8-40c3-b8e7-0a5fe599118a service nova] [instance: 061acca0-e5a9-4eb0-bf5c-d81472ec4b83] No waiting events found dispatching network-vif-plugged-a80152d0-325a-4285-89b6-db143d556ed6 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:10:39 user nova-compute[103546]: WARNING nova.compute.manager [req-81ef5f10-de2f-4ab5-9fe4-aa6b8b6d2c98 req-77172e36-5fb8-40c3-b8e7-0a5fe599118a service nova] [instance: 061acca0-e5a9-4eb0-bf5c-d81472ec4b83] Received unexpected event network-vif-plugged-a80152d0-325a-4285-89b6-db143d556ed6 for instance with vm_state building and task_state spawning.
Nov 16 04:10:39 user nova-compute[103546]: DEBUG nova.compute.manager [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] [instance: 061acca0-e5a9-4eb0-bf5c-d81472ec4b83] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 04:10:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] [instance: 061acca0-e5a9-4eb0-bf5c-d81472ec4b83] Guest created on hypervisor {{(pid=103546) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 04:10:39 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 061acca0-e5a9-4eb0-bf5c-d81472ec4b83] Instance spawned successfully.
Nov 16 04:10:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] [instance: 061acca0-e5a9-4eb0-bf5c-d81472ec4b83] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 04:10:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] [instance: 061acca0-e5a9-4eb0-bf5c-d81472ec4b83] Found default for hw_cdrom_bus of ide {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:10:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] [instance: 061acca0-e5a9-4eb0-bf5c-d81472ec4b83] Found default for hw_disk_bus of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:10:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] [instance: 061acca0-e5a9-4eb0-bf5c-d81472ec4b83] Found default for hw_input_bus of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:10:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] [instance: 061acca0-e5a9-4eb0-bf5c-d81472ec4b83] Found default for hw_pointer_model of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:10:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] [instance: 061acca0-e5a9-4eb0-bf5c-d81472ec4b83] Found default for hw_video_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:10:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] [instance: 061acca0-e5a9-4eb0-bf5c-d81472ec4b83] Found default for hw_vif_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:10:39 user nova-compute[103546]: INFO nova.compute.manager [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] [instance: 061acca0-e5a9-4eb0-bf5c-d81472ec4b83] Took 8.52 seconds to spawn the instance on the hypervisor.
Nov 16 04:10:39 user nova-compute[103546]: DEBUG nova.compute.manager [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] [instance: 061acca0-e5a9-4eb0-bf5c-d81472ec4b83] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 04:10:39 user nova-compute[103546]: INFO nova.compute.manager [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] [instance: 061acca0-e5a9-4eb0-bf5c-d81472ec4b83] Took 9.59 seconds to build instance.
Nov 16 04:10:39 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0e4c3ba6-49ba-448d-b858-c63aea9459ec tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Lock "061acca0-e5a9-4eb0-bf5c-d81472ec4b83" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.708s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:10:40 user nova-compute[103546]: INFO nova.compute.manager [None req-d4ad34ab-1c19-4c67-b335-228c55956c56 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Took 0.80 seconds to detach 1 volumes for instance.
Nov 16 04:10:40 user nova-compute[103546]: DEBUG nova.compute.manager [req-83086650-1bdb-4062-96c4-35af25e97fe6 req-868701ab-80ba-428b-8859-7a685c70bb87 service nova] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Received event network-vif-plugged-764b22e9-e899-4d39-8bc7-903ff8a7c3f6 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:10:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-83086650-1bdb-4062-96c4-35af25e97fe6 req-868701ab-80ba-428b-8859-7a685c70bb87 service nova] Acquiring lock "fa7e5468-9dd4-407d-85ec-d45ec76f9e29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:10:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-83086650-1bdb-4062-96c4-35af25e97fe6 req-868701ab-80ba-428b-8859-7a685c70bb87 service nova] Lock "fa7e5468-9dd4-407d-85ec-d45ec76f9e29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:10:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-83086650-1bdb-4062-96c4-35af25e97fe6 req-868701ab-80ba-428b-8859-7a685c70bb87 service nova] Lock "fa7e5468-9dd4-407d-85ec-d45ec76f9e29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:10:40 user nova-compute[103546]: DEBUG nova.compute.manager [req-83086650-1bdb-4062-96c4-35af25e97fe6 req-868701ab-80ba-428b-8859-7a685c70bb87 service nova] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] No waiting events found dispatching network-vif-plugged-764b22e9-e899-4d39-8bc7-903ff8a7c3f6 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:10:40 user nova-compute[103546]: WARNING nova.compute.manager [req-83086650-1bdb-4062-96c4-35af25e97fe6 req-868701ab-80ba-428b-8859-7a685c70bb87 service nova] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Received unexpected event network-vif-plugged-764b22e9-e899-4d39-8bc7-903ff8a7c3f6 for instance with vm_state active and task_state deleting.
Nov 16 04:10:40 user nova-compute[103546]: DEBUG nova.compute.manager [req-83086650-1bdb-4062-96c4-35af25e97fe6 req-868701ab-80ba-428b-8859-7a685c70bb87 service nova] [instance: fa7e5468-9dd4-407d-85ec-d45ec76f9e29] Received event network-vif-deleted-764b22e9-e899-4d39-8bc7-903ff8a7c3f6 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:10:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d4ad34ab-1c19-4c67-b335-228c55956c56 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:10:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d4ad34ab-1c19-4c67-b335-228c55956c56 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:10:40 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-d4ad34ab-1c19-4c67-b335-228c55956c56 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:10:40 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-d4ad34ab-1c19-4c67-b335-228c55956c56 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:10:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d4ad34ab-1c19-4c67-b335-228c55956c56 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.290s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:10:40 user nova-compute[103546]: INFO nova.scheduler.client.report [None req-d4ad34ab-1c19-4c67-b335-228c55956c56 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Deleted allocations for instance fa7e5468-9dd4-407d-85ec-d45ec76f9e29
Nov 16 04:10:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-d4ad34ab-1c19-4c67-b335-228c55956c56 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "fa7e5468-9dd4-407d-85ec-d45ec76f9e29" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.983s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:10:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:44 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:48 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:10:59 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:11:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:11:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:11:06 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:11:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:11:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:11:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e1017f53-40ab-4efc-a3d3-0d84896c72ff tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Acquiring lock "8d229d05-95f1-4997-8539-802ac65cff8b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:11:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e1017f53-40ab-4efc-a3d3-0d84896c72ff tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "8d229d05-95f1-4997-8539-802ac65cff8b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:11:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e1017f53-40ab-4efc-a3d3-0d84896c72ff tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Acquiring lock "8d229d05-95f1-4997-8539-802ac65cff8b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:11:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e1017f53-40ab-4efc-a3d3-0d84896c72ff tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "8d229d05-95f1-4997-8539-802ac65cff8b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:11:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e1017f53-40ab-4efc-a3d3-0d84896c72ff tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "8d229d05-95f1-4997-8539-802ac65cff8b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:11:11 user nova-compute[103546]: INFO nova.compute.manager [None req-e1017f53-40ab-4efc-a3d3-0d84896c72ff tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Terminating instance
Nov 16 04:11:11 user nova-compute[103546]: DEBUG nova.compute.manager [None req-e1017f53-40ab-4efc-a3d3-0d84896c72ff tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Start destroying the instance on the hypervisor. {{(pid=103546) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 04:11:11 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:11:11 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:11:11 user nova-compute[103546]: DEBUG nova.compute.manager [req-47913490-e760-42f0-aa5c-4c23ed0c44c3 req-dc8a26bb-85c8-48d9-8f4a-13ddf49edd1b service nova] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Received event network-vif-unplugged-5c802613-81ea-4855-a8ee-d851a4ab2ff5 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:11:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-47913490-e760-42f0-aa5c-4c23ed0c44c3 req-dc8a26bb-85c8-48d9-8f4a-13ddf49edd1b service nova] Acquiring lock "8d229d05-95f1-4997-8539-802ac65cff8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:11:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-47913490-e760-42f0-aa5c-4c23ed0c44c3 req-dc8a26bb-85c8-48d9-8f4a-13ddf49edd1b service nova] Lock "8d229d05-95f1-4997-8539-802ac65cff8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:11:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-47913490-e760-42f0-aa5c-4c23ed0c44c3 req-dc8a26bb-85c8-48d9-8f4a-13ddf49edd1b service nova] Lock "8d229d05-95f1-4997-8539-802ac65cff8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:11:11 user nova-compute[103546]: DEBUG nova.compute.manager [req-47913490-e760-42f0-aa5c-4c23ed0c44c3 req-dc8a26bb-85c8-48d9-8f4a-13ddf49edd1b service nova] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] No waiting events found dispatching network-vif-unplugged-5c802613-81ea-4855-a8ee-d851a4ab2ff5 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:11:11 user nova-compute[103546]: DEBUG nova.compute.manager [req-47913490-e760-42f0-aa5c-4c23ed0c44c3 req-dc8a26bb-85c8-48d9-8f4a-13ddf49edd1b service nova] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Received event network-vif-unplugged-5c802613-81ea-4855-a8ee-d851a4ab2ff5 for instance with task_state deleting. {{(pid=103546) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 04:11:11 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:11:11 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:11:11 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Instance destroyed successfully.
Nov 16 04:11:11 user nova-compute[103546]: DEBUG nova.objects.instance [None req-e1017f53-40ab-4efc-a3d3-0d84896c72ff tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lazy-loading 'resources' on Instance uuid 8d229d05-95f1-4997-8539-802ac65cff8b {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:11:12 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-e1017f53-40ab-4efc-a3d3-0d84896c72ff tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:55:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-293131064',display_name='tempest-ServerRescueNegativeTestJSON-server-293131064',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-293131064',id=28,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:57:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ca049d5674dc4c59814f98478752d73d',ramdisk_id='',reservation_id='r-cqeuglk4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1943614153',owner_user_name='tempest-ServerRescueNegativeTestJSON-1943614153-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T03:57:10Z,user_data=None,user_id='7626749c82fb4b5c81e696e4beeed858',uuid=8d229d05-95f1-4997-8539-802ac65cff8b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "5c802613-81ea-4855-a8ee-d851a4ab2ff5", "address": "fa:16:3e:01:69:11", "network": {"id": "337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-40560053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca049d5674dc4c59814f98478752d73d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c802613-81", "ovs_interfaceid": "5c802613-81ea-4855-a8ee-d851a4ab2ff5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 04:11:12 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-e1017f53-40ab-4efc-a3d3-0d84896c72ff tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Converting VIF {"id": "5c802613-81ea-4855-a8ee-d851a4ab2ff5", "address": "fa:16:3e:01:69:11", "network": {"id": "337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-40560053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca049d5674dc4c59814f98478752d73d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c802613-81", "ovs_interfaceid": "5c802613-81ea-4855-a8ee-d851a4ab2ff5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:11:12 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-e1017f53-40ab-4efc-a3d3-0d84896c72ff tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:69:11,bridge_name='br-int',has_traffic_filtering=True,id=5c802613-81ea-4855-a8ee-d851a4ab2ff5,network=Network(337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c802613-81') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:11:12 user nova-compute[103546]: DEBUG os_vif [None req-e1017f53-40ab-4efc-a3d3-0d84896c72ff tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:69:11,bridge_name='br-int',has_traffic_filtering=True,id=5c802613-81ea-4855-a8ee-d851a4ab2ff5,network=Network(337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c802613-81') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 04:11:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:11:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5c802613-81, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:11:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:11:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:11:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:11:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e4b5c03e-ce6f-4fdc-969c-0a60976b96b1) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:11:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:11:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:11:12 user nova-compute[103546]: INFO os_vif [None req-e1017f53-40ab-4efc-a3d3-0d84896c72ff tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:69:11,bridge_name='br-int',has_traffic_filtering=True,id=5c802613-81ea-4855-a8ee-d851a4ab2ff5,network=Network(337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c802613-81')
Nov 16 04:11:12 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-e1017f53-40ab-4efc-a3d3-0d84896c72ff tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Deleting instance files /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b_del
Nov 16 04:11:12 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-e1017f53-40ab-4efc-a3d3-0d84896c72ff tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Deletion of /opt/stack/data/nova/instances/8d229d05-95f1-4997-8539-802ac65cff8b_del complete
Nov 16 04:11:12 user nova-compute[103546]: INFO nova.compute.manager [None req-e1017f53-40ab-4efc-a3d3-0d84896c72ff tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Took 0.71 seconds to destroy the instance on the hypervisor.
Nov 16 04:11:12 user nova-compute[103546]: DEBUG oslo.service.loopingcall [None req-e1017f53-40ab-4efc-a3d3-0d84896c72ff tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=103546) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 04:11:12 user nova-compute[103546]: DEBUG nova.compute.manager [-] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Deallocating network for instance {{(pid=103546) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 04:11:12 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] deallocate_for_instance() {{(pid=103546) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 04:11:12 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:11:12 user nova-compute[103546]: INFO nova.compute.manager [-] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Took 0.40 seconds to deallocate network for instance.
Nov 16 04:11:12 user nova-compute[103546]: DEBUG nova.compute.manager [req-96df9b52-d00c-4d9c-8558-80376b257994 req-593c826a-212a-415a-9993-df112635a822 service nova] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Received event network-vif-deleted-5c802613-81ea-4855-a8ee-d851a4ab2ff5 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:11:12 user nova-compute[103546]: INFO nova.compute.manager [req-96df9b52-d00c-4d9c-8558-80376b257994 req-593c826a-212a-415a-9993-df112635a822 service nova] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Neutron deleted interface 5c802613-81ea-4855-a8ee-d851a4ab2ff5; detaching it from the instance and deleting it from the info cache
Nov 16 04:11:12 user nova-compute[103546]: DEBUG nova.network.neutron [req-96df9b52-d00c-4d9c-8558-80376b257994 req-593c826a-212a-415a-9993-df112635a822 service nova] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:11:12 user nova-compute[103546]: DEBUG nova.compute.manager [req-96df9b52-d00c-4d9c-8558-80376b257994 req-593c826a-212a-415a-9993-df112635a822 service nova] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Detach interface failed, port_id=5c802613-81ea-4855-a8ee-d851a4ab2ff5, reason: Instance 8d229d05-95f1-4997-8539-802ac65cff8b could not be found. {{(pid=103546) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 04:11:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e1017f53-40ab-4efc-a3d3-0d84896c72ff tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:11:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e1017f53-40ab-4efc-a3d3-0d84896c72ff tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:11:12 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-e1017f53-40ab-4efc-a3d3-0d84896c72ff tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:11:12 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-e1017f53-40ab-4efc-a3d3-0d84896c72ff tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:11:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e1017f53-40ab-4efc-a3d3-0d84896c72ff tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.242s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:11:12 user nova-compute[103546]: INFO nova.scheduler.client.report [None req-e1017f53-40ab-4efc-a3d3-0d84896c72ff tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Deleted allocations for instance 8d229d05-95f1-4997-8539-802ac65cff8b
Nov 16 04:11:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-e1017f53-40ab-4efc-a3d3-0d84896c72ff tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "8d229d05-95f1-4997-8539-802ac65cff8b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.513s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:11:13 user nova-compute[103546]: DEBUG nova.compute.manager [req-254a7f89-faa5-4c91-ada5-e1f63a7145fa req-50d93ed5-4cb6-4084-82bb-4f08670df94b service nova] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Received event network-vif-plugged-5c802613-81ea-4855-a8ee-d851a4ab2ff5 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:11:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-254a7f89-faa5-4c91-ada5-e1f63a7145fa req-50d93ed5-4cb6-4084-82bb-4f08670df94b service nova] Acquiring lock "8d229d05-95f1-4997-8539-802ac65cff8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:11:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-254a7f89-faa5-4c91-ada5-e1f63a7145fa req-50d93ed5-4cb6-4084-82bb-4f08670df94b service nova] Lock "8d229d05-95f1-4997-8539-802ac65cff8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:11:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-254a7f89-faa5-4c91-ada5-e1f63a7145fa req-50d93ed5-4cb6-4084-82bb-4f08670df94b service nova] Lock "8d229d05-95f1-4997-8539-802ac65cff8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:11:13 user nova-compute[103546]: DEBUG nova.compute.manager [req-254a7f89-faa5-4c91-ada5-e1f63a7145fa req-50d93ed5-4cb6-4084-82bb-4f08670df94b service nova] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] No waiting events found dispatching network-vif-plugged-5c802613-81ea-4855-a8ee-d851a4ab2ff5 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:11:13 user nova-compute[103546]: WARNING nova.compute.manager [req-254a7f89-faa5-4c91-ada5-e1f63a7145fa req-50d93ed5-4cb6-4084-82bb-4f08670df94b service nova] [instance: 8d229d05-95f1-4997-8539-802ac65cff8b] Received unexpected event network-vif-plugged-5c802613-81ea-4855-a8ee-d851a4ab2ff5 for instance with vm_state deleted and task_state None.
Nov 16 04:11:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:11:17 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:11:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:11:27 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:11:28 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b486fb69-d3e8-48e4-8fde-0882d32f7632 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Acquiring lock "04101512-7333-4581-add3-7af3821e335b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:11:28 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b486fb69-d3e8-48e4-8fde-0882d32f7632 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "04101512-7333-4581-add3-7af3821e335b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:11:28 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b486fb69-d3e8-48e4-8fde-0882d32f7632 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Acquiring lock "04101512-7333-4581-add3-7af3821e335b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:11:28 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b486fb69-d3e8-48e4-8fde-0882d32f7632 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "04101512-7333-4581-add3-7af3821e335b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:11:28 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b486fb69-d3e8-48e4-8fde-0882d32f7632 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "04101512-7333-4581-add3-7af3821e335b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:11:28 user nova-compute[103546]: INFO nova.compute.manager [None req-b486fb69-d3e8-48e4-8fde-0882d32f7632 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 04101512-7333-4581-add3-7af3821e335b] Terminating instance
Nov 16 04:11:28 user nova-compute[103546]: DEBUG nova.compute.manager [None req-b486fb69-d3e8-48e4-8fde-0882d32f7632 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 04101512-7333-4581-add3-7af3821e335b] Start destroying the instance on the hypervisor. {{(pid=103546) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 04:11:28 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:11:28 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:11:28 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:11:28 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:11:28 user nova-compute[103546]: DEBUG nova.compute.manager [req-5fb1029c-6edc-4b0b-a477-6b8870ab65e3 req-e4d7a814-9344-4147-badf-88ece7790301 service nova] [instance: 04101512-7333-4581-add3-7af3821e335b] Received event network-vif-unplugged-20bc48cc-9db0-49c8-8dd5-246c685c6884 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:11:28 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-5fb1029c-6edc-4b0b-a477-6b8870ab65e3 req-e4d7a814-9344-4147-badf-88ece7790301 service nova] Acquiring lock "04101512-7333-4581-add3-7af3821e335b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:11:28 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-5fb1029c-6edc-4b0b-a477-6b8870ab65e3 req-e4d7a814-9344-4147-badf-88ece7790301 service nova] Lock "04101512-7333-4581-add3-7af3821e335b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:11:28 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-5fb1029c-6edc-4b0b-a477-6b8870ab65e3 req-e4d7a814-9344-4147-badf-88ece7790301 service nova] Lock "04101512-7333-4581-add3-7af3821e335b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:11:28 user nova-compute[103546]: DEBUG nova.compute.manager [req-5fb1029c-6edc-4b0b-a477-6b8870ab65e3 req-e4d7a814-9344-4147-badf-88ece7790301 service nova] [instance: 04101512-7333-4581-add3-7af3821e335b] No waiting events found dispatching network-vif-unplugged-20bc48cc-9db0-49c8-8dd5-246c685c6884 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:11:28 user nova-compute[103546]: DEBUG nova.compute.manager [req-5fb1029c-6edc-4b0b-a477-6b8870ab65e3 req-e4d7a814-9344-4147-badf-88ece7790301 service nova] [instance: 04101512-7333-4581-add3-7af3821e335b] Received event network-vif-unplugged-20bc48cc-9db0-49c8-8dd5-246c685c6884 for instance with task_state deleting. {{(pid=103546) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 04:11:29 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 04101512-7333-4581-add3-7af3821e335b] Instance destroyed successfully.
Nov 16 04:11:29 user nova-compute[103546]: DEBUG nova.objects.instance [None req-b486fb69-d3e8-48e4-8fde-0882d32f7632 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lazy-loading 'resources' on Instance uuid 04101512-7333-4581-add3-7af3821e335b {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:11:29 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-b486fb69-d3e8-48e4-8fde-0882d32f7632 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:51:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-999070143',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-999070143',id=16,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T03:51:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6f2a38a5eb514ce8a7569c8322657eac',ramdisk_id='',reservation_id='r-deszru9j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1634874924',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T03:53:00Z,user_data=None,user_id='e1176a2817ef428ea81e2fb18299a306',uuid=04101512-7333-4581-add3-7af3821e335b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "20bc48cc-9db0-49c8-8dd5-246c685c6884", "address": "fa:16:3e:a5:d9:dc", "network": {"id": "fdbb2d2c-9a54-4517-b33a-cf27ce7570b1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79661471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2a38a5eb514ce8a7569c8322657eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20bc48cc-9d", "ovs_interfaceid": "20bc48cc-9db0-49c8-8dd5-246c685c6884", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 04:11:29 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-b486fb69-d3e8-48e4-8fde-0882d32f7632 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Converting VIF {"id": "20bc48cc-9db0-49c8-8dd5-246c685c6884", "address": "fa:16:3e:a5:d9:dc", "network": {"id": "fdbb2d2c-9a54-4517-b33a-cf27ce7570b1", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-79661471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f2a38a5eb514ce8a7569c8322657eac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20bc48cc-9d", "ovs_interfaceid": "20bc48cc-9db0-49c8-8dd5-246c685c6884", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:11:29 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-b486fb69-d3e8-48e4-8fde-0882d32f7632 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:d9:dc,bridge_name='br-int',has_traffic_filtering=True,id=20bc48cc-9db0-49c8-8dd5-246c685c6884,network=Network(fdbb2d2c-9a54-4517-b33a-cf27ce7570b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20bc48cc-9d') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:11:29 user nova-compute[103546]: DEBUG os_vif [None req-b486fb69-d3e8-48e4-8fde-0882d32f7632 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:d9:dc,bridge_name='br-int',has_traffic_filtering=True,id=20bc48cc-9db0-49c8-8dd5-246c685c6884,network=Network(fdbb2d2c-9a54-4517-b33a-cf27ce7570b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20bc48cc-9d') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 04:11:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:11:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap20bc48cc-9d, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:11:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:11:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:11:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:11:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5aac755b-94e1-45b3-8c4a-ac84bed5536e) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:11:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:11:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:11:29 user nova-compute[103546]: INFO os_vif [None req-b486fb69-d3e8-48e4-8fde-0882d32f7632 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:d9:dc,bridge_name='br-int',has_traffic_filtering=True,id=20bc48cc-9db0-49c8-8dd5-246c685c6884,network=Network(fdbb2d2c-9a54-4517-b33a-cf27ce7570b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20bc48cc-9d')
Nov 16 04:11:29 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-b486fb69-d3e8-48e4-8fde-0882d32f7632 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 04101512-7333-4581-add3-7af3821e335b] Deleting instance files /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b_del
Nov 16 04:11:29 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-b486fb69-d3e8-48e4-8fde-0882d32f7632 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 04101512-7333-4581-add3-7af3821e335b] Deletion of /opt/stack/data/nova/instances/04101512-7333-4581-add3-7af3821e335b_del complete
Nov 16 04:11:29 user nova-compute[103546]: INFO nova.compute.manager [None req-b486fb69-d3e8-48e4-8fde-0882d32f7632 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] [instance: 04101512-7333-4581-add3-7af3821e335b] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 16 04:11:29 user nova-compute[103546]: DEBUG oslo.service.loopingcall [None req-b486fb69-d3e8-48e4-8fde-0882d32f7632 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=103546) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 04:11:29 user nova-compute[103546]: DEBUG nova.compute.manager [-] [instance: 04101512-7333-4581-add3-7af3821e335b] Deallocating network for instance {{(pid=103546) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 04:11:29 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 04101512-7333-4581-add3-7af3821e335b] deallocate_for_instance() {{(pid=103546) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 04:11:29 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 04101512-7333-4581-add3-7af3821e335b] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:11:29 user nova-compute[103546]: INFO nova.compute.manager [-] [instance: 04101512-7333-4581-add3-7af3821e335b] Took 0.35 seconds to deallocate network for instance.
Nov 16 04:11:29 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b486fb69-d3e8-48e4-8fde-0882d32f7632 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:11:29 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b486fb69-d3e8-48e4-8fde-0882d32f7632 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:11:30 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-b486fb69-d3e8-48e4-8fde-0882d32f7632 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:11:30 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-b486fb69-d3e8-48e4-8fde-0882d32f7632 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:11:30 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b486fb69-d3e8-48e4-8fde-0882d32f7632 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.254s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:11:30 user nova-compute[103546]: INFO nova.scheduler.client.report [None req-b486fb69-d3e8-48e4-8fde-0882d32f7632 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Deleted allocations for instance 04101512-7333-4581-add3-7af3821e335b
Nov 16 04:11:30 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b486fb69-d3e8-48e4-8fde-0882d32f7632 tempest-ServerBootFromVolumeStableRescueTest-1634874924 tempest-ServerBootFromVolumeStableRescueTest-1634874924-project-member] Lock "04101512-7333-4581-add3-7af3821e335b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.644s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:11:30 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:11:30 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:11:30 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:11:30 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=103546) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 04:11:30 user nova-compute[103546]: DEBUG nova.compute.manager [req-7d025361-cbe7-4639-86f6-85002d9895e6 req-ebe83d4d-2e0d-4a04-8c65-07e5b8c64502 service nova] [instance: 04101512-7333-4581-add3-7af3821e335b] Received event network-vif-plugged-20bc48cc-9db0-49c8-8dd5-246c685c6884 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:11:30 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-7d025361-cbe7-4639-86f6-85002d9895e6 req-ebe83d4d-2e0d-4a04-8c65-07e5b8c64502 service nova] Acquiring lock "04101512-7333-4581-add3-7af3821e335b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:11:30 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-7d025361-cbe7-4639-86f6-85002d9895e6 req-ebe83d4d-2e0d-4a04-8c65-07e5b8c64502 service nova] Lock "04101512-7333-4581-add3-7af3821e335b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:11:30 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-7d025361-cbe7-4639-86f6-85002d9895e6 req-ebe83d4d-2e0d-4a04-8c65-07e5b8c64502 service nova] Lock "04101512-7333-4581-add3-7af3821e335b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:11:30 user nova-compute[103546]: DEBUG nova.compute.manager [req-7d025361-cbe7-4639-86f6-85002d9895e6 req-ebe83d4d-2e0d-4a04-8c65-07e5b8c64502 service nova] [instance: 04101512-7333-4581-add3-7af3821e335b] No waiting events found dispatching network-vif-plugged-20bc48cc-9db0-49c8-8dd5-246c685c6884 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:11:30 user nova-compute[103546]: WARNING nova.compute.manager [req-7d025361-cbe7-4639-86f6-85002d9895e6 req-ebe83d4d-2e0d-4a04-8c65-07e5b8c64502 service nova] [instance: 04101512-7333-4581-add3-7af3821e335b] Received unexpected event network-vif-plugged-20bc48cc-9db0-49c8-8dd5-246c685c6884 for instance with vm_state deleted and task_state None.
Nov 16 04:11:30 user nova-compute[103546]: DEBUG nova.compute.manager [req-7d025361-cbe7-4639-86f6-85002d9895e6 req-ebe83d4d-2e0d-4a04-8c65-07e5b8c64502 service nova] [instance: 04101512-7333-4581-add3-7af3821e335b] Received event network-vif-deleted-20bc48cc-9db0-49c8-8dd5-246c685c6884 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:11:31 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager.update_available_resource {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:11:31 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:11:31 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:11:31 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:11:31 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Auditing locally available compute resources for user (node: user) {{(pid=103546) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 04:11:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:11:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:11:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:11:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:11:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba82fe3-33e6-4ae4-8716-2efbe66a6f06/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:11:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba82fe3-33e6-4ae4-8716-2efbe66a6f06/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:11:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba82fe3-33e6-4ae4-8716-2efbe66a6f06/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:11:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba82fe3-33e6-4ae4-8716-2efbe66a6f06/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:11:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce616440-9d69-4812-8910-a2d9ad58f504/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:11:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce616440-9d69-4812-8910-a2d9ad58f504/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:11:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce616440-9d69-4812-8910-a2d9ad58f504/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:11:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce616440-9d69-4812-8910-a2d9ad58f504/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:11:32 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 04:11:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061acca0-e5a9-4eb0-bf5c-d81472ec4b83/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:11:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061acca0-e5a9-4eb0-bf5c-d81472ec4b83/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:11:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061acca0-e5a9-4eb0-bf5c-d81472ec4b83/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:11:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/061acca0-e5a9-4eb0-bf5c-d81472ec4b83/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:11:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fdca5a2-7e02-4c4a-96ae-cc61547232c1/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:11:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fdca5a2-7e02-4c4a-96ae-cc61547232c1/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:11:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fdca5a2-7e02-4c4a-96ae-cc61547232c1/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:11:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fdca5a2-7e02-4c4a-96ae-cc61547232c1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:11:34 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:11:34 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:11:34 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Hypervisor/Node resource view: name=user free_ram=8221MB free_disk=25.071918487548828GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=103546) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 04:11:34 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:11:34 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:11:34 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 246ccf69-847c-4ab2-b709-ad1a85e81eab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:11:34 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance ce616440-9d69-4812-8910-a2d9ad58f504 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:11:34 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:11:34 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 2fdca5a2-7e02-4c4a-96ae-cc61547232c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:11:34 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 061acca0-e5a9-4eb0-bf5c-d81472ec4b83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:11:34 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 04:11:34 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 04:11:34 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:11:34 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:11:34 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:11:34 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Compute_service record updated for user:user {{(pid=103546) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 04:11:34 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.346s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:11:36 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:11:36 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:11:36 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:11:38 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:11:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:11:40 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:11:40 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Starting heal instance info cache {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 04:11:40 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Rebuilding the list of instances to heal {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 04:11:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "refresh_cache-246ccf69-847c-4ab2-b709-ad1a85e81eab" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:11:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquired lock "refresh_cache-246ccf69-847c-4ab2-b709-ad1a85e81eab" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:11:40 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Forcefully refreshing network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 04:11:40 user nova-compute[103546]: DEBUG nova.objects.instance [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lazy-loading 'info_cache' on Instance uuid 246ccf69-847c-4ab2-b709-ad1a85e81eab {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:11:41 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Updating instance_info_cache with network_info: [{"id": "84add44b-0c93-4ebc-b45d-2f30d63d900f", "address": "fa:16:3e:13:18:5f", "network": {"id": "337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-40560053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca049d5674dc4c59814f98478752d73d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84add44b-0c", "ovs_interfaceid": "84add44b-0c93-4ebc-b45d-2f30d63d900f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:11:41 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Releasing lock "refresh_cache-246ccf69-847c-4ab2-b709-ad1a85e81eab" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:11:41 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Updated the network info_cache for instance {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 04:11:42 user nova-compute[103546]: DEBUG nova.compute.manager [req-5e246ede-72b4-4f28-a5e7-68d2588307b5 req-862e0ae9-18f5-4823-abb3-9e5865feca49 service nova] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Received event network-changed-a64e3b5a-f0ee-4b9c-8736-84e4e4c9a1b3 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:11:42 user nova-compute[103546]: DEBUG nova.compute.manager [req-5e246ede-72b4-4f28-a5e7-68d2588307b5 req-862e0ae9-18f5-4823-abb3-9e5865feca49 service nova] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Refreshing instance network info cache due to event network-changed-a64e3b5a-f0ee-4b9c-8736-84e4e4c9a1b3. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 04:11:42 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-5e246ede-72b4-4f28-a5e7-68d2588307b5 req-862e0ae9-18f5-4823-abb3-9e5865feca49 service nova] Acquiring lock "refresh_cache-0ba82fe3-33e6-4ae4-8716-2efbe66a6f06" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:11:42 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-5e246ede-72b4-4f28-a5e7-68d2588307b5 req-862e0ae9-18f5-4823-abb3-9e5865feca49 service nova] Acquired lock "refresh_cache-0ba82fe3-33e6-4ae4-8716-2efbe66a6f06" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:11:42 user nova-compute[103546]: DEBUG nova.network.neutron [req-5e246ede-72b4-4f28-a5e7-68d2588307b5 req-862e0ae9-18f5-4823-abb3-9e5865feca49 service nova] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Refreshing network info cache for port a64e3b5a-f0ee-4b9c-8736-84e4e4c9a1b3 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 04:11:43 user nova-compute[103546]: DEBUG nova.network.neutron [req-5e246ede-72b4-4f28-a5e7-68d2588307b5 req-862e0ae9-18f5-4823-abb3-9e5865feca49 service nova] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Updated VIF entry in instance network info cache for port a64e3b5a-f0ee-4b9c-8736-84e4e4c9a1b3. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 04:11:43 user nova-compute[103546]: DEBUG nova.network.neutron [req-5e246ede-72b4-4f28-a5e7-68d2588307b5 req-862e0ae9-18f5-4823-abb3-9e5865feca49 service nova] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Updating instance_info_cache with network_info: [{"id": "a64e3b5a-f0ee-4b9c-8736-84e4e4c9a1b3", "address": "fa:16:3e:86:b7:f6", "network": {"id": "23baa589-ae15-4a44-8991-d6fe8569dc8a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-464431710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f33e7eff7954fcc895f66982d7d45c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64e3b5a-f0", "ovs_interfaceid": "a64e3b5a-f0ee-4b9c-8736-84e4e4c9a1b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:11:43 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-5e246ede-72b4-4f28-a5e7-68d2588307b5 req-862e0ae9-18f5-4823-abb3-9e5865feca49 service nova] Releasing lock "refresh_cache-0ba82fe3-33e6-4ae4-8716-2efbe66a6f06" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:11:44 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:11:44 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:11:45 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-ed338ede-9bf9-40e8-a7ef-1103a0383061 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Acquiring lock "0ba82fe3-33e6-4ae4-8716-2efbe66a6f06" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:11:45 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-ed338ede-9bf9-40e8-a7ef-1103a0383061 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "0ba82fe3-33e6-4ae4-8716-2efbe66a6f06" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:11:45 user nova-compute[103546]: DEBUG nova.objects.instance [None req-ed338ede-9bf9-40e8-a7ef-1103a0383061 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lazy-loading 'flavor' on Instance uuid 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:11:45 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-ed338ede-9bf9-40e8-a7ef-1103a0383061 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "0ba82fe3-33e6-4ae4-8716-2efbe66a6f06" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:11:45 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-ed338ede-9bf9-40e8-a7ef-1103a0383061 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Acquiring lock "0ba82fe3-33e6-4ae4-8716-2efbe66a6f06" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:11:45 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-ed338ede-9bf9-40e8-a7ef-1103a0383061 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "0ba82fe3-33e6-4ae4-8716-2efbe66a6f06" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:11:45 user nova-compute[103546]: INFO nova.compute.manager [None req-ed338ede-9bf9-40e8-a7ef-1103a0383061 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Attaching volume acc3764f-b353-43c6-80f7-3ac84b8fff54 to /dev/vdb
Nov 16 04:11:45 user nova-compute[103546]: DEBUG os_brick.utils [None req-ed338ede-9bf9-40e8-a7ef-1103a0383061 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:11:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:11:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:11:45 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ceb3d7-a1ca-4be6-bcd5-c75592cab704]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af5c39b14ece\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:11:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:11:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:11:45 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c564bbd5-d608-4bee-981c-7edeacd13e17]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:11:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:11:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:11:45 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f608ef-caf7-4430-97c7-4ce9c86f6c9c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:11:45 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d825cb7-0742-4837-9331-1a23cc0fdac0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:11:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-ed338ede-9bf9-40e8-a7ef-1103a0383061 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Running cmd (subprocess): nvme version {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:11:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-ed338ede-9bf9-40e8-a7ef-1103a0383061 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] 'nvme version' failed. Not Retrying. {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 04:11:45 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ed338ede-9bf9-40e8-a7ef-1103a0383061 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] nvme not present on system {{(pid=103546) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 04:11:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:11:45 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 04:11:45 user nova-compute[103546]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 04:11:45 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7849dd5-d4e8-4425-83ad-75c93342290a]: (4, '') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:11:45 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-ed338ede-9bf9-40e8-a7ef-1103a0383061 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=103546) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 04:11:45 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-ed338ede-9bf9-40e8-a7ef-1103a0383061 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 04:11:45 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-ed338ede-9bf9-40e8-a7ef-1103a0383061 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] LIGHTOS: no hostnqn found. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 04:11:45 user nova-compute[103546]: DEBUG os_brick.utils [None req-ed338ede-9bf9-40e8-a7ef-1103a0383061 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af5c39b14ece', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:11:45 user nova-compute[103546]: DEBUG nova.virt.block_device [None req-ed338ede-9bf9-40e8-a7ef-1103a0383061 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Updating existing volume attachment record: dcf80e48-8661-4375-a4dd-b9befeb6e824 {{(pid=103546) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 04:11:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:11:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:11:50 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed338ede-9bf9-40e8-a7ef-1103a0383061 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 04:11:50 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed338ede-9bf9-40e8-a7ef-1103a0383061 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:acc3764f-b353-43c6-80f7-3ac84b8fff54', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'psLznkeQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:11:50 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-ed338ede-9bf9-40e8-a7ef-1103a0383061 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:11:50 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-ed338ede-9bf9-40e8-a7ef-1103a0383061 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:11:50 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-ed338ede-9bf9-40e8-a7ef-1103a0383061 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:11:50 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-ed338ede-9bf9-40e8-a7ef-1103a0383061 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:11:50 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-ed338ede-9bf9-40e8-a7ef-1103a0383061 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:acc3764f-b353-43c6-80f7-3ac84b8fff54" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:11:50 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-ed338ede-9bf9-40e8-a7ef-1103a0383061 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:acc3764f-b353-43c6-80f7-3ac84b8fff54" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:11:50 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-ed338ede-9bf9-40e8-a7ef-1103a0383061 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 04:11:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc3764f-b353-43c6-80f7-3ac84b8fff54 -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:11:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc3764f-b353-43c6-80f7-3ac84b8fff54 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:11:50 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b613c547-49aa-4bfb-a8a5-4523662334a9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:11:50 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed338ede-9bf9-40e8-a7ef-1103a0383061 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 04:11:50 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:11:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc3764f-b353-43c6-80f7-3ac84b8fff54 -p 172.16.0.220:3260 --interface default --op new {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:11:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc3764f-b353-43c6-80f7-3ac84b8fff54 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:11:50 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f29347d-8ed7-4053-95bf-ef2576c3bb33]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:acc3764f-b353-43c6-80f7-3ac84b8fff54] added\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:11:50 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed338ede-9bf9-40e8-a7ef-1103a0383061 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:acc3764f-b353-43c6-80f7-3ac84b8fff54] added
Nov 16 04:11:50 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:11:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc3764f-b353-43c6-80f7-3ac84b8fff54 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:11:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc3764f-b353-43c6-80f7-3ac84b8fff54 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:11:50 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[15bffeb6-d73e-478c-851d-4e89521b1f02]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:11:50 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed338ede-9bf9-40e8-a7ef-1103a0383061 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:11:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc3764f-b353-43c6-80f7-3ac84b8fff54 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:11:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc3764f-b353-43c6-80f7-3ac84b8fff54 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:11:50 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[42dd801a-82cd-420e-b182-42368a5f61a2]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:11:50 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed338ede-9bf9-40e8-a7ef-1103a0383061 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:11:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc3764f-b353-43c6-80f7-3ac84b8fff54 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v psLznkeQ {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:11:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc3764f-b353-43c6-80f7-3ac84b8fff54 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v psLznkeQ" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:11:50 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[750c61e9-73a5-49d6-bdd7-85defb5558cb]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:11:50 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed338ede-9bf9-40e8-a7ef-1103a0383061 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'psLznkeQ'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:11:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc3764f-b353-43c6-80f7-3ac84b8fff54 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:11:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc3764f-b353-43c6-80f7-3ac84b8fff54 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:11:50 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[89533fe3-ea22-4c06-acff-dc1264e594c4]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:11:50 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed338ede-9bf9-40e8-a7ef-1103a0383061 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:11:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:11:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:11:50 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c2191b-eac8-4131-9e71-204b58b7d379]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:11:50 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed338ede-9bf9-40e8-a7ef-1103a0383061 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098 (non-flash)
Nov 16 04:11:50 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:11:50 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed338ede-9bf9-40e8-a7ef-1103a0383061 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098 (non-flash)
Nov 16 04:11:50 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:11:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc3764f-b353-43c6-80f7-3ac84b8fff54 -p 172.16.0.220:3260 --login {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:11:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc3764f-b353-43c6-80f7-3ac84b8fff54 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:11:50 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea459ad3-eed0-4694-a190-0ad5558f16c0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:acc3764f-b353-43c6-80f7-3ac84b8fff54, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:acc3764f-b353-43c6-80f7-3ac84b8fff54, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:11:50 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed338ede-9bf9-40e8-a7ef-1103a0383061 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:acc3764f-b353-43c6-80f7-3ac84b8fff54, portal: 172.16.0.220,3260]
Nov 16 04:11:50 user nova-compute[103546]: Login to [iface: default, target: iqn.2010-10.org.openstack:acc3764f-b353-43c6-80f7-3ac84b8fff54, portal: 172.16.0.220,3260] successful.
Nov 16 04:11:50 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:11:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc3764f-b353-43c6-80f7-3ac84b8fff54 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:11:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc3764f-b353-43c6-80f7-3ac84b8fff54 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:11:50 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51edcbd-d0aa-47a6-815d-abc5d76c1b1f]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:11:50 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed338ede-9bf9-40e8-a7ef-1103a0383061 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:11:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:11:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:11:50 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[10186fc1-67ad-4e12-9750-931b9ec099f2]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3764f-b353-43c6-80f7-3ac84b8fff54 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:11:50 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed338ede-9bf9-40e8-a7ef-1103a0383061 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098 (non-flash)
Nov 16 04:11:50 user nova-compute[103546]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3764f-b353-43c6-80f7-3ac84b8fff54 (non-flash)
Nov 16 04:11:50 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:11:50 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed338ede-9bf9-40e8-a7ef-1103a0383061 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098 (non-flash)
Nov 16 04:11:50 user nova-compute[103546]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3764f-b353-43c6-80f7-3ac84b8fff54 (non-flash)
Nov 16 04:11:50 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:11:50 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-ed338ede-9bf9-40e8-a7ef-1103a0383061 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:acc3764f-b353-43c6-80f7-3ac84b8fff54" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:11:50 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed338ede-9bf9-40e8-a7ef-1103a0383061 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 04:11:50 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-ed338ede-9bf9-40e8-a7ef-1103a0383061 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 04:11:50 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-ed338ede-9bf9-40e8-a7ef-1103a0383061 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 04:11:50 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:11:51 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:11:51 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a9a044-f89f-4293-857d-4e7f7c7649db]: (4, ('- - 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:11:51 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-ed338ede-9bf9-40e8-a7ef-1103a0383061 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 04:11:51 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed338ede-9bf9-40e8-a7ef-1103a0383061 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:acc3764f-b353-43c6-80f7-3ac84b8fff54', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'psLznkeQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 04:11:52 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-ed338ede-9bf9-40e8-a7ef-1103a0383061 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:11:52 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed338ede-9bf9-40e8-a7ef-1103a0383061 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '26164333665366462', 'path': '/dev/sdb'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:11:52 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed338ede-9bf9-40e8-a7ef-1103a0383061 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26164333665366462', 'path': '/dev/sdb'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 04:11:52 user nova-compute[103546]: DEBUG nova.objects.instance [None req-ed338ede-9bf9-40e8-a7ef-1103a0383061 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lazy-loading 'flavor' on Instance uuid 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:11:52 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-ed338ede-9bf9-40e8-a7ef-1103a0383061 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 04:11:52 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:11:52 user nova-compute[103546]:   <source dev="/dev/sdb"/>
Nov 16 04:11:52 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 04:11:52 user nova-compute[103546]:   <serial>acc3764f-b353-43c6-80f7-3ac84b8fff54</serial>
Nov 16 04:11:52 user nova-compute[103546]: </disk>
Nov 16 04:11:52 user nova-compute[103546]:  {{(pid=103546) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 04:11:52 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-ed338ede-9bf9-40e8-a7ef-1103a0383061 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:11:52 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-ed338ede-9bf9-40e8-a7ef-1103a0383061 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] No BDM found with device name vdb, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:11:52 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-ed338ede-9bf9-40e8-a7ef-1103a0383061 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] No VIF found with MAC fa:16:3e:86:b7:f6, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 04:11:52 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-ed338ede-9bf9-40e8-a7ef-1103a0383061 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "0ba82fe3-33e6-4ae4-8716-2efbe66a6f06" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.825s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:11:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:11:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:11:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b8134878-7380-40d9-9a09-ac1acfde0791 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Acquiring lock "0ba82fe3-33e6-4ae4-8716-2efbe66a6f06" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:11:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b8134878-7380-40d9-9a09-ac1acfde0791 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "0ba82fe3-33e6-4ae4-8716-2efbe66a6f06" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:11:54 user nova-compute[103546]: DEBUG nova.objects.instance [None req-b8134878-7380-40d9-9a09-ac1acfde0791 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lazy-loading 'flavor' on Instance uuid 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:11:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b8134878-7380-40d9-9a09-ac1acfde0791 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "0ba82fe3-33e6-4ae4-8716-2efbe66a6f06" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:11:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b8134878-7380-40d9-9a09-ac1acfde0791 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Acquiring lock "0ba82fe3-33e6-4ae4-8716-2efbe66a6f06" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:11:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b8134878-7380-40d9-9a09-ac1acfde0791 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "0ba82fe3-33e6-4ae4-8716-2efbe66a6f06" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:11:55 user nova-compute[103546]: INFO nova.compute.manager [None req-b8134878-7380-40d9-9a09-ac1acfde0791 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Attaching volume 735ce75d-60fc-4cdb-a3e6-2083087ccbc4 to /dev/vdc
Nov 16 04:11:55 user nova-compute[103546]: DEBUG os_brick.utils [None req-b8134878-7380-40d9-9a09-ac1acfde0791 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:11:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:11:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:11:55 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[9531a465-29b5-441b-b3d4-a451c634c0c6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af5c39b14ece\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:11:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:11:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:11:55 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff31651-b674-4d6d-9a24-5161b5a241f2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:11:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:11:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:11:55 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ccd59e-046f-4f46-b90e-44a3e9f6ccce]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:11:55 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0324b12-99b0-4d44-873f-f9f2e71077f8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:11:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-b8134878-7380-40d9-9a09-ac1acfde0791 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Running cmd (subprocess): nvme version {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:11:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-b8134878-7380-40d9-9a09-ac1acfde0791 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] 'nvme version' failed. Not Retrying. {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 04:11:55 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b8134878-7380-40d9-9a09-ac1acfde0791 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] nvme not present on system {{(pid=103546) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 04:11:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:11:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 04:11:55 user nova-compute[103546]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 04:11:55 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7e526c-2d78-44c8-83af-d4fd4302cb6f]: (4, '') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:11:55 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-b8134878-7380-40d9-9a09-ac1acfde0791 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=103546) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 04:11:55 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-b8134878-7380-40d9-9a09-ac1acfde0791 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 04:11:55 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-b8134878-7380-40d9-9a09-ac1acfde0791 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] LIGHTOS: no hostnqn found. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 04:11:55 user nova-compute[103546]: DEBUG os_brick.utils [None req-b8134878-7380-40d9-9a09-ac1acfde0791 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af5c39b14ece', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:11:55 user nova-compute[103546]: DEBUG nova.virt.block_device [None req-b8134878-7380-40d9-9a09-ac1acfde0791 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Updating existing volume attachment record: 7d880c21-ebc6-44eb-9bae-d7de8a35b288 {{(pid=103546) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 04:11:59 user nova-compute[103546]: DEBUG nova.compute.manager [req-d4bcc745-49b9-4321-9b6b-d8704031054a req-e08d70b6-89e7-4bc4-a65e-f8679ecc4042 service nova] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Received event network-changed-3d061027-8dbb-48b4-bbcd-b057c196a301 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:11:59 user nova-compute[103546]: DEBUG nova.compute.manager [req-d4bcc745-49b9-4321-9b6b-d8704031054a req-e08d70b6-89e7-4bc4-a65e-f8679ecc4042 service nova] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Refreshing instance network info cache due to event network-changed-3d061027-8dbb-48b4-bbcd-b057c196a301. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 04:11:59 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d4bcc745-49b9-4321-9b6b-d8704031054a req-e08d70b6-89e7-4bc4-a65e-f8679ecc4042 service nova] Acquiring lock "refresh_cache-ce616440-9d69-4812-8910-a2d9ad58f504" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:11:59 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d4bcc745-49b9-4321-9b6b-d8704031054a req-e08d70b6-89e7-4bc4-a65e-f8679ecc4042 service nova] Acquired lock "refresh_cache-ce616440-9d69-4812-8910-a2d9ad58f504" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:11:59 user nova-compute[103546]: DEBUG nova.network.neutron [req-d4bcc745-49b9-4321-9b6b-d8704031054a req-e08d70b6-89e7-4bc4-a65e-f8679ecc4042 service nova] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Refreshing network info cache for port 3d061027-8dbb-48b4-bbcd-b057c196a301 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 04:11:59 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:11:59 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:11:59 user nova-compute[103546]: DEBUG nova.network.neutron [req-d4bcc745-49b9-4321-9b6b-d8704031054a req-e08d70b6-89e7-4bc4-a65e-f8679ecc4042 service nova] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Updated VIF entry in instance network info cache for port 3d061027-8dbb-48b4-bbcd-b057c196a301. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 04:11:59 user nova-compute[103546]: DEBUG nova.network.neutron [req-d4bcc745-49b9-4321-9b6b-d8704031054a req-e08d70b6-89e7-4bc4-a65e-f8679ecc4042 service nova] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Updating instance_info_cache with network_info: [{"id": "3d061027-8dbb-48b4-bbcd-b057c196a301", "address": "fa:16:3e:45:2b:d3", "network": {"id": "d942264a-f03e-49a2-89eb-103a12c99518", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484356505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edb839c76c0d4513b9be0ec92301707f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d061027-8d", "ovs_interfaceid": "3d061027-8dbb-48b4-bbcd-b057c196a301", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:11:59 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d4bcc745-49b9-4321-9b6b-d8704031054a req-e08d70b6-89e7-4bc4-a65e-f8679ecc4042 service nova] Releasing lock "refresh_cache-ce616440-9d69-4812-8910-a2d9ad58f504" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:11:59 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-8ad44855-68be-4a67-b2e0-ab1d717b2ae8 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Acquiring lock "ce616440-9d69-4812-8910-a2d9ad58f504" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:11:59 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-8ad44855-68be-4a67-b2e0-ab1d717b2ae8 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "ce616440-9d69-4812-8910-a2d9ad58f504" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:11:59 user nova-compute[103546]: INFO nova.compute.manager [None req-8ad44855-68be-4a67-b2e0-ab1d717b2ae8 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Detaching volume 9d28e72a-a41e-4b84-9c3a-5af173b4f098
Nov 16 04:12:00 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8134878-7380-40d9-9a09-ac1acfde0791 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 04:12:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8134878-7380-40d9-9a09-ac1acfde0791 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:735ce75d-60fc-4cdb-a3e6-2083087ccbc4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TvfurAIy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:12:00 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-b8134878-7380-40d9-9a09-ac1acfde0791 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:12:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-b8134878-7380-40d9-9a09-ac1acfde0791 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:12:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-b8134878-7380-40d9-9a09-ac1acfde0791 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:12:00 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-b8134878-7380-40d9-9a09-ac1acfde0791 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:12:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-b8134878-7380-40d9-9a09-ac1acfde0791 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:735ce75d-60fc-4cdb-a3e6-2083087ccbc4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:12:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-b8134878-7380-40d9-9a09-ac1acfde0791 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:735ce75d-60fc-4cdb-a3e6-2083087ccbc4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:12:00 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-b8134878-7380-40d9-9a09-ac1acfde0791 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 04:12:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:735ce75d-60fc-4cdb-a3e6-2083087ccbc4 -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:12:00 user nova-compute[103546]: INFO nova.virt.block_device [None req-8ad44855-68be-4a67-b2e0-ab1d717b2ae8 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Attempting to driver detach volume 9d28e72a-a41e-4b84-9c3a-5af173b4f098 from mountpoint /dev/vdb
Nov 16 04:12:00 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-8ad44855-68be-4a67-b2e0-ab1d717b2ae8 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Attempting to detach device vdb from instance ce616440-9d69-4812-8910-a2d9ad58f504 from the persistent domain config. {{(pid=103546) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 04:12:00 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-8ad44855-68be-4a67-b2e0-ab1d717b2ae8 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 04:12:00 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:12:00 user nova-compute[103546]:   <source dev="/dev/sdc"/>
Nov 16 04:12:00 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 04:12:00 user nova-compute[103546]:   <serial>9d28e72a-a41e-4b84-9c3a-5af173b4f098</serial>
Nov 16 04:12:00 user nova-compute[103546]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 04:12:00 user nova-compute[103546]: </disk>
Nov 16 04:12:00 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 04:12:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:735ce75d-60fc-4cdb-a3e6-2083087ccbc4 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:12:00 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eef2656-9cfe-46e0-899d-490d78219edc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:12:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8134878-7380-40d9-9a09-ac1acfde0791 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 04:12:00 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:12:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:735ce75d-60fc-4cdb-a3e6-2083087ccbc4 -p 172.16.0.220:3260 --interface default --op new {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:12:00 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-8ad44855-68be-4a67-b2e0-ab1d717b2ae8 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Successfully detached device vdb from instance ce616440-9d69-4812-8910-a2d9ad58f504 from the persistent domain config.
Nov 16 04:12:00 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-8ad44855-68be-4a67-b2e0-ab1d717b2ae8 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ce616440-9d69-4812-8910-a2d9ad58f504 from the live domain config. {{(pid=103546) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 04:12:00 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-8ad44855-68be-4a67-b2e0-ab1d717b2ae8 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 04:12:00 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:12:00 user nova-compute[103546]:   <source dev="/dev/sdc"/>
Nov 16 04:12:00 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 04:12:00 user nova-compute[103546]:   <serial>9d28e72a-a41e-4b84-9c3a-5af173b4f098</serial>
Nov 16 04:12:00 user nova-compute[103546]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 04:12:00 user nova-compute[103546]: </disk>
Nov 16 04:12:00 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 04:12:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:735ce75d-60fc-4cdb-a3e6-2083087ccbc4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:12:00 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ea908b-6fa9-45a4-8254-86ab750b1fd2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:735ce75d-60fc-4cdb-a3e6-2083087ccbc4] added\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:12:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8134878-7380-40d9-9a09-ac1acfde0791 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:735ce75d-60fc-4cdb-a3e6-2083087ccbc4] added
Nov 16 04:12:00 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:12:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:735ce75d-60fc-4cdb-a3e6-2083087ccbc4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:12:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:735ce75d-60fc-4cdb-a3e6-2083087ccbc4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:12:00 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0aa8cf4-0bf2-4bed-b306-9e0de77c34c7]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:12:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8134878-7380-40d9-9a09-ac1acfde0791 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:12:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:735ce75d-60fc-4cdb-a3e6-2083087ccbc4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:12:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:735ce75d-60fc-4cdb-a3e6-2083087ccbc4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:12:00 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[083069ec-811a-4895-8c66-37c355ab2d67]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:12:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8134878-7380-40d9-9a09-ac1acfde0791 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:12:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:735ce75d-60fc-4cdb-a3e6-2083087ccbc4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TvfurAIy {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:12:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:735ce75d-60fc-4cdb-a3e6-2083087ccbc4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TvfurAIy" returned: 0 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:12:00 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8c8f7a-3583-4697-adc2-a617ab2e89d7]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:12:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8134878-7380-40d9-9a09-ac1acfde0791 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TvfurAIy'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:12:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:735ce75d-60fc-4cdb-a3e6-2083087ccbc4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:12:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:735ce75d-60fc-4cdb-a3e6-2083087ccbc4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:12:00 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c67597f-d05c-4b4d-b13d-efb25e4e8864]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:12:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8134878-7380-40d9-9a09-ac1acfde0791 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:12:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:12:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:12:00 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[6944207b-a2c6-4f0f-a121-b69dabdc0e7a]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3764f-b353-43c6-80f7-3ac84b8fff54 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:12:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8134878-7380-40d9-9a09-ac1acfde0791 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098 (non-flash)
Nov 16 04:12:00 user nova-compute[103546]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3764f-b353-43c6-80f7-3ac84b8fff54 (non-flash)
Nov 16 04:12:00 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:12:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8134878-7380-40d9-9a09-ac1acfde0791 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098 (non-flash)
Nov 16 04:12:00 user nova-compute[103546]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3764f-b353-43c6-80f7-3ac84b8fff54 (non-flash)
Nov 16 04:12:00 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:12:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:735ce75d-60fc-4cdb-a3e6-2083087ccbc4 -p 172.16.0.220:3260 --login {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:12:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:735ce75d-60fc-4cdb-a3e6-2083087ccbc4 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:12:00 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b616e1-40d2-4059-b889-77cafaddd974]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:735ce75d-60fc-4cdb-a3e6-2083087ccbc4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:735ce75d-60fc-4cdb-a3e6-2083087ccbc4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:12:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8134878-7380-40d9-9a09-ac1acfde0791 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:735ce75d-60fc-4cdb-a3e6-2083087ccbc4, portal: 172.16.0.220,3260]
Nov 16 04:12:00 user nova-compute[103546]: Login to [iface: default, target: iqn.2010-10.org.openstack:735ce75d-60fc-4cdb-a3e6-2083087ccbc4, portal: 172.16.0.220,3260] successful.
Nov 16 04:12:00 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:12:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:735ce75d-60fc-4cdb-a3e6-2083087ccbc4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:12:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:735ce75d-60fc-4cdb-a3e6-2083087ccbc4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:12:00 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7b6dd5-af89-4cfd-ba69-db0a2c270c05]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:12:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8134878-7380-40d9-9a09-ac1acfde0791 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:12:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:12:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:12:00 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0d58ef-5bbf-41e7-a521-863b55f6c1cc]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3764f-b353-43c6-80f7-3ac84b8fff54 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735ce75d-60fc-4cdb-a3e6-2083087ccbc4 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:12:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8134878-7380-40d9-9a09-ac1acfde0791 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098 (non-flash)
Nov 16 04:12:00 user nova-compute[103546]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3764f-b353-43c6-80f7-3ac84b8fff54 (non-flash)
Nov 16 04:12:00 user nova-compute[103546]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735ce75d-60fc-4cdb-a3e6-2083087ccbc4 (non-flash)
Nov 16 04:12:00 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:12:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8134878-7380-40d9-9a09-ac1acfde0791 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098 (non-flash)
Nov 16 04:12:00 user nova-compute[103546]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3764f-b353-43c6-80f7-3ac84b8fff54 (non-flash)
Nov 16 04:12:00 user nova-compute[103546]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735ce75d-60fc-4cdb-a3e6-2083087ccbc4 (non-flash)
Nov 16 04:12:00 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:12:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-b8134878-7380-40d9-9a09-ac1acfde0791 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:735ce75d-60fc-4cdb-a3e6-2083087ccbc4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:12:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8134878-7380-40d9-9a09-ac1acfde0791 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 04:12:00 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-b8134878-7380-40d9-9a09-ac1acfde0791 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] HCTL ('35', '-', '-', 0) found on session 54 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 04:12:00 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-b8134878-7380-40d9-9a09-ac1acfde0791 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 04:12:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:12:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:12:00 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[635f8a8f-7d0f-4e0f-a041-6b066f890ab9]: (4, ('- - 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:12:00 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-b8134878-7380-40d9-9a09-ac1acfde0791 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Searching for a device in session 54 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 04:12:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8134878-7380-40d9-9a09-ac1acfde0791 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:735ce75d-60fc-4cdb-a3e6-2083087ccbc4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TvfurAIy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 04:12:00 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-8ad44855-68be-4a67-b2e0-ab1d717b2ae8 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ce616440-9d69-4812-8910-a2d9ad58f504 {{(pid=103546) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 04:12:01 user nova-compute[103546]: DEBUG nova.compute.manager [req-6d1ff4e6-b9d0-4531-9fcb-b47395a97361 req-ff8f1b0c-33b7-45bf-963d-d6d1072a39f0 service nova] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Received event network-changed-3d061027-8dbb-48b4-bbcd-b057c196a301 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:12:01 user nova-compute[103546]: DEBUG nova.compute.manager [req-6d1ff4e6-b9d0-4531-9fcb-b47395a97361 req-ff8f1b0c-33b7-45bf-963d-d6d1072a39f0 service nova] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Refreshing instance network info cache due to event network-changed-3d061027-8dbb-48b4-bbcd-b057c196a301. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 04:12:01 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6d1ff4e6-b9d0-4531-9fcb-b47395a97361 req-ff8f1b0c-33b7-45bf-963d-d6d1072a39f0 service nova] Acquiring lock "refresh_cache-ce616440-9d69-4812-8910-a2d9ad58f504" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:12:01 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6d1ff4e6-b9d0-4531-9fcb-b47395a97361 req-ff8f1b0c-33b7-45bf-963d-d6d1072a39f0 service nova] Acquired lock "refresh_cache-ce616440-9d69-4812-8910-a2d9ad58f504" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:12:01 user nova-compute[103546]: DEBUG nova.network.neutron [req-6d1ff4e6-b9d0-4531-9fcb-b47395a97361 req-ff8f1b0c-33b7-45bf-963d-d6d1072a39f0 service nova] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Refreshing network info cache for port 3d061027-8dbb-48b4-bbcd-b057c196a301 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 04:12:01 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-b8134878-7380-40d9-9a09-ac1acfde0791 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:12:01 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8134878-7380-40d9-9a09-ac1acfde0791 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23866633166616562', 'path': '/dev/sdd'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:12:01 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8134878-7380-40d9-9a09-ac1acfde0791 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866633166616562', 'path': '/dev/sdd'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 04:12:01 user nova-compute[103546]: DEBUG nova.objects.instance [None req-b8134878-7380-40d9-9a09-ac1acfde0791 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lazy-loading 'flavor' on Instance uuid 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:12:01 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-b8134878-7380-40d9-9a09-ac1acfde0791 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 04:12:01 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:12:01 user nova-compute[103546]:   <source dev="/dev/sdd"/>
Nov 16 04:12:01 user nova-compute[103546]:   <target dev="vdc" bus="virtio"/>
Nov 16 04:12:01 user nova-compute[103546]:   <serial>735ce75d-60fc-4cdb-a3e6-2083087ccbc4</serial>
Nov 16 04:12:01 user nova-compute[103546]: </disk>
Nov 16 04:12:01 user nova-compute[103546]:  {{(pid=103546) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 04:12:01 user nova-compute[103546]: DEBUG nova.network.neutron [req-6d1ff4e6-b9d0-4531-9fcb-b47395a97361 req-ff8f1b0c-33b7-45bf-963d-d6d1072a39f0 service nova] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Updated VIF entry in instance network info cache for port 3d061027-8dbb-48b4-bbcd-b057c196a301. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 04:12:01 user nova-compute[103546]: DEBUG nova.network.neutron [req-6d1ff4e6-b9d0-4531-9fcb-b47395a97361 req-ff8f1b0c-33b7-45bf-963d-d6d1072a39f0 service nova] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Updating instance_info_cache with network_info: [{"id": "3d061027-8dbb-48b4-bbcd-b057c196a301", "address": "fa:16:3e:45:2b:d3", "network": {"id": "d942264a-f03e-49a2-89eb-103a12c99518", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484356505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edb839c76c0d4513b9be0ec92301707f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d061027-8d", "ovs_interfaceid": "3d061027-8dbb-48b4-bbcd-b057c196a301", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:12:01 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-b8134878-7380-40d9-9a09-ac1acfde0791 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:12:01 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-b8134878-7380-40d9-9a09-ac1acfde0791 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] No BDM found with device name vdb, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:12:01 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-b8134878-7380-40d9-9a09-ac1acfde0791 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] No BDM found with device name vdc, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:12:01 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-b8134878-7380-40d9-9a09-ac1acfde0791 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] No VIF found with MAC fa:16:3e:86:b7:f6, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 04:12:01 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6d1ff4e6-b9d0-4531-9fcb-b47395a97361 req-ff8f1b0c-33b7-45bf-963d-d6d1072a39f0 service nova] Releasing lock "refresh_cache-ce616440-9d69-4812-8910-a2d9ad58f504" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:12:01 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b8134878-7380-40d9-9a09-ac1acfde0791 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "0ba82fe3-33e6-4ae4-8716-2efbe66a6f06" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.786s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:12:01 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-c3364a17-5943-42ec-98c5-c4a93c15e6c4 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Acquiring lock "246ccf69-847c-4ab2-b709-ad1a85e81eab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:12:01 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-c3364a17-5943-42ec-98c5-c4a93c15e6c4 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "246ccf69-847c-4ab2-b709-ad1a85e81eab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:12:01 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-c3364a17-5943-42ec-98c5-c4a93c15e6c4 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Acquiring lock "246ccf69-847c-4ab2-b709-ad1a85e81eab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:12:01 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-c3364a17-5943-42ec-98c5-c4a93c15e6c4 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "246ccf69-847c-4ab2-b709-ad1a85e81eab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:12:01 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-c3364a17-5943-42ec-98c5-c4a93c15e6c4 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "246ccf69-847c-4ab2-b709-ad1a85e81eab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:12:01 user nova-compute[103546]: INFO nova.compute.manager [None req-c3364a17-5943-42ec-98c5-c4a93c15e6c4 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Terminating instance
Nov 16 04:12:01 user nova-compute[103546]: DEBUG nova.compute.manager [None req-c3364a17-5943-42ec-98c5-c4a93c15e6c4 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Start destroying the instance on the hypervisor. {{(pid=103546) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 04:12:02 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:12:02 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:12:02 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:12:02 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:12:02 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Instance destroyed successfully.
Nov 16 04:12:02 user nova-compute[103546]: DEBUG nova.objects.instance [None req-c3364a17-5943-42ec-98c5-c4a93c15e6c4 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lazy-loading 'resources' on Instance uuid 246ccf69-847c-4ab2-b709-ad1a85e81eab {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:12:02 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-c3364a17-5943-42ec-98c5-c4a93c15e6c4 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T03:55:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2068912145',display_name='tempest-ServerRescueNegativeTestJSON-server-2068912145',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2068912145',id=27,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T04:00:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ca049d5674dc4c59814f98478752d73d',ramdisk_id='',reservation_id='r-rkqsk0gl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1943614153',owner_user_name='tempest-ServerRescueNegativeTestJSON-1943614153-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T04:01:52Z,user_data=None,user_id='7626749c82fb4b5c81e696e4beeed858',uuid=246ccf69-847c-4ab2-b709-ad1a85e81eab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84add44b-0c93-4ebc-b45d-2f30d63d900f", "address": "fa:16:3e:13:18:5f", "network": {"id": "337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-40560053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca049d5674dc4c59814f98478752d73d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84add44b-0c", "ovs_interfaceid": "84add44b-0c93-4ebc-b45d-2f30d63d900f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 04:12:02 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-c3364a17-5943-42ec-98c5-c4a93c15e6c4 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Converting VIF {"id": "84add44b-0c93-4ebc-b45d-2f30d63d900f", "address": "fa:16:3e:13:18:5f", "network": {"id": "337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-40560053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca049d5674dc4c59814f98478752d73d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84add44b-0c", "ovs_interfaceid": "84add44b-0c93-4ebc-b45d-2f30d63d900f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:12:02 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-c3364a17-5943-42ec-98c5-c4a93c15e6c4 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:18:5f,bridge_name='br-int',has_traffic_filtering=True,id=84add44b-0c93-4ebc-b45d-2f30d63d900f,network=Network(337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84add44b-0c') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:12:02 user nova-compute[103546]: DEBUG os_vif [None req-c3364a17-5943-42ec-98c5-c4a93c15e6c4 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:18:5f,bridge_name='br-int',has_traffic_filtering=True,id=84add44b-0c93-4ebc-b45d-2f30d63d900f,network=Network(337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84add44b-0c') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 04:12:02 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:12:02 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84add44b-0c, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:12:02 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:12:02 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:12:02 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:12:02 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3a7bf80e-881a-47a5-bcab-4eb2b4d5fc40) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:12:02 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:12:02 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:12:02 user nova-compute[103546]: INFO os_vif [None req-c3364a17-5943-42ec-98c5-c4a93c15e6c4 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:18:5f,bridge_name='br-int',has_traffic_filtering=True,id=84add44b-0c93-4ebc-b45d-2f30d63d900f,network=Network(337ff7f8-a3ae-4ff8-b8df-2733fa6c8cd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84add44b-0c')
Nov 16 04:12:02 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-c3364a17-5943-42ec-98c5-c4a93c15e6c4 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Deleting instance files /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab_del
Nov 16 04:12:02 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-c3364a17-5943-42ec-98c5-c4a93c15e6c4 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Deletion of /opt/stack/data/nova/instances/246ccf69-847c-4ab2-b709-ad1a85e81eab_del complete
Nov 16 04:12:02 user nova-compute[103546]: INFO nova.compute.manager [None req-c3364a17-5943-42ec-98c5-c4a93c15e6c4 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 16 04:12:02 user nova-compute[103546]: DEBUG oslo.service.loopingcall [None req-c3364a17-5943-42ec-98c5-c4a93c15e6c4 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=103546) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 04:12:02 user nova-compute[103546]: DEBUG nova.compute.manager [-] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Deallocating network for instance {{(pid=103546) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 04:12:02 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] deallocate_for_instance() {{(pid=103546) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 04:12:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-65761341-a9c9-4147-8df7-25b9f7008a1e tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Acquiring lock "0ba82fe3-33e6-4ae4-8716-2efbe66a6f06" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:12:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-65761341-a9c9-4147-8df7-25b9f7008a1e tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "0ba82fe3-33e6-4ae4-8716-2efbe66a6f06" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:12:03 user nova-compute[103546]: INFO nova.compute.manager [None req-65761341-a9c9-4147-8df7-25b9f7008a1e tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Detaching volume acc3764f-b353-43c6-80f7-3ac84b8fff54
Nov 16 04:12:03 user nova-compute[103546]: INFO nova.virt.block_device [None req-65761341-a9c9-4147-8df7-25b9f7008a1e tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Attempting to driver detach volume acc3764f-b353-43c6-80f7-3ac84b8fff54 from mountpoint /dev/vdb
Nov 16 04:12:03 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-65761341-a9c9-4147-8df7-25b9f7008a1e tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Attempting to detach device vdb from instance 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06 from the persistent domain config. {{(pid=103546) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 04:12:03 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-65761341-a9c9-4147-8df7-25b9f7008a1e tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 04:12:03 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:12:03 user nova-compute[103546]:   <source dev="/dev/sdb"/>
Nov 16 04:12:03 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 04:12:03 user nova-compute[103546]:   <serial>acc3764f-b353-43c6-80f7-3ac84b8fff54</serial>
Nov 16 04:12:03 user nova-compute[103546]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 04:12:03 user nova-compute[103546]: </disk>
Nov 16 04:12:03 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 04:12:03 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-65761341-a9c9-4147-8df7-25b9f7008a1e tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Successfully detached device vdb from instance 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06 from the persistent domain config.
Nov 16 04:12:03 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-65761341-a9c9-4147-8df7-25b9f7008a1e tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06 from the live domain config. {{(pid=103546) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 04:12:03 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-65761341-a9c9-4147-8df7-25b9f7008a1e tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 04:12:03 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:12:03 user nova-compute[103546]:   <source dev="/dev/sdb"/>
Nov 16 04:12:03 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 04:12:03 user nova-compute[103546]:   <serial>acc3764f-b353-43c6-80f7-3ac84b8fff54</serial>
Nov 16 04:12:03 user nova-compute[103546]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 04:12:03 user nova-compute[103546]: </disk>
Nov 16 04:12:03 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 04:12:03 user nova-compute[103546]: DEBUG nova.compute.manager [req-a37d7635-bdcb-41f6-9050-17b76140b0ae req-5455c8cd-bed4-4c1d-a8c1-7b385991fe12 service nova] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Received event network-vif-unplugged-84add44b-0c93-4ebc-b45d-2f30d63d900f {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:12:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a37d7635-bdcb-41f6-9050-17b76140b0ae req-5455c8cd-bed4-4c1d-a8c1-7b385991fe12 service nova] Acquiring lock "246ccf69-847c-4ab2-b709-ad1a85e81eab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:12:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a37d7635-bdcb-41f6-9050-17b76140b0ae req-5455c8cd-bed4-4c1d-a8c1-7b385991fe12 service nova] Lock "246ccf69-847c-4ab2-b709-ad1a85e81eab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:12:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a37d7635-bdcb-41f6-9050-17b76140b0ae req-5455c8cd-bed4-4c1d-a8c1-7b385991fe12 service nova] Lock "246ccf69-847c-4ab2-b709-ad1a85e81eab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:12:03 user nova-compute[103546]: DEBUG nova.compute.manager [req-a37d7635-bdcb-41f6-9050-17b76140b0ae req-5455c8cd-bed4-4c1d-a8c1-7b385991fe12 service nova] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] No waiting events found dispatching network-vif-unplugged-84add44b-0c93-4ebc-b45d-2f30d63d900f {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:12:03 user nova-compute[103546]: DEBUG nova.compute.manager [req-a37d7635-bdcb-41f6-9050-17b76140b0ae req-5455c8cd-bed4-4c1d-a8c1-7b385991fe12 service nova] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Received event network-vif-unplugged-84add44b-0c93-4ebc-b45d-2f30d63d900f for instance with task_state deleting. {{(pid=103546) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 04:12:03 user nova-compute[103546]: DEBUG nova.compute.manager [req-a37d7635-bdcb-41f6-9050-17b76140b0ae req-5455c8cd-bed4-4c1d-a8c1-7b385991fe12 service nova] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Received event network-vif-plugged-84add44b-0c93-4ebc-b45d-2f30d63d900f {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:12:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a37d7635-bdcb-41f6-9050-17b76140b0ae req-5455c8cd-bed4-4c1d-a8c1-7b385991fe12 service nova] Acquiring lock "246ccf69-847c-4ab2-b709-ad1a85e81eab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:12:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a37d7635-bdcb-41f6-9050-17b76140b0ae req-5455c8cd-bed4-4c1d-a8c1-7b385991fe12 service nova] Lock "246ccf69-847c-4ab2-b709-ad1a85e81eab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:12:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a37d7635-bdcb-41f6-9050-17b76140b0ae req-5455c8cd-bed4-4c1d-a8c1-7b385991fe12 service nova] Lock "246ccf69-847c-4ab2-b709-ad1a85e81eab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:12:03 user nova-compute[103546]: DEBUG nova.compute.manager [req-a37d7635-bdcb-41f6-9050-17b76140b0ae req-5455c8cd-bed4-4c1d-a8c1-7b385991fe12 service nova] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] No waiting events found dispatching network-vif-plugged-84add44b-0c93-4ebc-b45d-2f30d63d900f {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:12:03 user nova-compute[103546]: WARNING nova.compute.manager [req-a37d7635-bdcb-41f6-9050-17b76140b0ae req-5455c8cd-bed4-4c1d-a8c1-7b385991fe12 service nova] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Received unexpected event network-vif-plugged-84add44b-0c93-4ebc-b45d-2f30d63d900f for instance with vm_state active and task_state deleting.
Nov 16 04:12:03 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:12:03 user nova-compute[103546]: INFO nova.compute.manager [-] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Took 0.46 seconds to deallocate network for instance.
Nov 16 04:12:03 user nova-compute[103546]: DEBUG nova.compute.manager [req-cf21069f-9026-42eb-b550-8032438036e5 req-098074fe-159e-4f68-a43c-6a942d04813d service nova] [instance: 246ccf69-847c-4ab2-b709-ad1a85e81eab] Received event network-vif-deleted-84add44b-0c93-4ebc-b45d-2f30d63d900f {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:12:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-c3364a17-5943-42ec-98c5-c4a93c15e6c4 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:12:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-c3364a17-5943-42ec-98c5-c4a93c15e6c4 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:12:03 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-c3364a17-5943-42ec-98c5-c4a93c15e6c4 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:12:03 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-c3364a17-5943-42ec-98c5-c4a93c15e6c4 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:12:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-c3364a17-5943-42ec-98c5-c4a93c15e6c4 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.203s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:12:03 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-65761341-a9c9-4147-8df7-25b9f7008a1e tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06 {{(pid=103546) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 04:12:03 user nova-compute[103546]: INFO nova.scheduler.client.report [None req-c3364a17-5943-42ec-98c5-c4a93c15e6c4 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Deleted allocations for instance 246ccf69-847c-4ab2-b709-ad1a85e81eab
Nov 16 04:12:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-c3364a17-5943-42ec-98c5-c4a93c15e6c4 tempest-ServerRescueNegativeTestJSON-1943614153 tempest-ServerRescueNegativeTestJSON-1943614153-project-member] Lock "246ccf69-847c-4ab2-b709-ad1a85e81eab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.870s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:12:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:12:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:12:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:12:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:12:17 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:12:19 user nova-compute[103546]: DEBUG nova.compute.manager [req-ec329be9-477e-47b3-a5a9-f07f740033ce req-b3fd10f4-e928-4b43-a975-dc5b958f7644 service nova] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Received event network-changed-9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:12:19 user nova-compute[103546]: DEBUG nova.compute.manager [req-ec329be9-477e-47b3-a5a9-f07f740033ce req-b3fd10f4-e928-4b43-a975-dc5b958f7644 service nova] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Refreshing instance network info cache due to event network-changed-9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 04:12:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ec329be9-477e-47b3-a5a9-f07f740033ce req-b3fd10f4-e928-4b43-a975-dc5b958f7644 service nova] Acquiring lock "refresh_cache-2fdca5a2-7e02-4c4a-96ae-cc61547232c1" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:12:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ec329be9-477e-47b3-a5a9-f07f740033ce req-b3fd10f4-e928-4b43-a975-dc5b958f7644 service nova] Acquired lock "refresh_cache-2fdca5a2-7e02-4c4a-96ae-cc61547232c1" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:12:19 user nova-compute[103546]: DEBUG nova.network.neutron [req-ec329be9-477e-47b3-a5a9-f07f740033ce req-b3fd10f4-e928-4b43-a975-dc5b958f7644 service nova] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Refreshing network info cache for port 9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG nova.network.neutron [req-ec329be9-477e-47b3-a5a9-f07f740033ce req-b3fd10f4-e928-4b43-a975-dc5b958f7644 service nova] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Updated VIF entry in instance network info cache for port 9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG nova.network.neutron [req-ec329be9-477e-47b3-a5a9-f07f740033ce req-b3fd10f4-e928-4b43-a975-dc5b958f7644 service nova] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Updating instance_info_cache with network_info: [{"id": "9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a", "address": "fa:16:3e:f0:c5:13", "network": {"id": "5f10f091-8358-4c8c-92bb-999d989f26b0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-513865819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18a17119476d4eea9a39078a48af5a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a11f3f3-1a", "ovs_interfaceid": "9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ec329be9-477e-47b3-a5a9-f07f740033ce req-b3fd10f4-e928-4b43-a975-dc5b958f7644 service nova] Releasing lock "refresh_cache-2fdca5a2-7e02-4c4a-96ae-cc61547232c1" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a1170b43-5ebd-4b18-a2fe-5d76e35fafc6 tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Acquiring lock "061acca0-e5a9-4eb0-bf5c-d81472ec4b83" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a1170b43-5ebd-4b18-a2fe-5d76e35fafc6 tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Lock "061acca0-e5a9-4eb0-bf5c-d81472ec4b83" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a1170b43-5ebd-4b18-a2fe-5d76e35fafc6 tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Acquiring lock "061acca0-e5a9-4eb0-bf5c-d81472ec4b83-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a1170b43-5ebd-4b18-a2fe-5d76e35fafc6 tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Lock "061acca0-e5a9-4eb0-bf5c-d81472ec4b83-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a1170b43-5ebd-4b18-a2fe-5d76e35fafc6 tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Lock "061acca0-e5a9-4eb0-bf5c-d81472ec4b83-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:12:20 user nova-compute[103546]: INFO nova.compute.manager [None req-a1170b43-5ebd-4b18-a2fe-5d76e35fafc6 tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] [instance: 061acca0-e5a9-4eb0-bf5c-d81472ec4b83] Terminating instance
Nov 16 04:12:20 user nova-compute[103546]: DEBUG nova.compute.manager [None req-a1170b43-5ebd-4b18-a2fe-5d76e35fafc6 tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] [instance: 061acca0-e5a9-4eb0-bf5c-d81472ec4b83] Start destroying the instance on the hypervisor. {{(pid=103546) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 04:12:20 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-8ad44855-68be-4a67-b2e0-ab1d717b2ae8 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ce616440-9d69-4812-8910-a2d9ad58f504 is timed out.
Nov 16 04:12:20 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-8ad44855-68be-4a67-b2e0-ab1d717b2ae8 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Successfully detached device vdb from instance ce616440-9d69-4812-8910-a2d9ad58f504 from the live domain config.
Nov 16 04:12:20 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ad44855-68be-4a67-b2e0-ab1d717b2ae8 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ad44855-68be-4a67-b2e0-ab1d717b2ae8 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cQiRzHwN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:12:20 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-8ad44855-68be-4a67-b2e0-ab1d717b2ae8 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:12:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-8ad44855-68be-4a67-b2e0-ab1d717b2ae8 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-8ad44855-68be-4a67-b2e0-ab1d717b2ae8 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd66368e-ddf8-46ce-81e3-f18ca5c034d7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:acc3764f-b353-43c6-80f7-3ac84b8fff54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:735ce75d-60fc-4cdb-a3e6-2083087ccbc4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ad44855-68be-4a67-b2e0-ab1d717b2ae8 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 04:12:20 user nova-compute[103546]: No targets found.
Nov 16 04:12:20 user nova-compute[103546]: iSNS:
Nov 16 04:12:20 user nova-compute[103546]: No targets found.
Nov 16 04:12:20 user nova-compute[103546]: STATIC:
Nov 16 04:12:20 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098
Nov 16 04:12:20 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:12:20 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:12:20 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:acc3764f-b353-43c6-80f7-3ac84b8fff54
Nov 16 04:12:20 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:12:20 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:12:20 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:735ce75d-60fc-4cdb-a3e6-2083087ccbc4
Nov 16 04:12:20 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:12:20 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:12:20 user nova-compute[103546]: FIRMWARE:
Nov 16 04:12:20 user nova-compute[103546]: No targets found.
Nov 16 04:12:20 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ad44855-68be-4a67-b2e0-ab1d717b2ae8 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 04:12:20 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 04:12:20 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ad44855-68be-4a67-b2e0-ab1d717b2ae8 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e6e68f-f852-4d20-a05e-035e4f0151f8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:735ce75d-60fc-4cdb-a3e6-2083087ccbc4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acc3764f-b353-43c6-80f7-3ac84b8fff54\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8967f12-59de-4f3b-8545-904a81dcab8a]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3764f-b353-43c6-80f7-3ac84b8fff54 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735ce75d-60fc-4cdb-a3e6-2083087ccbc4 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ad44855-68be-4a67-b2e0-ab1d717b2ae8 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098 (non-flash)
Nov 16 04:12:20 user nova-compute[103546]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3764f-b353-43c6-80f7-3ac84b8fff54 (non-flash)
Nov 16 04:12:20 user nova-compute[103546]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735ce75d-60fc-4cdb-a3e6-2083087ccbc4 (non-flash)
Nov 16 04:12:20 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ad44855-68be-4a67-b2e0-ab1d717b2ae8 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098 (non-flash)
Nov 16 04:12:20 user nova-compute[103546]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3764f-b353-43c6-80f7-3ac84b8fff54 (non-flash)
Nov 16 04:12:20 user nova-compute[103546]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735ce75d-60fc-4cdb-a3e6-2083087ccbc4 (non-flash)
Nov 16 04:12:20 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ad44855-68be-4a67-b2e0-ab1d717b2ae8 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60ac43fa30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098'): ({'sdc'}, set())}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-8ad44855-68be-4a67-b2e0-ab1d717b2ae8 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Removing single pathed devices sdc {{(pid=103546) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[03bb1910-3b6c-496f-9b59-e60e0bc5d903]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca19ee7-fb5c-419d-aa68-c6313c505cfd]: (4, ('ok\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-8ad44855-68be-4a67-b2e0-ab1d717b2ae8 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Flushing IO for device /dev/sdc {{(pid=103546) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f3e384-0084-485c-b353-7f8d80eded0c]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-8ad44855-68be-4a67-b2e0-ab1d717b2ae8 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=103546) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8c3e8a-fce1-446f-8d96-fb5e8e4ca091]: (4, ('1', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-8ad44855-68be-4a67-b2e0-ab1d717b2ae8 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-8ad44855-68be-4a67-b2e0-ab1d717b2ae8 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] SCSI volumes sdc have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ad44855-68be-4a67-b2e0-ab1d717b2ae8 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098')] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecee090f-1957-4fb4-8f6c-7e12282612c9]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ad44855-68be-4a67-b2e0-ab1d717b2ae8 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098 -p 172.16.0.220:3260 --logout {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41d1b06-88d1-48f7-9d30-1a12cd4f0073]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ad44855-68be-4a67-b2e0-ab1d717b2ae8 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098, portal: 172.16.0.220,3260]
Nov 16 04:12:20 user nova-compute[103546]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098, portal: 172.16.0.220,3260] successful.
Nov 16 04:12:20 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098 -p 172.16.0.220:3260 --op delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG nova.compute.manager [None req-b694dae4-8186-4edf-95a2-3d27f999708d tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d28e72a-a41e-4b84-9c3a-5af173b4f098 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[714b5310-f601-43f7-85d3-73cc91707023]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ad44855-68be-4a67-b2e0-ab1d717b2ae8 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-8ad44855-68be-4a67-b2e0-ab1d717b2ae8 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ad44855-68be-4a67-b2e0-ab1d717b2ae8 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] <== disconnect_volume: return (334ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:12:20 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ad44855-68be-4a67-b2e0-ab1d717b2ae8 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 04:12:20 user nova-compute[103546]: INFO nova.compute.manager [None req-b694dae4-8186-4edf-95a2-3d27f999708d tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] instance snapshotting
Nov 16 04:12:20 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-b694dae4-8186-4edf-95a2-3d27f999708d tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Beginning live snapshot process
Nov 16 04:12:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-b694dae4-8186-4edf-95a2-3d27f999708d tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fdca5a2-7e02-4c4a-96ae-cc61547232c1/disk --force-share --output=json -f qcow2 {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:12:21 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 061acca0-e5a9-4eb0-bf5c-d81472ec4b83] Instance destroyed successfully.
Nov 16 04:12:21 user nova-compute[103546]: DEBUG nova.objects.instance [None req-a1170b43-5ebd-4b18-a2fe-5d76e35fafc6 tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Lazy-loading 'resources' on Instance uuid 061acca0-e5a9-4eb0-bf5c-d81472ec4b83 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:12:21 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-a1170b43-5ebd-4b18-a2fe-5d76e35fafc6 tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:10:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1321892363',display_name='tempest-VolumesNegativeTest-instance-1321892363',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1321892363',id=47,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T04:10:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6ab3113e86994ad1928990adae464bd7',ramdisk_id='',reservation_id='r-mca9rsus',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1099470511',owner_user_name='tempest-VolumesNegativeTest-1099470511-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T04:10:40Z,user_data=None,user_id='79f4ff3a7d6d47949f664d17e1d64a64',uuid=061acca0-e5a9-4eb0-bf5c-d81472ec4b83,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a80152d0-325a-4285-89b6-db143d556ed6", "address": "fa:16:3e:1c:66:07", "network": {"id": "f710b8fb-f648-48dc-aa6e-60de8f5d2d7c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6f027778eecb4af282f5bb7ebd069be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa80152d0-32", "ovs_interfaceid": "a80152d0-325a-4285-89b6-db143d556ed6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 04:12:21 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-a1170b43-5ebd-4b18-a2fe-5d76e35fafc6 tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Converting VIF {"id": "a80152d0-325a-4285-89b6-db143d556ed6", "address": "fa:16:3e:1c:66:07", "network": {"id": "f710b8fb-f648-48dc-aa6e-60de8f5d2d7c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6f027778eecb4af282f5bb7ebd069be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa80152d0-32", "ovs_interfaceid": "a80152d0-325a-4285-89b6-db143d556ed6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:12:21 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-a1170b43-5ebd-4b18-a2fe-5d76e35fafc6 tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:66:07,bridge_name='br-int',has_traffic_filtering=True,id=a80152d0-325a-4285-89b6-db143d556ed6,network=Network(f710b8fb-f648-48dc-aa6e-60de8f5d2d7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa80152d0-32') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:12:21 user nova-compute[103546]: DEBUG os_vif [None req-a1170b43-5ebd-4b18-a2fe-5d76e35fafc6 tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:66:07,bridge_name='br-int',has_traffic_filtering=True,id=a80152d0-325a-4285-89b6-db143d556ed6,network=Network(f710b8fb-f648-48dc-aa6e-60de8f5d2d7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa80152d0-32') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 04:12:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:12:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa80152d0-32, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:12:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:12:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:12:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:12:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=48dfe316-68e7-4d3f-ace4-f2bd96d25e73) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:12:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:12:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:12:21 user nova-compute[103546]: INFO os_vif [None req-a1170b43-5ebd-4b18-a2fe-5d76e35fafc6 tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:66:07,bridge_name='br-int',has_traffic_filtering=True,id=a80152d0-325a-4285-89b6-db143d556ed6,network=Network(f710b8fb-f648-48dc-aa6e-60de8f5d2d7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa80152d0-32')
Nov 16 04:12:21 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-a1170b43-5ebd-4b18-a2fe-5d76e35fafc6 tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] [instance: 061acca0-e5a9-4eb0-bf5c-d81472ec4b83] Deleting instance files /opt/stack/data/nova/instances/061acca0-e5a9-4eb0-bf5c-d81472ec4b83_del
Nov 16 04:12:21 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-a1170b43-5ebd-4b18-a2fe-5d76e35fafc6 tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] [instance: 061acca0-e5a9-4eb0-bf5c-d81472ec4b83] Deletion of /opt/stack/data/nova/instances/061acca0-e5a9-4eb0-bf5c-d81472ec4b83_del complete
Nov 16 04:12:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-b694dae4-8186-4edf-95a2-3d27f999708d tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fdca5a2-7e02-4c4a-96ae-cc61547232c1/disk --force-share --output=json -f qcow2" returned: 0 in 0.178s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:12:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-b694dae4-8186-4edf-95a2-3d27f999708d tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fdca5a2-7e02-4c4a-96ae-cc61547232c1/disk --force-share --output=json -f qcow2 {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:12:21 user nova-compute[103546]: INFO nova.compute.manager [None req-a1170b43-5ebd-4b18-a2fe-5d76e35fafc6 tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] [instance: 061acca0-e5a9-4eb0-bf5c-d81472ec4b83] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 16 04:12:21 user nova-compute[103546]: DEBUG oslo.service.loopingcall [None req-a1170b43-5ebd-4b18-a2fe-5d76e35fafc6 tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=103546) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 04:12:21 user nova-compute[103546]: DEBUG nova.compute.manager [-] [instance: 061acca0-e5a9-4eb0-bf5c-d81472ec4b83] Deallocating network for instance {{(pid=103546) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 04:12:21 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 061acca0-e5a9-4eb0-bf5c-d81472ec4b83] deallocate_for_instance() {{(pid=103546) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 04:12:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-b694dae4-8186-4edf-95a2-3d27f999708d tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fdca5a2-7e02-4c4a-96ae-cc61547232c1/disk --force-share --output=json -f qcow2" returned: 0 in 0.193s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:12:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-b694dae4-8186-4edf-95a2-3d27f999708d tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:12:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-b694dae4-8186-4edf-95a2-3d27f999708d tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.177s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:12:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-b694dae4-8186-4edf-95a2-3d27f999708d tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpsu6ieynx/a3e8def15e5d40a9a9a153658e76c71b.delta 1073741824 {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:12:21 user nova-compute[103546]: DEBUG nova.objects.instance [None req-8ad44855-68be-4a67-b2e0-ab1d717b2ae8 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lazy-loading 'flavor' on Instance uuid ce616440-9d69-4812-8910-a2d9ad58f504 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:12:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-b694dae4-8186-4edf-95a2-3d27f999708d tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpsu6ieynx/a3e8def15e5d40a9a9a153658e76c71b.delta 1073741824" returned: 0 in 0.057s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:12:21 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-b694dae4-8186-4edf-95a2-3d27f999708d tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 16 04:12:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-8ad44855-68be-4a67-b2e0-ab1d717b2ae8 tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "ce616440-9d69-4812-8910-a2d9ad58f504" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.897s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:12:21 user nova-compute[103546]: DEBUG nova.compute.manager [req-ef3b666c-356f-4101-81ba-4c02f7d56902 req-834715e9-e409-4b45-ad0f-f55135f4546a service nova] [instance: 061acca0-e5a9-4eb0-bf5c-d81472ec4b83] Received event network-vif-unplugged-a80152d0-325a-4285-89b6-db143d556ed6 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:12:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ef3b666c-356f-4101-81ba-4c02f7d56902 req-834715e9-e409-4b45-ad0f-f55135f4546a service nova] Acquiring lock "061acca0-e5a9-4eb0-bf5c-d81472ec4b83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:12:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ef3b666c-356f-4101-81ba-4c02f7d56902 req-834715e9-e409-4b45-ad0f-f55135f4546a service nova] Lock "061acca0-e5a9-4eb0-bf5c-d81472ec4b83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:12:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ef3b666c-356f-4101-81ba-4c02f7d56902 req-834715e9-e409-4b45-ad0f-f55135f4546a service nova] Lock "061acca0-e5a9-4eb0-bf5c-d81472ec4b83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:12:21 user nova-compute[103546]: DEBUG nova.compute.manager [req-ef3b666c-356f-4101-81ba-4c02f7d56902 req-834715e9-e409-4b45-ad0f-f55135f4546a service nova] [instance: 061acca0-e5a9-4eb0-bf5c-d81472ec4b83] No waiting events found dispatching network-vif-unplugged-a80152d0-325a-4285-89b6-db143d556ed6 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:12:21 user nova-compute[103546]: DEBUG nova.compute.manager [req-ef3b666c-356f-4101-81ba-4c02f7d56902 req-834715e9-e409-4b45-ad0f-f55135f4546a service nova] [instance: 061acca0-e5a9-4eb0-bf5c-d81472ec4b83] Received event network-vif-unplugged-a80152d0-325a-4285-89b6-db143d556ed6 for instance with task_state deleting. {{(pid=103546) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 04:12:21 user nova-compute[103546]: DEBUG nova.compute.manager [req-ef3b666c-356f-4101-81ba-4c02f7d56902 req-834715e9-e409-4b45-ad0f-f55135f4546a service nova] [instance: 061acca0-e5a9-4eb0-bf5c-d81472ec4b83] Received event network-vif-plugged-a80152d0-325a-4285-89b6-db143d556ed6 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:12:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ef3b666c-356f-4101-81ba-4c02f7d56902 req-834715e9-e409-4b45-ad0f-f55135f4546a service nova] Acquiring lock "061acca0-e5a9-4eb0-bf5c-d81472ec4b83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:12:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ef3b666c-356f-4101-81ba-4c02f7d56902 req-834715e9-e409-4b45-ad0f-f55135f4546a service nova] Lock "061acca0-e5a9-4eb0-bf5c-d81472ec4b83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:12:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ef3b666c-356f-4101-81ba-4c02f7d56902 req-834715e9-e409-4b45-ad0f-f55135f4546a service nova] Lock "061acca0-e5a9-4eb0-bf5c-d81472ec4b83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:12:21 user nova-compute[103546]: DEBUG nova.compute.manager [req-ef3b666c-356f-4101-81ba-4c02f7d56902 req-834715e9-e409-4b45-ad0f-f55135f4546a service nova] [instance: 061acca0-e5a9-4eb0-bf5c-d81472ec4b83] No waiting events found dispatching network-vif-plugged-a80152d0-325a-4285-89b6-db143d556ed6 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:12:21 user nova-compute[103546]: WARNING nova.compute.manager [req-ef3b666c-356f-4101-81ba-4c02f7d56902 req-834715e9-e409-4b45-ad0f-f55135f4546a service nova] [instance: 061acca0-e5a9-4eb0-bf5c-d81472ec4b83] Received unexpected event network-vif-plugged-a80152d0-325a-4285-89b6-db143d556ed6 for instance with vm_state active and task_state deleting.
Nov 16 04:12:21 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 061acca0-e5a9-4eb0-bf5c-d81472ec4b83] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:12:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:12:21 user nova-compute[103546]: INFO nova.compute.manager [-] [instance: 061acca0-e5a9-4eb0-bf5c-d81472ec4b83] Took 0.54 seconds to deallocate network for instance.
Nov 16 04:12:21 user nova-compute[103546]: DEBUG nova.compute.manager [req-0d2780b0-cb8c-4b2a-9575-f2fc7453d84f req-ff4e44fe-95ec-40fd-a4c1-bd93fd95410c service nova] [instance: 061acca0-e5a9-4eb0-bf5c-d81472ec4b83] Received event network-vif-deleted-a80152d0-325a-4285-89b6-db143d556ed6 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:12:22 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a1170b43-5ebd-4b18-a2fe-5d76e35fafc6 tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:12:22 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a1170b43-5ebd-4b18-a2fe-5d76e35fafc6 tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:12:22 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-a1170b43-5ebd-4b18-a2fe-5d76e35fafc6 tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:12:22 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-a1170b43-5ebd-4b18-a2fe-5d76e35fafc6 tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:12:22 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a1170b43-5ebd-4b18-a2fe-5d76e35fafc6 tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.199s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:12:22 user nova-compute[103546]: INFO nova.scheduler.client.report [None req-a1170b43-5ebd-4b18-a2fe-5d76e35fafc6 tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Deleted allocations for instance 061acca0-e5a9-4eb0-bf5c-d81472ec4b83
Nov 16 04:12:22 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a1170b43-5ebd-4b18-a2fe-5d76e35fafc6 tempest-VolumesNegativeTest-1099470511 tempest-VolumesNegativeTest-1099470511-project-member] Lock "061acca0-e5a9-4eb0-bf5c-d81472ec4b83" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.862s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:12:22 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-b694dae4-8186-4edf-95a2-3d27f999708d tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=103546) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 04:12:23 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-b694dae4-8186-4edf-95a2-3d27f999708d tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=103546) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 04:12:23 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-b694dae4-8186-4edf-95a2-3d27f999708d tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 16 04:12:23 user nova-compute[103546]: DEBUG nova.privsep.utils [None req-b694dae4-8186-4edf-95a2-3d27f999708d tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=103546) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 04:12:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-b694dae4-8186-4edf-95a2-3d27f999708d tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpsu6ieynx/a3e8def15e5d40a9a9a153658e76c71b.delta /opt/stack/data/nova/instances/snapshots/tmpsu6ieynx/a3e8def15e5d40a9a9a153658e76c71b {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:12:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-b694dae4-8186-4edf-95a2-3d27f999708d tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpsu6ieynx/a3e8def15e5d40a9a9a153658e76c71b.delta /opt/stack/data/nova/instances/snapshots/tmpsu6ieynx/a3e8def15e5d40a9a9a153658e76c71b" returned: 0 in 0.489s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:12:23 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-b694dae4-8186-4edf-95a2-3d27f999708d tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Snapshot extracted, beginning image upload
Nov 16 04:12:23 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-65761341-a9c9-4147-8df7-25b9f7008a1e tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06 is timed out.
Nov 16 04:12:23 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-65761341-a9c9-4147-8df7-25b9f7008a1e tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Successfully detached device vdb from instance 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06 from the live domain config.
Nov 16 04:12:23 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65761341-a9c9-4147-8df7-25b9f7008a1e tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 04:12:23 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-65761341-a9c9-4147-8df7-25b9f7008a1e tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:acc3764f-b353-43c6-80f7-3ac84b8fff54', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'psLznkeQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:12:23 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-65761341-a9c9-4147-8df7-25b9f7008a1e tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:12:23 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-65761341-a9c9-4147-8df7-25b9f7008a1e tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:12:23 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-65761341-a9c9-4147-8df7-25b9f7008a1e tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:12:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:12:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:12:23 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[866cf392-baa8-4a56-ae21-6486902d2d1d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:acc3764f-b353-43c6-80f7-3ac84b8fff54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:735ce75d-60fc-4cdb-a3e6-2083087ccbc4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:12:23 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-65761341-a9c9-4147-8df7-25b9f7008a1e tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 04:12:23 user nova-compute[103546]: No targets found.
Nov 16 04:12:23 user nova-compute[103546]: iSNS:
Nov 16 04:12:23 user nova-compute[103546]: No targets found.
Nov 16 04:12:23 user nova-compute[103546]: STATIC:
Nov 16 04:12:23 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:acc3764f-b353-43c6-80f7-3ac84b8fff54
Nov 16 04:12:23 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:12:23 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:12:23 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:735ce75d-60fc-4cdb-a3e6-2083087ccbc4
Nov 16 04:12:23 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:12:23 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:12:23 user nova-compute[103546]: FIRMWARE:
Nov 16 04:12:23 user nova-compute[103546]: No targets found.
Nov 16 04:12:23 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:12:23 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-65761341-a9c9-4147-8df7-25b9f7008a1e tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 04:12:23 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 04:12:23 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 04:12:23 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-65761341-a9c9-4147-8df7-25b9f7008a1e tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acc3764f-b353-43c6-80f7-3ac84b8fff54', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 04:12:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:12:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:12:23 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9c945f-c530-476d-a38a-e9eefcf92cf8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:735ce75d-60fc-4cdb-a3e6-2083087ccbc4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acc3764f-b353-43c6-80f7-3ac84b8fff54\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:12:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:12:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:12:23 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9059ca-8a12-4f03-a80c-ce07208dcf3f]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3764f-b353-43c6-80f7-3ac84b8fff54 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735ce75d-60fc-4cdb-a3e6-2083087ccbc4 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:12:23 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-65761341-a9c9-4147-8df7-25b9f7008a1e tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3764f-b353-43c6-80f7-3ac84b8fff54 (non-flash)
Nov 16 04:12:23 user nova-compute[103546]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735ce75d-60fc-4cdb-a3e6-2083087ccbc4 (non-flash)
Nov 16 04:12:23 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:12:23 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-65761341-a9c9-4147-8df7-25b9f7008a1e tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acc3764f-b353-43c6-80f7-3ac84b8fff54 (non-flash)
Nov 16 04:12:23 user nova-compute[103546]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735ce75d-60fc-4cdb-a3e6-2083087ccbc4 (non-flash)
Nov 16 04:12:23 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:12:23 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-65761341-a9c9-4147-8df7-25b9f7008a1e tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60ac61aef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acc3764f-b353-43c6-80f7-3ac84b8fff54'): ({'sdb'}, set())}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 04:12:23 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-65761341-a9c9-4147-8df7-25b9f7008a1e tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Removing single pathed devices sdb {{(pid=103546) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 04:12:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:12:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:12:23 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d01de85-2cd9-46a4-bc5f-e0870192ff94]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:12:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:12:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:12:23 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5a5a11-305c-45f5-bd18-366bade4ad21]: (4, ('ok\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:12:23 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-65761341-a9c9-4147-8df7-25b9f7008a1e tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Flushing IO for device /dev/sdb {{(pid=103546) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 04:12:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:12:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:12:23 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c040039-812d-4cbf-b881-1dedb4946b4c]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:12:23 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-65761341-a9c9-4147-8df7-25b9f7008a1e tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=103546) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 04:12:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:12:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:12:23 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[91961219-2c0d-4207-8387-65eb0d7fbc38]: (4, ('1', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:12:23 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-65761341-a9c9-4147-8df7-25b9f7008a1e tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 04:12:23 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-65761341-a9c9-4147-8df7-25b9f7008a1e tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] SCSI volumes sdb have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 04:12:23 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-65761341-a9c9-4147-8df7-25b9f7008a1e tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acc3764f-b353-43c6-80f7-3ac84b8fff54')] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 04:12:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc3764f-b353-43c6-80f7-3ac84b8fff54 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:12:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc3764f-b353-43c6-80f7-3ac84b8fff54 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:12:23 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[620d36f5-b89c-45bd-b77d-3426e276f275]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:12:23 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-65761341-a9c9-4147-8df7-25b9f7008a1e tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:12:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc3764f-b353-43c6-80f7-3ac84b8fff54 -p 172.16.0.220:3260 --logout {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:12:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc3764f-b353-43c6-80f7-3ac84b8fff54 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:12:23 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6dffa13-d729-4c3f-86ab-9a8f75130442]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:acc3764f-b353-43c6-80f7-3ac84b8fff54, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:acc3764f-b353-43c6-80f7-3ac84b8fff54, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:12:23 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-65761341-a9c9-4147-8df7-25b9f7008a1e tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:acc3764f-b353-43c6-80f7-3ac84b8fff54, portal: 172.16.0.220,3260]
Nov 16 04:12:23 user nova-compute[103546]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:acc3764f-b353-43c6-80f7-3ac84b8fff54, portal: 172.16.0.220,3260] successful.
Nov 16 04:12:23 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:12:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acc3764f-b353-43c6-80f7-3ac84b8fff54 -p 172.16.0.220:3260 --op delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:12:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acc3764f-b353-43c6-80f7-3ac84b8fff54 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:12:23 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b984dd-cef0-4de6-8829-55c0d245382b]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:12:23 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-65761341-a9c9-4147-8df7-25b9f7008a1e tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:12:23 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-65761341-a9c9-4147-8df7-25b9f7008a1e tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:12:23 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-65761341-a9c9-4147-8df7-25b9f7008a1e tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] <== disconnect_volume: return (323ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:12:23 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65761341-a9c9-4147-8df7-25b9f7008a1e tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 04:12:24 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:12:24 user nova-compute[103546]: DEBUG nova.objects.instance [None req-65761341-a9c9-4147-8df7-25b9f7008a1e tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lazy-loading 'flavor' on Instance uuid 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:12:24 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-65761341-a9c9-4147-8df7-25b9f7008a1e tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "0ba82fe3-33e6-4ae4-8716-2efbe66a6f06" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.613s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:12:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-18dc8ee6-5c2b-44b8-a199-479258792a32 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Acquiring lock "0ba82fe3-33e6-4ae4-8716-2efbe66a6f06" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:12:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-18dc8ee6-5c2b-44b8-a199-479258792a32 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "0ba82fe3-33e6-4ae4-8716-2efbe66a6f06" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:12:25 user nova-compute[103546]: INFO nova.compute.manager [None req-18dc8ee6-5c2b-44b8-a199-479258792a32 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Detaching volume 735ce75d-60fc-4cdb-a3e6-2083087ccbc4
Nov 16 04:12:25 user nova-compute[103546]: INFO nova.virt.block_device [None req-18dc8ee6-5c2b-44b8-a199-479258792a32 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Attempting to driver detach volume 735ce75d-60fc-4cdb-a3e6-2083087ccbc4 from mountpoint /dev/vdc
Nov 16 04:12:25 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-18dc8ee6-5c2b-44b8-a199-479258792a32 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Attempting to detach device vdc from instance 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06 from the persistent domain config. {{(pid=103546) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 04:12:25 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-18dc8ee6-5c2b-44b8-a199-479258792a32 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 04:12:25 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:12:25 user nova-compute[103546]:   <source dev="/dev/sdd"/>
Nov 16 04:12:25 user nova-compute[103546]:   <target dev="vdc" bus="virtio"/>
Nov 16 04:12:25 user nova-compute[103546]:   <serial>735ce75d-60fc-4cdb-a3e6-2083087ccbc4</serial>
Nov 16 04:12:25 user nova-compute[103546]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 16 04:12:25 user nova-compute[103546]: </disk>
Nov 16 04:12:25 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 04:12:25 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-18dc8ee6-5c2b-44b8-a199-479258792a32 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Successfully detached device vdc from instance 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06 from the persistent domain config.
Nov 16 04:12:25 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-18dc8ee6-5c2b-44b8-a199-479258792a32 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06 from the live domain config. {{(pid=103546) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 04:12:25 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-18dc8ee6-5c2b-44b8-a199-479258792a32 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 04:12:25 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:12:25 user nova-compute[103546]:   <source dev="/dev/sdd"/>
Nov 16 04:12:25 user nova-compute[103546]:   <target dev="vdc" bus="virtio"/>
Nov 16 04:12:25 user nova-compute[103546]:   <serial>735ce75d-60fc-4cdb-a3e6-2083087ccbc4</serial>
Nov 16 04:12:25 user nova-compute[103546]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 16 04:12:25 user nova-compute[103546]: </disk>
Nov 16 04:12:25 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 04:12:26 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-b694dae4-8186-4edf-95a2-3d27f999708d tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Snapshot image upload complete
Nov 16 04:12:26 user nova-compute[103546]: INFO nova.compute.manager [None req-b694dae4-8186-4edf-95a2-3d27f999708d tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Took 5.27 seconds to snapshot the instance on the hypervisor.
Nov 16 04:12:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:12:26 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-18dc8ee6-5c2b-44b8-a199-479258792a32 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06 {{(pid=103546) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 04:12:28 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:12:28 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Cleaning up deleted instances {{(pid=103546) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 04:12:28 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] There are 0 instances to clean {{(pid=103546) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 04:12:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:12:31 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:12:31 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:12:31 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:12:31 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:12:31 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=103546) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 04:12:33 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:12:33 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager.update_available_resource {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:12:33 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:12:33 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:12:33 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:12:33 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Auditing locally available compute resources for user (node: user) {{(pid=103546) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 04:12:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce616440-9d69-4812-8910-a2d9ad58f504/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:12:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce616440-9d69-4812-8910-a2d9ad58f504/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:12:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce616440-9d69-4812-8910-a2d9ad58f504/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:12:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce616440-9d69-4812-8910-a2d9ad58f504/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:12:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba82fe3-33e6-4ae4-8716-2efbe66a6f06/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:12:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba82fe3-33e6-4ae4-8716-2efbe66a6f06/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:12:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba82fe3-33e6-4ae4-8716-2efbe66a6f06/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:12:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba82fe3-33e6-4ae4-8716-2efbe66a6f06/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:12:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fdca5a2-7e02-4c4a-96ae-cc61547232c1/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:12:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fdca5a2-7e02-4c4a-96ae-cc61547232c1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:12:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fdca5a2-7e02-4c4a-96ae-cc61547232c1/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:12:34 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fdca5a2-7e02-4c4a-96ae-cc61547232c1/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:12:35 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:12:35 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:12:35 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Hypervisor/Node resource view: name=user free_ram=8615MB free_disk=25.068531036376953GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=103546) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 04:12:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:12:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:12:35 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance ce616440-9d69-4812-8910-a2d9ad58f504 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:12:35 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:12:35 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 2fdca5a2-7e02-4c4a-96ae-cc61547232c1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:12:35 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 04:12:35 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 04:12:35 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Refreshing inventories for resource provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 04:12:35 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Updating ProviderTree inventory for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 04:12:35 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Updating inventory in ProviderTree for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 04:12:35 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Refreshing aggregate associations for resource provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a, aggregates: None {{(pid=103546) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 04:12:35 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Refreshing trait associations for resource provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=103546) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 04:12:35 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:12:35 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:12:35 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Compute_service record updated for user:user {{(pid=103546) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 04:12:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.601s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:12:36 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:12:36 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:12:36 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:12:36 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:12:38 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:12:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:12:39 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:12:40 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:12:40 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Starting heal instance info cache {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 04:12:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "refresh_cache-ce616440-9d69-4812-8910-a2d9ad58f504" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:12:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquired lock "refresh_cache-ce616440-9d69-4812-8910-a2d9ad58f504" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:12:40 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Forcefully refreshing network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 04:12:41 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Updating instance_info_cache with network_info: [{"id": "3d061027-8dbb-48b4-bbcd-b057c196a301", "address": "fa:16:3e:45:2b:d3", "network": {"id": "d942264a-f03e-49a2-89eb-103a12c99518", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484356505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edb839c76c0d4513b9be0ec92301707f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d061027-8d", "ovs_interfaceid": "3d061027-8dbb-48b4-bbcd-b057c196a301", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:12:41 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Releasing lock "refresh_cache-ce616440-9d69-4812-8910-a2d9ad58f504" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:12:41 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Updated the network info_cache for instance {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 04:12:41 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:12:46 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-18dc8ee6-5c2b-44b8-a199-479258792a32 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06 is timed out.
Nov 16 04:12:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:12:46 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-18dc8ee6-5c2b-44b8-a199-479258792a32 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Successfully detached device vdc from instance 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06 from the live domain config.
Nov 16 04:12:46 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18dc8ee6-5c2b-44b8-a199-479258792a32 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 04:12:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-18dc8ee6-5c2b-44b8-a199-479258792a32 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:735ce75d-60fc-4cdb-a3e6-2083087ccbc4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TvfurAIy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:12:46 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-18dc8ee6-5c2b-44b8-a199-479258792a32 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:12:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-18dc8ee6-5c2b-44b8-a199-479258792a32 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:12:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-18dc8ee6-5c2b-44b8-a199-479258792a32 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:12:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:12:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:12:46 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b391f4-0396-4b00-b867-928416f26773]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:735ce75d-60fc-4cdb-a3e6-2083087ccbc4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:12:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-18dc8ee6-5c2b-44b8-a199-479258792a32 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 04:12:46 user nova-compute[103546]: No targets found.
Nov 16 04:12:46 user nova-compute[103546]: iSNS:
Nov 16 04:12:46 user nova-compute[103546]: No targets found.
Nov 16 04:12:46 user nova-compute[103546]: STATIC:
Nov 16 04:12:46 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:735ce75d-60fc-4cdb-a3e6-2083087ccbc4
Nov 16 04:12:46 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:12:46 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:12:46 user nova-compute[103546]: FIRMWARE:
Nov 16 04:12:46 user nova-compute[103546]: No targets found.
Nov 16 04:12:46 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:12:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-18dc8ee6-5c2b-44b8-a199-479258792a32 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 04:12:46 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 04:12:46 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 04:12:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-18dc8ee6-5c2b-44b8-a199-479258792a32 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:735ce75d-60fc-4cdb-a3e6-2083087ccbc4', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 04:12:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:12:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:12:46 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[089b68a0-2d6c-4a02-a6d5-e388490fc9c6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:735ce75d-60fc-4cdb-a3e6-2083087ccbc4\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:12:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:12:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:12:46 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a959309-fdf5-4d43-a12d-ccd53c3dbecc]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735ce75d-60fc-4cdb-a3e6-2083087ccbc4 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:12:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-18dc8ee6-5c2b-44b8-a199-479258792a32 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735ce75d-60fc-4cdb-a3e6-2083087ccbc4 (non-flash)
Nov 16 04:12:46 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:12:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-18dc8ee6-5c2b-44b8-a199-479258792a32 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:735ce75d-60fc-4cdb-a3e6-2083087ccbc4 (non-flash)
Nov 16 04:12:46 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:12:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-18dc8ee6-5c2b-44b8-a199-479258792a32 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60cc56b640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:735ce75d-60fc-4cdb-a3e6-2083087ccbc4'): ({'sdd'}, set())}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 04:12:46 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-18dc8ee6-5c2b-44b8-a199-479258792a32 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Removing single pathed devices sdd {{(pid=103546) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 04:12:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:12:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:12:46 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e0bba9-d6c0-4759-b13d-b7743a67e310]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:12:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:12:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:12:46 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8156ce-17fb-4561-8e94-4f27bd3b4402]: (4, ('ok\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:12:46 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-18dc8ee6-5c2b-44b8-a199-479258792a32 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Flushing IO for device /dev/sdd {{(pid=103546) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 04:12:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:12:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:12:46 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[17659539-5679-4c48-8285-73739b5dfba9]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:12:46 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-18dc8ee6-5c2b-44b8-a199-479258792a32 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=103546) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 04:12:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:12:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:12:46 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c64d0f3-7497-4d9e-9136-cb2a678362e2]: (4, ('1', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:12:46 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-18dc8ee6-5c2b-44b8-a199-479258792a32 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 04:12:46 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-18dc8ee6-5c2b-44b8-a199-479258792a32 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] SCSI volumes sdd have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 04:12:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-18dc8ee6-5c2b-44b8-a199-479258792a32 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:735ce75d-60fc-4cdb-a3e6-2083087ccbc4')] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 04:12:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:735ce75d-60fc-4cdb-a3e6-2083087ccbc4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:12:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:735ce75d-60fc-4cdb-a3e6-2083087ccbc4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:12:46 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f936fc-a8f1-4598-af35-465a17aedfa7]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:12:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-18dc8ee6-5c2b-44b8-a199-479258792a32 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:12:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:735ce75d-60fc-4cdb-a3e6-2083087ccbc4 -p 172.16.0.220:3260 --logout {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:12:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:735ce75d-60fc-4cdb-a3e6-2083087ccbc4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:12:46 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e50943-4766-4ef3-8493-277eaa5a47d7]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:735ce75d-60fc-4cdb-a3e6-2083087ccbc4, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:735ce75d-60fc-4cdb-a3e6-2083087ccbc4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:12:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-18dc8ee6-5c2b-44b8-a199-479258792a32 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:735ce75d-60fc-4cdb-a3e6-2083087ccbc4, portal: 172.16.0.220,3260]
Nov 16 04:12:46 user nova-compute[103546]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:735ce75d-60fc-4cdb-a3e6-2083087ccbc4, portal: 172.16.0.220,3260] successful.
Nov 16 04:12:46 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:12:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:735ce75d-60fc-4cdb-a3e6-2083087ccbc4 -p 172.16.0.220:3260 --op delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:12:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:735ce75d-60fc-4cdb-a3e6-2083087ccbc4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:12:46 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5cb0fea-1ffd-4b28-83ba-e03fdb58b98b]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:12:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-18dc8ee6-5c2b-44b8-a199-479258792a32 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:12:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-18dc8ee6-5c2b-44b8-a199-479258792a32 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:12:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-18dc8ee6-5c2b-44b8-a199-479258792a32 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] <== disconnect_volume: return (278ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:12:46 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18dc8ee6-5c2b-44b8-a199-479258792a32 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 04:12:47 user nova-compute[103546]: DEBUG nova.objects.instance [None req-18dc8ee6-5c2b-44b8-a199-479258792a32 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lazy-loading 'flavor' on Instance uuid 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:12:47 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-18dc8ee6-5c2b-44b8-a199-479258792a32 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "0ba82fe3-33e6-4ae4-8716-2efbe66a6f06" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.692s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:12:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-9320fd35-9cad-4c8b-895f-2e7e48a669d7 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Acquiring lock "0ba82fe3-33e6-4ae4-8716-2efbe66a6f06" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:12:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-9320fd35-9cad-4c8b-895f-2e7e48a669d7 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "0ba82fe3-33e6-4ae4-8716-2efbe66a6f06" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:12:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-9320fd35-9cad-4c8b-895f-2e7e48a669d7 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Acquiring lock "0ba82fe3-33e6-4ae4-8716-2efbe66a6f06-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:12:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-9320fd35-9cad-4c8b-895f-2e7e48a669d7 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "0ba82fe3-33e6-4ae4-8716-2efbe66a6f06-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:12:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-9320fd35-9cad-4c8b-895f-2e7e48a669d7 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "0ba82fe3-33e6-4ae4-8716-2efbe66a6f06-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:12:48 user nova-compute[103546]: INFO nova.compute.manager [None req-9320fd35-9cad-4c8b-895f-2e7e48a669d7 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Terminating instance
Nov 16 04:12:48 user nova-compute[103546]: DEBUG nova.compute.manager [None req-9320fd35-9cad-4c8b-895f-2e7e48a669d7 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Start destroying the instance on the hypervisor. {{(pid=103546) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 04:12:48 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:12:48 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:12:48 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:12:48 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:12:49 user nova-compute[103546]: DEBUG nova.compute.manager [req-99eb3f27-a89e-4122-8edf-4f96dd0aa0f6 req-f877f918-4475-4dab-a1bc-dd843a83bd0a service nova] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Received event network-vif-unplugged-a64e3b5a-f0ee-4b9c-8736-84e4e4c9a1b3 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:12:49 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-99eb3f27-a89e-4122-8edf-4f96dd0aa0f6 req-f877f918-4475-4dab-a1bc-dd843a83bd0a service nova] Acquiring lock "0ba82fe3-33e6-4ae4-8716-2efbe66a6f06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:12:49 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-99eb3f27-a89e-4122-8edf-4f96dd0aa0f6 req-f877f918-4475-4dab-a1bc-dd843a83bd0a service nova] Lock "0ba82fe3-33e6-4ae4-8716-2efbe66a6f06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:12:49 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-99eb3f27-a89e-4122-8edf-4f96dd0aa0f6 req-f877f918-4475-4dab-a1bc-dd843a83bd0a service nova] Lock "0ba82fe3-33e6-4ae4-8716-2efbe66a6f06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:12:49 user nova-compute[103546]: DEBUG nova.compute.manager [req-99eb3f27-a89e-4122-8edf-4f96dd0aa0f6 req-f877f918-4475-4dab-a1bc-dd843a83bd0a service nova] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] No waiting events found dispatching network-vif-unplugged-a64e3b5a-f0ee-4b9c-8736-84e4e4c9a1b3 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:12:49 user nova-compute[103546]: DEBUG nova.compute.manager [req-99eb3f27-a89e-4122-8edf-4f96dd0aa0f6 req-f877f918-4475-4dab-a1bc-dd843a83bd0a service nova] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Received event network-vif-unplugged-a64e3b5a-f0ee-4b9c-8736-84e4e4c9a1b3 for instance with task_state deleting. {{(pid=103546) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 04:12:49 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Instance destroyed successfully.
Nov 16 04:12:49 user nova-compute[103546]: DEBUG nova.objects.instance [None req-9320fd35-9cad-4c8b-895f-2e7e48a669d7 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lazy-loading 'resources' on Instance uuid 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:12:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-9320fd35-9cad-4c8b-895f-2e7e48a669d7 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:09:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1992494703',display_name='tempest-AttachVolumeTestJSON-server-1992494703',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1992494703',id=45,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDGcVKSTsR+Zc6tO7e5zGbXF+jcqBx1XZIYJe/oabs/6MpPezPv1ZSLbIBIpzCiejSjIE7n7xce696/H4ktZNIFAxmhwjZKMVcmdnV3DEcIuHDaiUTNVKKuK3vM26XPjhg==',key_name='tempest-keypair-268007081',keypairs=<?>,launch_index=0,launched_at=2023-11-16T04:09:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f33e7eff7954fcc895f66982d7d45c8',ramdisk_id='',reservation_id='r-ha6a0jmj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1584447380',owner_user_name='tempest-AttachVolumeTestJSON-1584447380-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T04:09:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='005ffc068a19494bb5a436fc4a07aaa1',uuid=0ba82fe3-33e6-4ae4-8716-2efbe66a6f06,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a64e3b5a-f0ee-4b9c-8736-84e4e4c9a1b3", "address": "fa:16:3e:86:b7:f6", "network": {"id": "23baa589-ae15-4a44-8991-d6fe8569dc8a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-464431710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f33e7eff7954fcc895f66982d7d45c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64e3b5a-f0", "ovs_interfaceid": "a64e3b5a-f0ee-4b9c-8736-84e4e4c9a1b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 04:12:49 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-9320fd35-9cad-4c8b-895f-2e7e48a669d7 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Converting VIF {"id": "a64e3b5a-f0ee-4b9c-8736-84e4e4c9a1b3", "address": "fa:16:3e:86:b7:f6", "network": {"id": "23baa589-ae15-4a44-8991-d6fe8569dc8a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-464431710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f33e7eff7954fcc895f66982d7d45c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64e3b5a-f0", "ovs_interfaceid": "a64e3b5a-f0ee-4b9c-8736-84e4e4c9a1b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:12:49 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-9320fd35-9cad-4c8b-895f-2e7e48a669d7 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:b7:f6,bridge_name='br-int',has_traffic_filtering=True,id=a64e3b5a-f0ee-4b9c-8736-84e4e4c9a1b3,network=Network(23baa589-ae15-4a44-8991-d6fe8569dc8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa64e3b5a-f0') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:12:49 user nova-compute[103546]: DEBUG os_vif [None req-9320fd35-9cad-4c8b-895f-2e7e48a669d7 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:b7:f6,bridge_name='br-int',has_traffic_filtering=True,id=a64e3b5a-f0ee-4b9c-8736-84e4e4c9a1b3,network=Network(23baa589-ae15-4a44-8991-d6fe8569dc8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa64e3b5a-f0') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 04:12:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:12:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa64e3b5a-f0, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:12:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:12:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:12:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:12:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dbe23727-acd8-4871-a81b-487679dbc334) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:12:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:12:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:12:49 user nova-compute[103546]: INFO os_vif [None req-9320fd35-9cad-4c8b-895f-2e7e48a669d7 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:b7:f6,bridge_name='br-int',has_traffic_filtering=True,id=a64e3b5a-f0ee-4b9c-8736-84e4e4c9a1b3,network=Network(23baa589-ae15-4a44-8991-d6fe8569dc8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa64e3b5a-f0')
Nov 16 04:12:49 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-9320fd35-9cad-4c8b-895f-2e7e48a669d7 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Deleting instance files /opt/stack/data/nova/instances/0ba82fe3-33e6-4ae4-8716-2efbe66a6f06_del
Nov 16 04:12:49 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-9320fd35-9cad-4c8b-895f-2e7e48a669d7 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Deletion of /opt/stack/data/nova/instances/0ba82fe3-33e6-4ae4-8716-2efbe66a6f06_del complete
Nov 16 04:12:49 user nova-compute[103546]: INFO nova.compute.manager [None req-9320fd35-9cad-4c8b-895f-2e7e48a669d7 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 16 04:12:49 user nova-compute[103546]: DEBUG oslo.service.loopingcall [None req-9320fd35-9cad-4c8b-895f-2e7e48a669d7 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=103546) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 04:12:49 user nova-compute[103546]: DEBUG nova.compute.manager [-] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Deallocating network for instance {{(pid=103546) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 04:12:49 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] deallocate_for_instance() {{(pid=103546) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 04:12:50 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:12:50 user nova-compute[103546]: INFO nova.compute.manager [-] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Took 0.66 seconds to deallocate network for instance.
Nov 16 04:12:50 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-9320fd35-9cad-4c8b-895f-2e7e48a669d7 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:12:50 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-9320fd35-9cad-4c8b-895f-2e7e48a669d7 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:12:50 user nova-compute[103546]: DEBUG nova.compute.manager [req-54ecccac-ab56-4468-9635-654e78139033 req-313d07a1-891d-4607-b933-8ee064b46df4 service nova] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Received event network-vif-deleted-a64e3b5a-f0ee-4b9c-8736-84e4e4c9a1b3 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:12:50 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-9320fd35-9cad-4c8b-895f-2e7e48a669d7 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:12:50 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-9320fd35-9cad-4c8b-895f-2e7e48a669d7 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:12:50 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-9320fd35-9cad-4c8b-895f-2e7e48a669d7 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.160s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:12:50 user nova-compute[103546]: INFO nova.scheduler.client.report [None req-9320fd35-9cad-4c8b-895f-2e7e48a669d7 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Deleted allocations for instance 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06
Nov 16 04:12:50 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-9320fd35-9cad-4c8b-895f-2e7e48a669d7 tempest-AttachVolumeTestJSON-1584447380 tempest-AttachVolumeTestJSON-1584447380-project-member] Lock "0ba82fe3-33e6-4ae4-8716-2efbe66a6f06" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.843s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:12:51 user nova-compute[103546]: DEBUG nova.compute.manager [req-f36b5ef1-07a6-43c2-9749-96f4a7ffe73b req-01c9e323-9f79-4c9a-b545-79cf31943a68 service nova] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Received event network-vif-plugged-a64e3b5a-f0ee-4b9c-8736-84e4e4c9a1b3 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:12:51 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-f36b5ef1-07a6-43c2-9749-96f4a7ffe73b req-01c9e323-9f79-4c9a-b545-79cf31943a68 service nova] Acquiring lock "0ba82fe3-33e6-4ae4-8716-2efbe66a6f06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:12:51 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-f36b5ef1-07a6-43c2-9749-96f4a7ffe73b req-01c9e323-9f79-4c9a-b545-79cf31943a68 service nova] Lock "0ba82fe3-33e6-4ae4-8716-2efbe66a6f06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:12:51 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-f36b5ef1-07a6-43c2-9749-96f4a7ffe73b req-01c9e323-9f79-4c9a-b545-79cf31943a68 service nova] Lock "0ba82fe3-33e6-4ae4-8716-2efbe66a6f06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:12:51 user nova-compute[103546]: DEBUG nova.compute.manager [req-f36b5ef1-07a6-43c2-9749-96f4a7ffe73b req-01c9e323-9f79-4c9a-b545-79cf31943a68 service nova] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] No waiting events found dispatching network-vif-plugged-a64e3b5a-f0ee-4b9c-8736-84e4e4c9a1b3 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:12:51 user nova-compute[103546]: WARNING nova.compute.manager [req-f36b5ef1-07a6-43c2-9749-96f4a7ffe73b req-01c9e323-9f79-4c9a-b545-79cf31943a68 service nova] [instance: 0ba82fe3-33e6-4ae4-8716-2efbe66a6f06] Received unexpected event network-vif-plugged-a64e3b5a-f0ee-4b9c-8736-84e4e4c9a1b3 for instance with vm_state deleted and task_state None.
Nov 16 04:12:52 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b4d5e5ea-969b-4afc-8b11-5e654081ad5f tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Acquiring lock "ce616440-9d69-4812-8910-a2d9ad58f504" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:12:52 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b4d5e5ea-969b-4afc-8b11-5e654081ad5f tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "ce616440-9d69-4812-8910-a2d9ad58f504" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:12:52 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b4d5e5ea-969b-4afc-8b11-5e654081ad5f tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Acquiring lock "ce616440-9d69-4812-8910-a2d9ad58f504-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:12:52 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b4d5e5ea-969b-4afc-8b11-5e654081ad5f tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "ce616440-9d69-4812-8910-a2d9ad58f504-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:12:52 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b4d5e5ea-969b-4afc-8b11-5e654081ad5f tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "ce616440-9d69-4812-8910-a2d9ad58f504-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:12:52 user nova-compute[103546]: INFO nova.compute.manager [None req-b4d5e5ea-969b-4afc-8b11-5e654081ad5f tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Terminating instance
Nov 16 04:12:52 user nova-compute[103546]: DEBUG nova.compute.manager [None req-b4d5e5ea-969b-4afc-8b11-5e654081ad5f tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Start destroying the instance on the hypervisor. {{(pid=103546) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 04:12:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:12:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:12:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:12:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:12:52 user nova-compute[103546]: DEBUG nova.compute.manager [req-e0f170f8-cb43-4f0a-ba07-9f8cdc67624c req-4c1eed66-5407-4b8a-b736-d16508826d3d service nova] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Received event network-vif-unplugged-3d061027-8dbb-48b4-bbcd-b057c196a301 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:12:52 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-e0f170f8-cb43-4f0a-ba07-9f8cdc67624c req-4c1eed66-5407-4b8a-b736-d16508826d3d service nova] Acquiring lock "ce616440-9d69-4812-8910-a2d9ad58f504-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:12:52 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-e0f170f8-cb43-4f0a-ba07-9f8cdc67624c req-4c1eed66-5407-4b8a-b736-d16508826d3d service nova] Lock "ce616440-9d69-4812-8910-a2d9ad58f504-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:12:52 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-e0f170f8-cb43-4f0a-ba07-9f8cdc67624c req-4c1eed66-5407-4b8a-b736-d16508826d3d service nova] Lock "ce616440-9d69-4812-8910-a2d9ad58f504-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:12:52 user nova-compute[103546]: DEBUG nova.compute.manager [req-e0f170f8-cb43-4f0a-ba07-9f8cdc67624c req-4c1eed66-5407-4b8a-b736-d16508826d3d service nova] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] No waiting events found dispatching network-vif-unplugged-3d061027-8dbb-48b4-bbcd-b057c196a301 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:12:52 user nova-compute[103546]: DEBUG nova.compute.manager [req-e0f170f8-cb43-4f0a-ba07-9f8cdc67624c req-4c1eed66-5407-4b8a-b736-d16508826d3d service nova] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Received event network-vif-unplugged-3d061027-8dbb-48b4-bbcd-b057c196a301 for instance with task_state deleting. {{(pid=103546) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 04:12:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:12:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:12:53 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Instance destroyed successfully.
Nov 16 04:12:53 user nova-compute[103546]: DEBUG nova.objects.instance [None req-b4d5e5ea-969b-4afc-8b11-5e654081ad5f tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lazy-loading 'resources' on Instance uuid ce616440-9d69-4812-8910-a2d9ad58f504 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:12:53 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-b4d5e5ea-969b-4afc-8b11-5e654081ad5f tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:08:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-829606681',display_name='tempest-TestMinimumBasicScenario-server-829606681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-829606681',id=44,image_ref='9edde7eb-2bcc-446e-842d-e4cbb02faadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZA1+LQ3LL4xp7ktFRkByfEiyPUaRQ87nZMVkm4VlxVQfWqXvhgFsq6d9veVThqGJ8FQC6gNT+bPrYMP+KHpfUbXUr+UBlMEgwT/isovxXcR4e7zeqF8YH3w1VcrRMs4A==',key_name='tempest-TestMinimumBasicScenario-1639304563',keypairs=<?>,launch_index=0,launched_at=2023-11-16T04:08:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='edb839c76c0d4513b9be0ec92301707f',ramdisk_id='',reservation_id='r-nxzvb0yz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9edde7eb-2bcc-446e-842d-e4cbb02faadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1416270309',owner_user_name='tempest-TestMinimumBasicScenario-1416270309-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T04:10:14Z,user_data=None,user_id='341066fb5ead4ef28e4900c085593814',uuid=ce616440-9d69-4812-8910-a2d9ad58f504,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d061027-8dbb-48b4-bbcd-b057c196a301", "address": "fa:16:3e:45:2b:d3", "network": {"id": "d942264a-f03e-49a2-89eb-103a12c99518", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484356505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edb839c76c0d4513b9be0ec92301707f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d061027-8d", "ovs_interfaceid": "3d061027-8dbb-48b4-bbcd-b057c196a301", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 04:12:53 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-b4d5e5ea-969b-4afc-8b11-5e654081ad5f tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Converting VIF {"id": "3d061027-8dbb-48b4-bbcd-b057c196a301", "address": "fa:16:3e:45:2b:d3", "network": {"id": "d942264a-f03e-49a2-89eb-103a12c99518", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-484356505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edb839c76c0d4513b9be0ec92301707f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d061027-8d", "ovs_interfaceid": "3d061027-8dbb-48b4-bbcd-b057c196a301", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:12:53 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-b4d5e5ea-969b-4afc-8b11-5e654081ad5f tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:2b:d3,bridge_name='br-int',has_traffic_filtering=True,id=3d061027-8dbb-48b4-bbcd-b057c196a301,network=Network(d942264a-f03e-49a2-89eb-103a12c99518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d061027-8d') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:12:53 user nova-compute[103546]: DEBUG os_vif [None req-b4d5e5ea-969b-4afc-8b11-5e654081ad5f tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:2b:d3,bridge_name='br-int',has_traffic_filtering=True,id=3d061027-8dbb-48b4-bbcd-b057c196a301,network=Network(d942264a-f03e-49a2-89eb-103a12c99518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d061027-8d') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 04:12:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:12:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d061027-8d, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:12:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:12:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:12:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:12:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bc9dcb8a-f19e-43a2-bcae-f5e4242b469d) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:12:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:12:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:12:53 user nova-compute[103546]: INFO os_vif [None req-b4d5e5ea-969b-4afc-8b11-5e654081ad5f tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:2b:d3,bridge_name='br-int',has_traffic_filtering=True,id=3d061027-8dbb-48b4-bbcd-b057c196a301,network=Network(d942264a-f03e-49a2-89eb-103a12c99518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d061027-8d')
Nov 16 04:12:53 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-b4d5e5ea-969b-4afc-8b11-5e654081ad5f tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Deleting instance files /opt/stack/data/nova/instances/ce616440-9d69-4812-8910-a2d9ad58f504_del
Nov 16 04:12:53 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-b4d5e5ea-969b-4afc-8b11-5e654081ad5f tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Deletion of /opt/stack/data/nova/instances/ce616440-9d69-4812-8910-a2d9ad58f504_del complete
Nov 16 04:12:53 user nova-compute[103546]: INFO nova.compute.manager [None req-b4d5e5ea-969b-4afc-8b11-5e654081ad5f tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 16 04:12:53 user nova-compute[103546]: DEBUG oslo.service.loopingcall [None req-b4d5e5ea-969b-4afc-8b11-5e654081ad5f tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=103546) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 04:12:53 user nova-compute[103546]: DEBUG nova.compute.manager [-] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Deallocating network for instance {{(pid=103546) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 04:12:53 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] deallocate_for_instance() {{(pid=103546) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 04:12:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:12:54 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:12:54 user nova-compute[103546]: INFO nova.compute.manager [-] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Took 1.23 seconds to deallocate network for instance.
Nov 16 04:12:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b4d5e5ea-969b-4afc-8b11-5e654081ad5f tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:12:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b4d5e5ea-969b-4afc-8b11-5e654081ad5f tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:12:54 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-b4d5e5ea-969b-4afc-8b11-5e654081ad5f tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:12:54 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-b4d5e5ea-969b-4afc-8b11-5e654081ad5f tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:12:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b4d5e5ea-969b-4afc-8b11-5e654081ad5f tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.161s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:12:54 user nova-compute[103546]: INFO nova.scheduler.client.report [None req-b4d5e5ea-969b-4afc-8b11-5e654081ad5f tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Deleted allocations for instance ce616440-9d69-4812-8910-a2d9ad58f504
Nov 16 04:12:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b4d5e5ea-969b-4afc-8b11-5e654081ad5f tempest-TestMinimumBasicScenario-1416270309 tempest-TestMinimumBasicScenario-1416270309-project-member] Lock "ce616440-9d69-4812-8910-a2d9ad58f504" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.461s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:12:55 user nova-compute[103546]: DEBUG nova.compute.manager [req-28604adc-bbf7-4784-86e0-5c371d253be6 req-77a2b7fc-ac64-42ab-b7ee-b29b1200b3d8 service nova] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Received event network-vif-plugged-3d061027-8dbb-48b4-bbcd-b057c196a301 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:12:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-28604adc-bbf7-4784-86e0-5c371d253be6 req-77a2b7fc-ac64-42ab-b7ee-b29b1200b3d8 service nova] Acquiring lock "ce616440-9d69-4812-8910-a2d9ad58f504-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:12:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-28604adc-bbf7-4784-86e0-5c371d253be6 req-77a2b7fc-ac64-42ab-b7ee-b29b1200b3d8 service nova] Lock "ce616440-9d69-4812-8910-a2d9ad58f504-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:12:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-28604adc-bbf7-4784-86e0-5c371d253be6 req-77a2b7fc-ac64-42ab-b7ee-b29b1200b3d8 service nova] Lock "ce616440-9d69-4812-8910-a2d9ad58f504-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:12:55 user nova-compute[103546]: DEBUG nova.compute.manager [req-28604adc-bbf7-4784-86e0-5c371d253be6 req-77a2b7fc-ac64-42ab-b7ee-b29b1200b3d8 service nova] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] No waiting events found dispatching network-vif-plugged-3d061027-8dbb-48b4-bbcd-b057c196a301 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:12:55 user nova-compute[103546]: WARNING nova.compute.manager [req-28604adc-bbf7-4784-86e0-5c371d253be6 req-77a2b7fc-ac64-42ab-b7ee-b29b1200b3d8 service nova] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Received unexpected event network-vif-plugged-3d061027-8dbb-48b4-bbcd-b057c196a301 for instance with vm_state deleted and task_state None.
Nov 16 04:12:55 user nova-compute[103546]: DEBUG nova.compute.manager [req-28604adc-bbf7-4784-86e0-5c371d253be6 req-77a2b7fc-ac64-42ab-b7ee-b29b1200b3d8 service nova] [instance: ce616440-9d69-4812-8910-a2d9ad58f504] Received event network-vif-deleted-3d061027-8dbb-48b4-bbcd-b057c196a301 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:12:55 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:12:56 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:12:56 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Cleaning up deleted instances with incomplete migration  {{(pid=103546) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 04:12:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:13:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:13:05 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:13:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:13:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:13:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=103546) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 04:13:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:13:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:13:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:13:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:13:18 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:13:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:13:23 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:13:25 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:13:28 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:13:28 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:13:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:13:32 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:13:32 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:13:32 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=103546) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 04:13:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:13:33 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:13:34 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:13:34 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:13:35 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager.update_available_resource {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:13:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:13:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:13:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:13:35 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Auditing locally available compute resources for user (node: user) {{(pid=103546) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 04:13:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fdca5a2-7e02-4c4a-96ae-cc61547232c1/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:13:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fdca5a2-7e02-4c4a-96ae-cc61547232c1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:13:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fdca5a2-7e02-4c4a-96ae-cc61547232c1/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:13:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fdca5a2-7e02-4c4a-96ae-cc61547232c1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:13:36 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:13:36 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:13:36 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Hypervisor/Node resource view: name=user free_ram=8897MB free_disk=25.110931396484375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=103546) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 04:13:36 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:13:36 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:13:36 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 2fdca5a2-7e02-4c4a-96ae-cc61547232c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:13:36 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 04:13:36 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 04:13:36 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:13:36 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:13:36 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Compute_service record updated for user:user {{(pid=103546) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 04:13:36 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.225s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:13:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Acquiring lock "96d12e49-5dc7-43ad-9f6b-b366a8e7013d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:13:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lock "96d12e49-5dc7-43ad-9f6b-b366a8e7013d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:13:37 user nova-compute[103546]: DEBUG nova.compute.manager [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Starting instance... {{(pid=103546) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 04:13:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:13:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:13:37 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=103546) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 04:13:37 user nova-compute[103546]: INFO nova.compute.claims [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Claim successful on node user
Nov 16 04:13:37 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:13:37 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:13:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.220s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:13:37 user nova-compute[103546]: DEBUG nova.compute.manager [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Start building networks asynchronously for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 04:13:37 user nova-compute[103546]: DEBUG nova.compute.manager [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Allocating IP information in the background. {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 04:13:37 user nova-compute[103546]: DEBUG nova.network.neutron [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] allocate_for_instance() {{(pid=103546) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 04:13:37 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 04:13:37 user nova-compute[103546]: DEBUG nova.compute.manager [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Start building block device mappings for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 04:13:37 user nova-compute[103546]: DEBUG nova.policy [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '04ea7f587fd94211b18f97f3fe23714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7de09c5b11a4b0f96a66c9788e5942c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103546) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 04:13:37 user nova-compute[103546]: DEBUG nova.compute.manager [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Start spawning the instance on the hypervisor. {{(pid=103546) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 04:13:37 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Creating instance directory {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 04:13:37 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Creating image(s)
Nov 16 04:13:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Acquiring lock "/opt/stack/data/nova/instances/96d12e49-5dc7-43ad-9f6b-b366a8e7013d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:13:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lock "/opt/stack/data/nova/instances/96d12e49-5dc7-43ad-9f6b-b366a8e7013d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:13:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lock "/opt/stack/data/nova/instances/96d12e49-5dc7-43ad-9f6b-b366a8e7013d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:13:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:13:37 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:13:37 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:13:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.172s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:13:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Acquiring lock "8c9efafb670bfe5842ba1f4ce398924612164af7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:13:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:13:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:13:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.173s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:13:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/96d12e49-5dc7-43ad-9f6b-b366a8e7013d/disk 1073741824 {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:13:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/96d12e49-5dc7-43ad-9f6b-b366a8e7013d/disk 1073741824" returned: 0 in 0.059s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:13:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:13:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:13:38 user nova-compute[103546]: DEBUG nova.network.neutron [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Successfully created port: 8450ed01-4f54-4d95-ac8a-fcc4057ac88a {{(pid=103546) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 04:13:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.188s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:13:38 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Checking if we can resize image /opt/stack/data/nova/instances/96d12e49-5dc7-43ad-9f6b-b366a8e7013d/disk. size=1073741824 {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 04:13:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96d12e49-5dc7-43ad-9f6b-b366a8e7013d/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:13:38 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:13:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96d12e49-5dc7-43ad-9f6b-b366a8e7013d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:13:38 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Cannot resize image /opt/stack/data/nova/instances/96d12e49-5dc7-43ad-9f6b-b366a8e7013d/disk to a smaller size. {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 04:13:38 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Created local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 04:13:38 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Ensure instance console log exists: /opt/stack/data/nova/instances/96d12e49-5dc7-43ad-9f6b-b366a8e7013d/console.log {{(pid=103546) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 04:13:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:13:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:13:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:13:38 user nova-compute[103546]: DEBUG nova.network.neutron [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Successfully updated port: 8450ed01-4f54-4d95-ac8a-fcc4057ac88a {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 04:13:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Acquiring lock "refresh_cache-96d12e49-5dc7-43ad-9f6b-b366a8e7013d" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:13:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Acquired lock "refresh_cache-96d12e49-5dc7-43ad-9f6b-b366a8e7013d" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:13:38 user nova-compute[103546]: DEBUG nova.network.neutron [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 04:13:38 user nova-compute[103546]: DEBUG nova.compute.manager [req-978d679b-cdd7-48b6-83ae-e90292b4c4e7 req-f5573cd1-7dd2-43c9-b546-f6c2b80e730c service nova] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Received event network-changed-8450ed01-4f54-4d95-ac8a-fcc4057ac88a {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:13:38 user nova-compute[103546]: DEBUG nova.compute.manager [req-978d679b-cdd7-48b6-83ae-e90292b4c4e7 req-f5573cd1-7dd2-43c9-b546-f6c2b80e730c service nova] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Refreshing instance network info cache due to event network-changed-8450ed01-4f54-4d95-ac8a-fcc4057ac88a. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 04:13:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-978d679b-cdd7-48b6-83ae-e90292b4c4e7 req-f5573cd1-7dd2-43c9-b546-f6c2b80e730c service nova] Acquiring lock "refresh_cache-96d12e49-5dc7-43ad-9f6b-b366a8e7013d" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:13:38 user nova-compute[103546]: DEBUG nova.network.neutron [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 04:13:39 user nova-compute[103546]: DEBUG nova.network.neutron [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Updating instance_info_cache with network_info: [{"id": "8450ed01-4f54-4d95-ac8a-fcc4057ac88a", "address": "fa:16:3e:4f:91:ee", "network": {"id": "855d0097-2e3c-4168-900e-d811676a8bff", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1275657618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7de09c5b11a4b0f96a66c9788e5942c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8450ed01-4f", "ovs_interfaceid": "8450ed01-4f54-4d95-ac8a-fcc4057ac88a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:13:39 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Releasing lock "refresh_cache-96d12e49-5dc7-43ad-9f6b-b366a8e7013d" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:13:39 user nova-compute[103546]: DEBUG nova.compute.manager [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Instance network_info: |[{"id": "8450ed01-4f54-4d95-ac8a-fcc4057ac88a", "address": "fa:16:3e:4f:91:ee", "network": {"id": "855d0097-2e3c-4168-900e-d811676a8bff", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1275657618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7de09c5b11a4b0f96a66c9788e5942c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8450ed01-4f", "ovs_interfaceid": "8450ed01-4f54-4d95-ac8a-fcc4057ac88a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 04:13:39 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-978d679b-cdd7-48b6-83ae-e90292b4c4e7 req-f5573cd1-7dd2-43c9-b546-f6c2b80e730c service nova] Acquired lock "refresh_cache-96d12e49-5dc7-43ad-9f6b-b366a8e7013d" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:13:39 user nova-compute[103546]: DEBUG nova.network.neutron [req-978d679b-cdd7-48b6-83ae-e90292b4c4e7 req-f5573cd1-7dd2-43c9-b546-f6c2b80e730c service nova] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Refreshing network info cache for port 8450ed01-4f54-4d95-ac8a-fcc4057ac88a {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 04:13:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Start _get_guest_xml network_info=[{"id": "8450ed01-4f54-4d95-ac8a-fcc4057ac88a", "address": "fa:16:3e:4f:91:ee", "network": {"id": "855d0097-2e3c-4168-900e-d811676a8bff", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1275657618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7de09c5b11a4b0f96a66c9788e5942c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8450ed01-4f", "ovs_interfaceid": "8450ed01-4f54-4d95-ac8a-fcc4057ac88a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '5c6f539a-01e5-4478-bf8f-a14310b5d7dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 04:13:39 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:13:39 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:13:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 04:13:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 04:13:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 04:13:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 04:13:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 04:13:39 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 04:13:39 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 04:13:39 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 04:13:39 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 04:13:39 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 04:13:39 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 04:13:39 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 04:13:39 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 04:13:39 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 04:13:39 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 04:13:39 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 04:13:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:13:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-215095677',display_name='tempest-VolumesSnapshotTestJSON-instance-215095677',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-215095677',id=48,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+qYfiAB8R1GUBROxaRlEoAS7GwSEbkHq9U0YoJu8lCz8+AsQsvouMn8QL4UJLsNc8kGFnt67K+TwjoPnwaoNMHM1dDVA+hPTQK0q/kTtiVU1Pi0op4D6FpRx4VJGXrSA==',key_name='tempest-keypair-295918848',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7de09c5b11a4b0f96a66c9788e5942c',ramdisk_id='',reservation_id='r-374z77yw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1700179265',owner_user_name='tempest-VolumesSnapshotTestJSON-1700179265-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T04:13:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04ea7f587fd94211b18f97f3fe23714a',uuid=96d12e49-5dc7-43ad-9f6b-b366a8e7013d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8450ed01-4f54-4d95-ac8a-fcc4057ac88a", "address": "fa:16:3e:4f:91:ee", "network": {"id": "855d0097-2e3c-4168-900e-d811676a8bff", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1275657618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7de09c5b11a4b0f96a66c9788e5942c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8450ed01-4f", "ovs_interfaceid": "8450ed01-4f54-4d95-ac8a-fcc4057ac88a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 04:13:39 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Converting VIF {"id": "8450ed01-4f54-4d95-ac8a-fcc4057ac88a", "address": "fa:16:3e:4f:91:ee", "network": {"id": "855d0097-2e3c-4168-900e-d811676a8bff", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1275657618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7de09c5b11a4b0f96a66c9788e5942c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8450ed01-4f", "ovs_interfaceid": "8450ed01-4f54-4d95-ac8a-fcc4057ac88a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:13:39 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:91:ee,bridge_name='br-int',has_traffic_filtering=True,id=8450ed01-4f54-4d95-ac8a-fcc4057ac88a,network=Network(855d0097-2e3c-4168-900e-d811676a8bff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8450ed01-4f') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:13:39 user nova-compute[103546]: DEBUG nova.objects.instance [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lazy-loading 'pci_devices' on Instance uuid 96d12e49-5dc7-43ad-9f6b-b366a8e7013d {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:13:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] End _get_guest_xml xml=<domain type="kvm">
Nov 16 04:13:39 user nova-compute[103546]:   <uuid>96d12e49-5dc7-43ad-9f6b-b366a8e7013d</uuid>
Nov 16 04:13:39 user nova-compute[103546]:   <name>instance-00000030</name>
Nov 16 04:13:39 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 04:13:39 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 04:13:39 user nova-compute[103546]:   <metadata>
Nov 16 04:13:39 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 04:13:39 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 04:13:39 user nova-compute[103546]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-215095677</nova:name>
Nov 16 04:13:39 user nova-compute[103546]:       <nova:creationTime>2023-11-16 04:13:39</nova:creationTime>
Nov 16 04:13:39 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 04:13:39 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 04:13:39 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 04:13:39 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 04:13:39 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 04:13:39 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 04:13:39 user nova-compute[103546]:       </nova:flavor>
Nov 16 04:13:39 user nova-compute[103546]:       <nova:owner>
Nov 16 04:13:39 user nova-compute[103546]:         <nova:user uuid="04ea7f587fd94211b18f97f3fe23714a">tempest-VolumesSnapshotTestJSON-1700179265-project-member</nova:user>
Nov 16 04:13:39 user nova-compute[103546]:         <nova:project uuid="c7de09c5b11a4b0f96a66c9788e5942c">tempest-VolumesSnapshotTestJSON-1700179265</nova:project>
Nov 16 04:13:39 user nova-compute[103546]:       </nova:owner>
Nov 16 04:13:39 user nova-compute[103546]:       <nova:root type="image" uuid="5c6f539a-01e5-4478-bf8f-a14310b5d7dd"/>
Nov 16 04:13:39 user nova-compute[103546]:       <nova:ports>
Nov 16 04:13:39 user nova-compute[103546]:         <nova:port uuid="8450ed01-4f54-4d95-ac8a-fcc4057ac88a">
Nov 16 04:13:39 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 04:13:39 user nova-compute[103546]:         </nova:port>
Nov 16 04:13:39 user nova-compute[103546]:       </nova:ports>
Nov 16 04:13:39 user nova-compute[103546]:     </nova:instance>
Nov 16 04:13:39 user nova-compute[103546]:   </metadata>
Nov 16 04:13:39 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 04:13:39 user nova-compute[103546]:     <system>
Nov 16 04:13:39 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 04:13:39 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 04:13:39 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 04:13:39 user nova-compute[103546]:       <entry name="serial">96d12e49-5dc7-43ad-9f6b-b366a8e7013d</entry>
Nov 16 04:13:39 user nova-compute[103546]:       <entry name="uuid">96d12e49-5dc7-43ad-9f6b-b366a8e7013d</entry>
Nov 16 04:13:39 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 04:13:39 user nova-compute[103546]:     </system>
Nov 16 04:13:39 user nova-compute[103546]:   </sysinfo>
Nov 16 04:13:39 user nova-compute[103546]:   <os>
Nov 16 04:13:39 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 04:13:39 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 04:13:39 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 04:13:39 user nova-compute[103546]:   </os>
Nov 16 04:13:39 user nova-compute[103546]:   <features>
Nov 16 04:13:39 user nova-compute[103546]:     <acpi/>
Nov 16 04:13:39 user nova-compute[103546]:     <apic/>
Nov 16 04:13:39 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 04:13:39 user nova-compute[103546]:   </features>
Nov 16 04:13:39 user nova-compute[103546]:   <clock offset="utc">
Nov 16 04:13:39 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 04:13:39 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 04:13:39 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 04:13:39 user nova-compute[103546]:   </clock>
Nov 16 04:13:39 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 04:13:39 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 04:13:39 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 04:13:39 user nova-compute[103546]:   </cpu>
Nov 16 04:13:39 user nova-compute[103546]:   <devices>
Nov 16 04:13:39 user nova-compute[103546]:     <disk type="file" device="disk">
Nov 16 04:13:39 user nova-compute[103546]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 04:13:39 user nova-compute[103546]:       <source file="/opt/stack/data/nova/instances/96d12e49-5dc7-43ad-9f6b-b366a8e7013d/disk"/>
Nov 16 04:13:39 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 04:13:39 user nova-compute[103546]:     </disk>
Nov 16 04:13:39 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 04:13:39 user nova-compute[103546]:       <mac address="fa:16:3e:4f:91:ee"/>
Nov 16 04:13:39 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 04:13:39 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 04:13:39 user nova-compute[103546]:       <target dev="tap8450ed01-4f"/>
Nov 16 04:13:39 user nova-compute[103546]:     </interface>
Nov 16 04:13:39 user nova-compute[103546]:     <serial type="pty">
Nov 16 04:13:39 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/96d12e49-5dc7-43ad-9f6b-b366a8e7013d/console.log" append="off"/>
Nov 16 04:13:39 user nova-compute[103546]:     </serial>
Nov 16 04:13:39 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 04:13:39 user nova-compute[103546]:     <video>
Nov 16 04:13:39 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 04:13:39 user nova-compute[103546]:     </video>
Nov 16 04:13:39 user nova-compute[103546]:     <rng model="virtio">
Nov 16 04:13:39 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 04:13:39 user nova-compute[103546]:     </rng>
Nov 16 04:13:39 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 04:13:39 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 04:13:39 user nova-compute[103546]:       <stats period="10"/>
Nov 16 04:13:39 user nova-compute[103546]:     </memballoon>
Nov 16 04:13:39 user nova-compute[103546]:   </devices>
Nov 16 04:13:39 user nova-compute[103546]: </domain>
Nov 16 04:13:39 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 04:13:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:13:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-215095677',display_name='tempest-VolumesSnapshotTestJSON-instance-215095677',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-215095677',id=48,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+qYfiAB8R1GUBROxaRlEoAS7GwSEbkHq9U0YoJu8lCz8+AsQsvouMn8QL4UJLsNc8kGFnt67K+TwjoPnwaoNMHM1dDVA+hPTQK0q/kTtiVU1Pi0op4D6FpRx4VJGXrSA==',key_name='tempest-keypair-295918848',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7de09c5b11a4b0f96a66c9788e5942c',ramdisk_id='',reservation_id='r-374z77yw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1700179265',owner_user_name='tempest-VolumesSnapshotTestJSON-1700179265-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T04:13:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04ea7f587fd94211b18f97f3fe23714a',uuid=96d12e49-5dc7-43ad-9f6b-b366a8e7013d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8450ed01-4f54-4d95-ac8a-fcc4057ac88a", "address": "fa:16:3e:4f:91:ee", "network": {"id": "855d0097-2e3c-4168-900e-d811676a8bff", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1275657618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7de09c5b11a4b0f96a66c9788e5942c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8450ed01-4f", "ovs_interfaceid": "8450ed01-4f54-4d95-ac8a-fcc4057ac88a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 04:13:39 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Converting VIF {"id": "8450ed01-4f54-4d95-ac8a-fcc4057ac88a", "address": "fa:16:3e:4f:91:ee", "network": {"id": "855d0097-2e3c-4168-900e-d811676a8bff", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1275657618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7de09c5b11a4b0f96a66c9788e5942c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8450ed01-4f", "ovs_interfaceid": "8450ed01-4f54-4d95-ac8a-fcc4057ac88a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:13:39 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:91:ee,bridge_name='br-int',has_traffic_filtering=True,id=8450ed01-4f54-4d95-ac8a-fcc4057ac88a,network=Network(855d0097-2e3c-4168-900e-d811676a8bff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8450ed01-4f') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:13:39 user nova-compute[103546]: DEBUG os_vif [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:91:ee,bridge_name='br-int',has_traffic_filtering=True,id=8450ed01-4f54-4d95-ac8a-fcc4057ac88a,network=Network(855d0097-2e3c-4168-900e-d811676a8bff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8450ed01-4f') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 04:13:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:13:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:13:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 04:13:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:13:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5b703c2b-b2f6-54de-a10e-ce02cc33c2d3', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:13:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:13:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:13:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:13:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8450ed01-4f, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:13:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8450ed01-4f, col_values=(('qos', UUID('226a96b0-7de3-4d3e-bc06-eb496cc977fa')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:13:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8450ed01-4f, col_values=(('external_ids', {'iface-id': '8450ed01-4f54-4d95-ac8a-fcc4057ac88a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:91:ee', 'vm-uuid': '96d12e49-5dc7-43ad-9f6b-b366a8e7013d'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:13:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:13:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:13:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:13:39 user nova-compute[103546]: INFO os_vif [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:91:ee,bridge_name='br-int',has_traffic_filtering=True,id=8450ed01-4f54-4d95-ac8a-fcc4057ac88a,network=Network(855d0097-2e3c-4168-900e-d811676a8bff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8450ed01-4f')
Nov 16 04:13:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:13:39 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] No VIF found with MAC fa:16:3e:4f:91:ee, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 04:13:39 user nova-compute[103546]: DEBUG nova.network.neutron [req-978d679b-cdd7-48b6-83ae-e90292b4c4e7 req-f5573cd1-7dd2-43c9-b546-f6c2b80e730c service nova] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Updated VIF entry in instance network info cache for port 8450ed01-4f54-4d95-ac8a-fcc4057ac88a. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 04:13:39 user nova-compute[103546]: DEBUG nova.network.neutron [req-978d679b-cdd7-48b6-83ae-e90292b4c4e7 req-f5573cd1-7dd2-43c9-b546-f6c2b80e730c service nova] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Updating instance_info_cache with network_info: [{"id": "8450ed01-4f54-4d95-ac8a-fcc4057ac88a", "address": "fa:16:3e:4f:91:ee", "network": {"id": "855d0097-2e3c-4168-900e-d811676a8bff", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1275657618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7de09c5b11a4b0f96a66c9788e5942c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8450ed01-4f", "ovs_interfaceid": "8450ed01-4f54-4d95-ac8a-fcc4057ac88a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:13:39 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-978d679b-cdd7-48b6-83ae-e90292b4c4e7 req-f5573cd1-7dd2-43c9-b546-f6c2b80e730c service nova] Releasing lock "refresh_cache-96d12e49-5dc7-43ad-9f6b-b366a8e7013d" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:13:40 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:13:40 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:13:40 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:13:40 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:13:40 user nova-compute[103546]: DEBUG nova.compute.manager [req-b00e9c85-b419-4210-8401-a0658c47d335 req-d70401fe-ff51-4436-8548-f04a05707bb9 service nova] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Received event network-vif-plugged-8450ed01-4f54-4d95-ac8a-fcc4057ac88a {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:13:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-b00e9c85-b419-4210-8401-a0658c47d335 req-d70401fe-ff51-4436-8548-f04a05707bb9 service nova] Acquiring lock "96d12e49-5dc7-43ad-9f6b-b366a8e7013d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:13:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-b00e9c85-b419-4210-8401-a0658c47d335 req-d70401fe-ff51-4436-8548-f04a05707bb9 service nova] Lock "96d12e49-5dc7-43ad-9f6b-b366a8e7013d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:13:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-b00e9c85-b419-4210-8401-a0658c47d335 req-d70401fe-ff51-4436-8548-f04a05707bb9 service nova] Lock "96d12e49-5dc7-43ad-9f6b-b366a8e7013d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:13:40 user nova-compute[103546]: DEBUG nova.compute.manager [req-b00e9c85-b419-4210-8401-a0658c47d335 req-d70401fe-ff51-4436-8548-f04a05707bb9 service nova] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] No waiting events found dispatching network-vif-plugged-8450ed01-4f54-4d95-ac8a-fcc4057ac88a {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:13:40 user nova-compute[103546]: WARNING nova.compute.manager [req-b00e9c85-b419-4210-8401-a0658c47d335 req-d70401fe-ff51-4436-8548-f04a05707bb9 service nova] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Received unexpected event network-vif-plugged-8450ed01-4f54-4d95-ac8a-fcc4057ac88a for instance with vm_state building and task_state spawning.
Nov 16 04:13:41 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:13:41 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:13:41 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:13:41 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._sync_power_states {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:13:42 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Triggering sync for uuid 2fdca5a2-7e02-4c4a-96ae-cc61547232c1 {{(pid=103546) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 04:13:42 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Triggering sync for uuid 96d12e49-5dc7-43ad-9f6b-b366a8e7013d {{(pid=103546) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 04:13:42 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "2fdca5a2-7e02-4c4a-96ae-cc61547232c1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:13:42 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "2fdca5a2-7e02-4c4a-96ae-cc61547232c1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:13:42 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "96d12e49-5dc7-43ad-9f6b-b366a8e7013d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:13:42 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "2fdca5a2-7e02-4c4a-96ae-cc61547232c1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:13:42 user nova-compute[103546]: DEBUG nova.compute.manager [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 04:13:42 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Guest created on hypervisor {{(pid=103546) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 04:13:42 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Instance spawned successfully.
Nov 16 04:13:42 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 04:13:42 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:13:42 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Starting heal instance info cache {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 04:13:42 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Found default for hw_cdrom_bus of ide {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:13:42 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Found default for hw_disk_bus of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:13:42 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Found default for hw_input_bus of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:13:42 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Found default for hw_pointer_model of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:13:42 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Found default for hw_video_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:13:42 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Found default for hw_vif_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:13:42 user nova-compute[103546]: DEBUG nova.compute.manager [req-27551daf-5869-46b0-8f81-89f5be36049c req-b1fbbef8-9394-48c1-911f-71cdfba8353f service nova] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Received event network-vif-plugged-8450ed01-4f54-4d95-ac8a-fcc4057ac88a {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:13:42 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-27551daf-5869-46b0-8f81-89f5be36049c req-b1fbbef8-9394-48c1-911f-71cdfba8353f service nova] Acquiring lock "96d12e49-5dc7-43ad-9f6b-b366a8e7013d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:13:42 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-27551daf-5869-46b0-8f81-89f5be36049c req-b1fbbef8-9394-48c1-911f-71cdfba8353f service nova] Lock "96d12e49-5dc7-43ad-9f6b-b366a8e7013d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:13:42 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-27551daf-5869-46b0-8f81-89f5be36049c req-b1fbbef8-9394-48c1-911f-71cdfba8353f service nova] Lock "96d12e49-5dc7-43ad-9f6b-b366a8e7013d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:13:42 user nova-compute[103546]: DEBUG nova.compute.manager [req-27551daf-5869-46b0-8f81-89f5be36049c req-b1fbbef8-9394-48c1-911f-71cdfba8353f service nova] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] No waiting events found dispatching network-vif-plugged-8450ed01-4f54-4d95-ac8a-fcc4057ac88a {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:13:42 user nova-compute[103546]: WARNING nova.compute.manager [req-27551daf-5869-46b0-8f81-89f5be36049c req-b1fbbef8-9394-48c1-911f-71cdfba8353f service nova] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Received unexpected event network-vif-plugged-8450ed01-4f54-4d95-ac8a-fcc4057ac88a for instance with vm_state building and task_state spawning.
Nov 16 04:13:42 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "refresh_cache-2fdca5a2-7e02-4c4a-96ae-cc61547232c1" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:13:42 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquired lock "refresh_cache-2fdca5a2-7e02-4c4a-96ae-cc61547232c1" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:13:42 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Forcefully refreshing network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 04:13:42 user nova-compute[103546]: INFO nova.compute.manager [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Took 5.24 seconds to spawn the instance on the hypervisor.
Nov 16 04:13:42 user nova-compute[103546]: DEBUG nova.compute.manager [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 04:13:42 user nova-compute[103546]: INFO nova.compute.manager [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Took 5.80 seconds to build instance.
Nov 16 04:13:42 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-677ef7e3-12b2-4695-be83-ec902db92b3f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lock "96d12e49-5dc7-43ad-9f6b-b366a8e7013d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.897s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:13:42 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "96d12e49-5dc7-43ad-9f6b-b366a8e7013d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.919s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:13:42 user nova-compute[103546]: INFO nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] During sync_power_state the instance has a pending task (spawning). Skip.
Nov 16 04:13:42 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "96d12e49-5dc7-43ad-9f6b-b366a8e7013d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:13:43 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Updating instance_info_cache with network_info: [{"id": "9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a", "address": "fa:16:3e:f0:c5:13", "network": {"id": "5f10f091-8358-4c8c-92bb-999d989f26b0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-513865819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18a17119476d4eea9a39078a48af5a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a11f3f3-1a", "ovs_interfaceid": "9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:13:43 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Releasing lock "refresh_cache-2fdca5a2-7e02-4c4a-96ae-cc61547232c1" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:13:43 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Updated the network info_cache for instance {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 04:13:44 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:13:44 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:13:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:13:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:13:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:13:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:13:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:13:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=103546) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 04:13:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:13:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:13:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:13:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:13:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:13:59 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:13:59 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:14:01 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:14:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:14:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:14:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:14:06 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Acquiring lock "9ad85e80-259e-4d97-8087-60c1068c9826" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:14:06 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Lock "9ad85e80-259e-4d97-8087-60c1068c9826" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:14:06 user nova-compute[103546]: DEBUG nova.compute.manager [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Starting instance... {{(pid=103546) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 04:14:06 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:14:06 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:14:06 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=103546) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 04:14:06 user nova-compute[103546]: INFO nova.compute.claims [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Claim successful on node user
Nov 16 04:14:07 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:14:07 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:14:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.261s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:14:07 user nova-compute[103546]: DEBUG nova.compute.manager [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Start building networks asynchronously for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 04:14:07 user nova-compute[103546]: DEBUG nova.compute.manager [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Allocating IP information in the background. {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 04:14:07 user nova-compute[103546]: DEBUG nova.network.neutron [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] allocate_for_instance() {{(pid=103546) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 04:14:07 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 04:14:07 user nova-compute[103546]: DEBUG nova.compute.manager [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Start building block device mappings for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 04:14:07 user nova-compute[103546]: DEBUG nova.policy [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8d6bc37bf5844cedacd57be55c6fe0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0298f102e0042d5ac7d4e3d899fc6e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103546) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 04:14:07 user nova-compute[103546]: DEBUG nova.compute.manager [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Start spawning the instance on the hypervisor. {{(pid=103546) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 04:14:07 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Creating instance directory {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 04:14:07 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Creating image(s)
Nov 16 04:14:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Acquiring lock "/opt/stack/data/nova/instances/9ad85e80-259e-4d97-8087-60c1068c9826/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:14:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Lock "/opt/stack/data/nova/instances/9ad85e80-259e-4d97-8087-60c1068c9826/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:14:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Lock "/opt/stack/data/nova/instances/9ad85e80-259e-4d97-8087-60c1068c9826/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:14:07 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:14:07 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.227s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:14:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Acquiring lock "8c9efafb670bfe5842ba1f4ce398924612164af7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:14:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:14:07 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:14:07 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.203s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:14:07 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/9ad85e80-259e-4d97-8087-60c1068c9826/disk 1073741824 {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:14:07 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/9ad85e80-259e-4d97-8087-60c1068c9826/disk 1073741824" returned: 0 in 0.063s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:14:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:14:07 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:14:07 user nova-compute[103546]: DEBUG nova.network.neutron [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Successfully created port: 2e72a898-1c0f-44a5-a6e2-8c3e9aa13f38 {{(pid=103546) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 04:14:08 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.181s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:14:08 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9ad85e80-259e-4d97-8087-60c1068c9826/disk. size=1073741824 {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 04:14:08 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad85e80-259e-4d97-8087-60c1068c9826/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:14:08 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad85e80-259e-4d97-8087-60c1068c9826/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:14:08 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Cannot resize image /opt/stack/data/nova/instances/9ad85e80-259e-4d97-8087-60c1068c9826/disk to a smaller size. {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 04:14:08 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Created local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 04:14:08 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Ensure instance console log exists: /opt/stack/data/nova/instances/9ad85e80-259e-4d97-8087-60c1068c9826/console.log {{(pid=103546) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 04:14:08 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:14:08 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:14:08 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:14:08 user nova-compute[103546]: DEBUG nova.network.neutron [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Successfully updated port: 2e72a898-1c0f-44a5-a6e2-8c3e9aa13f38 {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 04:14:08 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Acquiring lock "refresh_cache-9ad85e80-259e-4d97-8087-60c1068c9826" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:14:08 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Acquired lock "refresh_cache-9ad85e80-259e-4d97-8087-60c1068c9826" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:14:08 user nova-compute[103546]: DEBUG nova.network.neutron [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 04:14:08 user nova-compute[103546]: DEBUG nova.compute.manager [req-1b52d52c-b8e4-45f4-a0b0-7842aea3c926 req-3ba6f88c-a9c3-4b5d-ada9-a60121f75c60 service nova] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Received event network-changed-2e72a898-1c0f-44a5-a6e2-8c3e9aa13f38 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:14:08 user nova-compute[103546]: DEBUG nova.compute.manager [req-1b52d52c-b8e4-45f4-a0b0-7842aea3c926 req-3ba6f88c-a9c3-4b5d-ada9-a60121f75c60 service nova] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Refreshing instance network info cache due to event network-changed-2e72a898-1c0f-44a5-a6e2-8c3e9aa13f38. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 04:14:08 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-1b52d52c-b8e4-45f4-a0b0-7842aea3c926 req-3ba6f88c-a9c3-4b5d-ada9-a60121f75c60 service nova] Acquiring lock "refresh_cache-9ad85e80-259e-4d97-8087-60c1068c9826" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:14:08 user nova-compute[103546]: DEBUG nova.network.neutron [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 04:14:08 user nova-compute[103546]: DEBUG nova.network.neutron [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Updating instance_info_cache with network_info: [{"id": "2e72a898-1c0f-44a5-a6e2-8c3e9aa13f38", "address": "fa:16:3e:d6:a7:78", "network": {"id": "09cd9f1b-f026-441f-98b0-fcbce2718aae", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-97767409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0298f102e0042d5ac7d4e3d899fc6e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e72a898-1c", "ovs_interfaceid": "2e72a898-1c0f-44a5-a6e2-8c3e9aa13f38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:14:08 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Releasing lock "refresh_cache-9ad85e80-259e-4d97-8087-60c1068c9826" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:14:08 user nova-compute[103546]: DEBUG nova.compute.manager [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Instance network_info: |[{"id": "2e72a898-1c0f-44a5-a6e2-8c3e9aa13f38", "address": "fa:16:3e:d6:a7:78", "network": {"id": "09cd9f1b-f026-441f-98b0-fcbce2718aae", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-97767409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0298f102e0042d5ac7d4e3d899fc6e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e72a898-1c", "ovs_interfaceid": "2e72a898-1c0f-44a5-a6e2-8c3e9aa13f38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 04:14:08 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-1b52d52c-b8e4-45f4-a0b0-7842aea3c926 req-3ba6f88c-a9c3-4b5d-ada9-a60121f75c60 service nova] Acquired lock "refresh_cache-9ad85e80-259e-4d97-8087-60c1068c9826" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:14:08 user nova-compute[103546]: DEBUG nova.network.neutron [req-1b52d52c-b8e4-45f4-a0b0-7842aea3c926 req-3ba6f88c-a9c3-4b5d-ada9-a60121f75c60 service nova] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Refreshing network info cache for port 2e72a898-1c0f-44a5-a6e2-8c3e9aa13f38 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 04:14:08 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Start _get_guest_xml network_info=[{"id": "2e72a898-1c0f-44a5-a6e2-8c3e9aa13f38", "address": "fa:16:3e:d6:a7:78", "network": {"id": "09cd9f1b-f026-441f-98b0-fcbce2718aae", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-97767409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0298f102e0042d5ac7d4e3d899fc6e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e72a898-1c", "ovs_interfaceid": "2e72a898-1c0f-44a5-a6e2-8c3e9aa13f38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '5c6f539a-01e5-4478-bf8f-a14310b5d7dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 04:14:08 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:14:08 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:14:08 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 04:14:08 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 04:14:08 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 04:14:08 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 04:14:08 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 04:14:08 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 04:14:08 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 04:14:08 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 04:14:08 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 04:14:08 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 04:14:08 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 04:14:08 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 04:14:08 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 04:14:08 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 04:14:08 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 04:14:08 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 04:14:08 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:14:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-885257577',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-885257577',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-8852575',id=49,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9dr9qOdCSjsCuCig/FaYaXIScOlEMb0P97ebdPkZNHOaEwf/mlLQYqWCq9k9KJDAibU2G+bjvFYgwsDu1uuI1Is8DozMlVws81WUyQQipcVPbcWN6+WjhAR6ZX1tjV2g==',key_name='tempest-keypair-1082843614',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0298f102e0042d5ac7d4e3d899fc6e3',ramdisk_id='',reservation_id='r-0wwyz7un',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1030327997',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T04:14:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d6bc37bf5844cedacd57be55c6fe0d5',uuid=9ad85e80-259e-4d97-8087-60c1068c9826,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e72a898-1c0f-44a5-a6e2-8c3e9aa13f38", "address": "fa:16:3e:d6:a7:78", "network": {"id": "09cd9f1b-f026-441f-98b0-fcbce2718aae", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-97767409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0298f102e0042d5ac7d4e3d899fc6e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e72a898-1c", "ovs_interfaceid": "2e72a898-1c0f-44a5-a6e2-8c3e9aa13f38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 04:14:08 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Converting VIF {"id": "2e72a898-1c0f-44a5-a6e2-8c3e9aa13f38", "address": "fa:16:3e:d6:a7:78", "network": {"id": "09cd9f1b-f026-441f-98b0-fcbce2718aae", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-97767409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0298f102e0042d5ac7d4e3d899fc6e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e72a898-1c", "ovs_interfaceid": "2e72a898-1c0f-44a5-a6e2-8c3e9aa13f38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:14:08 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:a7:78,bridge_name='br-int',has_traffic_filtering=True,id=2e72a898-1c0f-44a5-a6e2-8c3e9aa13f38,network=Network(09cd9f1b-f026-441f-98b0-fcbce2718aae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e72a898-1c') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:14:08 user nova-compute[103546]: DEBUG nova.objects.instance [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ad85e80-259e-4d97-8087-60c1068c9826 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:14:08 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] End _get_guest_xml xml=<domain type="kvm">
Nov 16 04:14:08 user nova-compute[103546]:   <uuid>9ad85e80-259e-4d97-8087-60c1068c9826</uuid>
Nov 16 04:14:08 user nova-compute[103546]:   <name>instance-00000031</name>
Nov 16 04:14:08 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 04:14:08 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 04:14:08 user nova-compute[103546]:   <metadata>
Nov 16 04:14:08 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 04:14:08 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 04:14:08 user nova-compute[103546]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-885257577</nova:name>
Nov 16 04:14:08 user nova-compute[103546]:       <nova:creationTime>2023-11-16 04:14:08</nova:creationTime>
Nov 16 04:14:08 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 04:14:08 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 04:14:08 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 04:14:08 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 04:14:08 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 04:14:08 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 04:14:08 user nova-compute[103546]:       </nova:flavor>
Nov 16 04:14:08 user nova-compute[103546]:       <nova:owner>
Nov 16 04:14:08 user nova-compute[103546]:         <nova:user uuid="8d6bc37bf5844cedacd57be55c6fe0d5">tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member</nova:user>
Nov 16 04:14:08 user nova-compute[103546]:         <nova:project uuid="c0298f102e0042d5ac7d4e3d899fc6e3">tempest-TestServerVolumeAttachScenarioOldVersion-1030327997</nova:project>
Nov 16 04:14:08 user nova-compute[103546]:       </nova:owner>
Nov 16 04:14:08 user nova-compute[103546]:       <nova:root type="image" uuid="5c6f539a-01e5-4478-bf8f-a14310b5d7dd"/>
Nov 16 04:14:08 user nova-compute[103546]:       <nova:ports>
Nov 16 04:14:08 user nova-compute[103546]:         <nova:port uuid="2e72a898-1c0f-44a5-a6e2-8c3e9aa13f38">
Nov 16 04:14:08 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 16 04:14:08 user nova-compute[103546]:         </nova:port>
Nov 16 04:14:08 user nova-compute[103546]:       </nova:ports>
Nov 16 04:14:08 user nova-compute[103546]:     </nova:instance>
Nov 16 04:14:08 user nova-compute[103546]:   </metadata>
Nov 16 04:14:08 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 04:14:08 user nova-compute[103546]:     <system>
Nov 16 04:14:08 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 04:14:08 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 04:14:08 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 04:14:08 user nova-compute[103546]:       <entry name="serial">9ad85e80-259e-4d97-8087-60c1068c9826</entry>
Nov 16 04:14:08 user nova-compute[103546]:       <entry name="uuid">9ad85e80-259e-4d97-8087-60c1068c9826</entry>
Nov 16 04:14:08 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 04:14:08 user nova-compute[103546]:     </system>
Nov 16 04:14:08 user nova-compute[103546]:   </sysinfo>
Nov 16 04:14:08 user nova-compute[103546]:   <os>
Nov 16 04:14:08 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 04:14:08 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 04:14:08 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 04:14:08 user nova-compute[103546]:   </os>
Nov 16 04:14:08 user nova-compute[103546]:   <features>
Nov 16 04:14:08 user nova-compute[103546]:     <acpi/>
Nov 16 04:14:08 user nova-compute[103546]:     <apic/>
Nov 16 04:14:08 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 04:14:08 user nova-compute[103546]:   </features>
Nov 16 04:14:08 user nova-compute[103546]:   <clock offset="utc">
Nov 16 04:14:08 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 04:14:08 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 04:14:08 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 04:14:08 user nova-compute[103546]:   </clock>
Nov 16 04:14:08 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 04:14:08 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 04:14:08 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 04:14:08 user nova-compute[103546]:   </cpu>
Nov 16 04:14:08 user nova-compute[103546]:   <devices>
Nov 16 04:14:08 user nova-compute[103546]:     <disk type="file" device="disk">
Nov 16 04:14:08 user nova-compute[103546]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 04:14:08 user nova-compute[103546]:       <source file="/opt/stack/data/nova/instances/9ad85e80-259e-4d97-8087-60c1068c9826/disk"/>
Nov 16 04:14:08 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 04:14:08 user nova-compute[103546]:     </disk>
Nov 16 04:14:08 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 04:14:08 user nova-compute[103546]:       <mac address="fa:16:3e:d6:a7:78"/>
Nov 16 04:14:08 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 04:14:08 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 04:14:08 user nova-compute[103546]:       <target dev="tap2e72a898-1c"/>
Nov 16 04:14:08 user nova-compute[103546]:     </interface>
Nov 16 04:14:08 user nova-compute[103546]:     <serial type="pty">
Nov 16 04:14:08 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/9ad85e80-259e-4d97-8087-60c1068c9826/console.log" append="off"/>
Nov 16 04:14:08 user nova-compute[103546]:     </serial>
Nov 16 04:14:08 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 04:14:08 user nova-compute[103546]:     <video>
Nov 16 04:14:08 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 04:14:08 user nova-compute[103546]:     </video>
Nov 16 04:14:08 user nova-compute[103546]:     <rng model="virtio">
Nov 16 04:14:08 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 04:14:08 user nova-compute[103546]:     </rng>
Nov 16 04:14:08 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 04:14:08 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 04:14:08 user nova-compute[103546]:       <stats period="10"/>
Nov 16 04:14:08 user nova-compute[103546]:     </memballoon>
Nov 16 04:14:08 user nova-compute[103546]:   </devices>
Nov 16 04:14:08 user nova-compute[103546]: </domain>
Nov 16 04:14:08 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 04:14:08 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:14:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-885257577',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-885257577',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-8852575',id=49,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9dr9qOdCSjsCuCig/FaYaXIScOlEMb0P97ebdPkZNHOaEwf/mlLQYqWCq9k9KJDAibU2G+bjvFYgwsDu1uuI1Is8DozMlVws81WUyQQipcVPbcWN6+WjhAR6ZX1tjV2g==',key_name='tempest-keypair-1082843614',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0298f102e0042d5ac7d4e3d899fc6e3',ramdisk_id='',reservation_id='r-0wwyz7un',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1030327997',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T04:14:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d6bc37bf5844cedacd57be55c6fe0d5',uuid=9ad85e80-259e-4d97-8087-60c1068c9826,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e72a898-1c0f-44a5-a6e2-8c3e9aa13f38", "address": "fa:16:3e:d6:a7:78", "network": {"id": "09cd9f1b-f026-441f-98b0-fcbce2718aae", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-97767409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0298f102e0042d5ac7d4e3d899fc6e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e72a898-1c", "ovs_interfaceid": "2e72a898-1c0f-44a5-a6e2-8c3e9aa13f38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 04:14:08 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Converting VIF {"id": "2e72a898-1c0f-44a5-a6e2-8c3e9aa13f38", "address": "fa:16:3e:d6:a7:78", "network": {"id": "09cd9f1b-f026-441f-98b0-fcbce2718aae", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-97767409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0298f102e0042d5ac7d4e3d899fc6e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e72a898-1c", "ovs_interfaceid": "2e72a898-1c0f-44a5-a6e2-8c3e9aa13f38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:14:08 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:a7:78,bridge_name='br-int',has_traffic_filtering=True,id=2e72a898-1c0f-44a5-a6e2-8c3e9aa13f38,network=Network(09cd9f1b-f026-441f-98b0-fcbce2718aae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e72a898-1c') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:14:08 user nova-compute[103546]: DEBUG os_vif [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:a7:78,bridge_name='br-int',has_traffic_filtering=True,id=2e72a898-1c0f-44a5-a6e2-8c3e9aa13f38,network=Network(09cd9f1b-f026-441f-98b0-fcbce2718aae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e72a898-1c') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 04:14:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:14:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:14:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 04:14:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:14:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2fee2238-d320-5aa0-a05f-31b3ec7ff07b', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:14:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:14:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:14:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:14:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2e72a898-1c, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:14:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2e72a898-1c, col_values=(('qos', UUID('d8c2e4de-63c6-4549-a855-f2e3cae6bfe8')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:14:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2e72a898-1c, col_values=(('external_ids', {'iface-id': '2e72a898-1c0f-44a5-a6e2-8c3e9aa13f38', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:a7:78', 'vm-uuid': '9ad85e80-259e-4d97-8087-60c1068c9826'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:14:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:14:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:14:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:14:08 user nova-compute[103546]: INFO os_vif [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:a7:78,bridge_name='br-int',has_traffic_filtering=True,id=2e72a898-1c0f-44a5-a6e2-8c3e9aa13f38,network=Network(09cd9f1b-f026-441f-98b0-fcbce2718aae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e72a898-1c')
Nov 16 04:14:09 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:14:09 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] No VIF found with MAC fa:16:3e:d6:a7:78, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 04:14:09 user nova-compute[103546]: DEBUG nova.network.neutron [req-1b52d52c-b8e4-45f4-a0b0-7842aea3c926 req-3ba6f88c-a9c3-4b5d-ada9-a60121f75c60 service nova] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Updated VIF entry in instance network info cache for port 2e72a898-1c0f-44a5-a6e2-8c3e9aa13f38. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 04:14:09 user nova-compute[103546]: DEBUG nova.network.neutron [req-1b52d52c-b8e4-45f4-a0b0-7842aea3c926 req-3ba6f88c-a9c3-4b5d-ada9-a60121f75c60 service nova] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Updating instance_info_cache with network_info: [{"id": "2e72a898-1c0f-44a5-a6e2-8c3e9aa13f38", "address": "fa:16:3e:d6:a7:78", "network": {"id": "09cd9f1b-f026-441f-98b0-fcbce2718aae", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-97767409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0298f102e0042d5ac7d4e3d899fc6e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e72a898-1c", "ovs_interfaceid": "2e72a898-1c0f-44a5-a6e2-8c3e9aa13f38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:14:09 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-1b52d52c-b8e4-45f4-a0b0-7842aea3c926 req-3ba6f88c-a9c3-4b5d-ada9-a60121f75c60 service nova] Releasing lock "refresh_cache-9ad85e80-259e-4d97-8087-60c1068c9826" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:14:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:14:10 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:14:10 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:14:10 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:14:10 user nova-compute[103546]: DEBUG nova.compute.manager [req-ec4f2f5e-cbd2-4752-867a-82abf6957560 req-a3cca580-17d8-41e3-a39d-b54b73fe1990 service nova] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Received event network-vif-plugged-2e72a898-1c0f-44a5-a6e2-8c3e9aa13f38 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:14:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ec4f2f5e-cbd2-4752-867a-82abf6957560 req-a3cca580-17d8-41e3-a39d-b54b73fe1990 service nova] Acquiring lock "9ad85e80-259e-4d97-8087-60c1068c9826-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:14:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ec4f2f5e-cbd2-4752-867a-82abf6957560 req-a3cca580-17d8-41e3-a39d-b54b73fe1990 service nova] Lock "9ad85e80-259e-4d97-8087-60c1068c9826-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:14:10 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ec4f2f5e-cbd2-4752-867a-82abf6957560 req-a3cca580-17d8-41e3-a39d-b54b73fe1990 service nova] Lock "9ad85e80-259e-4d97-8087-60c1068c9826-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:14:10 user nova-compute[103546]: DEBUG nova.compute.manager [req-ec4f2f5e-cbd2-4752-867a-82abf6957560 req-a3cca580-17d8-41e3-a39d-b54b73fe1990 service nova] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] No waiting events found dispatching network-vif-plugged-2e72a898-1c0f-44a5-a6e2-8c3e9aa13f38 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:14:10 user nova-compute[103546]: WARNING nova.compute.manager [req-ec4f2f5e-cbd2-4752-867a-82abf6957560 req-a3cca580-17d8-41e3-a39d-b54b73fe1990 service nova] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Received unexpected event network-vif-plugged-2e72a898-1c0f-44a5-a6e2-8c3e9aa13f38 for instance with vm_state building and task_state spawning.
Nov 16 04:14:10 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:14:10 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:14:10 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:14:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-220f4e9f-1054-4e2a-a093-70e0b14c0d74 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Acquiring lock "2fdca5a2-7e02-4c4a-96ae-cc61547232c1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:14:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-220f4e9f-1054-4e2a-a093-70e0b14c0d74 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Lock "2fdca5a2-7e02-4c4a-96ae-cc61547232c1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:14:12 user nova-compute[103546]: DEBUG nova.objects.instance [None req-220f4e9f-1054-4e2a-a093-70e0b14c0d74 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Lazy-loading 'flavor' on Instance uuid 2fdca5a2-7e02-4c4a-96ae-cc61547232c1 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:14:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-220f4e9f-1054-4e2a-a093-70e0b14c0d74 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Lock "2fdca5a2-7e02-4c4a-96ae-cc61547232c1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:14:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:14:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-220f4e9f-1054-4e2a-a093-70e0b14c0d74 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Acquiring lock "2fdca5a2-7e02-4c4a-96ae-cc61547232c1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:14:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-220f4e9f-1054-4e2a-a093-70e0b14c0d74 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Lock "2fdca5a2-7e02-4c4a-96ae-cc61547232c1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:14:12 user nova-compute[103546]: INFO nova.compute.manager [None req-220f4e9f-1054-4e2a-a093-70e0b14c0d74 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Attaching volume 9e16fa65-da5e-401d-ba7e-de558d1a8597 to /dev/vdb
Nov 16 04:14:12 user nova-compute[103546]: DEBUG os_brick.utils [None req-220f4e9f-1054-4e2a-a093-70e0b14c0d74 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:14:12 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:14:12 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:14:12 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65f4bc1-ec5e-425f-bdfc-78f1233fd9ff]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af5c39b14ece\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:14:12 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:14:12 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:14:12 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[516fc918-8244-40b1-a68c-c7c84b2fd1be]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:14:12 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:14:12 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:14:12 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[7590fbe0-60e3-44f5-94af-9c5bc61acf61]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:14:12 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5302c261-65c4-4b51-8124-c5dc43e2d887]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:14:12 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-220f4e9f-1054-4e2a-a093-70e0b14c0d74 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Running cmd (subprocess): nvme version {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:14:12 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-220f4e9f-1054-4e2a-a093-70e0b14c0d74 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] 'nvme version' failed. Not Retrying. {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 04:14:12 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.nvmeof [None req-220f4e9f-1054-4e2a-a093-70e0b14c0d74 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] nvme not present on system {{(pid=103546) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 04:14:12 user nova-compute[103546]: DEBUG nova.compute.manager [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 04:14:12 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Guest created on hypervisor {{(pid=103546) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 04:14:12 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:14:12 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Instance spawned successfully.
Nov 16 04:14:12 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 04:14:12 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 04:14:12 user nova-compute[103546]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 04:14:12 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9286f1-efce-4908-bbce-e3588ea29ccb]: (4, '') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:14:12 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-220f4e9f-1054-4e2a-a093-70e0b14c0d74 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=103546) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 04:14:12 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-220f4e9f-1054-4e2a-a093-70e0b14c0d74 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 04:14:12 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-220f4e9f-1054-4e2a-a093-70e0b14c0d74 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] LIGHTOS: no hostnqn found. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 04:14:12 user nova-compute[103546]: DEBUG os_brick.utils [None req-220f4e9f-1054-4e2a-a093-70e0b14c0d74 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af5c39b14ece', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:14:12 user nova-compute[103546]: DEBUG nova.virt.block_device [None req-220f4e9f-1054-4e2a-a093-70e0b14c0d74 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Updating existing volume attachment record: 246d7a44-03c3-491d-85b0-335c9e883856 {{(pid=103546) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 04:14:12 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Found default for hw_cdrom_bus of ide {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:14:12 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Found default for hw_disk_bus of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:14:12 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Found default for hw_input_bus of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:14:12 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Found default for hw_pointer_model of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:14:12 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Found default for hw_video_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:14:12 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Found default for hw_vif_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:14:12 user nova-compute[103546]: INFO nova.compute.manager [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Took 5.28 seconds to spawn the instance on the hypervisor.
Nov 16 04:14:12 user nova-compute[103546]: DEBUG nova.compute.manager [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 04:14:12 user nova-compute[103546]: INFO nova.compute.manager [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Took 5.91 seconds to build instance.
Nov 16 04:14:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-4b606ccf-79f2-4c42-acd1-4db3a12bc8f9 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Lock "9ad85e80-259e-4d97-8087-60c1068c9826" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.010s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:14:12 user nova-compute[103546]: DEBUG nova.compute.manager [req-cbffc1dc-200e-4fc1-a3e9-c0a4adf4e844 req-4db2bb27-42ad-4f9f-95a2-3045528dbf2c service nova] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Received event network-vif-plugged-2e72a898-1c0f-44a5-a6e2-8c3e9aa13f38 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:14:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-cbffc1dc-200e-4fc1-a3e9-c0a4adf4e844 req-4db2bb27-42ad-4f9f-95a2-3045528dbf2c service nova] Acquiring lock "9ad85e80-259e-4d97-8087-60c1068c9826-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:14:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-cbffc1dc-200e-4fc1-a3e9-c0a4adf4e844 req-4db2bb27-42ad-4f9f-95a2-3045528dbf2c service nova] Lock "9ad85e80-259e-4d97-8087-60c1068c9826-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:14:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-cbffc1dc-200e-4fc1-a3e9-c0a4adf4e844 req-4db2bb27-42ad-4f9f-95a2-3045528dbf2c service nova] Lock "9ad85e80-259e-4d97-8087-60c1068c9826-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:14:12 user nova-compute[103546]: DEBUG nova.compute.manager [req-cbffc1dc-200e-4fc1-a3e9-c0a4adf4e844 req-4db2bb27-42ad-4f9f-95a2-3045528dbf2c service nova] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] No waiting events found dispatching network-vif-plugged-2e72a898-1c0f-44a5-a6e2-8c3e9aa13f38 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:14:12 user nova-compute[103546]: WARNING nova.compute.manager [req-cbffc1dc-200e-4fc1-a3e9-c0a4adf4e844 req-4db2bb27-42ad-4f9f-95a2-3045528dbf2c service nova] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Received unexpected event network-vif-plugged-2e72a898-1c0f-44a5-a6e2-8c3e9aa13f38 for instance with vm_state active and task_state None.
Nov 16 04:14:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:14:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:14:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:14:17 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-220f4e9f-1054-4e2a-a093-70e0b14c0d74 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 04:14:17 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-220f4e9f-1054-4e2a-a093-70e0b14c0d74 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gcXYHvZe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:14:17 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-220f4e9f-1054-4e2a-a093-70e0b14c0d74 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:14:17 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-220f4e9f-1054-4e2a-a093-70e0b14c0d74 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:14:17 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-220f4e9f-1054-4e2a-a093-70e0b14c0d74 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:14:17 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-220f4e9f-1054-4e2a-a093-70e0b14c0d74 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:14:17 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-220f4e9f-1054-4e2a-a093-70e0b14c0d74 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:14:17 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-220f4e9f-1054-4e2a-a093-70e0b14c0d74 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:14:17 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-220f4e9f-1054-4e2a-a093-70e0b14c0d74 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 04:14:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:14:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:14:17 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92301b8-0626-4722-9a0d-a774bdaf3538]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:14:17 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-220f4e9f-1054-4e2a-a093-70e0b14c0d74 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 04:14:17 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:14:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 -p 172.16.0.220:3260 --interface default --op new {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:14:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:14:17 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df16289-7b0e-468e-ba8d-208bc2f21779]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597] added\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:14:17 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-220f4e9f-1054-4e2a-a093-70e0b14c0d74 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597] added
Nov 16 04:14:17 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:14:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:14:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:14:17 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ec5bdd-b48d-48fb-94a5-bcd959a44bdc]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:14:17 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-220f4e9f-1054-4e2a-a093-70e0b14c0d74 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:14:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:14:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:14:17 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aff7ed4-beb5-4377-bc95-c4ee7a97fbc0]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:14:17 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-220f4e9f-1054-4e2a-a093-70e0b14c0d74 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:14:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gcXYHvZe {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:14:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gcXYHvZe" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:14:17 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[740560e1-eed4-4e07-9e1f-8b28f586af37]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:14:17 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-220f4e9f-1054-4e2a-a093-70e0b14c0d74 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gcXYHvZe'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:14:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:14:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:14:17 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2feba4c-0a3a-4da4-855a-ea146beea954]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:14:17 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-220f4e9f-1054-4e2a-a093-70e0b14c0d74 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:14:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:14:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:14:17 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f024d41-df7d-4555-83ea-85278ebcf990]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:14:17 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-220f4e9f-1054-4e2a-a093-70e0b14c0d74 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 04:14:17 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:14:17 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-220f4e9f-1054-4e2a-a093-70e0b14c0d74 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 04:14:17 user nova-compute[103546]:  {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:14:17 user nova-compute[103546]: WARNING os_brick.initiator.connectors.iscsi [None req-220f4e9f-1054-4e2a-a093-70e0b14c0d74 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 04:14:17 user nova-compute[103546]: 
Nov 16 04:14:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 -p 172.16.0.220:3260 --login {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:14:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:14:17 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[eadb1be1-ee32-4166-b5e4-404ef8efc21b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:14:17 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-220f4e9f-1054-4e2a-a093-70e0b14c0d74 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597, portal: 172.16.0.220,3260]
Nov 16 04:14:17 user nova-compute[103546]: Login to [iface: default, target: iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597, portal: 172.16.0.220,3260] successful.
Nov 16 04:14:17 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:14:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:14:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:14:17 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[198abc53-338a-424d-8f0b-d6f51b12c89f]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:14:17 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-220f4e9f-1054-4e2a-a093-70e0b14c0d74 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:14:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:14:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:14:17 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a933758f-eff3-4374-93bd-c82cd8192ff1]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:14:17 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-220f4e9f-1054-4e2a-a093-70e0b14c0d74 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 (non-flash)
Nov 16 04:14:17 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:14:17 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-220f4e9f-1054-4e2a-a093-70e0b14c0d74 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 (non-flash)
Nov 16 04:14:17 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:14:17 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-220f4e9f-1054-4e2a-a093-70e0b14c0d74 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:14:17 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-220f4e9f-1054-4e2a-a093-70e0b14c0d74 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 04:14:17 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-220f4e9f-1054-4e2a-a093-70e0b14c0d74 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 04:14:17 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-220f4e9f-1054-4e2a-a093-70e0b14c0d74 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 04:14:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:14:17 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:14:17 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b223f5b0-3520-4662-9041-eca3656c7a5a]: (4, ('- - 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:14:17 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-220f4e9f-1054-4e2a-a093-70e0b14c0d74 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: None {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 04:14:17 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:14:18 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-220f4e9f-1054-4e2a-a093-70e0b14c0d74 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 04:14:18 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-220f4e9f-1054-4e2a-a093-70e0b14c0d74 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gcXYHvZe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 04:14:18 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-220f4e9f-1054-4e2a-a093-70e0b14c0d74 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:14:18 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-220f4e9f-1054-4e2a-a093-70e0b14c0d74 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '26533666465653039', 'path': '/dev/sdb'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:14:18 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-220f4e9f-1054-4e2a-a093-70e0b14c0d74 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533666465653039', 'path': '/dev/sdb'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 04:14:18 user nova-compute[103546]: DEBUG nova.objects.instance [None req-220f4e9f-1054-4e2a-a093-70e0b14c0d74 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Lazy-loading 'flavor' on Instance uuid 2fdca5a2-7e02-4c4a-96ae-cc61547232c1 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:14:18 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-220f4e9f-1054-4e2a-a093-70e0b14c0d74 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 04:14:18 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:14:18 user nova-compute[103546]:   <source dev="/dev/sdb"/>
Nov 16 04:14:18 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 04:14:18 user nova-compute[103546]:   <serial>9e16fa65-da5e-401d-ba7e-de558d1a8597</serial>
Nov 16 04:14:18 user nova-compute[103546]: </disk>
Nov 16 04:14:18 user nova-compute[103546]:  {{(pid=103546) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 04:14:18 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:14:19 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-220f4e9f-1054-4e2a-a093-70e0b14c0d74 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:14:19 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-220f4e9f-1054-4e2a-a093-70e0b14c0d74 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] No BDM found with device name vdb, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:14:19 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-220f4e9f-1054-4e2a-a093-70e0b14c0d74 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] No VIF found with MAC fa:16:3e:f0:c5:13, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 04:14:19 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:14:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-220f4e9f-1054-4e2a-a093-70e0b14c0d74 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Lock "2fdca5a2-7e02-4c4a-96ae-cc61547232c1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.070s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:14:20 user nova-compute[103546]: INFO nova.compute.manager [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Rescuing
Nov 16 04:14:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Acquiring lock "refresh_cache-2fdca5a2-7e02-4c4a-96ae-cc61547232c1" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:14:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Acquired lock "refresh_cache-2fdca5a2-7e02-4c4a-96ae-cc61547232c1" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:14:20 user nova-compute[103546]: DEBUG nova.network.neutron [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 04:14:20 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:14:20 user nova-compute[103546]: DEBUG nova.network.neutron [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Updating instance_info_cache with network_info: [{"id": "9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a", "address": "fa:16:3e:f0:c5:13", "network": {"id": "5f10f091-8358-4c8c-92bb-999d989f26b0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-513865819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18a17119476d4eea9a39078a48af5a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a11f3f3-1a", "ovs_interfaceid": "9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:14:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Releasing lock "refresh_cache-2fdca5a2-7e02-4c4a-96ae-cc61547232c1" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:14:20 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:14:20 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:14:20 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:14:20 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:14:20 user nova-compute[103546]: DEBUG nova.compute.manager [req-aa06b7af-3b40-432a-b9b2-794ddf605cf5 req-0f0f727a-796f-4398-a8dc-bfe012b95624 service nova] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Received event network-vif-unplugged-9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:14:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-aa06b7af-3b40-432a-b9b2-794ddf605cf5 req-0f0f727a-796f-4398-a8dc-bfe012b95624 service nova] Acquiring lock "2fdca5a2-7e02-4c4a-96ae-cc61547232c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:14:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-aa06b7af-3b40-432a-b9b2-794ddf605cf5 req-0f0f727a-796f-4398-a8dc-bfe012b95624 service nova] Lock "2fdca5a2-7e02-4c4a-96ae-cc61547232c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:14:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-aa06b7af-3b40-432a-b9b2-794ddf605cf5 req-0f0f727a-796f-4398-a8dc-bfe012b95624 service nova] Lock "2fdca5a2-7e02-4c4a-96ae-cc61547232c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:14:21 user nova-compute[103546]: DEBUG nova.compute.manager [req-aa06b7af-3b40-432a-b9b2-794ddf605cf5 req-0f0f727a-796f-4398-a8dc-bfe012b95624 service nova] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] No waiting events found dispatching network-vif-unplugged-9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:14:21 user nova-compute[103546]: WARNING nova.compute.manager [req-aa06b7af-3b40-432a-b9b2-794ddf605cf5 req-0f0f727a-796f-4398-a8dc-bfe012b95624 service nova] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Received unexpected event network-vif-unplugged-9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a for instance with vm_state active and task_state rescuing.
Nov 16 04:14:21 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Instance destroyed successfully.
Nov 16 04:14:21 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Attempting a stable device rescue
Nov 16 04:14:21 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=103546) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 16 04:14:21 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Instance directory exists: not creating {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 16 04:14:21 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Creating image(s)
Nov 16 04:14:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Acquiring lock "/opt/stack/data/nova/instances/2fdca5a2-7e02-4c4a-96ae-cc61547232c1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:14:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Lock "/opt/stack/data/nova/instances/2fdca5a2-7e02-4c4a-96ae-cc61547232c1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:14:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Lock "/opt/stack/data/nova/instances/2fdca5a2-7e02-4c4a-96ae-cc61547232c1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:14:21 user nova-compute[103546]: DEBUG nova.objects.instance [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2fdca5a2-7e02-4c4a-96ae-cc61547232c1 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:14:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Acquiring lock "7acc2bd223399694aed68f2794b4a5a6570ce0c5" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:14:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Lock "7acc2bd223399694aed68f2794b4a5a6570ce0c5" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:14:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7acc2bd223399694aed68f2794b4a5a6570ce0c5.part --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:14:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:14:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7acc2bd223399694aed68f2794b4a5a6570ce0c5.part --force-share --output=json" returned: 0 in 0.197s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:14:22 user nova-compute[103546]: DEBUG nova.virt.images [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] f80bdbf5-c38f-4c44-9ea2-79977bbc8b72 was qcow2, converting to raw {{(pid=103546) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 04:14:22 user nova-compute[103546]: DEBUG nova.privsep.utils [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=103546) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 04:14:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7acc2bd223399694aed68f2794b4a5a6570ce0c5.part /opt/stack/data/nova/instances/_base/7acc2bd223399694aed68f2794b4a5a6570ce0c5.converted {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:14:23 user nova-compute[103546]: DEBUG nova.compute.manager [req-9202615f-22d6-4cd5-b0cd-2551841d7142 req-dea2a675-7457-4c61-bcaa-ef2a9953b9ad service nova] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Received event network-vif-plugged-9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:14:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-9202615f-22d6-4cd5-b0cd-2551841d7142 req-dea2a675-7457-4c61-bcaa-ef2a9953b9ad service nova] Acquiring lock "2fdca5a2-7e02-4c4a-96ae-cc61547232c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:14:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-9202615f-22d6-4cd5-b0cd-2551841d7142 req-dea2a675-7457-4c61-bcaa-ef2a9953b9ad service nova] Lock "2fdca5a2-7e02-4c4a-96ae-cc61547232c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:14:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-9202615f-22d6-4cd5-b0cd-2551841d7142 req-dea2a675-7457-4c61-bcaa-ef2a9953b9ad service nova] Lock "2fdca5a2-7e02-4c4a-96ae-cc61547232c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:14:23 user nova-compute[103546]: DEBUG nova.compute.manager [req-9202615f-22d6-4cd5-b0cd-2551841d7142 req-dea2a675-7457-4c61-bcaa-ef2a9953b9ad service nova] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] No waiting events found dispatching network-vif-plugged-9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:14:23 user nova-compute[103546]: WARNING nova.compute.manager [req-9202615f-22d6-4cd5-b0cd-2551841d7142 req-dea2a675-7457-4c61-bcaa-ef2a9953b9ad service nova] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Received unexpected event network-vif-plugged-9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a for instance with vm_state active and task_state rescuing.
Nov 16 04:14:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7acc2bd223399694aed68f2794b4a5a6570ce0c5.part /opt/stack/data/nova/instances/_base/7acc2bd223399694aed68f2794b4a5a6570ce0c5.converted" returned: 0 in 0.495s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:14:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7acc2bd223399694aed68f2794b4a5a6570ce0c5.converted --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:14:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7acc2bd223399694aed68f2794b4a5a6570ce0c5.converted --force-share --output=json" returned: 0 in 0.193s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:14:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Lock "7acc2bd223399694aed68f2794b4a5a6570ce0c5" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.936s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:14:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Acquiring lock "7acc2bd223399694aed68f2794b4a5a6570ce0c5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:14:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Lock "7acc2bd223399694aed68f2794b4a5a6570ce0c5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:14:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7acc2bd223399694aed68f2794b4a5a6570ce0c5 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:14:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7acc2bd223399694aed68f2794b4a5a6570ce0c5 --force-share --output=json" returned: 0 in 0.186s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:14:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7acc2bd223399694aed68f2794b4a5a6570ce0c5,backing_fmt=raw /opt/stack/data/nova/instances/2fdca5a2-7e02-4c4a-96ae-cc61547232c1/disk.rescue {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:14:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7acc2bd223399694aed68f2794b4a5a6570ce0c5,backing_fmt=raw /opt/stack/data/nova/instances/2fdca5a2-7e02-4c4a-96ae-cc61547232c1/disk.rescue" returned: 0 in 0.050s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:14:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Lock "7acc2bd223399694aed68f2794b4a5a6570ce0c5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:14:23 user nova-compute[103546]: DEBUG nova.objects.instance [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Lazy-loading 'migration_context' on Instance uuid 2fdca5a2-7e02-4c4a-96ae-cc61547232c1 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:14:23 user nova-compute[103546]: DEBUG nova.objects.base [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Object Instance<2fdca5a2-7e02-4c4a-96ae-cc61547232c1> lazy-loaded attributes: trusted_certs,migration_context {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 04:14:23 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Created local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 04:14:23 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Start _get_guest_xml network_info=[{"id": "9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a", "address": "fa:16:3e:f0:c5:13", "network": {"id": "5f10f091-8358-4c8c-92bb-999d989f26b0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-513865819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-513865819-network", "vif_mac": "fa:16:3e:f0:c5:13"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18a17119476d4eea9a39078a48af5a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a11f3f3-1a", "ovs_interfaceid": "9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f80bdbf5-c38f-4c44-9ea2-79977bbc8b72', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '5c6f539a-01e5-4478-bf8f-a14310b5d7dd'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gcXYHvZe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '2fdca5a2-7e02-4c4a-96ae-cc61547232c1', 'attached_at': '', 'detached_at': '', 'volume_id': '9e16fa65-da5e-401d-ba7e-de558d1a8597', 'serial': '9e16fa65-da5e-401d-ba7e-de558d1a8597'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'attachment_id': '246d7a44-03c3-491d-85b0-335c9e883856', 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 04:14:23 user nova-compute[103546]: DEBUG nova.objects.instance [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Lazy-loading 'resources' on Instance uuid 2fdca5a2-7e02-4c4a-96ae-cc61547232c1 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:14:23 user nova-compute[103546]: DEBUG nova.objects.base [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Object Instance<2fdca5a2-7e02-4c4a-96ae-cc61547232c1> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 04:14:23 user nova-compute[103546]: DEBUG nova.objects.instance [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Lazy-loading 'numa_topology' on Instance uuid 2fdca5a2-7e02-4c4a-96ae-cc61547232c1 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:14:23 user nova-compute[103546]: DEBUG nova.objects.base [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Object Instance<2fdca5a2-7e02-4c4a-96ae-cc61547232c1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 04:14:23 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:14:23 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:14:23 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 04:14:23 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 04:14:23 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 04:14:23 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 04:14:23 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 04:14:23 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 04:14:23 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 04:14:23 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 04:14:23 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 04:14:23 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 04:14:23 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 04:14:23 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 04:14:23 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 04:14:23 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 04:14:23 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 04:14:23 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 04:14:23 user nova-compute[103546]: DEBUG nova.objects.instance [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2fdca5a2-7e02-4c4a-96ae-cc61547232c1 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:14:23 user nova-compute[103546]: DEBUG nova.objects.base [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Object Instance<2fdca5a2-7e02-4c4a-96ae-cc61547232c1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 04:14:23 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 04:14:23 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gcXYHvZe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:14:23 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:14:23 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:14:23 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:14:23 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:14:23 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:14:23 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:14:23 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 04:14:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:14:23 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:14:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 -p 172.16.0.220:3260" returned: 0 in 0.028s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:14:23 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb353865-3bf8-4417-8780-f614ba016e65]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = gcXYHvZe\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:14:23 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 16 04:14:23 user nova-compute[103546]: node.name = iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597
Nov 16 04:14:23 user nova-compute[103546]: node.tpgt = -1
Nov 16 04:14:23 user nova-compute[103546]: node.startup = automatic
Nov 16 04:14:23 user nova-compute[103546]: node.leading_login = No
Nov 16 04:14:23 user nova-compute[103546]: iface.iscsi_ifacename = default
Nov 16 04:14:23 user nova-compute[103546]: iface.net_ifacename = <empty>
Nov 16 04:14:23 user nova-compute[103546]: iface.ipaddress = <empty>
Nov 16 04:14:23 user nova-compute[103546]: iface.prefix_len = 0
Nov 16 04:14:23 user nova-compute[103546]: iface.hwaddress = <empty>
Nov 16 04:14:23 user nova-compute[103546]: iface.transport_name = tcp
Nov 16 04:14:23 user nova-compute[103546]: iface.initiatorname = <empty>
Nov 16 04:14:23 user nova-compute[103546]: iface.state = <empty>
Nov 16 04:14:23 user nova-compute[103546]: iface.vlan_id = 0
Nov 16 04:14:23 user nova-compute[103546]: iface.vlan_priority = 0
Nov 16 04:14:23 user nova-compute[103546]: iface.vlan_state = <empty>
Nov 16 04:14:23 user nova-compute[103546]: iface.iface_num = 0
Nov 16 04:14:23 user nova-compute[103546]: iface.mtu = 0
Nov 16 04:14:23 user nova-compute[103546]: iface.port = 0
Nov 16 04:14:23 user nova-compute[103546]: iface.bootproto = <empty>
Nov 16 04:14:23 user nova-compute[103546]: iface.subnet_mask = <empty>
Nov 16 04:14:23 user nova-compute[103546]: iface.gateway = <empty>
Nov 16 04:14:23 user nova-compute[103546]: iface.dhcp_alt_client_id_state = <empty>
Nov 16 04:14:23 user nova-compute[103546]: iface.dhcp_alt_client_id = <empty>
Nov 16 04:14:23 user nova-compute[103546]: iface.dhcp_dns = <empty>
Nov 16 04:14:23 user nova-compute[103546]: iface.dhcp_learn_iqn = <empty>
Nov 16 04:14:23 user nova-compute[103546]: iface.dhcp_req_vendor_id_state = <empty>
Nov 16 04:14:23 user nova-compute[103546]: iface.dhcp_vendor_id_state = <empty>
Nov 16 04:14:23 user nova-compute[103546]: iface.dhcp_vendor_id = <empty>
Nov 16 04:14:23 user nova-compute[103546]: iface.dhcp_slp_da = <empty>
Nov 16 04:14:23 user nova-compute[103546]: iface.fragmentation = <empty>
Nov 16 04:14:23 user nova-compute[103546]: iface.gratuitous_arp = <empty>
Nov 16 04:14:23 user nova-compute[103546]: iface.incoming_forwarding = <empty>
Nov 16 04:14:23 user nova-compute[103546]: iface.tos_state = <empty>
Nov 16 04:14:23 user nova-compute[103546]: iface.tos = 0
Nov 16 04:14:23 user nova-compute[103546]: iface.ttl = 0
Nov 16 04:14:23 user nova-compute[103546]: iface.delayed_ack = <empty>
Nov 16 04:14:23 user nova-compute[103546]: iface.tcp_nagle = <empty>
Nov 16 04:14:23 user nova-compute[103546]: iface.tcp_wsf_state = <empty>
Nov 16 04:14:23 user nova-compute[103546]: iface.tcp_wsf = 0
Nov 16 04:14:23 user nova-compute[103546]: iface.tcp_timer_scale = 0
Nov 16 04:14:23 user nova-compute[103546]: iface.tcp_timestamp = <empty>
Nov 16 04:14:23 user nova-compute[103546]: iface.redirect = <empty>
Nov 16 04:14:23 user nova-compute[103546]: iface.def_task_mgmt_timeout = 0
Nov 16 04:14:23 user nova-compute[103546]: iface.header_digest = <empty>
Nov 16 04:14:23 user nova-compute[103546]: iface.data_digest = <empty>
Nov 16 04:14:23 user nova-compute[103546]: iface.immediate_data = <empty>
Nov 16 04:14:23 user nova-compute[103546]: iface.initial_r2t = <empty>
Nov 16 04:14:23 user nova-compute[103546]: iface.data_seq_inorder = <empty>
Nov 16 04:14:23 user nova-compute[103546]: iface.data_pdu_inorder = <empty>
Nov 16 04:14:23 user nova-compute[103546]: iface.erl = 0
Nov 16 04:14:23 user nova-compute[103546]: iface.max_receive_data_len = 0
Nov 16 04:14:23 user nova-compute[103546]: iface.first_burst_len = 0
Nov 16 04:14:23 user nova-compute[103546]: iface.max_outstanding_r2t = 0
Nov 16 04:14:23 user nova-compute[103546]: iface.max_burst_len = 0
Nov 16 04:14:23 user nova-compute[103546]: iface.chap_auth = <empty>
Nov 16 04:14:23 user nova-compute[103546]: iface.bidi_chap = <empty>
Nov 16 04:14:23 user nova-compute[103546]: iface.strict_login_compliance = <empty>
Nov 16 04:14:23 user nova-compute[103546]: iface.discovery_auth = <empty>
Nov 16 04:14:23 user nova-compute[103546]: iface.discovery_logout = <empty>
Nov 16 04:14:23 user nova-compute[103546]: node.discovery_address = <empty>
Nov 16 04:14:23 user nova-compute[103546]: node.discovery_port = 0
Nov 16 04:14:23 user nova-compute[103546]: node.discovery_type = static
Nov 16 04:14:23 user nova-compute[103546]: node.session.initial_cmdsn = 0
Nov 16 04:14:23 user nova-compute[103546]: node.session.initial_login_retry_max = 8
Nov 16 04:14:23 user nova-compute[103546]: node.session.xmit_thread_priority = -20
Nov 16 04:14:23 user nova-compute[103546]: node.session.cmds_max = 128
Nov 16 04:14:23 user nova-compute[103546]: node.session.queue_depth = 32
Nov 16 04:14:23 user nova-compute[103546]: node.session.nr_sessions = 1
Nov 16 04:14:23 user nova-compute[103546]: node.session.auth.authmethod = CHAP
Nov 16 04:14:23 user nova-compute[103546]: node.session.auth.username = gcXYHvZe
Nov 16 04:14:23 user nova-compute[103546]: node.session.auth.password = ***
Nov 16 04:14:23 user nova-compute[103546]: node.session.auth.username_in = <empty>
Nov 16 04:14:23 user nova-compute[103546]: node.session.auth.password_in = <empty>
Nov 16 04:14:23 user nova-compute[103546]: node.session.auth.chap_algs = MD5
Nov 16 04:14:23 user nova-compute[103546]: node.session.timeo.replacement_timeout = 120
Nov 16 04:14:23 user nova-compute[103546]: node.session.err_timeo.abort_timeout = 15
Nov 16 04:14:23 user nova-compute[103546]: node.session.err_timeo.lu_reset_timeout = 30
Nov 16 04:14:23 user nova-compute[103546]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 16 04:14:23 user nova-compute[103546]: node.session.err_timeo.host_reset_timeout = 60
Nov 16 04:14:23 user nova-compute[103546]: node.session.iscsi.FastAbort = Yes
Nov 16 04:14:23 user nova-compute[103546]: node.session.iscsi.InitialR2T = No
Nov 16 04:14:23 user nova-compute[103546]: node.session.iscsi.ImmediateData = Yes
Nov 16 04:14:23 user nova-compute[103546]: node.session.iscsi.FirstBurstLength = 262144
Nov 16 04:14:23 user nova-compute[103546]: node.session.iscsi.MaxBurstLength = 16776192
Nov 16 04:14:23 user nova-compute[103546]: node.session.iscsi.DefaultTime2Retain = 0
Nov 16 04:14:23 user nova-compute[103546]: node.session.iscsi.DefaultTime2Wait = 2
Nov 16 04:14:23 user nova-compute[103546]: node.session.iscsi.MaxConnections = 1
Nov 16 04:14:23 user nova-compute[103546]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 16 04:14:23 user nova-compute[103546]: node.session.iscsi.ERL = 0
Nov 16 04:14:23 user nova-compute[103546]: node.session.scan = manual
Nov 16 04:14:23 user nova-compute[103546]: node.session.reopen_max = 0
Nov 16 04:14:23 user nova-compute[103546]: node.conn[0].address = 172.16.0.220
Nov 16 04:14:23 user nova-compute[103546]: node.conn[0].port = 3260
Nov 16 04:14:23 user nova-compute[103546]: node.conn[0].startup = manual
Nov 16 04:14:23 user nova-compute[103546]: node.conn[0].tcp.window_size = 524288
Nov 16 04:14:23 user nova-compute[103546]: node.conn[0].tcp.type_of_service = 0
Nov 16 04:14:23 user nova-compute[103546]: node.conn[0].timeo.logout_timeout = 15
Nov 16 04:14:23 user nova-compute[103546]: node.conn[0].timeo.login_timeout = 15
Nov 16 04:14:23 user nova-compute[103546]: node.conn[0].timeo.auth_timeout = 45
Nov 16 04:14:23 user nova-compute[103546]: node.conn[0].timeo.noop_out_interval = 5
Nov 16 04:14:23 user nova-compute[103546]: node.conn[0].timeo.noop_out_timeout = 5
Nov 16 04:14:23 user nova-compute[103546]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 16 04:14:23 user nova-compute[103546]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 16 04:14:23 user nova-compute[103546]: node.conn[0].iscsi.HeaderDigest = None
Nov 16 04:14:23 user nova-compute[103546]: node.conn[0].iscsi.DataDigest = None
Nov 16 04:14:23 user nova-compute[103546]: node.conn[0].iscsi.IFMarker = No
Nov 16 04:14:23 user nova-compute[103546]: node.conn[0].iscsi.OFMarker = No
Nov 16 04:14:23 user nova-compute[103546]: # END RECORD
Nov 16 04:14:23 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:14:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:14:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:14:23 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ef0241-52e7-44c6-ad68-438f951f40f8]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:14:23 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:14:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:14:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:14:24 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f179cd47-5421-44fe-9c78-85ec7d66bfb2]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:14:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:14:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gcXYHvZe {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:14:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gcXYHvZe" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:14:24 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[09624e6b-af3d-4466-a793-aaff00b6a48a]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:14:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gcXYHvZe'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:14:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:14:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:14:24 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b07c4e-3a8d-4695-90b3-5a2c25f80f6c]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:14:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:14:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:14:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:14:24 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6372f64-656e-4a69-bbc4-3d826bbd5f36]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:14:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 (non-flash)
Nov 16 04:14:24 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:14:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 (non-flash)
Nov 16 04:14:24 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:14:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.171s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:14:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 04:14:24 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] HCTL ('33', '0', '0', 0) found on session 55 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 04:14:24 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 04:14:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:14:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.013s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:14:24 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5aac7f4-40b4-4650-bc1c-f27409cfcce8]: (4, ('0 0 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:14:24 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Searching for a device in session 55 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 04:14:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gcXYHvZe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 04:14:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.194s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:14:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] <== connect_volume: return (195ms) {'type': 'block', 'scsi_wwn': '26533666465653039', 'path': '/dev/sdb'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:14:24 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533666465653039', 'path': '/dev/sdb'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 04:14:24 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Acquiring lock "a276ab3f-657a-4148-bd08-007f79230ace" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:14:24 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lock "a276ab3f-657a-4148-bd08-007f79230ace" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:14:24 user nova-compute[103546]: DEBUG nova.compute.manager [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Starting instance... {{(pid=103546) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 04:14:24 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:10:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1044774600',display_name='tempest-ServerStableDeviceRescueTest-server-1044774600',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1044774600',id=46,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNj1JcuBCA8b1ASnZxEflVqxgwfGpOs0NT6q9GQ5ZSTNz5RgrGMdfc/dVQXXiVOxcYts+JD3hMifKvk9y98rW6TatUxDOWAmZ3/8ty/1zZeWm+ytAI6z5EPvdNn6qG4xhQ==',key_name='tempest-keypair-218434465',keypairs=<?>,launch_index=0,launched_at=2023-11-16T04:10:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='18a17119476d4eea9a39078a48af5a56',ramdisk_id='',reservation_id='r-tkm2shtw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-195956273',owner_user_name='tempest-ServerStableDeviceRescueTest-195956273-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T04:12:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8d2d54f82e5409d8c45166c3379b08f',uuid=2fdca5a2-7e02-4c4a-96ae-cc61547232c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a", "address": "fa:16:3e:f0:c5:13", "network": {"id": "5f10f091-8358-4c8c-92bb-999d989f26b0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-513865819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-513865819-network", "vif_mac": "fa:16:3e:f0:c5:13"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18a17119476d4eea9a39078a48af5a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a11f3f3-1a", "ovs_interfaceid": "9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 04:14:24 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Converting VIF {"id": "9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a", "address": "fa:16:3e:f0:c5:13", "network": {"id": "5f10f091-8358-4c8c-92bb-999d989f26b0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-513865819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-513865819-network", "vif_mac": "fa:16:3e:f0:c5:13"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18a17119476d4eea9a39078a48af5a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a11f3f3-1a", "ovs_interfaceid": "9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:14:24 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:c5:13,bridge_name='br-int',has_traffic_filtering=True,id=9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a,network=Network(5f10f091-8358-4c8c-92bb-999d989f26b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a11f3f3-1a') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:14:24 user nova-compute[103546]: DEBUG nova.objects.instance [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Lazy-loading 'pci_devices' on Instance uuid 2fdca5a2-7e02-4c4a-96ae-cc61547232c1 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:14:24 user nova-compute[103546]: DEBUG nova.objects.base [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Object Instance<2fdca5a2-7e02-4c4a-96ae-cc61547232c1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=103546) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 04:14:24 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] End _get_guest_xml xml=<domain type="kvm">
Nov 16 04:14:24 user nova-compute[103546]:   <uuid>2fdca5a2-7e02-4c4a-96ae-cc61547232c1</uuid>
Nov 16 04:14:24 user nova-compute[103546]:   <name>instance-0000002e</name>
Nov 16 04:14:24 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 04:14:24 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 04:14:24 user nova-compute[103546]:   <metadata>
Nov 16 04:14:24 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 04:14:24 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 04:14:24 user nova-compute[103546]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1044774600</nova:name>
Nov 16 04:14:24 user nova-compute[103546]:       <nova:creationTime>2023-11-16 04:14:23</nova:creationTime>
Nov 16 04:14:24 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 04:14:24 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 04:14:24 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 04:14:24 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 04:14:24 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 04:14:24 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 04:14:24 user nova-compute[103546]:       </nova:flavor>
Nov 16 04:14:24 user nova-compute[103546]:       <nova:owner>
Nov 16 04:14:24 user nova-compute[103546]:         <nova:user uuid="d8d2d54f82e5409d8c45166c3379b08f">tempest-ServerStableDeviceRescueTest-195956273-project-member</nova:user>
Nov 16 04:14:24 user nova-compute[103546]:         <nova:project uuid="18a17119476d4eea9a39078a48af5a56">tempest-ServerStableDeviceRescueTest-195956273</nova:project>
Nov 16 04:14:24 user nova-compute[103546]:       </nova:owner>
Nov 16 04:14:24 user nova-compute[103546]:       <nova:root type="image" uuid="5c6f539a-01e5-4478-bf8f-a14310b5d7dd"/>
Nov 16 04:14:24 user nova-compute[103546]:       <nova:ports>
Nov 16 04:14:24 user nova-compute[103546]:         <nova:port uuid="9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a">
Nov 16 04:14:24 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 04:14:24 user nova-compute[103546]:         </nova:port>
Nov 16 04:14:24 user nova-compute[103546]:       </nova:ports>
Nov 16 04:14:24 user nova-compute[103546]:     </nova:instance>
Nov 16 04:14:24 user nova-compute[103546]:   </metadata>
Nov 16 04:14:24 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 04:14:24 user nova-compute[103546]:     <system>
Nov 16 04:14:24 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 04:14:24 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 04:14:24 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 04:14:24 user nova-compute[103546]:       <entry name="serial">2fdca5a2-7e02-4c4a-96ae-cc61547232c1</entry>
Nov 16 04:14:24 user nova-compute[103546]:       <entry name="uuid">2fdca5a2-7e02-4c4a-96ae-cc61547232c1</entry>
Nov 16 04:14:24 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 04:14:24 user nova-compute[103546]:     </system>
Nov 16 04:14:24 user nova-compute[103546]:   </sysinfo>
Nov 16 04:14:24 user nova-compute[103546]:   <os>
Nov 16 04:14:24 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 04:14:24 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 04:14:24 user nova-compute[103546]:   </os>
Nov 16 04:14:24 user nova-compute[103546]:   <features>
Nov 16 04:14:24 user nova-compute[103546]:     <acpi/>
Nov 16 04:14:24 user nova-compute[103546]:     <apic/>
Nov 16 04:14:24 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 04:14:24 user nova-compute[103546]:   </features>
Nov 16 04:14:24 user nova-compute[103546]:   <clock offset="utc">
Nov 16 04:14:24 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 04:14:24 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 04:14:24 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 04:14:24 user nova-compute[103546]:   </clock>
Nov 16 04:14:24 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 04:14:24 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 04:14:24 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 04:14:24 user nova-compute[103546]:   </cpu>
Nov 16 04:14:24 user nova-compute[103546]:   <devices>
Nov 16 04:14:24 user nova-compute[103546]:     <disk type="file" device="disk">
Nov 16 04:14:24 user nova-compute[103546]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 04:14:24 user nova-compute[103546]:       <source file="/opt/stack/data/nova/instances/2fdca5a2-7e02-4c4a-96ae-cc61547232c1/disk"/>
Nov 16 04:14:24 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 04:14:24 user nova-compute[103546]:     </disk>
Nov 16 04:14:24 user nova-compute[103546]:     <disk type="block" device="disk">
Nov 16 04:14:24 user nova-compute[103546]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:14:24 user nova-compute[103546]:       <source dev="/dev/sdb"/>
Nov 16 04:14:24 user nova-compute[103546]:       <target dev="vdb" bus="virtio"/>
Nov 16 04:14:24 user nova-compute[103546]:       <serial>9e16fa65-da5e-401d-ba7e-de558d1a8597</serial>
Nov 16 04:14:24 user nova-compute[103546]:     </disk>
Nov 16 04:14:24 user nova-compute[103546]:     <disk type="file" device="disk">
Nov 16 04:14:24 user nova-compute[103546]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 04:14:24 user nova-compute[103546]:       <source file="/opt/stack/data/nova/instances/2fdca5a2-7e02-4c4a-96ae-cc61547232c1/disk.rescue"/>
Nov 16 04:14:24 user nova-compute[103546]:       <target dev="vdc" bus="virtio"/>
Nov 16 04:14:24 user nova-compute[103546]:       <boot order="1"/>
Nov 16 04:14:24 user nova-compute[103546]:     </disk>
Nov 16 04:14:24 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 04:14:24 user nova-compute[103546]:       <mac address="fa:16:3e:f0:c5:13"/>
Nov 16 04:14:24 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 04:14:24 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 04:14:24 user nova-compute[103546]:       <target dev="tap9a11f3f3-1a"/>
Nov 16 04:14:24 user nova-compute[103546]:     </interface>
Nov 16 04:14:24 user nova-compute[103546]:     <serial type="pty">
Nov 16 04:14:24 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/2fdca5a2-7e02-4c4a-96ae-cc61547232c1/console.log" append="off"/>
Nov 16 04:14:24 user nova-compute[103546]:     </serial>
Nov 16 04:14:24 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 04:14:24 user nova-compute[103546]:     <video>
Nov 16 04:14:24 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 04:14:24 user nova-compute[103546]:     </video>
Nov 16 04:14:24 user nova-compute[103546]:     <rng model="virtio">
Nov 16 04:14:24 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 04:14:24 user nova-compute[103546]:     </rng>
Nov 16 04:14:24 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 04:14:24 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 04:14:24 user nova-compute[103546]:       <stats period="10"/>
Nov 16 04:14:24 user nova-compute[103546]:     </memballoon>
Nov 16 04:14:24 user nova-compute[103546]:   </devices>
Nov 16 04:14:24 user nova-compute[103546]: </domain>
Nov 16 04:14:24 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 04:14:24 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Instance destroyed successfully.
Nov 16 04:14:24 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:14:24 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:14:24 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:14:24 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=103546) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 04:14:24 user nova-compute[103546]: INFO nova.compute.claims [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Claim successful on node user
Nov 16 04:14:24 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:14:24 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] No BDM found with device name vdb, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:14:24 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] No BDM found with device name vdc, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:14:24 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] No VIF found with MAC fa:16:3e:f0:c5:13, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 04:14:24 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:14:24 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:14:24 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.332s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:14:24 user nova-compute[103546]: DEBUG nova.compute.manager [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Start building networks asynchronously for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 04:14:24 user nova-compute[103546]: DEBUG nova.compute.manager [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Allocating IP information in the background. {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 04:14:24 user nova-compute[103546]: DEBUG nova.network.neutron [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: a276ab3f-657a-4148-bd08-007f79230ace] allocate_for_instance() {{(pid=103546) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 04:14:24 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 04:14:24 user nova-compute[103546]: DEBUG nova.compute.manager [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Start building block device mappings for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 04:14:24 user nova-compute[103546]: DEBUG nova.policy [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd11cfaa98a7a427bbda21bc38ddba079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21df2cbfb9234c13a504ad4a513970f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103546) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 04:14:24 user nova-compute[103546]: DEBUG nova.compute.manager [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Start spawning the instance on the hypervisor. {{(pid=103546) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 04:14:24 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Creating instance directory {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 04:14:24 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Creating image(s)
Nov 16 04:14:24 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Acquiring lock "/opt/stack/data/nova/instances/a276ab3f-657a-4148-bd08-007f79230ace/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:14:24 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lock "/opt/stack/data/nova/instances/a276ab3f-657a-4148-bd08-007f79230ace/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:14:24 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lock "/opt/stack/data/nova/instances/a276ab3f-657a-4148-bd08-007f79230ace/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:14:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:14:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.176s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:14:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Acquiring lock "8c9efafb670bfe5842ba1f4ce398924612164af7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:14:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:14:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:14:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.176s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:14:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/a276ab3f-657a-4148-bd08-007f79230ace/disk 1073741824 {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:14:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/a276ab3f-657a-4148-bd08-007f79230ace/disk 1073741824" returned: 0 in 0.055s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:14:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:14:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:14:25 user nova-compute[103546]: DEBUG nova.network.neutron [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Successfully created port: b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3 {{(pid=103546) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 04:14:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.196s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:14:25 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a276ab3f-657a-4148-bd08-007f79230ace/disk. size=1073741824 {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 04:14:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a276ab3f-657a-4148-bd08-007f79230ace/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:14:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a276ab3f-657a-4148-bd08-007f79230ace/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:14:25 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Cannot resize image /opt/stack/data/nova/instances/a276ab3f-657a-4148-bd08-007f79230ace/disk to a smaller size. {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 04:14:25 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Created local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 04:14:25 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Ensure instance console log exists: /opt/stack/data/nova/instances/a276ab3f-657a-4148-bd08-007f79230ace/console.log {{(pid=103546) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 04:14:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:14:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:14:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:14:25 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:14:25 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:14:25 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:14:25 user nova-compute[103546]: DEBUG nova.compute.manager [req-5144c01a-9e1d-4666-a219-64aeccd8b0e0 req-a2f03525-d82a-4b57-a40e-84c2ea2577b9 service nova] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Received event network-vif-plugged-9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:14:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-5144c01a-9e1d-4666-a219-64aeccd8b0e0 req-a2f03525-d82a-4b57-a40e-84c2ea2577b9 service nova] Acquiring lock "2fdca5a2-7e02-4c4a-96ae-cc61547232c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:14:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-5144c01a-9e1d-4666-a219-64aeccd8b0e0 req-a2f03525-d82a-4b57-a40e-84c2ea2577b9 service nova] Lock "2fdca5a2-7e02-4c4a-96ae-cc61547232c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:14:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-5144c01a-9e1d-4666-a219-64aeccd8b0e0 req-a2f03525-d82a-4b57-a40e-84c2ea2577b9 service nova] Lock "2fdca5a2-7e02-4c4a-96ae-cc61547232c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:14:25 user nova-compute[103546]: DEBUG nova.compute.manager [req-5144c01a-9e1d-4666-a219-64aeccd8b0e0 req-a2f03525-d82a-4b57-a40e-84c2ea2577b9 service nova] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] No waiting events found dispatching network-vif-plugged-9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:14:25 user nova-compute[103546]: WARNING nova.compute.manager [req-5144c01a-9e1d-4666-a219-64aeccd8b0e0 req-a2f03525-d82a-4b57-a40e-84c2ea2577b9 service nova] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Received unexpected event network-vif-plugged-9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a for instance with vm_state active and task_state rescuing.
Nov 16 04:14:26 user nova-compute[103546]: DEBUG nova.network.neutron [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Successfully updated port: b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3 {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 04:14:26 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Acquiring lock "refresh_cache-a276ab3f-657a-4148-bd08-007f79230ace" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:14:26 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Acquired lock "refresh_cache-a276ab3f-657a-4148-bd08-007f79230ace" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:14:26 user nova-compute[103546]: DEBUG nova.network.neutron [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 04:14:26 user nova-compute[103546]: DEBUG nova.compute.manager [req-3df7a1f2-d9e2-4f6d-b8c7-d554d38e2efc req-e736c404-514c-4ef8-9615-41a4706c8b92 service nova] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Received event network-changed-b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:14:26 user nova-compute[103546]: DEBUG nova.compute.manager [req-3df7a1f2-d9e2-4f6d-b8c7-d554d38e2efc req-e736c404-514c-4ef8-9615-41a4706c8b92 service nova] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Refreshing instance network info cache due to event network-changed-b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 04:14:26 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3df7a1f2-d9e2-4f6d-b8c7-d554d38e2efc req-e736c404-514c-4ef8-9615-41a4706c8b92 service nova] Acquiring lock "refresh_cache-a276ab3f-657a-4148-bd08-007f79230ace" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:14:26 user nova-compute[103546]: DEBUG nova.network.neutron [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 04:14:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:14:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:14:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:14:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:14:26 user nova-compute[103546]: DEBUG nova.network.neutron [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Updating instance_info_cache with network_info: [{"id": "b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3", "address": "fa:16:3e:52:f7:34", "network": {"id": "a758762c-c27c-4509-9870-1d42187aeaf4", "bridge": "br-int", "label": "tempest-TestStampPattern-405695915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21df2cbfb9234c13a504ad4a513970f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9fb2a6f-ec", "ovs_interfaceid": "b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:14:26 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Releasing lock "refresh_cache-a276ab3f-657a-4148-bd08-007f79230ace" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:14:26 user nova-compute[103546]: DEBUG nova.compute.manager [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Instance network_info: |[{"id": "b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3", "address": "fa:16:3e:52:f7:34", "network": {"id": "a758762c-c27c-4509-9870-1d42187aeaf4", "bridge": "br-int", "label": "tempest-TestStampPattern-405695915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21df2cbfb9234c13a504ad4a513970f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9fb2a6f-ec", "ovs_interfaceid": "b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 04:14:26 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3df7a1f2-d9e2-4f6d-b8c7-d554d38e2efc req-e736c404-514c-4ef8-9615-41a4706c8b92 service nova] Acquired lock "refresh_cache-a276ab3f-657a-4148-bd08-007f79230ace" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:14:26 user nova-compute[103546]: DEBUG nova.network.neutron [req-3df7a1f2-d9e2-4f6d-b8c7-d554d38e2efc req-e736c404-514c-4ef8-9615-41a4706c8b92 service nova] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Refreshing network info cache for port b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 04:14:26 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Start _get_guest_xml network_info=[{"id": "b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3", "address": "fa:16:3e:52:f7:34", "network": {"id": "a758762c-c27c-4509-9870-1d42187aeaf4", "bridge": "br-int", "label": "tempest-TestStampPattern-405695915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21df2cbfb9234c13a504ad4a513970f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9fb2a6f-ec", "ovs_interfaceid": "b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '5c6f539a-01e5-4478-bf8f-a14310b5d7dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 04:14:26 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:14:26 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:14:26 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 04:14:26 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 04:14:26 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 04:14:26 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 04:14:26 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 04:14:26 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 04:14:26 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 04:14:26 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 04:14:26 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 04:14:26 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 04:14:26 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 04:14:26 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 04:14:26 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 04:14:26 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 04:14:26 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 04:14:26 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 04:14:26 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:14:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-818214812',display_name='tempest-TestStampPattern-server-818214812',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-818214812',id=50,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMD4VeEQuyJQyIGByr5hnPNM80o5OzPF3CeZqlbvdjIFKuOQFbXyRn3ly86qjzEqmVlnZHqKHtk99JTBXYtTMc0ItAcSuqq3ptLxvKqOk9JWyorrPApaaM7CXlXFiNx/Q==',key_name='tempest-TestStampPattern-780202401',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21df2cbfb9234c13a504ad4a513970f3',ramdisk_id='',reservation_id='r-hzkzr248',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1443950495',owner_user_name='tempest-TestStampPattern-1443950495-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T04:14:25Z,user_data=None,user_id='d11cfaa98a7a427bbda21bc38ddba079',uuid=a276ab3f-657a-4148-bd08-007f79230ace,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3", "address": "fa:16:3e:52:f7:34", "network": {"id": "a758762c-c27c-4509-9870-1d42187aeaf4", "bridge": "br-int", "label": "tempest-TestStampPattern-405695915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21df2cbfb9234c13a504ad4a513970f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9fb2a6f-ec", "ovs_interfaceid": "b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 04:14:26 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Converting VIF {"id": "b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3", "address": "fa:16:3e:52:f7:34", "network": {"id": "a758762c-c27c-4509-9870-1d42187aeaf4", "bridge": "br-int", "label": "tempest-TestStampPattern-405695915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21df2cbfb9234c13a504ad4a513970f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9fb2a6f-ec", "ovs_interfaceid": "b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:14:26 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:f7:34,bridge_name='br-int',has_traffic_filtering=True,id=b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3,network=Network(a758762c-c27c-4509-9870-1d42187aeaf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9fb2a6f-ec') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:14:26 user nova-compute[103546]: DEBUG nova.objects.instance [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lazy-loading 'pci_devices' on Instance uuid a276ab3f-657a-4148-bd08-007f79230ace {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:14:26 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: a276ab3f-657a-4148-bd08-007f79230ace] End _get_guest_xml xml=<domain type="kvm">
Nov 16 04:14:26 user nova-compute[103546]:   <uuid>a276ab3f-657a-4148-bd08-007f79230ace</uuid>
Nov 16 04:14:26 user nova-compute[103546]:   <name>instance-00000032</name>
Nov 16 04:14:26 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 04:14:26 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 04:14:26 user nova-compute[103546]:   <metadata>
Nov 16 04:14:26 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 04:14:26 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 04:14:26 user nova-compute[103546]:       <nova:name>tempest-TestStampPattern-server-818214812</nova:name>
Nov 16 04:14:26 user nova-compute[103546]:       <nova:creationTime>2023-11-16 04:14:26</nova:creationTime>
Nov 16 04:14:26 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 04:14:26 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 04:14:26 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 04:14:26 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 04:14:26 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 04:14:26 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 04:14:26 user nova-compute[103546]:       </nova:flavor>
Nov 16 04:14:26 user nova-compute[103546]:       <nova:owner>
Nov 16 04:14:26 user nova-compute[103546]:         <nova:user uuid="d11cfaa98a7a427bbda21bc38ddba079">tempest-TestStampPattern-1443950495-project-member</nova:user>
Nov 16 04:14:26 user nova-compute[103546]:         <nova:project uuid="21df2cbfb9234c13a504ad4a513970f3">tempest-TestStampPattern-1443950495</nova:project>
Nov 16 04:14:26 user nova-compute[103546]:       </nova:owner>
Nov 16 04:14:26 user nova-compute[103546]:       <nova:root type="image" uuid="5c6f539a-01e5-4478-bf8f-a14310b5d7dd"/>
Nov 16 04:14:26 user nova-compute[103546]:       <nova:ports>
Nov 16 04:14:26 user nova-compute[103546]:         <nova:port uuid="b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3">
Nov 16 04:14:26 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 16 04:14:26 user nova-compute[103546]:         </nova:port>
Nov 16 04:14:26 user nova-compute[103546]:       </nova:ports>
Nov 16 04:14:26 user nova-compute[103546]:     </nova:instance>
Nov 16 04:14:26 user nova-compute[103546]:   </metadata>
Nov 16 04:14:26 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 04:14:26 user nova-compute[103546]:     <system>
Nov 16 04:14:26 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 04:14:26 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 04:14:26 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 04:14:26 user nova-compute[103546]:       <entry name="serial">a276ab3f-657a-4148-bd08-007f79230ace</entry>
Nov 16 04:14:26 user nova-compute[103546]:       <entry name="uuid">a276ab3f-657a-4148-bd08-007f79230ace</entry>
Nov 16 04:14:26 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 04:14:26 user nova-compute[103546]:     </system>
Nov 16 04:14:26 user nova-compute[103546]:   </sysinfo>
Nov 16 04:14:26 user nova-compute[103546]:   <os>
Nov 16 04:14:26 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 04:14:26 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 04:14:26 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 04:14:26 user nova-compute[103546]:   </os>
Nov 16 04:14:26 user nova-compute[103546]:   <features>
Nov 16 04:14:26 user nova-compute[103546]:     <acpi/>
Nov 16 04:14:26 user nova-compute[103546]:     <apic/>
Nov 16 04:14:26 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 04:14:26 user nova-compute[103546]:   </features>
Nov 16 04:14:26 user nova-compute[103546]:   <clock offset="utc">
Nov 16 04:14:26 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 04:14:26 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 04:14:26 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 04:14:26 user nova-compute[103546]:   </clock>
Nov 16 04:14:26 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 04:14:26 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 04:14:26 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 04:14:26 user nova-compute[103546]:   </cpu>
Nov 16 04:14:26 user nova-compute[103546]:   <devices>
Nov 16 04:14:26 user nova-compute[103546]:     <disk type="file" device="disk">
Nov 16 04:14:26 user nova-compute[103546]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 04:14:26 user nova-compute[103546]:       <source file="/opt/stack/data/nova/instances/a276ab3f-657a-4148-bd08-007f79230ace/disk"/>
Nov 16 04:14:26 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 04:14:26 user nova-compute[103546]:     </disk>
Nov 16 04:14:26 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 04:14:26 user nova-compute[103546]:       <mac address="fa:16:3e:52:f7:34"/>
Nov 16 04:14:26 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 04:14:26 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 04:14:26 user nova-compute[103546]:       <target dev="tapb9fb2a6f-ec"/>
Nov 16 04:14:26 user nova-compute[103546]:     </interface>
Nov 16 04:14:26 user nova-compute[103546]:     <serial type="pty">
Nov 16 04:14:26 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/a276ab3f-657a-4148-bd08-007f79230ace/console.log" append="off"/>
Nov 16 04:14:26 user nova-compute[103546]:     </serial>
Nov 16 04:14:26 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 04:14:26 user nova-compute[103546]:     <video>
Nov 16 04:14:26 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 04:14:26 user nova-compute[103546]:     </video>
Nov 16 04:14:26 user nova-compute[103546]:     <rng model="virtio">
Nov 16 04:14:26 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 04:14:26 user nova-compute[103546]:     </rng>
Nov 16 04:14:26 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 04:14:26 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 04:14:26 user nova-compute[103546]:       <stats period="10"/>
Nov 16 04:14:26 user nova-compute[103546]:     </memballoon>
Nov 16 04:14:26 user nova-compute[103546]:   </devices>
Nov 16 04:14:26 user nova-compute[103546]: </domain>
Nov 16 04:14:26 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 04:14:26 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:14:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-818214812',display_name='tempest-TestStampPattern-server-818214812',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-818214812',id=50,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMD4VeEQuyJQyIGByr5hnPNM80o5OzPF3CeZqlbvdjIFKuOQFbXyRn3ly86qjzEqmVlnZHqKHtk99JTBXYtTMc0ItAcSuqq3ptLxvKqOk9JWyorrPApaaM7CXlXFiNx/Q==',key_name='tempest-TestStampPattern-780202401',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21df2cbfb9234c13a504ad4a513970f3',ramdisk_id='',reservation_id='r-hzkzr248',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1443950495',owner_user_name='tempest-TestStampPattern-1443950495-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T04:14:25Z,user_data=None,user_id='d11cfaa98a7a427bbda21bc38ddba079',uuid=a276ab3f-657a-4148-bd08-007f79230ace,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3", "address": "fa:16:3e:52:f7:34", "network": {"id": "a758762c-c27c-4509-9870-1d42187aeaf4", "bridge": "br-int", "label": "tempest-TestStampPattern-405695915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21df2cbfb9234c13a504ad4a513970f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9fb2a6f-ec", "ovs_interfaceid": "b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 04:14:26 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Converting VIF {"id": "b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3", "address": "fa:16:3e:52:f7:34", "network": {"id": "a758762c-c27c-4509-9870-1d42187aeaf4", "bridge": "br-int", "label": "tempest-TestStampPattern-405695915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21df2cbfb9234c13a504ad4a513970f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9fb2a6f-ec", "ovs_interfaceid": "b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:14:26 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:f7:34,bridge_name='br-int',has_traffic_filtering=True,id=b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3,network=Network(a758762c-c27c-4509-9870-1d42187aeaf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9fb2a6f-ec') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:14:26 user nova-compute[103546]: DEBUG os_vif [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:f7:34,bridge_name='br-int',has_traffic_filtering=True,id=b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3,network=Network(a758762c-c27c-4509-9870-1d42187aeaf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9fb2a6f-ec') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 04:14:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:14:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:14:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 04:14:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:14:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dd590628-5d55-5953-9456-df6eeb413a08', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:14:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:14:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:14:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb9fb2a6f-ec, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:14:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb9fb2a6f-ec, col_values=(('qos', UUID('dae53bd4-4b0a-46f7-a0e7-2fb39d9f257d')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:14:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb9fb2a6f-ec, col_values=(('external_ids', {'iface-id': 'b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:f7:34', 'vm-uuid': 'a276ab3f-657a-4148-bd08-007f79230ace'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:14:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:14:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:14:26 user nova-compute[103546]: INFO os_vif [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:f7:34,bridge_name='br-int',has_traffic_filtering=True,id=b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3,network=Network(a758762c-c27c-4509-9870-1d42187aeaf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9fb2a6f-ec')
Nov 16 04:14:26 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:14:26 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] No VIF found with MAC fa:16:3e:52:f7:34, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 04:14:27 user nova-compute[103546]: DEBUG nova.network.neutron [req-3df7a1f2-d9e2-4f6d-b8c7-d554d38e2efc req-e736c404-514c-4ef8-9615-41a4706c8b92 service nova] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Updated VIF entry in instance network info cache for port b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 04:14:27 user nova-compute[103546]: DEBUG nova.network.neutron [req-3df7a1f2-d9e2-4f6d-b8c7-d554d38e2efc req-e736c404-514c-4ef8-9615-41a4706c8b92 service nova] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Updating instance_info_cache with network_info: [{"id": "b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3", "address": "fa:16:3e:52:f7:34", "network": {"id": "a758762c-c27c-4509-9870-1d42187aeaf4", "bridge": "br-int", "label": "tempest-TestStampPattern-405695915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21df2cbfb9234c13a504ad4a513970f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9fb2a6f-ec", "ovs_interfaceid": "b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:14:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3df7a1f2-d9e2-4f6d-b8c7-d554d38e2efc req-e736c404-514c-4ef8-9615-41a4706c8b92 service nova] Releasing lock "refresh_cache-a276ab3f-657a-4148-bd08-007f79230ace" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:14:27 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:14:27 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:14:27 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:14:27 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:14:28 user nova-compute[103546]: DEBUG nova.compute.manager [req-8abec356-5999-4760-a6e3-86183e2f7a45 req-043331ad-7523-4590-953d-3782e02bb75b service nova] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Received event network-vif-plugged-9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:14:28 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8abec356-5999-4760-a6e3-86183e2f7a45 req-043331ad-7523-4590-953d-3782e02bb75b service nova] Acquiring lock "2fdca5a2-7e02-4c4a-96ae-cc61547232c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:14:28 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8abec356-5999-4760-a6e3-86183e2f7a45 req-043331ad-7523-4590-953d-3782e02bb75b service nova] Lock "2fdca5a2-7e02-4c4a-96ae-cc61547232c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:14:28 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-8abec356-5999-4760-a6e3-86183e2f7a45 req-043331ad-7523-4590-953d-3782e02bb75b service nova] Lock "2fdca5a2-7e02-4c4a-96ae-cc61547232c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:14:28 user nova-compute[103546]: DEBUG nova.compute.manager [req-8abec356-5999-4760-a6e3-86183e2f7a45 req-043331ad-7523-4590-953d-3782e02bb75b service nova] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] No waiting events found dispatching network-vif-plugged-9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:14:28 user nova-compute[103546]: WARNING nova.compute.manager [req-8abec356-5999-4760-a6e3-86183e2f7a45 req-043331ad-7523-4590-953d-3782e02bb75b service nova] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Received unexpected event network-vif-plugged-9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a for instance with vm_state active and task_state rescuing.
Nov 16 04:14:28 user nova-compute[103546]: DEBUG nova.compute.manager [None req-bd9cb9be-bcdf-4ba2-9887-389eb74ddbc4 tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 04:14:28 user nova-compute[103546]: DEBUG nova.compute.manager [req-400be06e-a31b-4b78-9949-2f185649c326 req-19dcfe2f-33e7-4c72-9a2a-a23fe76885ac service nova] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Received event network-vif-plugged-b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:14:28 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-400be06e-a31b-4b78-9949-2f185649c326 req-19dcfe2f-33e7-4c72-9a2a-a23fe76885ac service nova] Acquiring lock "a276ab3f-657a-4148-bd08-007f79230ace-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:14:28 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-400be06e-a31b-4b78-9949-2f185649c326 req-19dcfe2f-33e7-4c72-9a2a-a23fe76885ac service nova] Lock "a276ab3f-657a-4148-bd08-007f79230ace-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:14:28 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-400be06e-a31b-4b78-9949-2f185649c326 req-19dcfe2f-33e7-4c72-9a2a-a23fe76885ac service nova] Lock "a276ab3f-657a-4148-bd08-007f79230ace-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:14:28 user nova-compute[103546]: DEBUG nova.compute.manager [req-400be06e-a31b-4b78-9949-2f185649c326 req-19dcfe2f-33e7-4c72-9a2a-a23fe76885ac service nova] [instance: a276ab3f-657a-4148-bd08-007f79230ace] No waiting events found dispatching network-vif-plugged-b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:14:28 user nova-compute[103546]: WARNING nova.compute.manager [req-400be06e-a31b-4b78-9949-2f185649c326 req-19dcfe2f-33e7-4c72-9a2a-a23fe76885ac service nova] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Received unexpected event network-vif-plugged-b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3 for instance with vm_state building and task_state spawning.
Nov 16 04:14:28 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:14:28 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:14:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:14:30 user nova-compute[103546]: DEBUG nova.compute.manager [req-2d56a005-e2e2-4308-b3e8-b2ad968279e3 req-48ace181-16ba-499c-8621-7c3f46e9a5a2 service nova] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Received event network-vif-plugged-b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:14:30 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-2d56a005-e2e2-4308-b3e8-b2ad968279e3 req-48ace181-16ba-499c-8621-7c3f46e9a5a2 service nova] Acquiring lock "a276ab3f-657a-4148-bd08-007f79230ace-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:14:30 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-2d56a005-e2e2-4308-b3e8-b2ad968279e3 req-48ace181-16ba-499c-8621-7c3f46e9a5a2 service nova] Lock "a276ab3f-657a-4148-bd08-007f79230ace-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:14:30 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-2d56a005-e2e2-4308-b3e8-b2ad968279e3 req-48ace181-16ba-499c-8621-7c3f46e9a5a2 service nova] Lock "a276ab3f-657a-4148-bd08-007f79230ace-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:14:30 user nova-compute[103546]: DEBUG nova.compute.manager [req-2d56a005-e2e2-4308-b3e8-b2ad968279e3 req-48ace181-16ba-499c-8621-7c3f46e9a5a2 service nova] [instance: a276ab3f-657a-4148-bd08-007f79230ace] No waiting events found dispatching network-vif-plugged-b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:14:30 user nova-compute[103546]: WARNING nova.compute.manager [req-2d56a005-e2e2-4308-b3e8-b2ad968279e3 req-48ace181-16ba-499c-8621-7c3f46e9a5a2 service nova] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Received unexpected event network-vif-plugged-b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3 for instance with vm_state building and task_state spawning.
Nov 16 04:14:30 user nova-compute[103546]: DEBUG nova.compute.manager [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 04:14:30 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Guest created on hypervisor {{(pid=103546) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 04:14:30 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Instance spawned successfully.
Nov 16 04:14:30 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 04:14:30 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Found default for hw_cdrom_bus of ide {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:14:30 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Found default for hw_disk_bus of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:14:30 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Found default for hw_input_bus of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:14:30 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Found default for hw_pointer_model of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:14:30 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Found default for hw_video_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:14:30 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Found default for hw_vif_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:14:30 user nova-compute[103546]: INFO nova.compute.manager [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Took 5.48 seconds to spawn the instance on the hypervisor.
Nov 16 04:14:30 user nova-compute[103546]: DEBUG nova.compute.manager [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 04:14:30 user nova-compute[103546]: INFO nova.compute.manager [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Took 6.21 seconds to build instance.
Nov 16 04:14:30 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f9797618-aecf-48e8-bd3f-1387958b0f10 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lock "a276ab3f-657a-4148-bd08-007f79230ace" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.309s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:14:31 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:14:34 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:14:34 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:14:34 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:14:34 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:14:34 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:14:34 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=103546) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 04:14:35 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager.update_available_resource {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:14:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:14:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:14:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:14:35 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Auditing locally available compute resources for user (node: user) {{(pid=103546) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 04:14:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad85e80-259e-4d97-8087-60c1068c9826/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:14:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad85e80-259e-4d97-8087-60c1068c9826/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:14:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad85e80-259e-4d97-8087-60c1068c9826/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:14:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad85e80-259e-4d97-8087-60c1068c9826/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:14:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96d12e49-5dc7-43ad-9f6b-b366a8e7013d/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:14:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96d12e49-5dc7-43ad-9f6b-b366a8e7013d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:14:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96d12e49-5dc7-43ad-9f6b-b366a8e7013d/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:14:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96d12e49-5dc7-43ad-9f6b-b366a8e7013d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:14:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fdca5a2-7e02-4c4a-96ae-cc61547232c1/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:14:36 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:14:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fdca5a2-7e02-4c4a-96ae-cc61547232c1/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:14:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fdca5a2-7e02-4c4a-96ae-cc61547232c1/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:14:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fdca5a2-7e02-4c4a-96ae-cc61547232c1/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:14:36 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 04:14:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fdca5a2-7e02-4c4a-96ae-cc61547232c1/disk.rescue --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:14:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fdca5a2-7e02-4c4a-96ae-cc61547232c1/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:14:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fdca5a2-7e02-4c4a-96ae-cc61547232c1/disk.rescue --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:14:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fdca5a2-7e02-4c4a-96ae-cc61547232c1/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:14:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a276ab3f-657a-4148-bd08-007f79230ace/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:14:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a276ab3f-657a-4148-bd08-007f79230ace/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:14:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a276ab3f-657a-4148-bd08-007f79230ace/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:14:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a276ab3f-657a-4148-bd08-007f79230ace/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:14:38 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:14:38 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:14:38 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Hypervisor/Node resource view: name=user free_ram=8475MB free_disk=24.9857177734375GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=103546) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 04:14:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:14:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:14:38 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 2fdca5a2-7e02-4c4a-96ae-cc61547232c1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:14:38 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 96d12e49-5dc7-43ad-9f6b-b366a8e7013d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:14:38 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 9ad85e80-259e-4d97-8087-60c1068c9826 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:14:38 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance a276ab3f-657a-4148-bd08-007f79230ace actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:14:38 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 04:14:38 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 04:14:38 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:14:38 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:14:38 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Compute_service record updated for user:user {{(pid=103546) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 04:14:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.272s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:14:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:14:40 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:14:40 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:14:40 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:14:41 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:14:41 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:14:42 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:14:42 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Starting heal instance info cache {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 04:14:42 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Didn't find any instances for network info cache update. {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 04:14:44 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:14:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:14:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:14:51 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:14:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:14:56 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:14:59 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:15:01 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:15:06 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:15:06 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:15:06 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=103546) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 04:15:06 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:15:06 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:15:06 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:15:11 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:15:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:15:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:15:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=103546) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 04:15:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:15:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:15:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:15:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:15:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:15:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=103546) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 04:15:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:15:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:15:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:15:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:15:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:15:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=103546) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 04:15:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:15:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:15:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:15:27 user nova-compute[103546]: DEBUG nova.compute.manager [req-557da82c-ea9d-4634-929b-93d199983563 req-87efaba6-9ac6-44e2-9679-686e40dce523 service nova] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Received event network-changed-8450ed01-4f54-4d95-ac8a-fcc4057ac88a {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:15:27 user nova-compute[103546]: DEBUG nova.compute.manager [req-557da82c-ea9d-4634-929b-93d199983563 req-87efaba6-9ac6-44e2-9679-686e40dce523 service nova] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Refreshing instance network info cache due to event network-changed-8450ed01-4f54-4d95-ac8a-fcc4057ac88a. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 04:15:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-557da82c-ea9d-4634-929b-93d199983563 req-87efaba6-9ac6-44e2-9679-686e40dce523 service nova] Acquiring lock "refresh_cache-96d12e49-5dc7-43ad-9f6b-b366a8e7013d" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:15:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-557da82c-ea9d-4634-929b-93d199983563 req-87efaba6-9ac6-44e2-9679-686e40dce523 service nova] Acquired lock "refresh_cache-96d12e49-5dc7-43ad-9f6b-b366a8e7013d" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:15:27 user nova-compute[103546]: DEBUG nova.network.neutron [req-557da82c-ea9d-4634-929b-93d199983563 req-87efaba6-9ac6-44e2-9679-686e40dce523 service nova] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Refreshing network info cache for port 8450ed01-4f54-4d95-ac8a-fcc4057ac88a {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 04:15:28 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-3009f413-98e2-42fd-8f99-f90eadec909f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Acquiring lock "96d12e49-5dc7-43ad-9f6b-b366a8e7013d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:15:28 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-3009f413-98e2-42fd-8f99-f90eadec909f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lock "96d12e49-5dc7-43ad-9f6b-b366a8e7013d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:15:28 user nova-compute[103546]: DEBUG nova.objects.instance [None req-3009f413-98e2-42fd-8f99-f90eadec909f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lazy-loading 'flavor' on Instance uuid 96d12e49-5dc7-43ad-9f6b-b366a8e7013d {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:15:28 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-3009f413-98e2-42fd-8f99-f90eadec909f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Ignoring supplied device name: /dev/vdb
Nov 16 04:15:28 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-3009f413-98e2-42fd-8f99-f90eadec909f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lock "96d12e49-5dc7-43ad-9f6b-b366a8e7013d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:15:28 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-3009f413-98e2-42fd-8f99-f90eadec909f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Acquiring lock "96d12e49-5dc7-43ad-9f6b-b366a8e7013d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:15:28 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-3009f413-98e2-42fd-8f99-f90eadec909f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lock "96d12e49-5dc7-43ad-9f6b-b366a8e7013d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:15:28 user nova-compute[103546]: INFO nova.compute.manager [None req-3009f413-98e2-42fd-8f99-f90eadec909f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Attaching volume 744cc806-ecce-4c24-b4f5-3db93c86d7bd to /dev/vdb
Nov 16 04:15:28 user nova-compute[103546]: DEBUG nova.network.neutron [req-557da82c-ea9d-4634-929b-93d199983563 req-87efaba6-9ac6-44e2-9679-686e40dce523 service nova] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Updated VIF entry in instance network info cache for port 8450ed01-4f54-4d95-ac8a-fcc4057ac88a. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 04:15:28 user nova-compute[103546]: DEBUG nova.network.neutron [req-557da82c-ea9d-4634-929b-93d199983563 req-87efaba6-9ac6-44e2-9679-686e40dce523 service nova] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Updating instance_info_cache with network_info: [{"id": "8450ed01-4f54-4d95-ac8a-fcc4057ac88a", "address": "fa:16:3e:4f:91:ee", "network": {"id": "855d0097-2e3c-4168-900e-d811676a8bff", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1275657618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7de09c5b11a4b0f96a66c9788e5942c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8450ed01-4f", "ovs_interfaceid": "8450ed01-4f54-4d95-ac8a-fcc4057ac88a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:15:28 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-557da82c-ea9d-4634-929b-93d199983563 req-87efaba6-9ac6-44e2-9679-686e40dce523 service nova] Releasing lock "refresh_cache-96d12e49-5dc7-43ad-9f6b-b366a8e7013d" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:15:28 user nova-compute[103546]: DEBUG os_brick.utils [None req-3009f413-98e2-42fd-8f99-f90eadec909f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:15:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:15:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:15:28 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a063e710-5e8d-401d-9bc4-4198e8613f62]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af5c39b14ece\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:15:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:15:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:15:28 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[091e6a93-5b20-4052-b9d5-2e46f93f720c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:15:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:15:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:15:28 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67efcf0-ba6a-4c41-b459-70a5364481ad]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:15:28 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ac3a23-393c-4b3a-8ab2-b5608124946c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:15:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-3009f413-98e2-42fd-8f99-f90eadec909f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Running cmd (subprocess): nvme version {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:15:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-3009f413-98e2-42fd-8f99-f90eadec909f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] 'nvme version' failed. Not Retrying. {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 04:15:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3009f413-98e2-42fd-8f99-f90eadec909f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] nvme not present on system {{(pid=103546) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 04:15:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:15:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 04:15:28 user nova-compute[103546]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 04:15:28 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9393dc-b859-4604-a36d-9204ab23ae99]: (4, '') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:15:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-3009f413-98e2-42fd-8f99-f90eadec909f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=103546) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 04:15:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-3009f413-98e2-42fd-8f99-f90eadec909f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 04:15:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-3009f413-98e2-42fd-8f99-f90eadec909f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] LIGHTOS: no hostnqn found. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 04:15:28 user nova-compute[103546]: DEBUG os_brick.utils [None req-3009f413-98e2-42fd-8f99-f90eadec909f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af5c39b14ece', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:15:28 user nova-compute[103546]: DEBUG nova.virt.block_device [None req-3009f413-98e2-42fd-8f99-f90eadec909f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Updating existing volume attachment record: 3481b649-c4fe-45f8-84ad-d4ae4c9cacfe {{(pid=103546) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 04:15:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:15:31 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:15:33 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3009f413-98e2-42fd-8f99-f90eadec909f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 04:15:33 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3009f413-98e2-42fd-8f99-f90eadec909f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:744cc806-ecce-4c24-b4f5-3db93c86d7bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IqofYvJD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:15:33 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-3009f413-98e2-42fd-8f99-f90eadec909f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:15:33 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-3009f413-98e2-42fd-8f99-f90eadec909f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:15:33 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-3009f413-98e2-42fd-8f99-f90eadec909f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:15:33 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-3009f413-98e2-42fd-8f99-f90eadec909f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:15:33 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-3009f413-98e2-42fd-8f99-f90eadec909f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:744cc806-ecce-4c24-b4f5-3db93c86d7bd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:15:33 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-3009f413-98e2-42fd-8f99-f90eadec909f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:744cc806-ecce-4c24-b4f5-3db93c86d7bd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:15:33 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-3009f413-98e2-42fd-8f99-f90eadec909f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 04:15:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744cc806-ecce-4c24-b4f5-3db93c86d7bd -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:15:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744cc806-ecce-4c24-b4f5-3db93c86d7bd -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:15:33 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b43f866-998c-40d2-b9a0-5535951985ad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:15:33 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3009f413-98e2-42fd-8f99-f90eadec909f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 04:15:33 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:15:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744cc806-ecce-4c24-b4f5-3db93c86d7bd -p 172.16.0.220:3260 --interface default --op new {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:15:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744cc806-ecce-4c24-b4f5-3db93c86d7bd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:15:33 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede087c9-b8a6-4431-acb4-ca3aa26c9bb8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:744cc806-ecce-4c24-b4f5-3db93c86d7bd] added\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:15:33 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3009f413-98e2-42fd-8f99-f90eadec909f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:744cc806-ecce-4c24-b4f5-3db93c86d7bd] added
Nov 16 04:15:33 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:15:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744cc806-ecce-4c24-b4f5-3db93c86d7bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:15:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744cc806-ecce-4c24-b4f5-3db93c86d7bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:15:33 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f77c49-cf82-427e-964b-f908e44a3141]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:15:33 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3009f413-98e2-42fd-8f99-f90eadec909f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:15:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744cc806-ecce-4c24-b4f5-3db93c86d7bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:15:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744cc806-ecce-4c24-b4f5-3db93c86d7bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:15:33 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e581dc19-9e29-4ac4-94fd-2f9a75ef0ec0]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:15:33 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3009f413-98e2-42fd-8f99-f90eadec909f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:15:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744cc806-ecce-4c24-b4f5-3db93c86d7bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IqofYvJD {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:15:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744cc806-ecce-4c24-b4f5-3db93c86d7bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IqofYvJD" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:15:33 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e39fac-6883-4c4d-81ef-293b895662a6]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:15:33 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3009f413-98e2-42fd-8f99-f90eadec909f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IqofYvJD'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:15:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744cc806-ecce-4c24-b4f5-3db93c86d7bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:15:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744cc806-ecce-4c24-b4f5-3db93c86d7bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:15:33 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85111a6-4384-436b-bfac-6bf346942084]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:15:33 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3009f413-98e2-42fd-8f99-f90eadec909f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:15:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:15:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:15:33 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f493921d-1a91-4975-8da0-85442f2ea25e]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:15:33 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3009f413-98e2-42fd-8f99-f90eadec909f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 (non-flash)
Nov 16 04:15:33 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:15:33 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3009f413-98e2-42fd-8f99-f90eadec909f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 (non-flash)
Nov 16 04:15:33 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:15:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744cc806-ecce-4c24-b4f5-3db93c86d7bd -p 172.16.0.220:3260 --login {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:15:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744cc806-ecce-4c24-b4f5-3db93c86d7bd -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:15:33 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed74c87f-f05f-4025-b7ae-f7e2d11f6ccd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:744cc806-ecce-4c24-b4f5-3db93c86d7bd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:744cc806-ecce-4c24-b4f5-3db93c86d7bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:15:33 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3009f413-98e2-42fd-8f99-f90eadec909f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:744cc806-ecce-4c24-b4f5-3db93c86d7bd, portal: 172.16.0.220,3260]
Nov 16 04:15:33 user nova-compute[103546]: Login to [iface: default, target: iqn.2010-10.org.openstack:744cc806-ecce-4c24-b4f5-3db93c86d7bd, portal: 172.16.0.220,3260] successful.
Nov 16 04:15:33 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:15:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744cc806-ecce-4c24-b4f5-3db93c86d7bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:15:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744cc806-ecce-4c24-b4f5-3db93c86d7bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:15:33 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0a50f7-9b76-4de3-b9a9-20c3483734b0]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:15:33 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3009f413-98e2-42fd-8f99-f90eadec909f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:15:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:15:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:15:33 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07fb9f9-7176-4af4-8d94-e4397bc5aaaf]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744cc806-ecce-4c24-b4f5-3db93c86d7bd (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:15:33 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3009f413-98e2-42fd-8f99-f90eadec909f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 (non-flash)
Nov 16 04:15:33 user nova-compute[103546]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744cc806-ecce-4c24-b4f5-3db93c86d7bd (non-flash)
Nov 16 04:15:33 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:15:33 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3009f413-98e2-42fd-8f99-f90eadec909f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 (non-flash)
Nov 16 04:15:33 user nova-compute[103546]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744cc806-ecce-4c24-b4f5-3db93c86d7bd (non-flash)
Nov 16 04:15:33 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:15:33 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-3009f413-98e2-42fd-8f99-f90eadec909f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:744cc806-ecce-4c24-b4f5-3db93c86d7bd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:15:33 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3009f413-98e2-42fd-8f99-f90eadec909f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 04:15:33 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-3009f413-98e2-42fd-8f99-f90eadec909f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] HCTL ('34', '-', '-', 0) found on session 56 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 04:15:33 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-3009f413-98e2-42fd-8f99-f90eadec909f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 04:15:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:15:33 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:15:33 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[403c3b26-2ea5-41fb-b77e-4c1a9744b64b]: (4, ('- - 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:15:33 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-3009f413-98e2-42fd-8f99-f90eadec909f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: None {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 04:15:34 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:15:34 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-3009f413-98e2-42fd-8f99-f90eadec909f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 04:15:34 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3009f413-98e2-42fd-8f99-f90eadec909f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:744cc806-ecce-4c24-b4f5-3db93c86d7bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IqofYvJD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 04:15:34 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-3009f413-98e2-42fd-8f99-f90eadec909f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:15:34 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-3009f413-98e2-42fd-8f99-f90eadec909f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '26635323663656638', 'path': '/dev/sdc'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:15:34 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3009f413-98e2-42fd-8f99-f90eadec909f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26635323663656638', 'path': '/dev/sdc'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 04:15:34 user nova-compute[103546]: DEBUG nova.objects.instance [None req-3009f413-98e2-42fd-8f99-f90eadec909f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lazy-loading 'flavor' on Instance uuid 96d12e49-5dc7-43ad-9f6b-b366a8e7013d {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:15:34 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-3009f413-98e2-42fd-8f99-f90eadec909f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 04:15:34 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:15:34 user nova-compute[103546]:   <source dev="/dev/sdc"/>
Nov 16 04:15:34 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 04:15:34 user nova-compute[103546]:   <serial>744cc806-ecce-4c24-b4f5-3db93c86d7bd</serial>
Nov 16 04:15:34 user nova-compute[103546]: </disk>
Nov 16 04:15:34 user nova-compute[103546]:  {{(pid=103546) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 04:15:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-3009f413-98e2-42fd-8f99-f90eadec909f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:15:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-3009f413-98e2-42fd-8f99-f90eadec909f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] No BDM found with device name vdb, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:15:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-3009f413-98e2-42fd-8f99-f90eadec909f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] No VIF found with MAC fa:16:3e:4f:91:ee, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 04:15:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-3009f413-98e2-42fd-8f99-f90eadec909f tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lock "96d12e49-5dc7-43ad-9f6b-b366a8e7013d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.880s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:15:35 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:15:35 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:15:35 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:15:35 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager.update_available_resource {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:15:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:15:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:15:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:15:35 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Auditing locally available compute resources for user (node: user) {{(pid=103546) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 04:15:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad85e80-259e-4d97-8087-60c1068c9826/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:15:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad85e80-259e-4d97-8087-60c1068c9826/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:15:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad85e80-259e-4d97-8087-60c1068c9826/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:15:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad85e80-259e-4d97-8087-60c1068c9826/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:15:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96d12e49-5dc7-43ad-9f6b-b366a8e7013d/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:15:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96d12e49-5dc7-43ad-9f6b-b366a8e7013d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:15:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96d12e49-5dc7-43ad-9f6b-b366a8e7013d/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:15:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96d12e49-5dc7-43ad-9f6b-b366a8e7013d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:15:36 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 04:15:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fdca5a2-7e02-4c4a-96ae-cc61547232c1/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:15:36 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:15:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fdca5a2-7e02-4c4a-96ae-cc61547232c1/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:15:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fdca5a2-7e02-4c4a-96ae-cc61547232c1/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:15:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fdca5a2-7e02-4c4a-96ae-cc61547232c1/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:15:36 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 04:15:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fdca5a2-7e02-4c4a-96ae-cc61547232c1/disk.rescue --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:15:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fdca5a2-7e02-4c4a-96ae-cc61547232c1/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:15:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fdca5a2-7e02-4c4a-96ae-cc61547232c1/disk.rescue --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:15:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fdca5a2-7e02-4c4a-96ae-cc61547232c1/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:15:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a276ab3f-657a-4148-bd08-007f79230ace/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:15:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a276ab3f-657a-4148-bd08-007f79230ace/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:15:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a276ab3f-657a-4148-bd08-007f79230ace/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:15:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a276ab3f-657a-4148-bd08-007f79230ace/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:15:37 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:15:37 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:15:37 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Hypervisor/Node resource view: name=user free_ram=8528MB free_disk=24.95453643798828GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=103546) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 04:15:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:15:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:15:38 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 2fdca5a2-7e02-4c4a-96ae-cc61547232c1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:15:38 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 96d12e49-5dc7-43ad-9f6b-b366a8e7013d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:15:38 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 9ad85e80-259e-4d97-8087-60c1068c9826 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:15:38 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance a276ab3f-657a-4148-bd08-007f79230ace actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:15:38 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 04:15:38 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 04:15:38 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:15:38 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:15:38 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Compute_service record updated for user:user {{(pid=103546) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 04:15:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.236s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:15:39 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:15:39 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:15:39 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=103546) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 04:15:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:15:39 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:15:41 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:15:43 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:15:43 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Starting heal instance info cache {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 04:15:43 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Rebuilding the list of instances to heal {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 04:15:43 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "refresh_cache-2fdca5a2-7e02-4c4a-96ae-cc61547232c1" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:15:43 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquired lock "refresh_cache-2fdca5a2-7e02-4c4a-96ae-cc61547232c1" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:15:43 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Forcefully refreshing network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 04:15:43 user nova-compute[103546]: DEBUG nova.objects.instance [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lazy-loading 'info_cache' on Instance uuid 2fdca5a2-7e02-4c4a-96ae-cc61547232c1 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:15:44 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Updating instance_info_cache with network_info: [{"id": "9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a", "address": "fa:16:3e:f0:c5:13", "network": {"id": "5f10f091-8358-4c8c-92bb-999d989f26b0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-513865819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18a17119476d4eea9a39078a48af5a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a11f3f3-1a", "ovs_interfaceid": "9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:15:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Releasing lock "refresh_cache-2fdca5a2-7e02-4c4a-96ae-cc61547232c1" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:15:44 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Updated the network info_cache for instance {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 04:15:44 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:15:44 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:15:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:15:49 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f2be59a9-3cff-4a8f-a610-cbabb215bcc8 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Acquiring lock "96d12e49-5dc7-43ad-9f6b-b366a8e7013d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:15:49 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f2be59a9-3cff-4a8f-a610-cbabb215bcc8 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lock "96d12e49-5dc7-43ad-9f6b-b366a8e7013d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:15:49 user nova-compute[103546]: INFO nova.compute.manager [None req-f2be59a9-3cff-4a8f-a610-cbabb215bcc8 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Detaching volume 744cc806-ecce-4c24-b4f5-3db93c86d7bd
Nov 16 04:15:49 user nova-compute[103546]: INFO nova.virt.block_device [None req-f2be59a9-3cff-4a8f-a610-cbabb215bcc8 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Attempting to driver detach volume 744cc806-ecce-4c24-b4f5-3db93c86d7bd from mountpoint /dev/vdb
Nov 16 04:15:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-f2be59a9-3cff-4a8f-a610-cbabb215bcc8 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Attempting to detach device vdb from instance 96d12e49-5dc7-43ad-9f6b-b366a8e7013d from the persistent domain config. {{(pid=103546) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 04:15:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-f2be59a9-3cff-4a8f-a610-cbabb215bcc8 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 04:15:49 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:15:49 user nova-compute[103546]:   <source dev="/dev/sdc"/>
Nov 16 04:15:49 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 04:15:49 user nova-compute[103546]:   <serial>744cc806-ecce-4c24-b4f5-3db93c86d7bd</serial>
Nov 16 04:15:49 user nova-compute[103546]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 04:15:49 user nova-compute[103546]: </disk>
Nov 16 04:15:49 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 04:15:49 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-f2be59a9-3cff-4a8f-a610-cbabb215bcc8 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Successfully detached device vdb from instance 96d12e49-5dc7-43ad-9f6b-b366a8e7013d from the persistent domain config.
Nov 16 04:15:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-f2be59a9-3cff-4a8f-a610-cbabb215bcc8 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 96d12e49-5dc7-43ad-9f6b-b366a8e7013d from the live domain config. {{(pid=103546) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 04:15:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-f2be59a9-3cff-4a8f-a610-cbabb215bcc8 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 04:15:49 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:15:49 user nova-compute[103546]:   <source dev="/dev/sdc"/>
Nov 16 04:15:49 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 04:15:49 user nova-compute[103546]:   <serial>744cc806-ecce-4c24-b4f5-3db93c86d7bd</serial>
Nov 16 04:15:49 user nova-compute[103546]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 04:15:49 user nova-compute[103546]: </disk>
Nov 16 04:15:49 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 04:15:49 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-2f49be01-d6fa-4faa-a3a0-22e7d55cc6bb tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Acquiring lock "96d12e49-5dc7-43ad-9f6b-b366a8e7013d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:15:50 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-f2be59a9-3cff-4a8f-a610-cbabb215bcc8 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 96d12e49-5dc7-43ad-9f6b-b366a8e7013d {{(pid=103546) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 04:15:51 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:15:56 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:15:57 user nova-compute[103546]: DEBUG nova.compute.manager [req-2c3f89f8-6a3c-4c9c-a425-5e1fe65b939c req-5ac97421-6432-4828-a690-a602c5785880 service nova] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Received event network-changed-2e72a898-1c0f-44a5-a6e2-8c3e9aa13f38 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:15:57 user nova-compute[103546]: DEBUG nova.compute.manager [req-2c3f89f8-6a3c-4c9c-a425-5e1fe65b939c req-5ac97421-6432-4828-a690-a602c5785880 service nova] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Refreshing instance network info cache due to event network-changed-2e72a898-1c0f-44a5-a6e2-8c3e9aa13f38. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 04:15:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-2c3f89f8-6a3c-4c9c-a425-5e1fe65b939c req-5ac97421-6432-4828-a690-a602c5785880 service nova] Acquiring lock "refresh_cache-9ad85e80-259e-4d97-8087-60c1068c9826" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:15:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-2c3f89f8-6a3c-4c9c-a425-5e1fe65b939c req-5ac97421-6432-4828-a690-a602c5785880 service nova] Acquired lock "refresh_cache-9ad85e80-259e-4d97-8087-60c1068c9826" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:15:57 user nova-compute[103546]: DEBUG nova.network.neutron [req-2c3f89f8-6a3c-4c9c-a425-5e1fe65b939c req-5ac97421-6432-4828-a690-a602c5785880 service nova] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Refreshing network info cache for port 2e72a898-1c0f-44a5-a6e2-8c3e9aa13f38 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 04:15:58 user nova-compute[103546]: DEBUG nova.network.neutron [req-2c3f89f8-6a3c-4c9c-a425-5e1fe65b939c req-5ac97421-6432-4828-a690-a602c5785880 service nova] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Updated VIF entry in instance network info cache for port 2e72a898-1c0f-44a5-a6e2-8c3e9aa13f38. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 04:15:58 user nova-compute[103546]: DEBUG nova.network.neutron [req-2c3f89f8-6a3c-4c9c-a425-5e1fe65b939c req-5ac97421-6432-4828-a690-a602c5785880 service nova] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Updating instance_info_cache with network_info: [{"id": "2e72a898-1c0f-44a5-a6e2-8c3e9aa13f38", "address": "fa:16:3e:d6:a7:78", "network": {"id": "09cd9f1b-f026-441f-98b0-fcbce2718aae", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-97767409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0298f102e0042d5ac7d4e3d899fc6e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e72a898-1c", "ovs_interfaceid": "2e72a898-1c0f-44a5-a6e2-8c3e9aa13f38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:15:58 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-2c3f89f8-6a3c-4c9c-a425-5e1fe65b939c req-5ac97421-6432-4828-a690-a602c5785880 service nova] Releasing lock "refresh_cache-9ad85e80-259e-4d97-8087-60c1068c9826" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:15:59 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:15:59 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-c80268f2-1d8f-4064-b156-7e1377514256 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Acquiring lock "9ad85e80-259e-4d97-8087-60c1068c9826" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:15:59 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-c80268f2-1d8f-4064-b156-7e1377514256 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Lock "9ad85e80-259e-4d97-8087-60c1068c9826" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:15:59 user nova-compute[103546]: DEBUG nova.objects.instance [None req-c80268f2-1d8f-4064-b156-7e1377514256 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Lazy-loading 'flavor' on Instance uuid 9ad85e80-259e-4d97-8087-60c1068c9826 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:15:59 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-c80268f2-1d8f-4064-b156-7e1377514256 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Lock "9ad85e80-259e-4d97-8087-60c1068c9826" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:16:00 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-c80268f2-1d8f-4064-b156-7e1377514256 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Acquiring lock "9ad85e80-259e-4d97-8087-60c1068c9826" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:16:00 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-c80268f2-1d8f-4064-b156-7e1377514256 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Lock "9ad85e80-259e-4d97-8087-60c1068c9826" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:16:00 user nova-compute[103546]: INFO nova.compute.manager [None req-c80268f2-1d8f-4064-b156-7e1377514256 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Attaching volume 19620850-bc6c-46f5-86dd-f84072c9278a to /dev/vdb
Nov 16 04:16:00 user nova-compute[103546]: DEBUG os_brick.utils [None req-c80268f2-1d8f-4064-b156-7e1377514256 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:16:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:00 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bec6af6-b241-49d0-80bf-2e33f7b09825]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af5c39b14ece\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:00 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6e8faf-0548-4d47-a29f-9d1387c361ca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:00 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2af852-5c9b-4e65-8a2c-1e7fe0258ed2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:00 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e476d6-47ee-47a4-ba1f-49bbd3c7d9c2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-c80268f2-1d8f-4064-b156-7e1377514256 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Running cmd (subprocess): nvme version {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-c80268f2-1d8f-4064-b156-7e1377514256 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] 'nvme version' failed. Not Retrying. {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 04:16:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c80268f2-1d8f-4064-b156-7e1377514256 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] nvme not present on system {{(pid=103546) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 04:16:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 04:16:00 user nova-compute[103546]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 04:16:00 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c56d99d-b5ba-4f99-82b8-838cace85b9f]: (4, '') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-c80268f2-1d8f-4064-b156-7e1377514256 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=103546) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 04:16:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-c80268f2-1d8f-4064-b156-7e1377514256 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 04:16:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-c80268f2-1d8f-4064-b156-7e1377514256 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] LIGHTOS: no hostnqn found. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 04:16:00 user nova-compute[103546]: DEBUG os_brick.utils [None req-c80268f2-1d8f-4064-b156-7e1377514256 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af5c39b14ece', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:16:00 user nova-compute[103546]: DEBUG nova.virt.block_device [None req-c80268f2-1d8f-4064-b156-7e1377514256 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Updating existing volume attachment record: 3b3a7d42-a3b9-45b0-b544-c6be5027891a {{(pid=103546) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 04:16:01 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:16:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:16:05 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c80268f2-1d8f-4064-b156-7e1377514256 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 04:16:05 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80268f2-1d8f-4064-b156-7e1377514256 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eGqfpmRl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:16:05 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-c80268f2-1d8f-4064-b156-7e1377514256 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:16:05 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-c80268f2-1d8f-4064-b156-7e1377514256 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:16:05 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-c80268f2-1d8f-4064-b156-7e1377514256 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:16:05 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-c80268f2-1d8f-4064-b156-7e1377514256 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:16:05 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-c80268f2-1d8f-4064-b156-7e1377514256 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:16:05 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-c80268f2-1d8f-4064-b156-7e1377514256 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:16:05 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-c80268f2-1d8f-4064-b156-7e1377514256 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 04:16:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:05 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f1a101-d926-4a8d-ab73-29949c7ecb32]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:05 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80268f2-1d8f-4064-b156-7e1377514256 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 04:16:05 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:16:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a -p 172.16.0.220:3260 --interface default --op new {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:05 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f126b863-c493-4a41-96af-96d1a6dedda5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a] added\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:05 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80268f2-1d8f-4064-b156-7e1377514256 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a] added
Nov 16 04:16:05 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:16:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:05 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[981192bf-cb57-49d6-8257-f0a8b2565c28]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:05 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80268f2-1d8f-4064-b156-7e1377514256 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:16:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:05 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[847548f0-6c30-4c61-a303-b18345c20d68]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:05 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80268f2-1d8f-4064-b156-7e1377514256 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:16:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eGqfpmRl {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eGqfpmRl" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:05 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[4032425e-b247-4399-9f38-6e751e6c4f83]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:05 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80268f2-1d8f-4064-b156-7e1377514256 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eGqfpmRl'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:16:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:05 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c38ee4b3-ab82-417b-8060-ba7ac0d715a0]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:05 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80268f2-1d8f-4064-b156-7e1377514256 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:16:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:05 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbb548c-df8e-448a-86f5-b390292e5774]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744cc806-ecce-4c24-b4f5-3db93c86d7bd (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:05 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80268f2-1d8f-4064-b156-7e1377514256 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 (non-flash)
Nov 16 04:16:05 user nova-compute[103546]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744cc806-ecce-4c24-b4f5-3db93c86d7bd (non-flash)
Nov 16 04:16:05 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:16:05 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80268f2-1d8f-4064-b156-7e1377514256 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 (non-flash)
Nov 16 04:16:05 user nova-compute[103546]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744cc806-ecce-4c24-b4f5-3db93c86d7bd (non-flash)
Nov 16 04:16:05 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:16:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a -p 172.16.0.220:3260 --login {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:05 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3d8d2f-0ae2-443e-b151-7813153cb0bc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:05 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80268f2-1d8f-4064-b156-7e1377514256 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a, portal: 172.16.0.220,3260]
Nov 16 04:16:05 user nova-compute[103546]: Login to [iface: default, target: iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a, portal: 172.16.0.220,3260] successful.
Nov 16 04:16:05 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:16:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:05 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4be6b8-41c5-43f2-bbc8-4018c2ec03df]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:05 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80268f2-1d8f-4064-b156-7e1377514256 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:16:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:05 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d972c2-acf4-452b-9696-b8cce4c06c48]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744cc806-ecce-4c24-b4f5-3db93c86d7bd (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:05 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80268f2-1d8f-4064-b156-7e1377514256 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 (non-flash)
Nov 16 04:16:05 user nova-compute[103546]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744cc806-ecce-4c24-b4f5-3db93c86d7bd (non-flash)
Nov 16 04:16:05 user nova-compute[103546]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a (non-flash)
Nov 16 04:16:05 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:16:05 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80268f2-1d8f-4064-b156-7e1377514256 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 (non-flash)
Nov 16 04:16:05 user nova-compute[103546]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744cc806-ecce-4c24-b4f5-3db93c86d7bd (non-flash)
Nov 16 04:16:05 user nova-compute[103546]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a (non-flash)
Nov 16 04:16:05 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:16:05 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-c80268f2-1d8f-4064-b156-7e1377514256 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:16:05 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80268f2-1d8f-4064-b156-7e1377514256 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 04:16:05 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-c80268f2-1d8f-4064-b156-7e1377514256 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] HCTL ('35', '-', '-', 0) found on session 57 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 04:16:05 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-c80268f2-1d8f-4064-b156-7e1377514256 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 04:16:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:05 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49fd996-e6ba-4c41-a14d-16695e614630]: (4, ('- - 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:05 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-c80268f2-1d8f-4064-b156-7e1377514256 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Searching for a device in session 57 and hctl ['35', '*', '*', 0] yield: None {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 04:16:06 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-c80268f2-1d8f-4064-b156-7e1377514256 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Searching for a device in session 57 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 04:16:06 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80268f2-1d8f-4064-b156-7e1377514256 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eGqfpmRl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 04:16:06 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-c80268f2-1d8f-4064-b156-7e1377514256 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:16:06 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-c80268f2-1d8f-4064-b156-7e1377514256 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '23235323561643339', 'path': '/dev/sdd'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:16:06 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c80268f2-1d8f-4064-b156-7e1377514256 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23235323561643339', 'path': '/dev/sdd'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 04:16:06 user nova-compute[103546]: DEBUG nova.objects.instance [None req-c80268f2-1d8f-4064-b156-7e1377514256 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Lazy-loading 'flavor' on Instance uuid 9ad85e80-259e-4d97-8087-60c1068c9826 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:16:06 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-c80268f2-1d8f-4064-b156-7e1377514256 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 04:16:06 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:16:06 user nova-compute[103546]:   <source dev="/dev/sdd"/>
Nov 16 04:16:06 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 04:16:06 user nova-compute[103546]:   <serial>19620850-bc6c-46f5-86dd-f84072c9278a</serial>
Nov 16 04:16:06 user nova-compute[103546]: </disk>
Nov 16 04:16:06 user nova-compute[103546]:  {{(pid=103546) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 04:16:06 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:16:06 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-c80268f2-1d8f-4064-b156-7e1377514256 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:16:06 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-c80268f2-1d8f-4064-b156-7e1377514256 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] No BDM found with device name vdb, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:16:06 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-c80268f2-1d8f-4064-b156-7e1377514256 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] No VIF found with MAC fa:16:3e:d6:a7:78, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 04:16:06 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-c80268f2-1d8f-4064-b156-7e1377514256 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Lock "9ad85e80-259e-4d97-8087-60c1068c9826" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.844s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:16:08 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0c595a7d-de0f-4db5-81a3-a42c505ff2a4 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Acquiring lock "9ad85e80-259e-4d97-8087-60c1068c9826" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:16:08 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0c595a7d-de0f-4db5-81a3-a42c505ff2a4 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Lock "9ad85e80-259e-4d97-8087-60c1068c9826" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:16:08 user nova-compute[103546]: INFO nova.compute.manager [None req-0c595a7d-de0f-4db5-81a3-a42c505ff2a4 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Detaching volume 19620850-bc6c-46f5-86dd-f84072c9278a
Nov 16 04:16:08 user nova-compute[103546]: INFO nova.virt.block_device [None req-0c595a7d-de0f-4db5-81a3-a42c505ff2a4 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Attempting to driver detach volume 19620850-bc6c-46f5-86dd-f84072c9278a from mountpoint /dev/vdb
Nov 16 04:16:08 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-0c595a7d-de0f-4db5-81a3-a42c505ff2a4 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Attempting to detach device vdb from instance 9ad85e80-259e-4d97-8087-60c1068c9826 from the persistent domain config. {{(pid=103546) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 04:16:08 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-0c595a7d-de0f-4db5-81a3-a42c505ff2a4 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 04:16:08 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:16:08 user nova-compute[103546]:   <source dev="/dev/sdd"/>
Nov 16 04:16:08 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 04:16:08 user nova-compute[103546]:   <serial>19620850-bc6c-46f5-86dd-f84072c9278a</serial>
Nov 16 04:16:08 user nova-compute[103546]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 04:16:08 user nova-compute[103546]: </disk>
Nov 16 04:16:08 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 04:16:08 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-0c595a7d-de0f-4db5-81a3-a42c505ff2a4 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Successfully detached device vdb from instance 9ad85e80-259e-4d97-8087-60c1068c9826 from the persistent domain config.
Nov 16 04:16:08 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-0c595a7d-de0f-4db5-81a3-a42c505ff2a4 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9ad85e80-259e-4d97-8087-60c1068c9826 from the live domain config. {{(pid=103546) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 04:16:08 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-0c595a7d-de0f-4db5-81a3-a42c505ff2a4 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 04:16:08 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:16:08 user nova-compute[103546]:   <source dev="/dev/sdd"/>
Nov 16 04:16:08 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 04:16:08 user nova-compute[103546]:   <serial>19620850-bc6c-46f5-86dd-f84072c9278a</serial>
Nov 16 04:16:08 user nova-compute[103546]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 04:16:08 user nova-compute[103546]: </disk>
Nov 16 04:16:08 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 04:16:08 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-0c595a7d-de0f-4db5-81a3-a42c505ff2a4 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9ad85e80-259e-4d97-8087-60c1068c9826 {{(pid=103546) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 04:16:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:16:10 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-f2be59a9-3cff-4a8f-a610-cbabb215bcc8 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 96d12e49-5dc7-43ad-9f6b-b366a8e7013d is timed out.
Nov 16 04:16:10 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-f2be59a9-3cff-4a8f-a610-cbabb215bcc8 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Successfully detached device vdb from instance 96d12e49-5dc7-43ad-9f6b-b366a8e7013d from the live domain config.
Nov 16 04:16:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2be59a9-3cff-4a8f-a610-cbabb215bcc8 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 04:16:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2be59a9-3cff-4a8f-a610-cbabb215bcc8 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:744cc806-ecce-4c24-b4f5-3db93c86d7bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IqofYvJD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:16:10 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-f2be59a9-3cff-4a8f-a610-cbabb215bcc8 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:16:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-f2be59a9-3cff-4a8f-a610-cbabb215bcc8 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:16:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-f2be59a9-3cff-4a8f-a610-cbabb215bcc8 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:16:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:10 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[054514b7-27af-4a62-9322-660d04e3de4a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:744cc806-ecce-4c24-b4f5-3db93c86d7bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2be59a9-3cff-4a8f-a610-cbabb215bcc8 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 04:16:10 user nova-compute[103546]: No targets found.
Nov 16 04:16:10 user nova-compute[103546]: iSNS:
Nov 16 04:16:10 user nova-compute[103546]: No targets found.
Nov 16 04:16:10 user nova-compute[103546]: STATIC:
Nov 16 04:16:10 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:744cc806-ecce-4c24-b4f5-3db93c86d7bd
Nov 16 04:16:10 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:16:10 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:16:10 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597
Nov 16 04:16:10 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:16:10 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:16:10 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a
Nov 16 04:16:10 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:16:10 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:16:10 user nova-compute[103546]: FIRMWARE:
Nov 16 04:16:10 user nova-compute[103546]: No targets found.
Nov 16 04:16:10 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:16:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2be59a9-3cff-4a8f-a610-cbabb215bcc8 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 04:16:10 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 04:16:10 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 04:16:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2be59a9-3cff-4a8f-a610-cbabb215bcc8 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:744cc806-ecce-4c24-b4f5-3db93c86d7bd', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 04:16:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:10 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0bd88e7-efb2-4611-8aff-92a4eae104d0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:744cc806-ecce-4c24-b4f5-3db93c86d7bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:10 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a63a1d-82c0-42d8-addb-9ff50a75f94d]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744cc806-ecce-4c24-b4f5-3db93c86d7bd (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2be59a9-3cff-4a8f-a610-cbabb215bcc8 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 (non-flash)
Nov 16 04:16:10 user nova-compute[103546]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744cc806-ecce-4c24-b4f5-3db93c86d7bd (non-flash)
Nov 16 04:16:10 user nova-compute[103546]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a (non-flash)
Nov 16 04:16:10 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:16:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2be59a9-3cff-4a8f-a610-cbabb215bcc8 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 (non-flash)
Nov 16 04:16:10 user nova-compute[103546]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744cc806-ecce-4c24-b4f5-3db93c86d7bd (non-flash)
Nov 16 04:16:10 user nova-compute[103546]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a (non-flash)
Nov 16 04:16:10 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:16:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2be59a9-3cff-4a8f-a610-cbabb215bcc8 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60cce05630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:744cc806-ecce-4c24-b4f5-3db93c86d7bd'): ({'sdc'}, set())}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 04:16:10 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-f2be59a9-3cff-4a8f-a610-cbabb215bcc8 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Removing single pathed devices sdc {{(pid=103546) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 04:16:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:10 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[433364c8-647d-4b74-8716-db9d36c51114]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:10 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff156fc5-f041-4fcd-ac79-808f5fd56394]: (4, ('ok\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:10 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-f2be59a9-3cff-4a8f-a610-cbabb215bcc8 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Flushing IO for device /dev/sdc {{(pid=103546) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 04:16:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:10 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e016a2b-1423-4ba9-922e-e22eb8ac9c09]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:10 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-f2be59a9-3cff-4a8f-a610-cbabb215bcc8 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=103546) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 04:16:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:10 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d55d92f-7cde-4502-943b-c97fe1b4b7e2]: (4, ('1', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:10 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-f2be59a9-3cff-4a8f-a610-cbabb215bcc8 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 04:16:10 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-f2be59a9-3cff-4a8f-a610-cbabb215bcc8 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] SCSI volumes sdc have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 04:16:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2be59a9-3cff-4a8f-a610-cbabb215bcc8 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:744cc806-ecce-4c24-b4f5-3db93c86d7bd')] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 04:16:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744cc806-ecce-4c24-b4f5-3db93c86d7bd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744cc806-ecce-4c24-b4f5-3db93c86d7bd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:10 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e32b38-192e-4fef-a782-f5b6435cd90c]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2be59a9-3cff-4a8f-a610-cbabb215bcc8 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:16:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744cc806-ecce-4c24-b4f5-3db93c86d7bd -p 172.16.0.220:3260 --logout {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744cc806-ecce-4c24-b4f5-3db93c86d7bd -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:10 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fdb22e6-73db-42f2-8d52-4d6ef17571d0]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:744cc806-ecce-4c24-b4f5-3db93c86d7bd, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:744cc806-ecce-4c24-b4f5-3db93c86d7bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2be59a9-3cff-4a8f-a610-cbabb215bcc8 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:744cc806-ecce-4c24-b4f5-3db93c86d7bd, portal: 172.16.0.220,3260]
Nov 16 04:16:10 user nova-compute[103546]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:744cc806-ecce-4c24-b4f5-3db93c86d7bd, portal: 172.16.0.220,3260] successful.
Nov 16 04:16:10 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:16:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744cc806-ecce-4c24-b4f5-3db93c86d7bd -p 172.16.0.220:3260 --op delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:10 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744cc806-ecce-4c24-b4f5-3db93c86d7bd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:10 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3992866d-6ca1-4585-8a1c-1a49706b85dd]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2be59a9-3cff-4a8f-a610-cbabb215bcc8 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:16:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-f2be59a9-3cff-4a8f-a610-cbabb215bcc8 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:16:10 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2be59a9-3cff-4a8f-a610-cbabb215bcc8 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] <== disconnect_volume: return (332ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:16:10 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2be59a9-3cff-4a8f-a610-cbabb215bcc8 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 04:16:11 user nova-compute[103546]: INFO nova.compute.manager [None req-ba8e9822-d83c-4a2b-a066-4398daa0052c tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Unrescuing
Nov 16 04:16:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-ba8e9822-d83c-4a2b-a066-4398daa0052c tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Acquiring lock "refresh_cache-2fdca5a2-7e02-4c4a-96ae-cc61547232c1" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:16:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-ba8e9822-d83c-4a2b-a066-4398daa0052c tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Acquired lock "refresh_cache-2fdca5a2-7e02-4c4a-96ae-cc61547232c1" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:16:11 user nova-compute[103546]: DEBUG nova.network.neutron [None req-ba8e9822-d83c-4a2b-a066-4398daa0052c tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 04:16:11 user nova-compute[103546]: DEBUG nova.objects.instance [None req-f2be59a9-3cff-4a8f-a610-cbabb215bcc8 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lazy-loading 'flavor' on Instance uuid 96d12e49-5dc7-43ad-9f6b-b366a8e7013d {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:16:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f2be59a9-3cff-4a8f-a610-cbabb215bcc8 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lock "96d12e49-5dc7-43ad-9f6b-b366a8e7013d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.674s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:16:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-2f49be01-d6fa-4faa-a3a0-22e7d55cc6bb tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lock "96d12e49-5dc7-43ad-9f6b-b366a8e7013d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.546s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:16:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-2f49be01-d6fa-4faa-a3a0-22e7d55cc6bb tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Acquiring lock "96d12e49-5dc7-43ad-9f6b-b366a8e7013d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:16:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-2f49be01-d6fa-4faa-a3a0-22e7d55cc6bb tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lock "96d12e49-5dc7-43ad-9f6b-b366a8e7013d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:16:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-2f49be01-d6fa-4faa-a3a0-22e7d55cc6bb tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lock "96d12e49-5dc7-43ad-9f6b-b366a8e7013d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:16:11 user nova-compute[103546]: INFO nova.compute.manager [None req-2f49be01-d6fa-4faa-a3a0-22e7d55cc6bb tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Terminating instance
Nov 16 04:16:11 user nova-compute[103546]: DEBUG nova.compute.manager [None req-2f49be01-d6fa-4faa-a3a0-22e7d55cc6bb tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Start destroying the instance on the hypervisor. {{(pid=103546) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 04:16:11 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:16:11 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:16:11 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:16:11 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:16:11 user nova-compute[103546]: DEBUG nova.compute.manager [req-f60e35ee-c0b0-4b85-bcbe-3aebd90824ce req-9e1f7fd6-d87c-4439-83b3-f3e93d57e8c4 service nova] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Received event network-vif-unplugged-8450ed01-4f54-4d95-ac8a-fcc4057ac88a {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:16:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-f60e35ee-c0b0-4b85-bcbe-3aebd90824ce req-9e1f7fd6-d87c-4439-83b3-f3e93d57e8c4 service nova] Acquiring lock "96d12e49-5dc7-43ad-9f6b-b366a8e7013d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:16:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-f60e35ee-c0b0-4b85-bcbe-3aebd90824ce req-9e1f7fd6-d87c-4439-83b3-f3e93d57e8c4 service nova] Lock "96d12e49-5dc7-43ad-9f6b-b366a8e7013d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:16:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-f60e35ee-c0b0-4b85-bcbe-3aebd90824ce req-9e1f7fd6-d87c-4439-83b3-f3e93d57e8c4 service nova] Lock "96d12e49-5dc7-43ad-9f6b-b366a8e7013d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:16:11 user nova-compute[103546]: DEBUG nova.compute.manager [req-f60e35ee-c0b0-4b85-bcbe-3aebd90824ce req-9e1f7fd6-d87c-4439-83b3-f3e93d57e8c4 service nova] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] No waiting events found dispatching network-vif-unplugged-8450ed01-4f54-4d95-ac8a-fcc4057ac88a {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:16:11 user nova-compute[103546]: DEBUG nova.compute.manager [req-f60e35ee-c0b0-4b85-bcbe-3aebd90824ce req-9e1f7fd6-d87c-4439-83b3-f3e93d57e8c4 service nova] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Received event network-vif-unplugged-8450ed01-4f54-4d95-ac8a-fcc4057ac88a for instance with task_state deleting. {{(pid=103546) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 04:16:11 user nova-compute[103546]: DEBUG nova.network.neutron [None req-ba8e9822-d83c-4a2b-a066-4398daa0052c tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Updating instance_info_cache with network_info: [{"id": "9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a", "address": "fa:16:3e:f0:c5:13", "network": {"id": "5f10f091-8358-4c8c-92bb-999d989f26b0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-513865819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18a17119476d4eea9a39078a48af5a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a11f3f3-1a", "ovs_interfaceid": "9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:16:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-ba8e9822-d83c-4a2b-a066-4398daa0052c tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Releasing lock "refresh_cache-2fdca5a2-7e02-4c4a-96ae-cc61547232c1" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:16:11 user nova-compute[103546]: DEBUG nova.objects.instance [None req-ba8e9822-d83c-4a2b-a066-4398daa0052c tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Lazy-loading 'flavor' on Instance uuid 2fdca5a2-7e02-4c4a-96ae-cc61547232c1 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:16:11 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:16:11 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:16:11 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:16:11 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:16:11 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:16:11 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:16:11 user nova-compute[103546]: DEBUG nova.compute.manager [req-6270875c-8138-41cf-bf1c-2a936ceb24ae req-b7b54aa0-2047-4de6-9fc3-2c75475148b5 service nova] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Received event network-vif-unplugged-9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:16:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6270875c-8138-41cf-bf1c-2a936ceb24ae req-b7b54aa0-2047-4de6-9fc3-2c75475148b5 service nova] Acquiring lock "2fdca5a2-7e02-4c4a-96ae-cc61547232c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:16:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6270875c-8138-41cf-bf1c-2a936ceb24ae req-b7b54aa0-2047-4de6-9fc3-2c75475148b5 service nova] Lock "2fdca5a2-7e02-4c4a-96ae-cc61547232c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:16:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6270875c-8138-41cf-bf1c-2a936ceb24ae req-b7b54aa0-2047-4de6-9fc3-2c75475148b5 service nova] Lock "2fdca5a2-7e02-4c4a-96ae-cc61547232c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:16:11 user nova-compute[103546]: DEBUG nova.compute.manager [req-6270875c-8138-41cf-bf1c-2a936ceb24ae req-b7b54aa0-2047-4de6-9fc3-2c75475148b5 service nova] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] No waiting events found dispatching network-vif-unplugged-9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:16:11 user nova-compute[103546]: WARNING nova.compute.manager [req-6270875c-8138-41cf-bf1c-2a936ceb24ae req-b7b54aa0-2047-4de6-9fc3-2c75475148b5 service nova] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Received unexpected event network-vif-unplugged-9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a for instance with vm_state rescued and task_state unrescuing.
Nov 16 04:16:11 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:16:12 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Instance destroyed successfully.
Nov 16 04:16:12 user nova-compute[103546]: DEBUG nova.objects.instance [None req-2f49be01-d6fa-4faa-a3a0-22e7d55cc6bb tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lazy-loading 'resources' on Instance uuid 96d12e49-5dc7-43ad-9f6b-b366a8e7013d {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:16:12 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-2f49be01-d6fa-4faa-a3a0-22e7d55cc6bb tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:13:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-215095677',display_name='tempest-VolumesSnapshotTestJSON-instance-215095677',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-215095677',id=48,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+qYfiAB8R1GUBROxaRlEoAS7GwSEbkHq9U0YoJu8lCz8+AsQsvouMn8QL4UJLsNc8kGFnt67K+TwjoPnwaoNMHM1dDVA+hPTQK0q/kTtiVU1Pi0op4D6FpRx4VJGXrSA==',key_name='tempest-keypair-295918848',keypairs=<?>,launch_index=0,launched_at=2023-11-16T04:13:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c7de09c5b11a4b0f96a66c9788e5942c',ramdisk_id='',reservation_id='r-374z77yw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1700179265',owner_user_name='tempest-VolumesSnapshotTestJSON-1700179265-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T04:13:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04ea7f587fd94211b18f97f3fe23714a',uuid=96d12e49-5dc7-43ad-9f6b-b366a8e7013d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8450ed01-4f54-4d95-ac8a-fcc4057ac88a", "address": "fa:16:3e:4f:91:ee", "network": {"id": "855d0097-2e3c-4168-900e-d811676a8bff", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1275657618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7de09c5b11a4b0f96a66c9788e5942c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8450ed01-4f", "ovs_interfaceid": "8450ed01-4f54-4d95-ac8a-fcc4057ac88a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 04:16:12 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-2f49be01-d6fa-4faa-a3a0-22e7d55cc6bb tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Converting VIF {"id": "8450ed01-4f54-4d95-ac8a-fcc4057ac88a", "address": "fa:16:3e:4f:91:ee", "network": {"id": "855d0097-2e3c-4168-900e-d811676a8bff", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1275657618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7de09c5b11a4b0f96a66c9788e5942c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8450ed01-4f", "ovs_interfaceid": "8450ed01-4f54-4d95-ac8a-fcc4057ac88a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:16:12 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-2f49be01-d6fa-4faa-a3a0-22e7d55cc6bb tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:91:ee,bridge_name='br-int',has_traffic_filtering=True,id=8450ed01-4f54-4d95-ac8a-fcc4057ac88a,network=Network(855d0097-2e3c-4168-900e-d811676a8bff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8450ed01-4f') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:16:12 user nova-compute[103546]: DEBUG os_vif [None req-2f49be01-d6fa-4faa-a3a0-22e7d55cc6bb tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:91:ee,bridge_name='br-int',has_traffic_filtering=True,id=8450ed01-4f54-4d95-ac8a-fcc4057ac88a,network=Network(855d0097-2e3c-4168-900e-d811676a8bff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8450ed01-4f') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 04:16:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:16:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8450ed01-4f, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:16:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:16:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:16:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:16:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:16:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=226a96b0-7de3-4d3e-bc06-eb496cc977fa) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:16:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:16:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:16:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:16:12 user nova-compute[103546]: INFO os_vif [None req-2f49be01-d6fa-4faa-a3a0-22e7d55cc6bb tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:91:ee,bridge_name='br-int',has_traffic_filtering=True,id=8450ed01-4f54-4d95-ac8a-fcc4057ac88a,network=Network(855d0097-2e3c-4168-900e-d811676a8bff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8450ed01-4f')
Nov 16 04:16:12 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f49be01-d6fa-4faa-a3a0-22e7d55cc6bb tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 04:16:12 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f49be01-d6fa-4faa-a3a0-22e7d55cc6bb tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:744cc806-ecce-4c24-b4f5-3db93c86d7bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IqofYvJD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:16:12 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-2f49be01-d6fa-4faa-a3a0-22e7d55cc6bb tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:16:12 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-2f49be01-d6fa-4faa-a3a0-22e7d55cc6bb tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:16:12 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-2f49be01-d6fa-4faa-a3a0-22e7d55cc6bb tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:16:12 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:12 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:12 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf249fb-b9f7-4344-b3f2-73522b881f77]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:12 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f49be01-d6fa-4faa-a3a0-22e7d55cc6bb tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 04:16:12 user nova-compute[103546]: No targets found.
Nov 16 04:16:12 user nova-compute[103546]: iSNS:
Nov 16 04:16:12 user nova-compute[103546]: No targets found.
Nov 16 04:16:12 user nova-compute[103546]: STATIC:
Nov 16 04:16:12 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597
Nov 16 04:16:12 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:16:12 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:16:12 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a
Nov 16 04:16:12 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:16:12 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:16:12 user nova-compute[103546]: FIRMWARE:
Nov 16 04:16:12 user nova-compute[103546]: No targets found.
Nov 16 04:16:12 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:16:12 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f49be01-d6fa-4faa-a3a0-22e7d55cc6bb tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 04:16:12 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 04:16:12 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 04:16:12 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f49be01-d6fa-4faa-a3a0-22e7d55cc6bb tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:744cc806-ecce-4c24-b4f5-3db93c86d7bd', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 04:16:12 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:12 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:12 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bbc66dd-c473-4834-a996-fd09a9350d9c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:12 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:12 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:12 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a01476-a9b4-40ce-97e4-87dfc1cb3a0c]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:12 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f49be01-d6fa-4faa-a3a0-22e7d55cc6bb tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 (non-flash)
Nov 16 04:16:12 user nova-compute[103546]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a (non-flash)
Nov 16 04:16:12 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:16:12 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f49be01-d6fa-4faa-a3a0-22e7d55cc6bb tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 (non-flash)
Nov 16 04:16:12 user nova-compute[103546]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a (non-flash)
Nov 16 04:16:12 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:16:12 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f49be01-d6fa-4faa-a3a0-22e7d55cc6bb tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60ac54f1c0>, {}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 04:16:12 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f49be01-d6fa-4faa-a3a0-22e7d55cc6bb tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Disconnecting from: [] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 04:16:12 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-2f49be01-d6fa-4faa-a3a0-22e7d55cc6bb tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.070s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:16:12 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f49be01-d6fa-4faa-a3a0-22e7d55cc6bb tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] <== disconnect_volume: return (71ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:16:12 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f49be01-d6fa-4faa-a3a0-22e7d55cc6bb tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 04:16:12 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-2f49be01-d6fa-4faa-a3a0-22e7d55cc6bb tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Deleting instance files /opt/stack/data/nova/instances/96d12e49-5dc7-43ad-9f6b-b366a8e7013d_del
Nov 16 04:16:12 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-2f49be01-d6fa-4faa-a3a0-22e7d55cc6bb tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Deletion of /opt/stack/data/nova/instances/96d12e49-5dc7-43ad-9f6b-b366a8e7013d_del complete
Nov 16 04:16:12 user nova-compute[103546]: INFO nova.compute.manager [None req-2f49be01-d6fa-4faa-a3a0-22e7d55cc6bb tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 16 04:16:12 user nova-compute[103546]: DEBUG oslo.service.loopingcall [None req-2f49be01-d6fa-4faa-a3a0-22e7d55cc6bb tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=103546) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 04:16:12 user nova-compute[103546]: DEBUG nova.compute.manager [-] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Deallocating network for instance {{(pid=103546) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 04:16:12 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] deallocate_for_instance() {{(pid=103546) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 04:16:12 user nova-compute[103546]: DEBUG nova.compute.manager [req-3a101f03-5b92-4ac4-8d5d-f39ec57abdbd req-69ddf084-f70f-454d-8a31-1780004504c7 service nova] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Received event network-changed-9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:16:12 user nova-compute[103546]: DEBUG nova.compute.manager [req-3a101f03-5b92-4ac4-8d5d-f39ec57abdbd req-69ddf084-f70f-454d-8a31-1780004504c7 service nova] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Refreshing instance network info cache due to event network-changed-9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 04:16:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3a101f03-5b92-4ac4-8d5d-f39ec57abdbd req-69ddf084-f70f-454d-8a31-1780004504c7 service nova] Acquiring lock "refresh_cache-2fdca5a2-7e02-4c4a-96ae-cc61547232c1" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:16:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3a101f03-5b92-4ac4-8d5d-f39ec57abdbd req-69ddf084-f70f-454d-8a31-1780004504c7 service nova] Acquired lock "refresh_cache-2fdca5a2-7e02-4c4a-96ae-cc61547232c1" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:16:12 user nova-compute[103546]: DEBUG nova.network.neutron [req-3a101f03-5b92-4ac4-8d5d-f39ec57abdbd req-69ddf084-f70f-454d-8a31-1780004504c7 service nova] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Refreshing network info cache for port 9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 04:16:12 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Instance destroyed successfully.
Nov 16 04:16:12 user nova-compute[103546]: DEBUG nova.network.neutron [req-3a101f03-5b92-4ac4-8d5d-f39ec57abdbd req-69ddf084-f70f-454d-8a31-1780004504c7 service nova] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Updated VIF entry in instance network info cache for port 9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 04:16:12 user nova-compute[103546]: DEBUG nova.network.neutron [req-3a101f03-5b92-4ac4-8d5d-f39ec57abdbd req-69ddf084-f70f-454d-8a31-1780004504c7 service nova] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Updating instance_info_cache with network_info: [{"id": "9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a", "address": "fa:16:3e:f0:c5:13", "network": {"id": "5f10f091-8358-4c8c-92bb-999d989f26b0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-513865819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18a17119476d4eea9a39078a48af5a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a11f3f3-1a", "ovs_interfaceid": "9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:16:12 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3a101f03-5b92-4ac4-8d5d-f39ec57abdbd req-69ddf084-f70f-454d-8a31-1780004504c7 service nova] Releasing lock "refresh_cache-2fdca5a2-7e02-4c4a-96ae-cc61547232c1" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:16:13 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:16:13 user nova-compute[103546]: INFO nova.compute.manager [-] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Took 1.03 seconds to deallocate network for instance.
Nov 16 04:16:13 user nova-compute[103546]: WARNING nova.volume.cinder [None req-2f49be01-d6fa-4faa-a3a0-22e7d55cc6bb tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Attachment 3481b649-c4fe-45f8-84ad-d4ae4c9cacfe does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 3481b649-c4fe-45f8-84ad-d4ae4c9cacfe. (HTTP 404) (Request-ID: req-5c4579cd-6c4e-4ced-a63e-bf04d312650e)
Nov 16 04:16:13 user nova-compute[103546]: INFO nova.compute.manager [None req-2f49be01-d6fa-4faa-a3a0-22e7d55cc6bb tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Took 0.04 seconds to detach 1 volumes for instance.
Nov 16 04:16:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-2f49be01-d6fa-4faa-a3a0-22e7d55cc6bb tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:16:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-2f49be01-d6fa-4faa-a3a0-22e7d55cc6bb tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:16:13 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-2f49be01-d6fa-4faa-a3a0-22e7d55cc6bb tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:16:13 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-2f49be01-d6fa-4faa-a3a0-22e7d55cc6bb tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:16:13 user nova-compute[103546]: DEBUG nova.compute.manager [req-1d7ecfb2-b7ce-4270-a67d-8d2cc9736088 req-309e2ed8-fec7-4143-9df4-33bcb7e7c916 service nova] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Received event network-vif-plugged-8450ed01-4f54-4d95-ac8a-fcc4057ac88a {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:16:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-1d7ecfb2-b7ce-4270-a67d-8d2cc9736088 req-309e2ed8-fec7-4143-9df4-33bcb7e7c916 service nova] Acquiring lock "96d12e49-5dc7-43ad-9f6b-b366a8e7013d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:16:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-1d7ecfb2-b7ce-4270-a67d-8d2cc9736088 req-309e2ed8-fec7-4143-9df4-33bcb7e7c916 service nova] Lock "96d12e49-5dc7-43ad-9f6b-b366a8e7013d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:16:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-1d7ecfb2-b7ce-4270-a67d-8d2cc9736088 req-309e2ed8-fec7-4143-9df4-33bcb7e7c916 service nova] Lock "96d12e49-5dc7-43ad-9f6b-b366a8e7013d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:16:13 user nova-compute[103546]: DEBUG nova.compute.manager [req-1d7ecfb2-b7ce-4270-a67d-8d2cc9736088 req-309e2ed8-fec7-4143-9df4-33bcb7e7c916 service nova] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] No waiting events found dispatching network-vif-plugged-8450ed01-4f54-4d95-ac8a-fcc4057ac88a {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:16:13 user nova-compute[103546]: WARNING nova.compute.manager [req-1d7ecfb2-b7ce-4270-a67d-8d2cc9736088 req-309e2ed8-fec7-4143-9df4-33bcb7e7c916 service nova] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Received unexpected event network-vif-plugged-8450ed01-4f54-4d95-ac8a-fcc4057ac88a for instance with vm_state deleted and task_state None.
Nov 16 04:16:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-2f49be01-d6fa-4faa-a3a0-22e7d55cc6bb tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.173s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:16:13 user nova-compute[103546]: INFO nova.scheduler.client.report [None req-2f49be01-d6fa-4faa-a3a0-22e7d55cc6bb tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Deleted allocations for instance 96d12e49-5dc7-43ad-9f6b-b366a8e7013d
Nov 16 04:16:13 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-2f49be01-d6fa-4faa-a3a0-22e7d55cc6bb tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lock "96d12e49-5dc7-43ad-9f6b-b366a8e7013d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.377s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:16:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:16:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:16:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:16:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:16:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:16:14 user nova-compute[103546]: DEBUG nova.compute.manager [req-89f28c76-e637-47bd-97fe-0d465a14289e req-75309fe9-c7c1-449f-a107-d995f947ffac service nova] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Received event network-vif-plugged-9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:16:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-89f28c76-e637-47bd-97fe-0d465a14289e req-75309fe9-c7c1-449f-a107-d995f947ffac service nova] Acquiring lock "2fdca5a2-7e02-4c4a-96ae-cc61547232c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:16:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-89f28c76-e637-47bd-97fe-0d465a14289e req-75309fe9-c7c1-449f-a107-d995f947ffac service nova] Lock "2fdca5a2-7e02-4c4a-96ae-cc61547232c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:16:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-89f28c76-e637-47bd-97fe-0d465a14289e req-75309fe9-c7c1-449f-a107-d995f947ffac service nova] Lock "2fdca5a2-7e02-4c4a-96ae-cc61547232c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:16:14 user nova-compute[103546]: DEBUG nova.compute.manager [req-89f28c76-e637-47bd-97fe-0d465a14289e req-75309fe9-c7c1-449f-a107-d995f947ffac service nova] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] No waiting events found dispatching network-vif-plugged-9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:16:14 user nova-compute[103546]: WARNING nova.compute.manager [req-89f28c76-e637-47bd-97fe-0d465a14289e req-75309fe9-c7c1-449f-a107-d995f947ffac service nova] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Received unexpected event network-vif-plugged-9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a for instance with vm_state rescued and task_state unrescuing.
Nov 16 04:16:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:16:14 user nova-compute[103546]: DEBUG nova.compute.manager [req-61721ae7-b69d-44a9-88bf-49f7eb829181 req-67eb620d-c17c-432b-9be7-eae93ad1bbd9 service nova] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Received event network-changed-9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:16:14 user nova-compute[103546]: DEBUG nova.compute.manager [req-61721ae7-b69d-44a9-88bf-49f7eb829181 req-67eb620d-c17c-432b-9be7-eae93ad1bbd9 service nova] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Refreshing instance network info cache due to event network-changed-9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 04:16:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-61721ae7-b69d-44a9-88bf-49f7eb829181 req-67eb620d-c17c-432b-9be7-eae93ad1bbd9 service nova] Acquiring lock "refresh_cache-2fdca5a2-7e02-4c4a-96ae-cc61547232c1" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:16:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-61721ae7-b69d-44a9-88bf-49f7eb829181 req-67eb620d-c17c-432b-9be7-eae93ad1bbd9 service nova] Acquired lock "refresh_cache-2fdca5a2-7e02-4c4a-96ae-cc61547232c1" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:16:14 user nova-compute[103546]: DEBUG nova.network.neutron [req-61721ae7-b69d-44a9-88bf-49f7eb829181 req-67eb620d-c17c-432b-9be7-eae93ad1bbd9 service nova] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Refreshing network info cache for port 9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 04:16:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:16:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:16:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:16:14 user nova-compute[103546]: DEBUG nova.network.neutron [req-61721ae7-b69d-44a9-88bf-49f7eb829181 req-67eb620d-c17c-432b-9be7-eae93ad1bbd9 service nova] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Updated VIF entry in instance network info cache for port 9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 04:16:14 user nova-compute[103546]: DEBUG nova.network.neutron [req-61721ae7-b69d-44a9-88bf-49f7eb829181 req-67eb620d-c17c-432b-9be7-eae93ad1bbd9 service nova] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Updating instance_info_cache with network_info: [{"id": "9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a", "address": "fa:16:3e:f0:c5:13", "network": {"id": "5f10f091-8358-4c8c-92bb-999d989f26b0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-513865819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18a17119476d4eea9a39078a48af5a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a11f3f3-1a", "ovs_interfaceid": "9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:16:14 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-61721ae7-b69d-44a9-88bf-49f7eb829181 req-67eb620d-c17c-432b-9be7-eae93ad1bbd9 service nova] Releasing lock "refresh_cache-2fdca5a2-7e02-4c4a-96ae-cc61547232c1" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:16:14 user nova-compute[103546]: DEBUG nova.compute.manager [req-61721ae7-b69d-44a9-88bf-49f7eb829181 req-67eb620d-c17c-432b-9be7-eae93ad1bbd9 service nova] [instance: 96d12e49-5dc7-43ad-9f6b-b366a8e7013d] Received event network-vif-deleted-8450ed01-4f54-4d95-ac8a-fcc4057ac88a {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:16:15 user nova-compute[103546]: DEBUG nova.compute.manager [None req-ba8e9822-d83c-4a2b-a066-4398daa0052c tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 04:16:15 user nova-compute[103546]: DEBUG nova.compute.manager [req-2b406b10-6eb9-4870-8847-b58bf2244a25 req-ab26eb50-2b72-4ae0-ad5b-b36f82ba2ab6 service nova] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Received event network-changed-b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:16:15 user nova-compute[103546]: DEBUG nova.compute.manager [req-2b406b10-6eb9-4870-8847-b58bf2244a25 req-ab26eb50-2b72-4ae0-ad5b-b36f82ba2ab6 service nova] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Refreshing instance network info cache due to event network-changed-b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 04:16:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-2b406b10-6eb9-4870-8847-b58bf2244a25 req-ab26eb50-2b72-4ae0-ad5b-b36f82ba2ab6 service nova] Acquiring lock "refresh_cache-a276ab3f-657a-4148-bd08-007f79230ace" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:16:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-2b406b10-6eb9-4870-8847-b58bf2244a25 req-ab26eb50-2b72-4ae0-ad5b-b36f82ba2ab6 service nova] Acquired lock "refresh_cache-a276ab3f-657a-4148-bd08-007f79230ace" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:16:15 user nova-compute[103546]: DEBUG nova.network.neutron [req-2b406b10-6eb9-4870-8847-b58bf2244a25 req-ab26eb50-2b72-4ae0-ad5b-b36f82ba2ab6 service nova] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Refreshing network info cache for port b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 04:16:16 user nova-compute[103546]: DEBUG nova.compute.manager [req-3c38385c-5ed9-4b14-bfbe-7e6194cee6f0 req-e449978e-bf15-4a67-8527-9ccccb5b00ee service nova] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Received event network-vif-plugged-9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:16:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3c38385c-5ed9-4b14-bfbe-7e6194cee6f0 req-e449978e-bf15-4a67-8527-9ccccb5b00ee service nova] Acquiring lock "2fdca5a2-7e02-4c4a-96ae-cc61547232c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:16:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3c38385c-5ed9-4b14-bfbe-7e6194cee6f0 req-e449978e-bf15-4a67-8527-9ccccb5b00ee service nova] Lock "2fdca5a2-7e02-4c4a-96ae-cc61547232c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:16:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3c38385c-5ed9-4b14-bfbe-7e6194cee6f0 req-e449978e-bf15-4a67-8527-9ccccb5b00ee service nova] Lock "2fdca5a2-7e02-4c4a-96ae-cc61547232c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:16:16 user nova-compute[103546]: DEBUG nova.compute.manager [req-3c38385c-5ed9-4b14-bfbe-7e6194cee6f0 req-e449978e-bf15-4a67-8527-9ccccb5b00ee service nova] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] No waiting events found dispatching network-vif-plugged-9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:16:16 user nova-compute[103546]: WARNING nova.compute.manager [req-3c38385c-5ed9-4b14-bfbe-7e6194cee6f0 req-e449978e-bf15-4a67-8527-9ccccb5b00ee service nova] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Received unexpected event network-vif-plugged-9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a for instance with vm_state active and task_state None.
Nov 16 04:16:16 user nova-compute[103546]: DEBUG nova.compute.manager [req-3c38385c-5ed9-4b14-bfbe-7e6194cee6f0 req-e449978e-bf15-4a67-8527-9ccccb5b00ee service nova] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Received event network-vif-plugged-9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:16:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3c38385c-5ed9-4b14-bfbe-7e6194cee6f0 req-e449978e-bf15-4a67-8527-9ccccb5b00ee service nova] Acquiring lock "2fdca5a2-7e02-4c4a-96ae-cc61547232c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:16:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3c38385c-5ed9-4b14-bfbe-7e6194cee6f0 req-e449978e-bf15-4a67-8527-9ccccb5b00ee service nova] Lock "2fdca5a2-7e02-4c4a-96ae-cc61547232c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:16:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3c38385c-5ed9-4b14-bfbe-7e6194cee6f0 req-e449978e-bf15-4a67-8527-9ccccb5b00ee service nova] Lock "2fdca5a2-7e02-4c4a-96ae-cc61547232c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:16:16 user nova-compute[103546]: DEBUG nova.compute.manager [req-3c38385c-5ed9-4b14-bfbe-7e6194cee6f0 req-e449978e-bf15-4a67-8527-9ccccb5b00ee service nova] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] No waiting events found dispatching network-vif-plugged-9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:16:16 user nova-compute[103546]: WARNING nova.compute.manager [req-3c38385c-5ed9-4b14-bfbe-7e6194cee6f0 req-e449978e-bf15-4a67-8527-9ccccb5b00ee service nova] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Received unexpected event network-vif-plugged-9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a for instance with vm_state active and task_state None.
Nov 16 04:16:16 user nova-compute[103546]: DEBUG nova.network.neutron [req-2b406b10-6eb9-4870-8847-b58bf2244a25 req-ab26eb50-2b72-4ae0-ad5b-b36f82ba2ab6 service nova] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Updated VIF entry in instance network info cache for port b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 04:16:16 user nova-compute[103546]: DEBUG nova.network.neutron [req-2b406b10-6eb9-4870-8847-b58bf2244a25 req-ab26eb50-2b72-4ae0-ad5b-b36f82ba2ab6 service nova] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Updating instance_info_cache with network_info: [{"id": "b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3", "address": "fa:16:3e:52:f7:34", "network": {"id": "a758762c-c27c-4509-9870-1d42187aeaf4", "bridge": "br-int", "label": "tempest-TestStampPattern-405695915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21df2cbfb9234c13a504ad4a513970f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9fb2a6f-ec", "ovs_interfaceid": "b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:16:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-2b406b10-6eb9-4870-8847-b58bf2244a25 req-ab26eb50-2b72-4ae0-ad5b-b36f82ba2ab6 service nova] Releasing lock "refresh_cache-a276ab3f-657a-4148-bd08-007f79230ace" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:16:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f334588b-2973-4686-9e80-59eb8d14b276 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Acquiring lock "a276ab3f-657a-4148-bd08-007f79230ace" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:16:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f334588b-2973-4686-9e80-59eb8d14b276 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lock "a276ab3f-657a-4148-bd08-007f79230ace" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:16:16 user nova-compute[103546]: DEBUG nova.objects.instance [None req-f334588b-2973-4686-9e80-59eb8d14b276 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lazy-loading 'flavor' on Instance uuid a276ab3f-657a-4148-bd08-007f79230ace {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:16:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f334588b-2973-4686-9e80-59eb8d14b276 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lock "a276ab3f-657a-4148-bd08-007f79230ace" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:16:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f334588b-2973-4686-9e80-59eb8d14b276 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Acquiring lock "a276ab3f-657a-4148-bd08-007f79230ace" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:16:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f334588b-2973-4686-9e80-59eb8d14b276 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lock "a276ab3f-657a-4148-bd08-007f79230ace" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:16:16 user nova-compute[103546]: INFO nova.compute.manager [None req-f334588b-2973-4686-9e80-59eb8d14b276 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Attaching volume f2b52ebe-cd9f-4638-a561-cbd91607a6b7 to /dev/vdb
Nov 16 04:16:16 user nova-compute[103546]: DEBUG os_brick.utils [None req-f334588b-2973-4686-9e80-59eb8d14b276 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:16:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:16 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29e4e0a-b552-44b7-93d7-1ebc45d94182]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af5c39b14ece\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:16 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b6beba1-c819-4f79-8b85-42ddd7a47238]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:16 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[6287dd1e-423f-424a-bf13-d112c77a5cf0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:16 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e257c0-55af-4cea-ae5c-f0ba914fbff5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-f334588b-2973-4686-9e80-59eb8d14b276 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Running cmd (subprocess): nvme version {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-f334588b-2973-4686-9e80-59eb8d14b276 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] 'nvme version' failed. Not Retrying. {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 04:16:16 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f334588b-2973-4686-9e80-59eb8d14b276 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] nvme not present on system {{(pid=103546) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 04:16:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:16 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 04:16:16 user nova-compute[103546]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 04:16:16 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[70363891-544a-4c04-a1d8-d862af891b4a]: (4, '') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:16 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-f334588b-2973-4686-9e80-59eb8d14b276 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=103546) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 04:16:16 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-f334588b-2973-4686-9e80-59eb8d14b276 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 04:16:16 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-f334588b-2973-4686-9e80-59eb8d14b276 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] LIGHTOS: no hostnqn found. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 04:16:16 user nova-compute[103546]: DEBUG os_brick.utils [None req-f334588b-2973-4686-9e80-59eb8d14b276 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af5c39b14ece', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:16:16 user nova-compute[103546]: DEBUG nova.virt.block_device [None req-f334588b-2973-4686-9e80-59eb8d14b276 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Updating existing volume attachment record: 08444eee-40d3-46dc-a787-ef041166a2eb {{(pid=103546) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 04:16:17 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:16:19 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:16:21 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f334588b-2973-4686-9e80-59eb8d14b276 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 04:16:21 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f334588b-2973-4686-9e80-59eb8d14b276 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f2b52ebe-cd9f-4638-a561-cbd91607a6b7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'siKQIlwH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:16:21 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-f334588b-2973-4686-9e80-59eb8d14b276 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:16:21 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-f334588b-2973-4686-9e80-59eb8d14b276 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:16:21 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-f334588b-2973-4686-9e80-59eb8d14b276 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:16:21 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-f334588b-2973-4686-9e80-59eb8d14b276 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:16:21 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-f334588b-2973-4686-9e80-59eb8d14b276 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2b52ebe-cd9f-4638-a561-cbd91607a6b7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:16:21 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-f334588b-2973-4686-9e80-59eb8d14b276 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2b52ebe-cd9f-4638-a561-cbd91607a6b7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:16:21 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-f334588b-2973-4686-9e80-59eb8d14b276 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 04:16:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2b52ebe-cd9f-4638-a561-cbd91607a6b7 -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2b52ebe-cd9f-4638-a561-cbd91607a6b7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:21 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4a4346-6376-4013-a9db-e88b8ccc23be]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:21 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f334588b-2973-4686-9e80-59eb8d14b276 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 04:16:21 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:16:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2b52ebe-cd9f-4638-a561-cbd91607a6b7 -p 172.16.0.220:3260 --interface default --op new {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2b52ebe-cd9f-4638-a561-cbd91607a6b7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:21 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbba5374-4a9a-47eb-a3ae-499ff227bf48]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f2b52ebe-cd9f-4638-a561-cbd91607a6b7] added\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:21 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f334588b-2973-4686-9e80-59eb8d14b276 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f2b52ebe-cd9f-4638-a561-cbd91607a6b7] added
Nov 16 04:16:21 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:16:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2b52ebe-cd9f-4638-a561-cbd91607a6b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2b52ebe-cd9f-4638-a561-cbd91607a6b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:21 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[678ba9f4-a81b-4d71-9f0a-ceb8934a800e]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:21 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f334588b-2973-4686-9e80-59eb8d14b276 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:16:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2b52ebe-cd9f-4638-a561-cbd91607a6b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2b52ebe-cd9f-4638-a561-cbd91607a6b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:21 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[834e2993-db3a-4a4f-9acb-68b0eb964330]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:21 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f334588b-2973-4686-9e80-59eb8d14b276 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:16:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2b52ebe-cd9f-4638-a561-cbd91607a6b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v siKQIlwH {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2b52ebe-cd9f-4638-a561-cbd91607a6b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v siKQIlwH" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:21 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[006012d9-7698-4b23-9778-59affb205617]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:21 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f334588b-2973-4686-9e80-59eb8d14b276 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'siKQIlwH'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:16:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2b52ebe-cd9f-4638-a561-cbd91607a6b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2b52ebe-cd9f-4638-a561-cbd91607a6b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:21 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd952f8-fba2-4a8c-ac04-c3a6eef5be6d]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:21 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f334588b-2973-4686-9e80-59eb8d14b276 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:16:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:21 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4bf578-da24-407a-9ec6-01b77d04bec0]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:21 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f334588b-2973-4686-9e80-59eb8d14b276 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 (non-flash)
Nov 16 04:16:21 user nova-compute[103546]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a (non-flash)
Nov 16 04:16:21 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:16:21 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f334588b-2973-4686-9e80-59eb8d14b276 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 (non-flash)
Nov 16 04:16:21 user nova-compute[103546]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a (non-flash)
Nov 16 04:16:21 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:16:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2b52ebe-cd9f-4638-a561-cbd91607a6b7 -p 172.16.0.220:3260 --login {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2b52ebe-cd9f-4638-a561-cbd91607a6b7 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:21 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd5de5a-9905-492f-9a0b-ee4150573df1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f2b52ebe-cd9f-4638-a561-cbd91607a6b7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f2b52ebe-cd9f-4638-a561-cbd91607a6b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:21 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f334588b-2973-4686-9e80-59eb8d14b276 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f2b52ebe-cd9f-4638-a561-cbd91607a6b7, portal: 172.16.0.220,3260]
Nov 16 04:16:21 user nova-compute[103546]: Login to [iface: default, target: iqn.2010-10.org.openstack:f2b52ebe-cd9f-4638-a561-cbd91607a6b7, portal: 172.16.0.220,3260] successful.
Nov 16 04:16:21 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:16:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2b52ebe-cd9f-4638-a561-cbd91607a6b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2b52ebe-cd9f-4638-a561-cbd91607a6b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:21 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c61fa3d-8312-495b-9b26-cd6236909fb4]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:21 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f334588b-2973-4686-9e80-59eb8d14b276 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:16:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:22 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1c4bec-2857-4d1e-a833-16b1e0b77313]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b52ebe-cd9f-4638-a561-cbd91607a6b7 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:22 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f334588b-2973-4686-9e80-59eb8d14b276 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 (non-flash)
Nov 16 04:16:22 user nova-compute[103546]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a (non-flash)
Nov 16 04:16:22 user nova-compute[103546]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b52ebe-cd9f-4638-a561-cbd91607a6b7 (non-flash)
Nov 16 04:16:22 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:16:22 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f334588b-2973-4686-9e80-59eb8d14b276 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 (non-flash)
Nov 16 04:16:22 user nova-compute[103546]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a (non-flash)
Nov 16 04:16:22 user nova-compute[103546]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b52ebe-cd9f-4638-a561-cbd91607a6b7 (non-flash)
Nov 16 04:16:22 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:16:22 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-f334588b-2973-4686-9e80-59eb8d14b276 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2b52ebe-cd9f-4638-a561-cbd91607a6b7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:16:22 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f334588b-2973-4686-9e80-59eb8d14b276 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 04:16:22 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-f334588b-2973-4686-9e80-59eb8d14b276 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] HCTL ('34', '-', '-', 0) found on session 58 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 04:16:22 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-f334588b-2973-4686-9e80-59eb8d14b276 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 04:16:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:22 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[20897f96-b3c2-4d4f-a949-23165612269f]: (4, ('- - 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:22 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-f334588b-2973-4686-9e80-59eb8d14b276 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 04:16:22 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f334588b-2973-4686-9e80-59eb8d14b276 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f2b52ebe-cd9f-4638-a561-cbd91607a6b7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'siKQIlwH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 04:16:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:16:23 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-f334588b-2973-4686-9e80-59eb8d14b276 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:16:23 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f334588b-2973-4686-9e80-59eb8d14b276 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '23539336662323562', 'path': '/dev/sdc'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:16:23 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f334588b-2973-4686-9e80-59eb8d14b276 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539336662323562', 'path': '/dev/sdc'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 04:16:23 user nova-compute[103546]: DEBUG nova.objects.instance [None req-f334588b-2973-4686-9e80-59eb8d14b276 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lazy-loading 'flavor' on Instance uuid a276ab3f-657a-4148-bd08-007f79230ace {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:16:23 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-f334588b-2973-4686-9e80-59eb8d14b276 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 04:16:23 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:16:23 user nova-compute[103546]:   <source dev="/dev/sdc"/>
Nov 16 04:16:23 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 04:16:23 user nova-compute[103546]:   <serial>f2b52ebe-cd9f-4638-a561-cbd91607a6b7</serial>
Nov 16 04:16:23 user nova-compute[103546]: </disk>
Nov 16 04:16:23 user nova-compute[103546]:  {{(pid=103546) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 04:16:23 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-f334588b-2973-4686-9e80-59eb8d14b276 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:16:23 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-f334588b-2973-4686-9e80-59eb8d14b276 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] No BDM found with device name vdb, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:16:23 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-f334588b-2973-4686-9e80-59eb8d14b276 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] No VIF found with MAC fa:16:3e:52:f7:34, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 04:16:23 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f334588b-2973-4686-9e80-59eb8d14b276 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lock "a276ab3f-657a-4148-bd08-007f79230ace" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.974s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:16:24 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:16:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1a8f6b4b-dd35-4f04-9f9c-92a91408c161 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Acquiring lock "a276ab3f-657a-4148-bd08-007f79230ace" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:16:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1a8f6b4b-dd35-4f04-9f9c-92a91408c161 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lock "a276ab3f-657a-4148-bd08-007f79230ace" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:16:25 user nova-compute[103546]: INFO nova.compute.manager [None req-1a8f6b4b-dd35-4f04-9f9c-92a91408c161 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Detaching volume f2b52ebe-cd9f-4638-a561-cbd91607a6b7
Nov 16 04:16:25 user nova-compute[103546]: INFO nova.virt.block_device [None req-1a8f6b4b-dd35-4f04-9f9c-92a91408c161 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Attempting to driver detach volume f2b52ebe-cd9f-4638-a561-cbd91607a6b7 from mountpoint /dev/vdb
Nov 16 04:16:25 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1a8f6b4b-dd35-4f04-9f9c-92a91408c161 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Attempting to detach device vdb from instance a276ab3f-657a-4148-bd08-007f79230ace from the persistent domain config. {{(pid=103546) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 04:16:25 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-1a8f6b4b-dd35-4f04-9f9c-92a91408c161 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 04:16:25 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:16:25 user nova-compute[103546]:   <source dev="/dev/sdc"/>
Nov 16 04:16:25 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 04:16:25 user nova-compute[103546]:   <serial>f2b52ebe-cd9f-4638-a561-cbd91607a6b7</serial>
Nov 16 04:16:25 user nova-compute[103546]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 04:16:25 user nova-compute[103546]: </disk>
Nov 16 04:16:25 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 04:16:25 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-1a8f6b4b-dd35-4f04-9f9c-92a91408c161 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Successfully detached device vdb from instance a276ab3f-657a-4148-bd08-007f79230ace from the persistent domain config.
Nov 16 04:16:25 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1a8f6b4b-dd35-4f04-9f9c-92a91408c161 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a276ab3f-657a-4148-bd08-007f79230ace from the live domain config. {{(pid=103546) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 04:16:25 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-1a8f6b4b-dd35-4f04-9f9c-92a91408c161 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 04:16:25 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:16:25 user nova-compute[103546]:   <source dev="/dev/sdc"/>
Nov 16 04:16:25 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 04:16:25 user nova-compute[103546]:   <serial>f2b52ebe-cd9f-4638-a561-cbd91607a6b7</serial>
Nov 16 04:16:25 user nova-compute[103546]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 04:16:25 user nova-compute[103546]: </disk>
Nov 16 04:16:25 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 04:16:26 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1a8f6b4b-dd35-4f04-9f9c-92a91408c161 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a276ab3f-657a-4148-bd08-007f79230ace {{(pid=103546) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 04:16:27 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:16:28 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-0c595a7d-de0f-4db5-81a3-a42c505ff2a4 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9ad85e80-259e-4d97-8087-60c1068c9826 is timed out.
Nov 16 04:16:28 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-0c595a7d-de0f-4db5-81a3-a42c505ff2a4 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Successfully detached device vdb from instance 9ad85e80-259e-4d97-8087-60c1068c9826 from the live domain config.
Nov 16 04:16:28 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c595a7d-de0f-4db5-81a3-a42c505ff2a4 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 04:16:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c595a7d-de0f-4db5-81a3-a42c505ff2a4 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eGqfpmRl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:16:28 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-0c595a7d-de0f-4db5-81a3-a42c505ff2a4 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:16:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-0c595a7d-de0f-4db5-81a3-a42c505ff2a4 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:16:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-0c595a7d-de0f-4db5-81a3-a42c505ff2a4 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:16:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:28 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68a6727-e6d3-4e44-8d9f-6322ee6654b3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f2b52ebe-cd9f-4638-a561-cbd91607a6b7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c595a7d-de0f-4db5-81a3-a42c505ff2a4 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 04:16:28 user nova-compute[103546]: No targets found.
Nov 16 04:16:28 user nova-compute[103546]: iSNS:
Nov 16 04:16:28 user nova-compute[103546]: No targets found.
Nov 16 04:16:28 user nova-compute[103546]: STATIC:
Nov 16 04:16:28 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:f2b52ebe-cd9f-4638-a561-cbd91607a6b7
Nov 16 04:16:28 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:16:28 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:16:28 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597
Nov 16 04:16:28 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:16:28 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:16:28 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a
Nov 16 04:16:28 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:16:28 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:16:28 user nova-compute[103546]: FIRMWARE:
Nov 16 04:16:28 user nova-compute[103546]: No targets found.
Nov 16 04:16:28 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:16:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c595a7d-de0f-4db5-81a3-a42c505ff2a4 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 04:16:28 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 04:16:28 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 04:16:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c595a7d-de0f-4db5-81a3-a42c505ff2a4 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 04:16:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:28 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d03e82-55b0-4e9f-b5b4-9c9fd618fc2a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2b52ebe-cd9f-4638-a561-cbd91607a6b7\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:28 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ceb9bd-8674-4edd-b5e0-bd02d00997bb]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b52ebe-cd9f-4638-a561-cbd91607a6b7 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c595a7d-de0f-4db5-81a3-a42c505ff2a4 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 (non-flash)
Nov 16 04:16:28 user nova-compute[103546]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a (non-flash)
Nov 16 04:16:28 user nova-compute[103546]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b52ebe-cd9f-4638-a561-cbd91607a6b7 (non-flash)
Nov 16 04:16:28 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:16:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c595a7d-de0f-4db5-81a3-a42c505ff2a4 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 (non-flash)
Nov 16 04:16:28 user nova-compute[103546]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a (non-flash)
Nov 16 04:16:28 user nova-compute[103546]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b52ebe-cd9f-4638-a561-cbd91607a6b7 (non-flash)
Nov 16 04:16:28 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:16:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c595a7d-de0f-4db5-81a3-a42c505ff2a4 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60ac5d8e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a'): ({'sdd'}, set())}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 04:16:28 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-0c595a7d-de0f-4db5-81a3-a42c505ff2a4 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Removing single pathed devices sdd {{(pid=103546) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 04:16:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:28 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e057f2f3-466d-4462-91e8-1aa4243388b2]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:29 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0cacebc-7baf-4bd6-95eb-8515c6cdd84f]: (4, ('ok\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:29 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-0c595a7d-de0f-4db5-81a3-a42c505ff2a4 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Flushing IO for device /dev/sdd {{(pid=103546) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 04:16:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:29 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec99f6a7-af1a-4ef6-93d8-ae215181c16b]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:29 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-0c595a7d-de0f-4db5-81a3-a42c505ff2a4 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=103546) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 04:16:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:29 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a989cdf-976c-497e-b0df-ebd61a7aecc7]: (4, ('1', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:29 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-0c595a7d-de0f-4db5-81a3-a42c505ff2a4 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 04:16:29 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-0c595a7d-de0f-4db5-81a3-a42c505ff2a4 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] SCSI volumes sdd have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 04:16:29 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c595a7d-de0f-4db5-81a3-a42c505ff2a4 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a')] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 04:16:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:29 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e635ee6-cde6-45c4-9354-daeea3abf2d9]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:29 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c595a7d-de0f-4db5-81a3-a42c505ff2a4 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:16:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a -p 172.16.0.220:3260 --logout {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:29 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[015a7427-0a31-4b12-8159-63b0a9c054f8]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:29 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c595a7d-de0f-4db5-81a3-a42c505ff2a4 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a, portal: 172.16.0.220,3260]
Nov 16 04:16:29 user nova-compute[103546]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a, portal: 172.16.0.220,3260] successful.
Nov 16 04:16:29 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:16:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a -p 172.16.0.220:3260 --op delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19620850-bc6c-46f5-86dd-f84072c9278a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:29 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c81a59-cdb5-408e-8be3-3a5f5ea35a5a]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:29 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c595a7d-de0f-4db5-81a3-a42c505ff2a4 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:16:29 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-0c595a7d-de0f-4db5-81a3-a42c505ff2a4 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:16:29 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c595a7d-de0f-4db5-81a3-a42c505ff2a4 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] <== disconnect_volume: return (283ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:16:29 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c595a7d-de0f-4db5-81a3-a42c505ff2a4 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 04:16:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:16:29 user nova-compute[103546]: DEBUG nova.objects.instance [None req-0c595a7d-de0f-4db5-81a3-a42c505ff2a4 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Lazy-loading 'flavor' on Instance uuid 9ad85e80-259e-4d97-8087-60c1068c9826 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:16:29 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0c595a7d-de0f-4db5-81a3-a42c505ff2a4 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Lock "9ad85e80-259e-4d97-8087-60c1068c9826" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.552s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:16:32 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:16:34 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:16:35 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:16:35 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:16:35 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager.update_available_resource {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:16:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:16:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:16:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:16:35 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Auditing locally available compute resources for user (node: user) {{(pid=103546) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 04:16:35 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad85e80-259e-4d97-8087-60c1068c9826/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad85e80-259e-4d97-8087-60c1068c9826/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad85e80-259e-4d97-8087-60c1068c9826/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad85e80-259e-4d97-8087-60c1068c9826/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fdca5a2-7e02-4c4a-96ae-cc61547232c1/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fdca5a2-7e02-4c4a-96ae-cc61547232c1/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fdca5a2-7e02-4c4a-96ae-cc61547232c1/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fdca5a2-7e02-4c4a-96ae-cc61547232c1/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:36 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=103546) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 04:16:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a276ab3f-657a-4148-bd08-007f79230ace/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a276ab3f-657a-4148-bd08-007f79230ace/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a276ab3f-657a-4148-bd08-007f79230ace/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a276ab3f-657a-4148-bd08-007f79230ace/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:16:37 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:16:37 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:16:37 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Hypervisor/Node resource view: name=user free_ram=8591MB free_disk=24.972869873046875GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=103546) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 04:16:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:16:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:16:37 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 2fdca5a2-7e02-4c4a-96ae-cc61547232c1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:16:37 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 9ad85e80-259e-4d97-8087-60c1068c9826 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:16:37 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance a276ab3f-657a-4148-bd08-007f79230ace actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:16:37 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 04:16:37 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 04:16:37 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:16:37 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:16:37 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Compute_service record updated for user:user {{(pid=103546) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 04:16:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.241s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:16:38 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:16:38 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:16:38 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=103546) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 04:16:38 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:16:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:16:41 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:16:42 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:16:43 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:16:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1956a2ab-8399-4dee-9b86-f44f07b1946c tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Acquiring lock "2fdca5a2-7e02-4c4a-96ae-cc61547232c1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:16:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1956a2ab-8399-4dee-9b86-f44f07b1946c tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Lock "2fdca5a2-7e02-4c4a-96ae-cc61547232c1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:16:44 user nova-compute[103546]: INFO nova.compute.manager [None req-1956a2ab-8399-4dee-9b86-f44f07b1946c tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Detaching volume 9e16fa65-da5e-401d-ba7e-de558d1a8597
Nov 16 04:16:44 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:16:44 user nova-compute[103546]: INFO nova.virt.block_device [None req-1956a2ab-8399-4dee-9b86-f44f07b1946c tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Attempting to driver detach volume 9e16fa65-da5e-401d-ba7e-de558d1a8597 from mountpoint /dev/vdb
Nov 16 04:16:44 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1956a2ab-8399-4dee-9b86-f44f07b1946c tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Attempting to detach device vdb from instance 2fdca5a2-7e02-4c4a-96ae-cc61547232c1 from the persistent domain config. {{(pid=103546) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 04:16:44 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-1956a2ab-8399-4dee-9b86-f44f07b1946c tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 04:16:44 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:16:44 user nova-compute[103546]:   <source dev="/dev/sdb"/>
Nov 16 04:16:44 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 04:16:44 user nova-compute[103546]:   <serial>9e16fa65-da5e-401d-ba7e-de558d1a8597</serial>
Nov 16 04:16:44 user nova-compute[103546]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 04:16:44 user nova-compute[103546]: </disk>
Nov 16 04:16:44 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 04:16:44 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-1956a2ab-8399-4dee-9b86-f44f07b1946c tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Successfully detached device vdb from instance 2fdca5a2-7e02-4c4a-96ae-cc61547232c1 from the persistent domain config.
Nov 16 04:16:44 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1956a2ab-8399-4dee-9b86-f44f07b1946c tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2fdca5a2-7e02-4c4a-96ae-cc61547232c1 from the live domain config. {{(pid=103546) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 04:16:44 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-1956a2ab-8399-4dee-9b86-f44f07b1946c tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 04:16:44 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:16:44 user nova-compute[103546]:   <source dev="/dev/sdb"/>
Nov 16 04:16:44 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 04:16:44 user nova-compute[103546]:   <serial>9e16fa65-da5e-401d-ba7e-de558d1a8597</serial>
Nov 16 04:16:44 user nova-compute[103546]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 04:16:44 user nova-compute[103546]: </disk>
Nov 16 04:16:44 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 04:16:44 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:16:44 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Starting heal instance info cache {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 04:16:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "refresh_cache-9ad85e80-259e-4d97-8087-60c1068c9826" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:16:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquired lock "refresh_cache-9ad85e80-259e-4d97-8087-60c1068c9826" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:16:44 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Forcefully refreshing network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 04:16:44 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-1956a2ab-8399-4dee-9b86-f44f07b1946c tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2fdca5a2-7e02-4c4a-96ae-cc61547232c1 {{(pid=103546) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 04:16:45 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Updating instance_info_cache with network_info: [{"id": "2e72a898-1c0f-44a5-a6e2-8c3e9aa13f38", "address": "fa:16:3e:d6:a7:78", "network": {"id": "09cd9f1b-f026-441f-98b0-fcbce2718aae", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-97767409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0298f102e0042d5ac7d4e3d899fc6e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e72a898-1c", "ovs_interfaceid": "2e72a898-1c0f-44a5-a6e2-8c3e9aa13f38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:16:45 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Releasing lock "refresh_cache-9ad85e80-259e-4d97-8087-60c1068c9826" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:16:45 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Updated the network info_cache for instance {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 04:16:45 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:16:46 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-1a8f6b4b-dd35-4f04-9f9c-92a91408c161 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a276ab3f-657a-4148-bd08-007f79230ace is timed out.
Nov 16 04:16:46 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-1a8f6b4b-dd35-4f04-9f9c-92a91408c161 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Successfully detached device vdb from instance a276ab3f-657a-4148-bd08-007f79230ace from the live domain config.
Nov 16 04:16:46 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a8f6b4b-dd35-4f04-9f9c-92a91408c161 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: a276ab3f-657a-4148-bd08-007f79230ace] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 04:16:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a8f6b4b-dd35-4f04-9f9c-92a91408c161 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:f2b52ebe-cd9f-4638-a561-cbd91607a6b7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'siKQIlwH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:16:46 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-1a8f6b4b-dd35-4f04-9f9c-92a91408c161 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:16:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-1a8f6b4b-dd35-4f04-9f9c-92a91408c161 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:16:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-1a8f6b4b-dd35-4f04-9f9c-92a91408c161 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:16:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:46 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce677e3-0c34-4e39-9854-321e538fb90d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f2b52ebe-cd9f-4638-a561-cbd91607a6b7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a8f6b4b-dd35-4f04-9f9c-92a91408c161 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 04:16:46 user nova-compute[103546]: No targets found.
Nov 16 04:16:46 user nova-compute[103546]: iSNS:
Nov 16 04:16:46 user nova-compute[103546]: No targets found.
Nov 16 04:16:46 user nova-compute[103546]: STATIC:
Nov 16 04:16:46 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:f2b52ebe-cd9f-4638-a561-cbd91607a6b7
Nov 16 04:16:46 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:16:46 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:16:46 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597
Nov 16 04:16:46 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:16:46 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:16:46 user nova-compute[103546]: FIRMWARE:
Nov 16 04:16:46 user nova-compute[103546]: No targets found.
Nov 16 04:16:46 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:16:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a8f6b4b-dd35-4f04-9f9c-92a91408c161 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 04:16:46 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 04:16:46 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 04:16:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a8f6b4b-dd35-4f04-9f9c-92a91408c161 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2b52ebe-cd9f-4638-a561-cbd91607a6b7', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 04:16:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:46 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3a3e2f-e7c5-4abc-97bf-cbfbb2d60d62]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2b52ebe-cd9f-4638-a561-cbd91607a6b7\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:46 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[51448957-ad0b-4dcd-a64e-e3215e822326]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b52ebe-cd9f-4638-a561-cbd91607a6b7 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a8f6b4b-dd35-4f04-9f9c-92a91408c161 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 (non-flash)
Nov 16 04:16:46 user nova-compute[103546]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b52ebe-cd9f-4638-a561-cbd91607a6b7 (non-flash)
Nov 16 04:16:46 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:16:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a8f6b4b-dd35-4f04-9f9c-92a91408c161 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 (non-flash)
Nov 16 04:16:46 user nova-compute[103546]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2b52ebe-cd9f-4638-a561-cbd91607a6b7 (non-flash)
Nov 16 04:16:46 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:16:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a8f6b4b-dd35-4f04-9f9c-92a91408c161 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60ac5d9000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2b52ebe-cd9f-4638-a561-cbd91607a6b7'): ({'sdc'}, set())}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 04:16:46 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-1a8f6b4b-dd35-4f04-9f9c-92a91408c161 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Removing single pathed devices sdc {{(pid=103546) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 04:16:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:46 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[032c4db4-1e51-46dc-9f02-8a0804d91c6d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:46 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f674e82-eb39-4a0f-b03c-43959e763411]: (4, ('ok\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:46 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-1a8f6b4b-dd35-4f04-9f9c-92a91408c161 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Flushing IO for device /dev/sdc {{(pid=103546) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 04:16:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:46 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af1a90c-b6cf-4bd1-9d41-fb164b35ca6c]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:46 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-1a8f6b4b-dd35-4f04-9f9c-92a91408c161 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=103546) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 04:16:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:46 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[682d73ea-cf14-48ba-8ff9-c35eaa873717]: (4, ('1', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:46 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-1a8f6b4b-dd35-4f04-9f9c-92a91408c161 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 04:16:46 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-1a8f6b4b-dd35-4f04-9f9c-92a91408c161 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] SCSI volumes sdc have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 04:16:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a8f6b4b-dd35-4f04-9f9c-92a91408c161 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2b52ebe-cd9f-4638-a561-cbd91607a6b7')] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 04:16:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2b52ebe-cd9f-4638-a561-cbd91607a6b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2b52ebe-cd9f-4638-a561-cbd91607a6b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:46 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f37f8f-7cdb-4ea1-be0a-fa81ca434c9b]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a8f6b4b-dd35-4f04-9f9c-92a91408c161 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:16:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2b52ebe-cd9f-4638-a561-cbd91607a6b7 -p 172.16.0.220:3260 --logout {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2b52ebe-cd9f-4638-a561-cbd91607a6b7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:46 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[52806fbf-f384-4d48-8e97-c2d62a42f279]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:f2b52ebe-cd9f-4638-a561-cbd91607a6b7, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:f2b52ebe-cd9f-4638-a561-cbd91607a6b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a8f6b4b-dd35-4f04-9f9c-92a91408c161 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:f2b52ebe-cd9f-4638-a561-cbd91607a6b7, portal: 172.16.0.220,3260]
Nov 16 04:16:46 user nova-compute[103546]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:f2b52ebe-cd9f-4638-a561-cbd91607a6b7, portal: 172.16.0.220,3260] successful.
Nov 16 04:16:46 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:16:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2b52ebe-cd9f-4638-a561-cbd91607a6b7 -p 172.16.0.220:3260 --op delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:46 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2b52ebe-cd9f-4638-a561-cbd91607a6b7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:46 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2857ea7-3c14-40db-98aa-793b441b5117]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:16:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a8f6b4b-dd35-4f04-9f9c-92a91408c161 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:16:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-1a8f6b4b-dd35-4f04-9f9c-92a91408c161 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:16:46 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a8f6b4b-dd35-4f04-9f9c-92a91408c161 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] <== disconnect_volume: return (297ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:16:46 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a8f6b4b-dd35-4f04-9f9c-92a91408c161 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 04:16:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:16:47 user nova-compute[103546]: DEBUG nova.objects.instance [None req-1a8f6b4b-dd35-4f04-9f9c-92a91408c161 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lazy-loading 'flavor' on Instance uuid a276ab3f-657a-4148-bd08-007f79230ace {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:16:47 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1a8f6b4b-dd35-4f04-9f9c-92a91408c161 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lock "a276ab3f-657a-4148-bd08-007f79230ace" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.594s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:16:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:16:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:16:53 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Acquiring lock "b52cc321-5160-4747-a646-77edfe185310" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:16:53 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lock "b52cc321-5160-4747-a646-77edfe185310" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:16:53 user nova-compute[103546]: DEBUG nova.compute.manager [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: b52cc321-5160-4747-a646-77edfe185310] Starting instance... {{(pid=103546) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 04:16:53 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:16:53 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:16:53 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=103546) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 04:16:53 user nova-compute[103546]: INFO nova.compute.claims [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: b52cc321-5160-4747-a646-77edfe185310] Claim successful on node user
Nov 16 04:16:53 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:16:53 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:16:53 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.244s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:16:53 user nova-compute[103546]: DEBUG nova.compute.manager [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: b52cc321-5160-4747-a646-77edfe185310] Start building networks asynchronously for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 04:16:53 user nova-compute[103546]: DEBUG nova.compute.manager [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: b52cc321-5160-4747-a646-77edfe185310] Allocating IP information in the background. {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 04:16:53 user nova-compute[103546]: DEBUG nova.network.neutron [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: b52cc321-5160-4747-a646-77edfe185310] allocate_for_instance() {{(pid=103546) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 04:16:53 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: b52cc321-5160-4747-a646-77edfe185310] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 04:16:53 user nova-compute[103546]: DEBUG nova.compute.manager [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: b52cc321-5160-4747-a646-77edfe185310] Start building block device mappings for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 04:16:53 user nova-compute[103546]: DEBUG nova.policy [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '04ea7f587fd94211b18f97f3fe23714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7de09c5b11a4b0f96a66c9788e5942c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103546) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 04:16:53 user nova-compute[103546]: DEBUG nova.compute.manager [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: b52cc321-5160-4747-a646-77edfe185310] Start spawning the instance on the hypervisor. {{(pid=103546) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 04:16:53 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: b52cc321-5160-4747-a646-77edfe185310] Creating instance directory {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 04:16:53 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: b52cc321-5160-4747-a646-77edfe185310] Creating image(s)
Nov 16 04:16:53 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Acquiring lock "/opt/stack/data/nova/instances/b52cc321-5160-4747-a646-77edfe185310/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:16:53 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lock "/opt/stack/data/nova/instances/b52cc321-5160-4747-a646-77edfe185310/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:16:53 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lock "/opt/stack/data/nova/instances/b52cc321-5160-4747-a646-77edfe185310/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:16:53 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:54 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.184s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Acquiring lock "8c9efafb670bfe5842ba1f4ce398924612164af7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:16:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:16:54 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:54 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.186s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:54 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/b52cc321-5160-4747-a646-77edfe185310/disk 1073741824 {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:54 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/b52cc321-5160-4747-a646-77edfe185310/disk 1073741824" returned: 0 in 0.052s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:16:54 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:54 user nova-compute[103546]: DEBUG nova.network.neutron [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: b52cc321-5160-4747-a646-77edfe185310] Successfully created port: 5400cbb0-846c-49a6-8d49-d00324e76bde {{(pid=103546) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 04:16:54 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.182s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:54 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b52cc321-5160-4747-a646-77edfe185310/disk. size=1073741824 {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 04:16:54 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b52cc321-5160-4747-a646-77edfe185310/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:16:54 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b52cc321-5160-4747-a646-77edfe185310/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:16:54 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Cannot resize image /opt/stack/data/nova/instances/b52cc321-5160-4747-a646-77edfe185310/disk to a smaller size. {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 04:16:54 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: b52cc321-5160-4747-a646-77edfe185310] Created local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 04:16:54 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: b52cc321-5160-4747-a646-77edfe185310] Ensure instance console log exists: /opt/stack/data/nova/instances/b52cc321-5160-4747-a646-77edfe185310/console.log {{(pid=103546) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 04:16:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:16:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:16:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:16:55 user nova-compute[103546]: DEBUG nova.network.neutron [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: b52cc321-5160-4747-a646-77edfe185310] Successfully updated port: 5400cbb0-846c-49a6-8d49-d00324e76bde {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 04:16:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Acquiring lock "refresh_cache-b52cc321-5160-4747-a646-77edfe185310" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:16:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Acquired lock "refresh_cache-b52cc321-5160-4747-a646-77edfe185310" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:16:55 user nova-compute[103546]: DEBUG nova.network.neutron [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: b52cc321-5160-4747-a646-77edfe185310] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 04:16:55 user nova-compute[103546]: DEBUG nova.compute.manager [req-96e399a8-5e5d-4f63-a191-cec4b75365b1 req-859f2d07-0534-4338-acd2-e2b120a03976 service nova] [instance: b52cc321-5160-4747-a646-77edfe185310] Received event network-changed-5400cbb0-846c-49a6-8d49-d00324e76bde {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:16:55 user nova-compute[103546]: DEBUG nova.compute.manager [req-96e399a8-5e5d-4f63-a191-cec4b75365b1 req-859f2d07-0534-4338-acd2-e2b120a03976 service nova] [instance: b52cc321-5160-4747-a646-77edfe185310] Refreshing instance network info cache due to event network-changed-5400cbb0-846c-49a6-8d49-d00324e76bde. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 04:16:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-96e399a8-5e5d-4f63-a191-cec4b75365b1 req-859f2d07-0534-4338-acd2-e2b120a03976 service nova] Acquiring lock "refresh_cache-b52cc321-5160-4747-a646-77edfe185310" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:16:55 user nova-compute[103546]: DEBUG nova.network.neutron [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: b52cc321-5160-4747-a646-77edfe185310] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 04:16:55 user nova-compute[103546]: DEBUG nova.network.neutron [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: b52cc321-5160-4747-a646-77edfe185310] Updating instance_info_cache with network_info: [{"id": "5400cbb0-846c-49a6-8d49-d00324e76bde", "address": "fa:16:3e:65:f4:e9", "network": {"id": "855d0097-2e3c-4168-900e-d811676a8bff", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1275657618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7de09c5b11a4b0f96a66c9788e5942c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5400cbb0-84", "ovs_interfaceid": "5400cbb0-846c-49a6-8d49-d00324e76bde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:16:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Releasing lock "refresh_cache-b52cc321-5160-4747-a646-77edfe185310" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:16:55 user nova-compute[103546]: DEBUG nova.compute.manager [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: b52cc321-5160-4747-a646-77edfe185310] Instance network_info: |[{"id": "5400cbb0-846c-49a6-8d49-d00324e76bde", "address": "fa:16:3e:65:f4:e9", "network": {"id": "855d0097-2e3c-4168-900e-d811676a8bff", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1275657618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7de09c5b11a4b0f96a66c9788e5942c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5400cbb0-84", "ovs_interfaceid": "5400cbb0-846c-49a6-8d49-d00324e76bde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 04:16:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-96e399a8-5e5d-4f63-a191-cec4b75365b1 req-859f2d07-0534-4338-acd2-e2b120a03976 service nova] Acquired lock "refresh_cache-b52cc321-5160-4747-a646-77edfe185310" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:16:55 user nova-compute[103546]: DEBUG nova.network.neutron [req-96e399a8-5e5d-4f63-a191-cec4b75365b1 req-859f2d07-0534-4338-acd2-e2b120a03976 service nova] [instance: b52cc321-5160-4747-a646-77edfe185310] Refreshing network info cache for port 5400cbb0-846c-49a6-8d49-d00324e76bde {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 04:16:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: b52cc321-5160-4747-a646-77edfe185310] Start _get_guest_xml network_info=[{"id": "5400cbb0-846c-49a6-8d49-d00324e76bde", "address": "fa:16:3e:65:f4:e9", "network": {"id": "855d0097-2e3c-4168-900e-d811676a8bff", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1275657618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7de09c5b11a4b0f96a66c9788e5942c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5400cbb0-84", "ovs_interfaceid": "5400cbb0-846c-49a6-8d49-d00324e76bde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '5c6f539a-01e5-4478-bf8f-a14310b5d7dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 04:16:55 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:16:55 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:16:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 04:16:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 04:16:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 04:16:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 04:16:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 04:16:55 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 04:16:55 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 04:16:55 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 04:16:55 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 04:16:55 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 04:16:55 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 04:16:55 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 04:16:55 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 04:16:55 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 04:16:55 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 04:16:55 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 04:16:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:16:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-121018800',display_name='tempest-VolumesSnapshotTestJSON-instance-121018800',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-121018800',id=51,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBELNLEmudfvz0YrxPfLxsA2mB4Eey2V7x6nbYHjwF+YXEO5PbJZwh2LGklfZ2uVNvnXV5gag6RG9bc/CUZmxnE9Qi68cD9S90tugSLix5QBFExfBLm9jXLpDTgd36/Xiaw==',key_name='tempest-keypair-1471533643',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7de09c5b11a4b0f96a66c9788e5942c',ramdisk_id='',reservation_id='r-byqy7zob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1700179265',owner_user_name='tempest-VolumesSnapshotTestJSON-1700179265-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T04:16:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04ea7f587fd94211b18f97f3fe23714a',uuid=b52cc321-5160-4747-a646-77edfe185310,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5400cbb0-846c-49a6-8d49-d00324e76bde", "address": "fa:16:3e:65:f4:e9", "network": {"id": "855d0097-2e3c-4168-900e-d811676a8bff", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1275657618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7de09c5b11a4b0f96a66c9788e5942c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5400cbb0-84", "ovs_interfaceid": "5400cbb0-846c-49a6-8d49-d00324e76bde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 04:16:55 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Converting VIF {"id": "5400cbb0-846c-49a6-8d49-d00324e76bde", "address": "fa:16:3e:65:f4:e9", "network": {"id": "855d0097-2e3c-4168-900e-d811676a8bff", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1275657618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7de09c5b11a4b0f96a66c9788e5942c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5400cbb0-84", "ovs_interfaceid": "5400cbb0-846c-49a6-8d49-d00324e76bde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:16:55 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:f4:e9,bridge_name='br-int',has_traffic_filtering=True,id=5400cbb0-846c-49a6-8d49-d00324e76bde,network=Network(855d0097-2e3c-4168-900e-d811676a8bff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5400cbb0-84') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:16:55 user nova-compute[103546]: DEBUG nova.objects.instance [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lazy-loading 'pci_devices' on Instance uuid b52cc321-5160-4747-a646-77edfe185310 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:16:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: b52cc321-5160-4747-a646-77edfe185310] End _get_guest_xml xml=<domain type="kvm">
Nov 16 04:16:55 user nova-compute[103546]:   <uuid>b52cc321-5160-4747-a646-77edfe185310</uuid>
Nov 16 04:16:55 user nova-compute[103546]:   <name>instance-00000033</name>
Nov 16 04:16:55 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 04:16:55 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 04:16:55 user nova-compute[103546]:   <metadata>
Nov 16 04:16:55 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 04:16:55 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 04:16:55 user nova-compute[103546]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-121018800</nova:name>
Nov 16 04:16:55 user nova-compute[103546]:       <nova:creationTime>2023-11-16 04:16:55</nova:creationTime>
Nov 16 04:16:55 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 04:16:55 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 04:16:55 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 04:16:55 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 04:16:55 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 04:16:55 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 04:16:55 user nova-compute[103546]:       </nova:flavor>
Nov 16 04:16:55 user nova-compute[103546]:       <nova:owner>
Nov 16 04:16:55 user nova-compute[103546]:         <nova:user uuid="04ea7f587fd94211b18f97f3fe23714a">tempest-VolumesSnapshotTestJSON-1700179265-project-member</nova:user>
Nov 16 04:16:55 user nova-compute[103546]:         <nova:project uuid="c7de09c5b11a4b0f96a66c9788e5942c">tempest-VolumesSnapshotTestJSON-1700179265</nova:project>
Nov 16 04:16:55 user nova-compute[103546]:       </nova:owner>
Nov 16 04:16:55 user nova-compute[103546]:       <nova:root type="image" uuid="5c6f539a-01e5-4478-bf8f-a14310b5d7dd"/>
Nov 16 04:16:55 user nova-compute[103546]:       <nova:ports>
Nov 16 04:16:55 user nova-compute[103546]:         <nova:port uuid="5400cbb0-846c-49a6-8d49-d00324e76bde">
Nov 16 04:16:55 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 16 04:16:55 user nova-compute[103546]:         </nova:port>
Nov 16 04:16:55 user nova-compute[103546]:       </nova:ports>
Nov 16 04:16:55 user nova-compute[103546]:     </nova:instance>
Nov 16 04:16:55 user nova-compute[103546]:   </metadata>
Nov 16 04:16:55 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 04:16:55 user nova-compute[103546]:     <system>
Nov 16 04:16:55 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 04:16:55 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 04:16:55 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 04:16:55 user nova-compute[103546]:       <entry name="serial">b52cc321-5160-4747-a646-77edfe185310</entry>
Nov 16 04:16:55 user nova-compute[103546]:       <entry name="uuid">b52cc321-5160-4747-a646-77edfe185310</entry>
Nov 16 04:16:55 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 04:16:55 user nova-compute[103546]:     </system>
Nov 16 04:16:55 user nova-compute[103546]:   </sysinfo>
Nov 16 04:16:55 user nova-compute[103546]:   <os>
Nov 16 04:16:55 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 04:16:55 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 04:16:55 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 04:16:55 user nova-compute[103546]:   </os>
Nov 16 04:16:55 user nova-compute[103546]:   <features>
Nov 16 04:16:55 user nova-compute[103546]:     <acpi/>
Nov 16 04:16:55 user nova-compute[103546]:     <apic/>
Nov 16 04:16:55 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 04:16:55 user nova-compute[103546]:   </features>
Nov 16 04:16:55 user nova-compute[103546]:   <clock offset="utc">
Nov 16 04:16:55 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 04:16:55 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 04:16:55 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 04:16:55 user nova-compute[103546]:   </clock>
Nov 16 04:16:55 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 04:16:55 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 04:16:55 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 04:16:55 user nova-compute[103546]:   </cpu>
Nov 16 04:16:55 user nova-compute[103546]:   <devices>
Nov 16 04:16:55 user nova-compute[103546]:     <disk type="file" device="disk">
Nov 16 04:16:55 user nova-compute[103546]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 04:16:55 user nova-compute[103546]:       <source file="/opt/stack/data/nova/instances/b52cc321-5160-4747-a646-77edfe185310/disk"/>
Nov 16 04:16:55 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 04:16:55 user nova-compute[103546]:     </disk>
Nov 16 04:16:55 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 04:16:55 user nova-compute[103546]:       <mac address="fa:16:3e:65:f4:e9"/>
Nov 16 04:16:55 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 04:16:55 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 04:16:55 user nova-compute[103546]:       <target dev="tap5400cbb0-84"/>
Nov 16 04:16:55 user nova-compute[103546]:     </interface>
Nov 16 04:16:55 user nova-compute[103546]:     <serial type="pty">
Nov 16 04:16:55 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/b52cc321-5160-4747-a646-77edfe185310/console.log" append="off"/>
Nov 16 04:16:55 user nova-compute[103546]:     </serial>
Nov 16 04:16:55 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 04:16:55 user nova-compute[103546]:     <video>
Nov 16 04:16:55 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 04:16:55 user nova-compute[103546]:     </video>
Nov 16 04:16:55 user nova-compute[103546]:     <rng model="virtio">
Nov 16 04:16:55 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 04:16:55 user nova-compute[103546]:     </rng>
Nov 16 04:16:55 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 04:16:55 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 04:16:55 user nova-compute[103546]:       <stats period="10"/>
Nov 16 04:16:55 user nova-compute[103546]:     </memballoon>
Nov 16 04:16:55 user nova-compute[103546]:   </devices>
Nov 16 04:16:55 user nova-compute[103546]: </domain>
Nov 16 04:16:55 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 04:16:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:16:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-121018800',display_name='tempest-VolumesSnapshotTestJSON-instance-121018800',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-121018800',id=51,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBELNLEmudfvz0YrxPfLxsA2mB4Eey2V7x6nbYHjwF+YXEO5PbJZwh2LGklfZ2uVNvnXV5gag6RG9bc/CUZmxnE9Qi68cD9S90tugSLix5QBFExfBLm9jXLpDTgd36/Xiaw==',key_name='tempest-keypair-1471533643',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7de09c5b11a4b0f96a66c9788e5942c',ramdisk_id='',reservation_id='r-byqy7zob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1700179265',owner_user_name='tempest-VolumesSnapshotTestJSON-1700179265-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T04:16:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04ea7f587fd94211b18f97f3fe23714a',uuid=b52cc321-5160-4747-a646-77edfe185310,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5400cbb0-846c-49a6-8d49-d00324e76bde", "address": "fa:16:3e:65:f4:e9", "network": {"id": "855d0097-2e3c-4168-900e-d811676a8bff", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1275657618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7de09c5b11a4b0f96a66c9788e5942c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5400cbb0-84", "ovs_interfaceid": "5400cbb0-846c-49a6-8d49-d00324e76bde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 04:16:55 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Converting VIF {"id": "5400cbb0-846c-49a6-8d49-d00324e76bde", "address": "fa:16:3e:65:f4:e9", "network": {"id": "855d0097-2e3c-4168-900e-d811676a8bff", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1275657618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7de09c5b11a4b0f96a66c9788e5942c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5400cbb0-84", "ovs_interfaceid": "5400cbb0-846c-49a6-8d49-d00324e76bde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:16:55 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:f4:e9,bridge_name='br-int',has_traffic_filtering=True,id=5400cbb0-846c-49a6-8d49-d00324e76bde,network=Network(855d0097-2e3c-4168-900e-d811676a8bff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5400cbb0-84') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:16:55 user nova-compute[103546]: DEBUG os_vif [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:f4:e9,bridge_name='br-int',has_traffic_filtering=True,id=5400cbb0-846c-49a6-8d49-d00324e76bde,network=Network(855d0097-2e3c-4168-900e-d811676a8bff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5400cbb0-84') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 04:16:55 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:16:55 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:16:55 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 04:16:55 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:16:55 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ebd7aed6-8a2f-5549-96f3-3212ca6db32a', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:16:55 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:16:55 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:16:55 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:16:55 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5400cbb0-84, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:16:55 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5400cbb0-84, col_values=(('qos', UUID('720260f6-e902-44f4-b13f-352b6f717550')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:16:55 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5400cbb0-84, col_values=(('external_ids', {'iface-id': '5400cbb0-846c-49a6-8d49-d00324e76bde', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:f4:e9', 'vm-uuid': 'b52cc321-5160-4747-a646-77edfe185310'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:16:55 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:16:55 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:16:55 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:16:55 user nova-compute[103546]: INFO os_vif [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:f4:e9,bridge_name='br-int',has_traffic_filtering=True,id=5400cbb0-846c-49a6-8d49-d00324e76bde,network=Network(855d0097-2e3c-4168-900e-d811676a8bff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5400cbb0-84')
Nov 16 04:16:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:16:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] No VIF found with MAC fa:16:3e:65:f4:e9, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 04:16:56 user nova-compute[103546]: DEBUG nova.network.neutron [req-96e399a8-5e5d-4f63-a191-cec4b75365b1 req-859f2d07-0534-4338-acd2-e2b120a03976 service nova] [instance: b52cc321-5160-4747-a646-77edfe185310] Updated VIF entry in instance network info cache for port 5400cbb0-846c-49a6-8d49-d00324e76bde. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 04:16:56 user nova-compute[103546]: DEBUG nova.network.neutron [req-96e399a8-5e5d-4f63-a191-cec4b75365b1 req-859f2d07-0534-4338-acd2-e2b120a03976 service nova] [instance: b52cc321-5160-4747-a646-77edfe185310] Updating instance_info_cache with network_info: [{"id": "5400cbb0-846c-49a6-8d49-d00324e76bde", "address": "fa:16:3e:65:f4:e9", "network": {"id": "855d0097-2e3c-4168-900e-d811676a8bff", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1275657618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7de09c5b11a4b0f96a66c9788e5942c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5400cbb0-84", "ovs_interfaceid": "5400cbb0-846c-49a6-8d49-d00324e76bde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:16:56 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-96e399a8-5e5d-4f63-a191-cec4b75365b1 req-859f2d07-0534-4338-acd2-e2b120a03976 service nova] Releasing lock "refresh_cache-b52cc321-5160-4747-a646-77edfe185310" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:16:56 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:16:56 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:16:56 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:16:56 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:16:57 user nova-compute[103546]: DEBUG nova.compute.manager [req-e7b7fabb-2473-4076-86a4-58741df4067d req-491169f1-15c8-4c16-9373-98a59b28266b service nova] [instance: b52cc321-5160-4747-a646-77edfe185310] Received event network-vif-plugged-5400cbb0-846c-49a6-8d49-d00324e76bde {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:16:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-e7b7fabb-2473-4076-86a4-58741df4067d req-491169f1-15c8-4c16-9373-98a59b28266b service nova] Acquiring lock "b52cc321-5160-4747-a646-77edfe185310-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:16:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-e7b7fabb-2473-4076-86a4-58741df4067d req-491169f1-15c8-4c16-9373-98a59b28266b service nova] Lock "b52cc321-5160-4747-a646-77edfe185310-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:16:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-e7b7fabb-2473-4076-86a4-58741df4067d req-491169f1-15c8-4c16-9373-98a59b28266b service nova] Lock "b52cc321-5160-4747-a646-77edfe185310-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:16:57 user nova-compute[103546]: DEBUG nova.compute.manager [req-e7b7fabb-2473-4076-86a4-58741df4067d req-491169f1-15c8-4c16-9373-98a59b28266b service nova] [instance: b52cc321-5160-4747-a646-77edfe185310] No waiting events found dispatching network-vif-plugged-5400cbb0-846c-49a6-8d49-d00324e76bde {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:16:57 user nova-compute[103546]: WARNING nova.compute.manager [req-e7b7fabb-2473-4076-86a4-58741df4067d req-491169f1-15c8-4c16-9373-98a59b28266b service nova] [instance: b52cc321-5160-4747-a646-77edfe185310] Received unexpected event network-vif-plugged-5400cbb0-846c-49a6-8d49-d00324e76bde for instance with vm_state building and task_state spawning.
Nov 16 04:16:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:16:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:16:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:16:59 user nova-compute[103546]: DEBUG nova.compute.manager [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: b52cc321-5160-4747-a646-77edfe185310] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 04:16:59 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: b52cc321-5160-4747-a646-77edfe185310] Guest created on hypervisor {{(pid=103546) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 04:16:59 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: b52cc321-5160-4747-a646-77edfe185310] Instance spawned successfully.
Nov 16 04:16:59 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: b52cc321-5160-4747-a646-77edfe185310] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 04:16:59 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: b52cc321-5160-4747-a646-77edfe185310] Found default for hw_cdrom_bus of ide {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:16:59 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: b52cc321-5160-4747-a646-77edfe185310] Found default for hw_disk_bus of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:16:59 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: b52cc321-5160-4747-a646-77edfe185310] Found default for hw_input_bus of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:16:59 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: b52cc321-5160-4747-a646-77edfe185310] Found default for hw_pointer_model of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:16:59 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: b52cc321-5160-4747-a646-77edfe185310] Found default for hw_video_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:16:59 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: b52cc321-5160-4747-a646-77edfe185310] Found default for hw_vif_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:16:59 user nova-compute[103546]: DEBUG nova.compute.manager [req-0a52b06c-f28f-463c-80b4-e8aacac48875 req-10eda869-35e1-4c90-9fe8-b97e1ce79751 service nova] [instance: b52cc321-5160-4747-a646-77edfe185310] Received event network-vif-plugged-5400cbb0-846c-49a6-8d49-d00324e76bde {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:16:59 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-0a52b06c-f28f-463c-80b4-e8aacac48875 req-10eda869-35e1-4c90-9fe8-b97e1ce79751 service nova] Acquiring lock "b52cc321-5160-4747-a646-77edfe185310-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:16:59 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-0a52b06c-f28f-463c-80b4-e8aacac48875 req-10eda869-35e1-4c90-9fe8-b97e1ce79751 service nova] Lock "b52cc321-5160-4747-a646-77edfe185310-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:16:59 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-0a52b06c-f28f-463c-80b4-e8aacac48875 req-10eda869-35e1-4c90-9fe8-b97e1ce79751 service nova] Lock "b52cc321-5160-4747-a646-77edfe185310-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:16:59 user nova-compute[103546]: DEBUG nova.compute.manager [req-0a52b06c-f28f-463c-80b4-e8aacac48875 req-10eda869-35e1-4c90-9fe8-b97e1ce79751 service nova] [instance: b52cc321-5160-4747-a646-77edfe185310] No waiting events found dispatching network-vif-plugged-5400cbb0-846c-49a6-8d49-d00324e76bde {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:16:59 user nova-compute[103546]: WARNING nova.compute.manager [req-0a52b06c-f28f-463c-80b4-e8aacac48875 req-10eda869-35e1-4c90-9fe8-b97e1ce79751 service nova] [instance: b52cc321-5160-4747-a646-77edfe185310] Received unexpected event network-vif-plugged-5400cbb0-846c-49a6-8d49-d00324e76bde for instance with vm_state building and task_state spawning.
Nov 16 04:16:59 user nova-compute[103546]: INFO nova.compute.manager [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: b52cc321-5160-4747-a646-77edfe185310] Took 5.40 seconds to spawn the instance on the hypervisor.
Nov 16 04:16:59 user nova-compute[103546]: DEBUG nova.compute.manager [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: b52cc321-5160-4747-a646-77edfe185310] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 04:16:59 user nova-compute[103546]: INFO nova.compute.manager [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: b52cc321-5160-4747-a646-77edfe185310] Took 5.95 seconds to build instance.
Nov 16 04:16:59 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-08f7dbb8-ca65-4ef3-b1f9-f53d7c827930 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lock "b52cc321-5160-4747-a646-77edfe185310" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.040s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:16:59 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:17:00 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:17:00 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-45940ee3-3fcd-44d3-9bcf-3b83685066ec tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Acquiring lock "9ad85e80-259e-4d97-8087-60c1068c9826" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:17:00 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-45940ee3-3fcd-44d3-9bcf-3b83685066ec tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Lock "9ad85e80-259e-4d97-8087-60c1068c9826" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:17:00 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-45940ee3-3fcd-44d3-9bcf-3b83685066ec tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Acquiring lock "9ad85e80-259e-4d97-8087-60c1068c9826-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:17:00 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-45940ee3-3fcd-44d3-9bcf-3b83685066ec tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Lock "9ad85e80-259e-4d97-8087-60c1068c9826-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:17:00 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-45940ee3-3fcd-44d3-9bcf-3b83685066ec tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Lock "9ad85e80-259e-4d97-8087-60c1068c9826-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:17:00 user nova-compute[103546]: INFO nova.compute.manager [None req-45940ee3-3fcd-44d3-9bcf-3b83685066ec tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Terminating instance
Nov 16 04:17:00 user nova-compute[103546]: DEBUG nova.compute.manager [None req-45940ee3-3fcd-44d3-9bcf-3b83685066ec tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Start destroying the instance on the hypervisor. {{(pid=103546) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 04:17:00 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:17:01 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:17:01 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:17:01 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:17:01 user nova-compute[103546]: DEBUG nova.compute.manager [req-fb709e66-f5c9-422d-a10f-273f16ab8890 req-a7a3e5a7-af11-4043-83b3-680a36003512 service nova] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Received event network-vif-unplugged-2e72a898-1c0f-44a5-a6e2-8c3e9aa13f38 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:17:01 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-fb709e66-f5c9-422d-a10f-273f16ab8890 req-a7a3e5a7-af11-4043-83b3-680a36003512 service nova] Acquiring lock "9ad85e80-259e-4d97-8087-60c1068c9826-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:17:01 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-fb709e66-f5c9-422d-a10f-273f16ab8890 req-a7a3e5a7-af11-4043-83b3-680a36003512 service nova] Lock "9ad85e80-259e-4d97-8087-60c1068c9826-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:17:01 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-fb709e66-f5c9-422d-a10f-273f16ab8890 req-a7a3e5a7-af11-4043-83b3-680a36003512 service nova] Lock "9ad85e80-259e-4d97-8087-60c1068c9826-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:17:01 user nova-compute[103546]: DEBUG nova.compute.manager [req-fb709e66-f5c9-422d-a10f-273f16ab8890 req-a7a3e5a7-af11-4043-83b3-680a36003512 service nova] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] No waiting events found dispatching network-vif-unplugged-2e72a898-1c0f-44a5-a6e2-8c3e9aa13f38 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:17:01 user nova-compute[103546]: DEBUG nova.compute.manager [req-fb709e66-f5c9-422d-a10f-273f16ab8890 req-a7a3e5a7-af11-4043-83b3-680a36003512 service nova] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Received event network-vif-unplugged-2e72a898-1c0f-44a5-a6e2-8c3e9aa13f38 for instance with task_state deleting. {{(pid=103546) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 04:17:01 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Instance destroyed successfully.
Nov 16 04:17:01 user nova-compute[103546]: DEBUG nova.objects.instance [None req-45940ee3-3fcd-44d3-9bcf-3b83685066ec tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Lazy-loading 'resources' on Instance uuid 9ad85e80-259e-4d97-8087-60c1068c9826 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:17:01 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-45940ee3-3fcd-44d3-9bcf-3b83685066ec tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:14:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-885257577',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-885257577',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-8852575',id=49,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9dr9qOdCSjsCuCig/FaYaXIScOlEMb0P97ebdPkZNHOaEwf/mlLQYqWCq9k9KJDAibU2G+bjvFYgwsDu1uuI1Is8DozMlVws81WUyQQipcVPbcWN6+WjhAR6ZX1tjV2g==',key_name='tempest-keypair-1082843614',keypairs=<?>,launch_index=0,launched_at=2023-11-16T04:14:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c0298f102e0042d5ac7d4e3d899fc6e3',ramdisk_id='',reservation_id='r-0wwyz7un',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1030327997',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T04:14:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d6bc37bf5844cedacd57be55c6fe0d5',uuid=9ad85e80-259e-4d97-8087-60c1068c9826,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e72a898-1c0f-44a5-a6e2-8c3e9aa13f38", "address": "fa:16:3e:d6:a7:78", "network": {"id": "09cd9f1b-f026-441f-98b0-fcbce2718aae", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-97767409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0298f102e0042d5ac7d4e3d899fc6e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e72a898-1c", "ovs_interfaceid": "2e72a898-1c0f-44a5-a6e2-8c3e9aa13f38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 04:17:01 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-45940ee3-3fcd-44d3-9bcf-3b83685066ec tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Converting VIF {"id": "2e72a898-1c0f-44a5-a6e2-8c3e9aa13f38", "address": "fa:16:3e:d6:a7:78", "network": {"id": "09cd9f1b-f026-441f-98b0-fcbce2718aae", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-97767409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0298f102e0042d5ac7d4e3d899fc6e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e72a898-1c", "ovs_interfaceid": "2e72a898-1c0f-44a5-a6e2-8c3e9aa13f38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:17:01 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-45940ee3-3fcd-44d3-9bcf-3b83685066ec tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:a7:78,bridge_name='br-int',has_traffic_filtering=True,id=2e72a898-1c0f-44a5-a6e2-8c3e9aa13f38,network=Network(09cd9f1b-f026-441f-98b0-fcbce2718aae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e72a898-1c') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:17:01 user nova-compute[103546]: DEBUG os_vif [None req-45940ee3-3fcd-44d3-9bcf-3b83685066ec tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:a7:78,bridge_name='br-int',has_traffic_filtering=True,id=2e72a898-1c0f-44a5-a6e2-8c3e9aa13f38,network=Network(09cd9f1b-f026-441f-98b0-fcbce2718aae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e72a898-1c') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 04:17:01 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:17:01 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2e72a898-1c, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:17:01 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:17:01 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:17:01 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:17:01 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d8c2e4de-63c6-4549-a855-f2e3cae6bfe8) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:17:01 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:17:01 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:17:01 user nova-compute[103546]: INFO os_vif [None req-45940ee3-3fcd-44d3-9bcf-3b83685066ec tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:a7:78,bridge_name='br-int',has_traffic_filtering=True,id=2e72a898-1c0f-44a5-a6e2-8c3e9aa13f38,network=Network(09cd9f1b-f026-441f-98b0-fcbce2718aae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e72a898-1c')
Nov 16 04:17:01 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-45940ee3-3fcd-44d3-9bcf-3b83685066ec tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Deleting instance files /opt/stack/data/nova/instances/9ad85e80-259e-4d97-8087-60c1068c9826_del
Nov 16 04:17:01 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-45940ee3-3fcd-44d3-9bcf-3b83685066ec tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Deletion of /opt/stack/data/nova/instances/9ad85e80-259e-4d97-8087-60c1068c9826_del complete
Nov 16 04:17:01 user nova-compute[103546]: INFO nova.compute.manager [None req-45940ee3-3fcd-44d3-9bcf-3b83685066ec tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 16 04:17:01 user nova-compute[103546]: DEBUG oslo.service.loopingcall [None req-45940ee3-3fcd-44d3-9bcf-3b83685066ec tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=103546) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 04:17:01 user nova-compute[103546]: DEBUG nova.compute.manager [-] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Deallocating network for instance {{(pid=103546) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 04:17:01 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] deallocate_for_instance() {{(pid=103546) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 04:17:02 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:17:02 user nova-compute[103546]: INFO nova.compute.manager [-] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Took 0.87 seconds to deallocate network for instance.
Nov 16 04:17:02 user nova-compute[103546]: DEBUG nova.compute.manager [req-b5d6e7c6-84c3-4f53-963e-51b3fcb0e530 req-f653ff9e-8bcd-4081-90eb-ce4c57f31405 service nova] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Received event network-vif-deleted-2e72a898-1c0f-44a5-a6e2-8c3e9aa13f38 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:17:02 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-45940ee3-3fcd-44d3-9bcf-3b83685066ec tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:17:02 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-45940ee3-3fcd-44d3-9bcf-3b83685066ec tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:17:02 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-45940ee3-3fcd-44d3-9bcf-3b83685066ec tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:17:02 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-45940ee3-3fcd-44d3-9bcf-3b83685066ec tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:17:02 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-45940ee3-3fcd-44d3-9bcf-3b83685066ec tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.205s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:17:02 user nova-compute[103546]: INFO nova.scheduler.client.report [None req-45940ee3-3fcd-44d3-9bcf-3b83685066ec tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Deleted allocations for instance 9ad85e80-259e-4d97-8087-60c1068c9826
Nov 16 04:17:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-45940ee3-3fcd-44d3-9bcf-3b83685066ec tempest-TestServerVolumeAttachScenarioOldVersion-1030327997 tempest-TestServerVolumeAttachScenarioOldVersion-1030327997-project-member] Lock "9ad85e80-259e-4d97-8087-60c1068c9826" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.145s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:17:03 user nova-compute[103546]: DEBUG nova.compute.manager [req-939fb698-4dde-4913-b77d-b0998ea0682c req-b27422a2-0f13-400d-ad41-a40769320078 service nova] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Received event network-vif-plugged-2e72a898-1c0f-44a5-a6e2-8c3e9aa13f38 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:17:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-939fb698-4dde-4913-b77d-b0998ea0682c req-b27422a2-0f13-400d-ad41-a40769320078 service nova] Acquiring lock "9ad85e80-259e-4d97-8087-60c1068c9826-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:17:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-939fb698-4dde-4913-b77d-b0998ea0682c req-b27422a2-0f13-400d-ad41-a40769320078 service nova] Lock "9ad85e80-259e-4d97-8087-60c1068c9826-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:17:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-939fb698-4dde-4913-b77d-b0998ea0682c req-b27422a2-0f13-400d-ad41-a40769320078 service nova] Lock "9ad85e80-259e-4d97-8087-60c1068c9826-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:17:03 user nova-compute[103546]: DEBUG nova.compute.manager [req-939fb698-4dde-4913-b77d-b0998ea0682c req-b27422a2-0f13-400d-ad41-a40769320078 service nova] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] No waiting events found dispatching network-vif-plugged-2e72a898-1c0f-44a5-a6e2-8c3e9aa13f38 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:17:03 user nova-compute[103546]: WARNING nova.compute.manager [req-939fb698-4dde-4913-b77d-b0998ea0682c req-b27422a2-0f13-400d-ad41-a40769320078 service nova] [instance: 9ad85e80-259e-4d97-8087-60c1068c9826] Received unexpected event network-vif-plugged-2e72a898-1c0f-44a5-a6e2-8c3e9aa13f38 for instance with vm_state deleted and task_state None.
Nov 16 04:17:04 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-1956a2ab-8399-4dee-9b86-f44f07b1946c tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2fdca5a2-7e02-4c4a-96ae-cc61547232c1 is timed out.
Nov 16 04:17:04 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-1956a2ab-8399-4dee-9b86-f44f07b1946c tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Successfully detached device vdb from instance 2fdca5a2-7e02-4c4a-96ae-cc61547232c1 from the live domain config.
Nov 16 04:17:04 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1956a2ab-8399-4dee-9b86-f44f07b1946c tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 04:17:04 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1956a2ab-8399-4dee-9b86-f44f07b1946c tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gcXYHvZe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:17:04 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-1956a2ab-8399-4dee-9b86-f44f07b1946c tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:17:04 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-1956a2ab-8399-4dee-9b86-f44f07b1946c tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:17:04 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-1956a2ab-8399-4dee-9b86-f44f07b1946c tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:17:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:17:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:17:04 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10cbaad-a788-4f41-a4cc-04fc6973cc1d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:17:04 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1956a2ab-8399-4dee-9b86-f44f07b1946c tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 04:17:04 user nova-compute[103546]: No targets found.
Nov 16 04:17:04 user nova-compute[103546]: iSNS:
Nov 16 04:17:04 user nova-compute[103546]: No targets found.
Nov 16 04:17:04 user nova-compute[103546]: STATIC:
Nov 16 04:17:04 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597
Nov 16 04:17:04 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:17:04 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:17:04 user nova-compute[103546]: FIRMWARE:
Nov 16 04:17:04 user nova-compute[103546]: No targets found.
Nov 16 04:17:04 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:17:04 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1956a2ab-8399-4dee-9b86-f44f07b1946c tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 04:17:04 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 04:17:04 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 04:17:04 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1956a2ab-8399-4dee-9b86-f44f07b1946c tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 04:17:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:17:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:17:04 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5fa866-f6e9-456e-b59a-5a76bd87f087]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:17:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:17:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:17:05 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a652ba-11a2-4fac-8e00-b90048da769f]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:17:05 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1956a2ab-8399-4dee-9b86-f44f07b1946c tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 (non-flash)
Nov 16 04:17:05 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:17:05 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1956a2ab-8399-4dee-9b86-f44f07b1946c tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 (non-flash)
Nov 16 04:17:05 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:17:05 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1956a2ab-8399-4dee-9b86-f44f07b1946c tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60cc27a440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597'): ({'sdb'}, set())}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 04:17:05 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-1956a2ab-8399-4dee-9b86-f44f07b1946c tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Removing single pathed devices sdb {{(pid=103546) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 04:17:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:17:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:17:05 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[9411ffa6-d7df-4b24-9e47-0d1f1172aae9]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:17:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:17:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:17:05 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bbc294-f23d-4c33-8bca-df57cfe8d2a5]: (4, ('ok\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:17:05 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-1956a2ab-8399-4dee-9b86-f44f07b1946c tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Flushing IO for device /dev/sdb {{(pid=103546) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 04:17:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:17:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:17:05 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2372f8-bc9c-48d9-9f80-bdcb0b5d6d21]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:17:05 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-1956a2ab-8399-4dee-9b86-f44f07b1946c tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=103546) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 04:17:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:17:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:17:05 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96b1d13-be7e-44b0-bd28-89dc8099071a]: (4, ('1', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:17:05 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-1956a2ab-8399-4dee-9b86-f44f07b1946c tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 04:17:05 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-1956a2ab-8399-4dee-9b86-f44f07b1946c tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] SCSI volumes sdb have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 04:17:05 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1956a2ab-8399-4dee-9b86-f44f07b1946c tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597')] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 04:17:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:17:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:17:05 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae52067-16ab-441e-b35e-f7a283fa300d]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:17:05 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1956a2ab-8399-4dee-9b86-f44f07b1946c tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:17:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 -p 172.16.0.220:3260 --logout {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:17:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 -p 172.16.0.220:3260 --logout" returned: 0 in 0.037s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:17:05 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f58784-fdad-4947-a922-b79584a5e86d]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:17:05 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1956a2ab-8399-4dee-9b86-f44f07b1946c tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597, portal: 172.16.0.220,3260]
Nov 16 04:17:05 user nova-compute[103546]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597, portal: 172.16.0.220,3260] successful.
Nov 16 04:17:05 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:17:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 -p 172.16.0.220:3260 --op delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:17:05 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e16fa65-da5e-401d-ba7e-de558d1a8597 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:17:05 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[22699156-0d79-4b16-9bcb-637beedafa7b]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:17:05 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1956a2ab-8399-4dee-9b86-f44f07b1946c tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:17:05 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-1956a2ab-8399-4dee-9b86-f44f07b1946c tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:17:05 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-1956a2ab-8399-4dee-9b86-f44f07b1946c tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] <== disconnect_volume: return (278ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:17:05 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1956a2ab-8399-4dee-9b86-f44f07b1946c tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 04:17:05 user nova-compute[103546]: DEBUG nova.objects.instance [None req-1956a2ab-8399-4dee-9b86-f44f07b1946c tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Lazy-loading 'flavor' on Instance uuid 2fdca5a2-7e02-4c4a-96ae-cc61547232c1 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:17:06 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-1956a2ab-8399-4dee-9b86-f44f07b1946c tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Lock "2fdca5a2-7e02-4c4a-96ae-cc61547232c1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.767s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:17:06 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:17:11 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:17:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:17:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:17:19 user nova-compute[103546]: DEBUG nova.compute.manager [None req-101621e0-119b-4cc9-b6d5-ff86d5eee690 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 04:17:19 user nova-compute[103546]: INFO nova.compute.manager [None req-101621e0-119b-4cc9-b6d5-ff86d5eee690 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: a276ab3f-657a-4148-bd08-007f79230ace] instance snapshotting
Nov 16 04:17:19 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-101621e0-119b-4cc9-b6d5-ff86d5eee690 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Beginning live snapshot process
Nov 16 04:17:19 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:17:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-101621e0-119b-4cc9-b6d5-ff86d5eee690 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a276ab3f-657a-4148-bd08-007f79230ace/disk --force-share --output=json -f qcow2 {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:17:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-101621e0-119b-4cc9-b6d5-ff86d5eee690 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a276ab3f-657a-4148-bd08-007f79230ace/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:17:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-101621e0-119b-4cc9-b6d5-ff86d5eee690 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a276ab3f-657a-4148-bd08-007f79230ace/disk --force-share --output=json -f qcow2 {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:17:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-101621e0-119b-4cc9-b6d5-ff86d5eee690 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a276ab3f-657a-4148-bd08-007f79230ace/disk --force-share --output=json -f qcow2" returned: 0 in 0.173s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:17:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-101621e0-119b-4cc9-b6d5-ff86d5eee690 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:17:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-101621e0-119b-4cc9-b6d5-ff86d5eee690 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.175s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:17:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-101621e0-119b-4cc9-b6d5-ff86d5eee690 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpb85_trzx/4b114edf09304346a8625c6e55933e07.delta 1073741824 {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:17:20 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-101621e0-119b-4cc9-b6d5-ff86d5eee690 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpb85_trzx/4b114edf09304346a8625c6e55933e07.delta 1073741824" returned: 0 in 0.050s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:17:20 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-101621e0-119b-4cc9-b6d5-ff86d5eee690 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 16 04:17:20 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-101621e0-119b-4cc9-b6d5-ff86d5eee690 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=103546) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 04:17:21 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-101621e0-119b-4cc9-b6d5-ff86d5eee690 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=103546) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 04:17:21 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-101621e0-119b-4cc9-b6d5-ff86d5eee690 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 16 04:17:21 user nova-compute[103546]: DEBUG nova.privsep.utils [None req-101621e0-119b-4cc9-b6d5-ff86d5eee690 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=103546) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 04:17:21 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-101621e0-119b-4cc9-b6d5-ff86d5eee690 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpb85_trzx/4b114edf09304346a8625c6e55933e07.delta /opt/stack/data/nova/instances/snapshots/tmpb85_trzx/4b114edf09304346a8625c6e55933e07 {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:17:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:17:22 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-101621e0-119b-4cc9-b6d5-ff86d5eee690 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpb85_trzx/4b114edf09304346a8625c6e55933e07.delta /opt/stack/data/nova/instances/snapshots/tmpb85_trzx/4b114edf09304346a8625c6e55933e07" returned: 0 in 0.755s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:17:22 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-101621e0-119b-4cc9-b6d5-ff86d5eee690 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Snapshot extracted, beginning image upload
Nov 16 04:17:24 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:17:24 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-101621e0-119b-4cc9-b6d5-ff86d5eee690 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Snapshot image upload complete
Nov 16 04:17:24 user nova-compute[103546]: INFO nova.compute.manager [None req-101621e0-119b-4cc9-b6d5-ff86d5eee690 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Took 5.48 seconds to snapshot the instance on the hypervisor.
Nov 16 04:17:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:17:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Acquiring lock "0805eb5a-79c7-43f2-b560-df687f7fbc0f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:17:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lock "0805eb5a-79c7-43f2-b560-df687f7fbc0f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:17:27 user nova-compute[103546]: DEBUG nova.compute.manager [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Starting instance... {{(pid=103546) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 04:17:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:17:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:17:27 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=103546) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 04:17:27 user nova-compute[103546]: INFO nova.compute.claims [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Claim successful on node user
Nov 16 04:17:27 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:17:27 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:17:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.268s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:17:27 user nova-compute[103546]: DEBUG nova.compute.manager [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Start building networks asynchronously for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 04:17:27 user nova-compute[103546]: DEBUG nova.compute.manager [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Allocating IP information in the background. {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 04:17:27 user nova-compute[103546]: DEBUG nova.network.neutron [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] allocate_for_instance() {{(pid=103546) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 04:17:27 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 04:17:27 user nova-compute[103546]: DEBUG nova.compute.manager [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Start building block device mappings for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 04:17:27 user nova-compute[103546]: DEBUG nova.policy [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd11cfaa98a7a427bbda21bc38ddba079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21df2cbfb9234c13a504ad4a513970f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103546) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 04:17:27 user nova-compute[103546]: DEBUG nova.compute.manager [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Start spawning the instance on the hypervisor. {{(pid=103546) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 04:17:27 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Creating instance directory {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 04:17:27 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Creating image(s)
Nov 16 04:17:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Acquiring lock "/opt/stack/data/nova/instances/0805eb5a-79c7-43f2-b560-df687f7fbc0f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:17:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lock "/opt/stack/data/nova/instances/0805eb5a-79c7-43f2-b560-df687f7fbc0f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:17:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lock "/opt/stack/data/nova/instances/0805eb5a-79c7-43f2-b560-df687f7fbc0f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:17:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Acquiring lock "d3ffd15992fc9ad9c0a868117892d44bb6f8a890" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:17:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lock "d3ffd15992fc9ad9c0a868117892d44bb6f8a890" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:17:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3ffd15992fc9ad9c0a868117892d44bb6f8a890.part --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:17:28 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:17:28 user nova-compute[103546]: DEBUG nova.network.neutron [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Successfully created port: be3177c3-f31d-4783-8231-d9d4b5819aef {{(pid=103546) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 04:17:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3ffd15992fc9ad9c0a868117892d44bb6f8a890.part --force-share --output=json" returned: 0 in 0.177s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:17:28 user nova-compute[103546]: DEBUG nova.virt.images [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] 2ff5cacb-6cbc-4a18-83f7-c3485801c61f was qcow2, converting to raw {{(pid=103546) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 04:17:28 user nova-compute[103546]: DEBUG nova.privsep.utils [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=103546) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 04:17:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d3ffd15992fc9ad9c0a868117892d44bb6f8a890.part /opt/stack/data/nova/instances/_base/d3ffd15992fc9ad9c0a868117892d44bb6f8a890.converted {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d3ffd15992fc9ad9c0a868117892d44bb6f8a890.part /opt/stack/data/nova/instances/_base/d3ffd15992fc9ad9c0a868117892d44bb6f8a890.converted" returned: 0 in 0.254s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3ffd15992fc9ad9c0a868117892d44bb6f8a890.converted --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG nova.network.neutron [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Successfully updated port: be3177c3-f31d-4783-8231-d9d4b5819aef {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3ffd15992fc9ad9c0a868117892d44bb6f8a890.converted --force-share --output=json" returned: 0 in 0.194s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lock "d3ffd15992fc9ad9c0a868117892d44bb6f8a890" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.606s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Acquiring lock "refresh_cache-0805eb5a-79c7-43f2-b560-df687f7fbc0f" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Acquired lock "refresh_cache-0805eb5a-79c7-43f2-b560-df687f7fbc0f" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG nova.network.neutron [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3ffd15992fc9ad9c0a868117892d44bb6f8a890 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG nova.compute.manager [req-260929e3-33bc-4ef6-8c99-281f0252732c req-37dfebc2-99b7-4910-b81b-e0ae8533c0db service nova] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Received event network-changed-be3177c3-f31d-4783-8231-d9d4b5819aef {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG nova.compute.manager [req-260929e3-33bc-4ef6-8c99-281f0252732c req-37dfebc2-99b7-4910-b81b-e0ae8533c0db service nova] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Refreshing instance network info cache due to event network-changed-be3177c3-f31d-4783-8231-d9d4b5819aef. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-260929e3-33bc-4ef6-8c99-281f0252732c req-37dfebc2-99b7-4910-b81b-e0ae8533c0db service nova] Acquiring lock "refresh_cache-0805eb5a-79c7-43f2-b560-df687f7fbc0f" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG nova.network.neutron [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3ffd15992fc9ad9c0a868117892d44bb6f8a890 --force-share --output=json" returned: 0 in 0.191s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Acquiring lock "d3ffd15992fc9ad9c0a868117892d44bb6f8a890" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lock "d3ffd15992fc9ad9c0a868117892d44bb6f8a890" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3ffd15992fc9ad9c0a868117892d44bb6f8a890 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3ffd15992fc9ad9c0a868117892d44bb6f8a890 --force-share --output=json" returned: 0 in 0.177s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3ffd15992fc9ad9c0a868117892d44bb6f8a890,backing_fmt=raw /opt/stack/data/nova/instances/0805eb5a-79c7-43f2-b560-df687f7fbc0f/disk 1073741824 {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG nova.network.neutron [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Updating instance_info_cache with network_info: [{"id": "be3177c3-f31d-4783-8231-d9d4b5819aef", "address": "fa:16:3e:57:29:00", "network": {"id": "a758762c-c27c-4509-9870-1d42187aeaf4", "bridge": "br-int", "label": "tempest-TestStampPattern-405695915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21df2cbfb9234c13a504ad4a513970f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe3177c3-f3", "ovs_interfaceid": "be3177c3-f31d-4783-8231-d9d4b5819aef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3ffd15992fc9ad9c0a868117892d44bb6f8a890,backing_fmt=raw /opt/stack/data/nova/instances/0805eb5a-79c7-43f2-b560-df687f7fbc0f/disk 1073741824" returned: 0 in 0.050s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lock "d3ffd15992fc9ad9c0a868117892d44bb6f8a890" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3ffd15992fc9ad9c0a868117892d44bb6f8a890 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Releasing lock "refresh_cache-0805eb5a-79c7-43f2-b560-df687f7fbc0f" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG nova.compute.manager [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Instance network_info: |[{"id": "be3177c3-f31d-4783-8231-d9d4b5819aef", "address": "fa:16:3e:57:29:00", "network": {"id": "a758762c-c27c-4509-9870-1d42187aeaf4", "bridge": "br-int", "label": "tempest-TestStampPattern-405695915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21df2cbfb9234c13a504ad4a513970f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe3177c3-f3", "ovs_interfaceid": "be3177c3-f31d-4783-8231-d9d4b5819aef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-260929e3-33bc-4ef6-8c99-281f0252732c req-37dfebc2-99b7-4910-b81b-e0ae8533c0db service nova] Acquired lock "refresh_cache-0805eb5a-79c7-43f2-b560-df687f7fbc0f" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG nova.network.neutron [req-260929e3-33bc-4ef6-8c99-281f0252732c req-37dfebc2-99b7-4910-b81b-e0ae8533c0db service nova] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Refreshing network info cache for port be3177c3-f31d-4783-8231-d9d4b5819aef {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3ffd15992fc9ad9c0a868117892d44bb6f8a890 --force-share --output=json" returned: 0 in 0.178s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Created local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Ensure instance console log exists: /opt/stack/data/nova/instances/0805eb5a-79c7-43f2-b560-df687f7fbc0f/console.log {{(pid=103546) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Start _get_guest_xml network_info=[{"id": "be3177c3-f31d-4783-8231-d9d4b5819aef", "address": "fa:16:3e:57:29:00", "network": {"id": "a758762c-c27c-4509-9870-1d42187aeaf4", "bridge": "br-int", "label": "tempest-TestStampPattern-405695915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21df2cbfb9234c13a504ad4a513970f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe3177c3-f3", "ovs_interfaceid": "be3177c3-f31d-4783-8231-d9d4b5819aef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='7cd2a7a87893022002e127477da15352',container_format='bare',created_at=2023-11-16T04:17:19Z,direct_url=<?>,disk_format='qcow2',id=2ff5cacb-6cbc-4a18-83f7-c3485801c61f,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1845231780',owner='21df2cbfb9234c13a504ad4a513970f3',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-16T04:17:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '2ff5cacb-6cbc-4a18-83f7-c3485801c61f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 04:17:29 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:17:29 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:17:29 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='7cd2a7a87893022002e127477da15352',container_format='bare',created_at=2023-11-16T04:17:19Z,direct_url=<?>,disk_format='qcow2',id=2ff5cacb-6cbc-4a18-83f7-c3485801c61f,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1845231780',owner='21df2cbfb9234c13a504ad4a513970f3',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-16T04:17:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:17:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1623828387',display_name='tempest-TestStampPattern-server-1623828387',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1623828387',id=52,image_ref='2ff5cacb-6cbc-4a18-83f7-c3485801c61f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMD4VeEQuyJQyIGByr5hnPNM80o5OzPF3CeZqlbvdjIFKuOQFbXyRn3ly86qjzEqmVlnZHqKHtk99JTBXYtTMc0ItAcSuqq3ptLxvKqOk9JWyorrPApaaM7CXlXFiNx/Q==',key_name='tempest-TestStampPattern-780202401',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21df2cbfb9234c13a504ad4a513970f3',ramdisk_id='',reservation_id='r-o1ss28xz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='a276ab3f-657a-4148-bd08-007f79230ace',image_min_disk='1',image_min_ram='0',image_owner_id='21df2cbfb9234c13a504ad4a513970f3',image_owner_project_name='tempest-TestStampPattern-1443950495',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1443950495-project-member',image_user_id='d11cfaa98a7a427bbda21bc38ddba079',network_allocated='True',owner_project_name='tempest-TestStampPattern-1443950495',owner_user_name='tempest-TestStampPattern-1443950495-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T04:17:28Z,user_data=None,user_id='d11cfaa98a7a427bbda21bc38ddba079',uuid=0805eb5a-79c7-43f2-b560-df687f7fbc0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be3177c3-f31d-4783-8231-d9d4b5819aef", "address": "fa:16:3e:57:29:00", "network": {"id": "a758762c-c27c-4509-9870-1d42187aeaf4", "bridge": "br-int", "label": "tempest-TestStampPattern-405695915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21df2cbfb9234c13a504ad4a513970f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe3177c3-f3", "ovs_interfaceid": "be3177c3-f31d-4783-8231-d9d4b5819aef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Converting VIF {"id": "be3177c3-f31d-4783-8231-d9d4b5819aef", "address": "fa:16:3e:57:29:00", "network": {"id": "a758762c-c27c-4509-9870-1d42187aeaf4", "bridge": "br-int", "label": "tempest-TestStampPattern-405695915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21df2cbfb9234c13a504ad4a513970f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe3177c3-f3", "ovs_interfaceid": "be3177c3-f31d-4783-8231-d9d4b5819aef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:29:00,bridge_name='br-int',has_traffic_filtering=True,id=be3177c3-f31d-4783-8231-d9d4b5819aef,network=Network(a758762c-c27c-4509-9870-1d42187aeaf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe3177c3-f3') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG nova.objects.instance [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lazy-loading 'pci_devices' on Instance uuid 0805eb5a-79c7-43f2-b560-df687f7fbc0f {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] End _get_guest_xml xml=<domain type="kvm">
Nov 16 04:17:29 user nova-compute[103546]:   <uuid>0805eb5a-79c7-43f2-b560-df687f7fbc0f</uuid>
Nov 16 04:17:29 user nova-compute[103546]:   <name>instance-00000034</name>
Nov 16 04:17:29 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 04:17:29 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 04:17:29 user nova-compute[103546]:   <metadata>
Nov 16 04:17:29 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 04:17:29 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 04:17:29 user nova-compute[103546]:       <nova:name>tempest-TestStampPattern-server-1623828387</nova:name>
Nov 16 04:17:29 user nova-compute[103546]:       <nova:creationTime>2023-11-16 04:17:29</nova:creationTime>
Nov 16 04:17:29 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 04:17:29 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 04:17:29 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 04:17:29 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 04:17:29 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 04:17:29 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 04:17:29 user nova-compute[103546]:       </nova:flavor>
Nov 16 04:17:29 user nova-compute[103546]:       <nova:owner>
Nov 16 04:17:29 user nova-compute[103546]:         <nova:user uuid="d11cfaa98a7a427bbda21bc38ddba079">tempest-TestStampPattern-1443950495-project-member</nova:user>
Nov 16 04:17:29 user nova-compute[103546]:         <nova:project uuid="21df2cbfb9234c13a504ad4a513970f3">tempest-TestStampPattern-1443950495</nova:project>
Nov 16 04:17:29 user nova-compute[103546]:       </nova:owner>
Nov 16 04:17:29 user nova-compute[103546]:       <nova:root type="image" uuid="2ff5cacb-6cbc-4a18-83f7-c3485801c61f"/>
Nov 16 04:17:29 user nova-compute[103546]:       <nova:ports>
Nov 16 04:17:29 user nova-compute[103546]:         <nova:port uuid="be3177c3-f31d-4783-8231-d9d4b5819aef">
Nov 16 04:17:29 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 16 04:17:29 user nova-compute[103546]:         </nova:port>
Nov 16 04:17:29 user nova-compute[103546]:       </nova:ports>
Nov 16 04:17:29 user nova-compute[103546]:     </nova:instance>
Nov 16 04:17:29 user nova-compute[103546]:   </metadata>
Nov 16 04:17:29 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 04:17:29 user nova-compute[103546]:     <system>
Nov 16 04:17:29 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 04:17:29 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 04:17:29 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 04:17:29 user nova-compute[103546]:       <entry name="serial">0805eb5a-79c7-43f2-b560-df687f7fbc0f</entry>
Nov 16 04:17:29 user nova-compute[103546]:       <entry name="uuid">0805eb5a-79c7-43f2-b560-df687f7fbc0f</entry>
Nov 16 04:17:29 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 04:17:29 user nova-compute[103546]:     </system>
Nov 16 04:17:29 user nova-compute[103546]:   </sysinfo>
Nov 16 04:17:29 user nova-compute[103546]:   <os>
Nov 16 04:17:29 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 04:17:29 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 04:17:29 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 04:17:29 user nova-compute[103546]:   </os>
Nov 16 04:17:29 user nova-compute[103546]:   <features>
Nov 16 04:17:29 user nova-compute[103546]:     <acpi/>
Nov 16 04:17:29 user nova-compute[103546]:     <apic/>
Nov 16 04:17:29 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 04:17:29 user nova-compute[103546]:   </features>
Nov 16 04:17:29 user nova-compute[103546]:   <clock offset="utc">
Nov 16 04:17:29 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 04:17:29 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 04:17:29 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 04:17:29 user nova-compute[103546]:   </clock>
Nov 16 04:17:29 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 04:17:29 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 04:17:29 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 04:17:29 user nova-compute[103546]:   </cpu>
Nov 16 04:17:29 user nova-compute[103546]:   <devices>
Nov 16 04:17:29 user nova-compute[103546]:     <disk type="file" device="disk">
Nov 16 04:17:29 user nova-compute[103546]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 04:17:29 user nova-compute[103546]:       <source file="/opt/stack/data/nova/instances/0805eb5a-79c7-43f2-b560-df687f7fbc0f/disk"/>
Nov 16 04:17:29 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 04:17:29 user nova-compute[103546]:     </disk>
Nov 16 04:17:29 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 04:17:29 user nova-compute[103546]:       <mac address="fa:16:3e:57:29:00"/>
Nov 16 04:17:29 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 04:17:29 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 04:17:29 user nova-compute[103546]:       <target dev="tapbe3177c3-f3"/>
Nov 16 04:17:29 user nova-compute[103546]:     </interface>
Nov 16 04:17:29 user nova-compute[103546]:     <serial type="pty">
Nov 16 04:17:29 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/0805eb5a-79c7-43f2-b560-df687f7fbc0f/console.log" append="off"/>
Nov 16 04:17:29 user nova-compute[103546]:     </serial>
Nov 16 04:17:29 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 04:17:29 user nova-compute[103546]:     <video>
Nov 16 04:17:29 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 04:17:29 user nova-compute[103546]:     </video>
Nov 16 04:17:29 user nova-compute[103546]:     <rng model="virtio">
Nov 16 04:17:29 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 04:17:29 user nova-compute[103546]:     </rng>
Nov 16 04:17:29 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 04:17:29 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 04:17:29 user nova-compute[103546]:       <stats period="10"/>
Nov 16 04:17:29 user nova-compute[103546]:     </memballoon>
Nov 16 04:17:29 user nova-compute[103546]:   </devices>
Nov 16 04:17:29 user nova-compute[103546]: </domain>
Nov 16 04:17:29 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:17:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1623828387',display_name='tempest-TestStampPattern-server-1623828387',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1623828387',id=52,image_ref='2ff5cacb-6cbc-4a18-83f7-c3485801c61f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMD4VeEQuyJQyIGByr5hnPNM80o5OzPF3CeZqlbvdjIFKuOQFbXyRn3ly86qjzEqmVlnZHqKHtk99JTBXYtTMc0ItAcSuqq3ptLxvKqOk9JWyorrPApaaM7CXlXFiNx/Q==',key_name='tempest-TestStampPattern-780202401',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21df2cbfb9234c13a504ad4a513970f3',ramdisk_id='',reservation_id='r-o1ss28xz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='a276ab3f-657a-4148-bd08-007f79230ace',image_min_disk='1',image_min_ram='0',image_owner_id='21df2cbfb9234c13a504ad4a513970f3',image_owner_project_name='tempest-TestStampPattern-1443950495',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1443950495-project-member',image_user_id='d11cfaa98a7a427bbda21bc38ddba079',network_allocated='True',owner_project_name='tempest-TestStampPattern-1443950495',owner_user_name='tempest-TestStampPattern-1443950495-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T04:17:28Z,user_data=None,user_id='d11cfaa98a7a427bbda21bc38ddba079',uuid=0805eb5a-79c7-43f2-b560-df687f7fbc0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be3177c3-f31d-4783-8231-d9d4b5819aef", "address": "fa:16:3e:57:29:00", "network": {"id": "a758762c-c27c-4509-9870-1d42187aeaf4", "bridge": "br-int", "label": "tempest-TestStampPattern-405695915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21df2cbfb9234c13a504ad4a513970f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe3177c3-f3", "ovs_interfaceid": "be3177c3-f31d-4783-8231-d9d4b5819aef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Converting VIF {"id": "be3177c3-f31d-4783-8231-d9d4b5819aef", "address": "fa:16:3e:57:29:00", "network": {"id": "a758762c-c27c-4509-9870-1d42187aeaf4", "bridge": "br-int", "label": "tempest-TestStampPattern-405695915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21df2cbfb9234c13a504ad4a513970f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe3177c3-f3", "ovs_interfaceid": "be3177c3-f31d-4783-8231-d9d4b5819aef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:29:00,bridge_name='br-int',has_traffic_filtering=True,id=be3177c3-f31d-4783-8231-d9d4b5819aef,network=Network(a758762c-c27c-4509-9870-1d42187aeaf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe3177c3-f3') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG os_vif [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:29:00,bridge_name='br-int',has_traffic_filtering=True,id=be3177c3-f31d-4783-8231-d9d4b5819aef,network=Network(a758762c-c27c-4509-9870-1d42187aeaf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe3177c3-f3') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c0236f23-b94d-5db3-a752-fc8445cb5703', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbe3177c3-f3, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbe3177c3-f3, col_values=(('qos', UUID('c25a4b11-1aeb-4b29-a3ac-83421f1fdbbf')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbe3177c3-f3, col_values=(('external_ids', {'iface-id': 'be3177c3-f31d-4783-8231-d9d4b5819aef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:29:00', 'vm-uuid': '0805eb5a-79c7-43f2-b560-df687f7fbc0f'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:17:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:17:29 user nova-compute[103546]: INFO os_vif [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:29:00,bridge_name='br-int',has_traffic_filtering=True,id=be3177c3-f31d-4783-8231-d9d4b5819aef,network=Network(a758762c-c27c-4509-9870-1d42187aeaf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe3177c3-f3')
Nov 16 04:17:30 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:17:30 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] No VIF found with MAC fa:16:3e:57:29:00, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 04:17:30 user nova-compute[103546]: DEBUG nova.network.neutron [req-260929e3-33bc-4ef6-8c99-281f0252732c req-37dfebc2-99b7-4910-b81b-e0ae8533c0db service nova] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Updated VIF entry in instance network info cache for port be3177c3-f31d-4783-8231-d9d4b5819aef. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 04:17:30 user nova-compute[103546]: DEBUG nova.network.neutron [req-260929e3-33bc-4ef6-8c99-281f0252732c req-37dfebc2-99b7-4910-b81b-e0ae8533c0db service nova] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Updating instance_info_cache with network_info: [{"id": "be3177c3-f31d-4783-8231-d9d4b5819aef", "address": "fa:16:3e:57:29:00", "network": {"id": "a758762c-c27c-4509-9870-1d42187aeaf4", "bridge": "br-int", "label": "tempest-TestStampPattern-405695915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21df2cbfb9234c13a504ad4a513970f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe3177c3-f3", "ovs_interfaceid": "be3177c3-f31d-4783-8231-d9d4b5819aef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:17:30 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-260929e3-33bc-4ef6-8c99-281f0252732c req-37dfebc2-99b7-4910-b81b-e0ae8533c0db service nova] Releasing lock "refresh_cache-0805eb5a-79c7-43f2-b560-df687f7fbc0f" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:17:31 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:17:31 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:17:31 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:17:31 user nova-compute[103546]: DEBUG nova.compute.manager [req-9dfb58ab-e5ad-48f0-b55a-8e453e7ab848 req-bf6abce8-ef33-4e9d-8501-1817d6571f68 service nova] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Received event network-vif-plugged-be3177c3-f31d-4783-8231-d9d4b5819aef {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:17:31 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-9dfb58ab-e5ad-48f0-b55a-8e453e7ab848 req-bf6abce8-ef33-4e9d-8501-1817d6571f68 service nova] Acquiring lock "0805eb5a-79c7-43f2-b560-df687f7fbc0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:17:31 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-9dfb58ab-e5ad-48f0-b55a-8e453e7ab848 req-bf6abce8-ef33-4e9d-8501-1817d6571f68 service nova] Lock "0805eb5a-79c7-43f2-b560-df687f7fbc0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:17:31 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-9dfb58ab-e5ad-48f0-b55a-8e453e7ab848 req-bf6abce8-ef33-4e9d-8501-1817d6571f68 service nova] Lock "0805eb5a-79c7-43f2-b560-df687f7fbc0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:17:31 user nova-compute[103546]: DEBUG nova.compute.manager [req-9dfb58ab-e5ad-48f0-b55a-8e453e7ab848 req-bf6abce8-ef33-4e9d-8501-1817d6571f68 service nova] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] No waiting events found dispatching network-vif-plugged-be3177c3-f31d-4783-8231-d9d4b5819aef {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:17:31 user nova-compute[103546]: WARNING nova.compute.manager [req-9dfb58ab-e5ad-48f0-b55a-8e453e7ab848 req-bf6abce8-ef33-4e9d-8501-1817d6571f68 service nova] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Received unexpected event network-vif-plugged-be3177c3-f31d-4783-8231-d9d4b5819aef for instance with vm_state building and task_state spawning.
Nov 16 04:17:31 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:17:33 user nova-compute[103546]: DEBUG nova.compute.manager [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 04:17:33 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Guest created on hypervisor {{(pid=103546) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 04:17:33 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Instance spawned successfully.
Nov 16 04:17:33 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 04:17:33 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Found default for hw_input_bus of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:17:33 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Found default for hw_pointer_model of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:17:33 user nova-compute[103546]: INFO nova.compute.manager [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Took 5.94 seconds to spawn the instance on the hypervisor.
Nov 16 04:17:33 user nova-compute[103546]: DEBUG nova.compute.manager [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 04:17:33 user nova-compute[103546]: INFO nova.compute.manager [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Took 6.54 seconds to build instance.
Nov 16 04:17:33 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-cd0454ed-d01a-49ae-92c4-b8729b03300a tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lock "0805eb5a-79c7-43f2-b560-df687f7fbc0f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.640s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:17:33 user nova-compute[103546]: DEBUG nova.compute.manager [req-798a385d-db7e-4174-97ed-da3165fe2fc0 req-995649c2-86e4-4916-8493-2b0f4cb56b50 service nova] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Received event network-vif-plugged-be3177c3-f31d-4783-8231-d9d4b5819aef {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:17:33 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-798a385d-db7e-4174-97ed-da3165fe2fc0 req-995649c2-86e4-4916-8493-2b0f4cb56b50 service nova] Acquiring lock "0805eb5a-79c7-43f2-b560-df687f7fbc0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:17:33 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-798a385d-db7e-4174-97ed-da3165fe2fc0 req-995649c2-86e4-4916-8493-2b0f4cb56b50 service nova] Lock "0805eb5a-79c7-43f2-b560-df687f7fbc0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:17:33 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-798a385d-db7e-4174-97ed-da3165fe2fc0 req-995649c2-86e4-4916-8493-2b0f4cb56b50 service nova] Lock "0805eb5a-79c7-43f2-b560-df687f7fbc0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:17:33 user nova-compute[103546]: DEBUG nova.compute.manager [req-798a385d-db7e-4174-97ed-da3165fe2fc0 req-995649c2-86e4-4916-8493-2b0f4cb56b50 service nova] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] No waiting events found dispatching network-vif-plugged-be3177c3-f31d-4783-8231-d9d4b5819aef {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:17:33 user nova-compute[103546]: WARNING nova.compute.manager [req-798a385d-db7e-4174-97ed-da3165fe2fc0 req-995649c2-86e4-4916-8493-2b0f4cb56b50 service nova] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Received unexpected event network-vif-plugged-be3177c3-f31d-4783-8231-d9d4b5819aef for instance with vm_state active and task_state None.
Nov 16 04:17:34 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:17:34 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:17:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-af1b4119-1a00-4b5b-9564-9c30d4b6b59d tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Acquiring lock "2fdca5a2-7e02-4c4a-96ae-cc61547232c1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:17:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-af1b4119-1a00-4b5b-9564-9c30d4b6b59d tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Lock "2fdca5a2-7e02-4c4a-96ae-cc61547232c1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:17:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-af1b4119-1a00-4b5b-9564-9c30d4b6b59d tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Acquiring lock "2fdca5a2-7e02-4c4a-96ae-cc61547232c1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:17:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-af1b4119-1a00-4b5b-9564-9c30d4b6b59d tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Lock "2fdca5a2-7e02-4c4a-96ae-cc61547232c1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:17:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-af1b4119-1a00-4b5b-9564-9c30d4b6b59d tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Lock "2fdca5a2-7e02-4c4a-96ae-cc61547232c1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:17:35 user nova-compute[103546]: INFO nova.compute.manager [None req-af1b4119-1a00-4b5b-9564-9c30d4b6b59d tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Terminating instance
Nov 16 04:17:35 user nova-compute[103546]: DEBUG nova.compute.manager [None req-af1b4119-1a00-4b5b-9564-9c30d4b6b59d tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Start destroying the instance on the hypervisor. {{(pid=103546) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 04:17:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:17:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:17:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:17:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:17:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:17:35 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager.update_available_resource {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:17:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:17:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:17:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:17:35 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Auditing locally available compute resources for user (node: user) {{(pid=103546) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 04:17:35 user nova-compute[103546]: DEBUG nova.compute.manager [req-ccf0fe47-9522-45f9-b4cf-ef919ad49e74 req-34a21053-52eb-462f-92c2-18a12aa6e16d service nova] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Received event network-vif-unplugged-9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:17:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ccf0fe47-9522-45f9-b4cf-ef919ad49e74 req-34a21053-52eb-462f-92c2-18a12aa6e16d service nova] Acquiring lock "2fdca5a2-7e02-4c4a-96ae-cc61547232c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:17:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ccf0fe47-9522-45f9-b4cf-ef919ad49e74 req-34a21053-52eb-462f-92c2-18a12aa6e16d service nova] Lock "2fdca5a2-7e02-4c4a-96ae-cc61547232c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:17:35 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-ccf0fe47-9522-45f9-b4cf-ef919ad49e74 req-34a21053-52eb-462f-92c2-18a12aa6e16d service nova] Lock "2fdca5a2-7e02-4c4a-96ae-cc61547232c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:17:35 user nova-compute[103546]: DEBUG nova.compute.manager [req-ccf0fe47-9522-45f9-b4cf-ef919ad49e74 req-34a21053-52eb-462f-92c2-18a12aa6e16d service nova] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] No waiting events found dispatching network-vif-unplugged-9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:17:35 user nova-compute[103546]: DEBUG nova.compute.manager [req-ccf0fe47-9522-45f9-b4cf-ef919ad49e74 req-34a21053-52eb-462f-92c2-18a12aa6e16d service nova] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Received event network-vif-unplugged-9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a for instance with task_state deleting. {{(pid=103546) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 04:17:35 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Instance destroyed successfully.
Nov 16 04:17:35 user nova-compute[103546]: DEBUG nova.objects.instance [None req-af1b4119-1a00-4b5b-9564-9c30d4b6b59d tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Lazy-loading 'resources' on Instance uuid 2fdca5a2-7e02-4c4a-96ae-cc61547232c1 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:17:35 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-af1b4119-1a00-4b5b-9564-9c30d4b6b59d tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:10:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1044774600',display_name='tempest-ServerStableDeviceRescueTest-server-1044774600',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1044774600',id=46,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNj1JcuBCA8b1ASnZxEflVqxgwfGpOs0NT6q9GQ5ZSTNz5RgrGMdfc/dVQXXiVOxcYts+JD3hMifKvk9y98rW6TatUxDOWAmZ3/8ty/1zZeWm+ytAI6z5EPvdNn6qG4xhQ==',key_name='tempest-keypair-218434465',keypairs=<?>,launch_index=0,launched_at=2023-11-16T04:14:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='18a17119476d4eea9a39078a48af5a56',ramdisk_id='',reservation_id='r-tkm2shtw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-195956273',owner_user_name='tempest-ServerStableDeviceRescueTest-195956273-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T04:16:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8d2d54f82e5409d8c45166c3379b08f',uuid=2fdca5a2-7e02-4c4a-96ae-cc61547232c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a", "address": "fa:16:3e:f0:c5:13", "network": {"id": "5f10f091-8358-4c8c-92bb-999d989f26b0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-513865819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18a17119476d4eea9a39078a48af5a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a11f3f3-1a", "ovs_interfaceid": "9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 04:17:35 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-af1b4119-1a00-4b5b-9564-9c30d4b6b59d tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Converting VIF {"id": "9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a", "address": "fa:16:3e:f0:c5:13", "network": {"id": "5f10f091-8358-4c8c-92bb-999d989f26b0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-513865819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18a17119476d4eea9a39078a48af5a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a11f3f3-1a", "ovs_interfaceid": "9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:17:35 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-af1b4119-1a00-4b5b-9564-9c30d4b6b59d tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:c5:13,bridge_name='br-int',has_traffic_filtering=True,id=9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a,network=Network(5f10f091-8358-4c8c-92bb-999d989f26b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a11f3f3-1a') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:17:35 user nova-compute[103546]: DEBUG os_vif [None req-af1b4119-1a00-4b5b-9564-9c30d4b6b59d tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:c5:13,bridge_name='br-int',has_traffic_filtering=True,id=9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a,network=Network(5f10f091-8358-4c8c-92bb-999d989f26b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a11f3f3-1a') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 04:17:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:17:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9a11f3f3-1a, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:17:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:17:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:17:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:17:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f493e2b4-36bb-4d95-b9b9-ef9f02c4a7b6) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:17:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:17:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:17:35 user nova-compute[103546]: INFO os_vif [None req-af1b4119-1a00-4b5b-9564-9c30d4b6b59d tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:c5:13,bridge_name='br-int',has_traffic_filtering=True,id=9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a,network=Network(5f10f091-8358-4c8c-92bb-999d989f26b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a11f3f3-1a')
Nov 16 04:17:35 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-af1b4119-1a00-4b5b-9564-9c30d4b6b59d tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Deleting instance files /opt/stack/data/nova/instances/2fdca5a2-7e02-4c4a-96ae-cc61547232c1_del
Nov 16 04:17:35 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-af1b4119-1a00-4b5b-9564-9c30d4b6b59d tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Deletion of /opt/stack/data/nova/instances/2fdca5a2-7e02-4c4a-96ae-cc61547232c1_del complete
Nov 16 04:17:36 user nova-compute[103546]: INFO nova.compute.manager [None req-af1b4119-1a00-4b5b-9564-9c30d4b6b59d tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 16 04:17:36 user nova-compute[103546]: DEBUG oslo.service.loopingcall [None req-af1b4119-1a00-4b5b-9564-9c30d4b6b59d tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=103546) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 04:17:36 user nova-compute[103546]: DEBUG nova.compute.manager [-] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Deallocating network for instance {{(pid=103546) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 04:17:36 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] deallocate_for_instance() {{(pid=103546) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 04:17:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b52cc321-5160-4747-a646-77edfe185310/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:17:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b52cc321-5160-4747-a646-77edfe185310/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:17:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b52cc321-5160-4747-a646-77edfe185310/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:17:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b52cc321-5160-4747-a646-77edfe185310/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:17:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0805eb5a-79c7-43f2-b560-df687f7fbc0f/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:17:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0805eb5a-79c7-43f2-b560-df687f7fbc0f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:17:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0805eb5a-79c7-43f2-b560-df687f7fbc0f/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:17:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0805eb5a-79c7-43f2-b560-df687f7fbc0f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:17:36 user nova-compute[103546]: DEBUG nova.compute.manager [req-257f0691-1e76-4793-848d-e5c49ee8abb4 req-17ebd3c6-b352-403b-9c74-2165aed4f055 service nova] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Received event network-vif-deleted-9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:17:36 user nova-compute[103546]: INFO nova.compute.manager [req-257f0691-1e76-4793-848d-e5c49ee8abb4 req-17ebd3c6-b352-403b-9c74-2165aed4f055 service nova] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Neutron deleted interface 9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a; detaching it from the instance and deleting it from the info cache
Nov 16 04:17:36 user nova-compute[103546]: DEBUG nova.network.neutron [req-257f0691-1e76-4793-848d-e5c49ee8abb4 req-17ebd3c6-b352-403b-9c74-2165aed4f055 service nova] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:17:36 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Error from libvirt while getting description of instance-0000002e: [Error Code 42] Domain not found: no domain with matching uuid '2fdca5a2-7e02-4c4a-96ae-cc61547232c1' (instance-0000002e): libvirt.libvirtError: Domain not found: no domain with matching uuid '2fdca5a2-7e02-4c4a-96ae-cc61547232c1' (instance-0000002e)
Nov 16 04:17:36 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:17:36 user nova-compute[103546]: DEBUG nova.compute.manager [req-257f0691-1e76-4793-848d-e5c49ee8abb4 req-17ebd3c6-b352-403b-9c74-2165aed4f055 service nova] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Detach interface failed, port_id=9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a, reason: Instance 2fdca5a2-7e02-4c4a-96ae-cc61547232c1 could not be found. {{(pid=103546) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 04:17:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a276ab3f-657a-4148-bd08-007f79230ace/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:17:36 user nova-compute[103546]: INFO nova.compute.manager [-] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Took 0.92 seconds to deallocate network for instance.
Nov 16 04:17:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-af1b4119-1a00-4b5b-9564-9c30d4b6b59d tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:17:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-af1b4119-1a00-4b5b-9564-9c30d4b6b59d tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:17:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a276ab3f-657a-4148-bd08-007f79230ace/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:17:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a276ab3f-657a-4148-bd08-007f79230ace/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:17:37 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-af1b4119-1a00-4b5b-9564-9c30d4b6b59d tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Refreshing inventories for resource provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 04:17:37 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-af1b4119-1a00-4b5b-9564-9c30d4b6b59d tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Updating ProviderTree inventory for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 04:17:37 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-af1b4119-1a00-4b5b-9564-9c30d4b6b59d tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Updating inventory in ProviderTree for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 04:17:37 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-af1b4119-1a00-4b5b-9564-9c30d4b6b59d tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Refreshing aggregate associations for resource provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a, aggregates: None {{(pid=103546) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 04:17:37 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-af1b4119-1a00-4b5b-9564-9c30d4b6b59d tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Refreshing trait associations for resource provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=103546) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 04:17:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a276ab3f-657a-4148-bd08-007f79230ace/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:17:37 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:17:37 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:17:37 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Hypervisor/Node resource view: name=user free_ram=8698MB free_disk=24.923301696777344GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=103546) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 04:17:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:17:37 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-af1b4119-1a00-4b5b-9564-9c30d4b6b59d tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:17:37 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-af1b4119-1a00-4b5b-9564-9c30d4b6b59d tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:17:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-af1b4119-1a00-4b5b-9564-9c30d4b6b59d tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.755s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:17:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.110s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:17:37 user nova-compute[103546]: INFO nova.scheduler.client.report [None req-af1b4119-1a00-4b5b-9564-9c30d4b6b59d tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Deleted allocations for instance 2fdca5a2-7e02-4c4a-96ae-cc61547232c1
Nov 16 04:17:37 user nova-compute[103546]: DEBUG nova.compute.manager [req-6d3d50ce-bd01-4a64-a5be-0615c3e05b6a req-cf1da686-e96b-42e3-8b15-5a77905ccce3 service nova] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Received event network-vif-plugged-9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:17:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6d3d50ce-bd01-4a64-a5be-0615c3e05b6a req-cf1da686-e96b-42e3-8b15-5a77905ccce3 service nova] Acquiring lock "2fdca5a2-7e02-4c4a-96ae-cc61547232c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:17:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6d3d50ce-bd01-4a64-a5be-0615c3e05b6a req-cf1da686-e96b-42e3-8b15-5a77905ccce3 service nova] Lock "2fdca5a2-7e02-4c4a-96ae-cc61547232c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:17:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-6d3d50ce-bd01-4a64-a5be-0615c3e05b6a req-cf1da686-e96b-42e3-8b15-5a77905ccce3 service nova] Lock "2fdca5a2-7e02-4c4a-96ae-cc61547232c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:17:37 user nova-compute[103546]: DEBUG nova.compute.manager [req-6d3d50ce-bd01-4a64-a5be-0615c3e05b6a req-cf1da686-e96b-42e3-8b15-5a77905ccce3 service nova] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] No waiting events found dispatching network-vif-plugged-9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:17:37 user nova-compute[103546]: WARNING nova.compute.manager [req-6d3d50ce-bd01-4a64-a5be-0615c3e05b6a req-cf1da686-e96b-42e3-8b15-5a77905ccce3 service nova] [instance: 2fdca5a2-7e02-4c4a-96ae-cc61547232c1] Received unexpected event network-vif-plugged-9a11f3f3-1a2a-49a2-adbe-36f2e2944a3a for instance with vm_state deleted and task_state None.
Nov 16 04:17:37 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance a276ab3f-657a-4148-bd08-007f79230ace actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:17:37 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance b52cc321-5160-4747-a646-77edfe185310 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:17:37 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 0805eb5a-79c7-43f2-b560-df687f7fbc0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:17:37 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 04:17:37 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 04:17:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-af1b4119-1a00-4b5b-9564-9c30d4b6b59d tempest-ServerStableDeviceRescueTest-195956273 tempest-ServerStableDeviceRescueTest-195956273-project-member] Lock "2fdca5a2-7e02-4c4a-96ae-cc61547232c1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.768s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:17:38 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:17:38 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:17:38 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Compute_service record updated for user:user {{(pid=103546) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 04:17:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.241s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:17:39 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:17:39 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:17:39 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:17:39 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:17:39 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:17:39 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=103546) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 04:17:40 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:17:40 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Cleaning up deleted instances {{(pid=103546) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 04:17:40 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] There are 0 instances to clean {{(pid=103546) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 04:17:40 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:17:43 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:17:45 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:17:45 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:17:46 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:17:46 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Starting heal instance info cache {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 04:17:46 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "refresh_cache-a276ab3f-657a-4148-bd08-007f79230ace" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:17:46 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquired lock "refresh_cache-a276ab3f-657a-4148-bd08-007f79230ace" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:17:46 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Forcefully refreshing network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 04:17:47 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Updating instance_info_cache with network_info: [{"id": "b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3", "address": "fa:16:3e:52:f7:34", "network": {"id": "a758762c-c27c-4509-9870-1d42187aeaf4", "bridge": "br-int", "label": "tempest-TestStampPattern-405695915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21df2cbfb9234c13a504ad4a513970f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9fb2a6f-ec", "ovs_interfaceid": "b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:17:47 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Releasing lock "refresh_cache-a276ab3f-657a-4148-bd08-007f79230ace" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:17:47 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Updated the network info_cache for instance {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 04:17:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:17:50 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:17:51 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:17:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:17:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:17:55 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:17:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:17:59 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:18:00 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:18:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:18:05 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:18:07 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:18:07 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Cleaning up deleted instances with incomplete migration  {{(pid=103546) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 04:18:10 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:18:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:18:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:18:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:18:28 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:18:31 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:18:31 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:18:36 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:18:36 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:18:36 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager.update_available_resource {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:18:36 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:18:36 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:18:36 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:18:36 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Auditing locally available compute resources for user (node: user) {{(pid=103546) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 04:18:36 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b52cc321-5160-4747-a646-77edfe185310/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:18:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b52cc321-5160-4747-a646-77edfe185310/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:18:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b52cc321-5160-4747-a646-77edfe185310/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:18:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b52cc321-5160-4747-a646-77edfe185310/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:18:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0805eb5a-79c7-43f2-b560-df687f7fbc0f/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:18:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0805eb5a-79c7-43f2-b560-df687f7fbc0f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:18:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0805eb5a-79c7-43f2-b560-df687f7fbc0f/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:18:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0805eb5a-79c7-43f2-b560-df687f7fbc0f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:18:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a276ab3f-657a-4148-bd08-007f79230ace/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:18:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a276ab3f-657a-4148-bd08-007f79230ace/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:18:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a276ab3f-657a-4148-bd08-007f79230ace/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:18:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a276ab3f-657a-4148-bd08-007f79230ace/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:18:38 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:18:38 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:18:38 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Hypervisor/Node resource view: name=user free_ram=8771MB free_disk=24.939937591552734GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=103546) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 04:18:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:18:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:18:38 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance a276ab3f-657a-4148-bd08-007f79230ace actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:18:38 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance b52cc321-5160-4747-a646-77edfe185310 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:18:38 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 0805eb5a-79c7-43f2-b560-df687f7fbc0f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:18:38 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 04:18:38 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 04:18:38 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:18:38 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:18:38 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Compute_service record updated for user:user {{(pid=103546) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 04:18:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.226s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:18:39 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:18:39 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:18:39 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=103546) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 04:18:39 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:18:40 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:18:41 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:18:43 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:18:44 user nova-compute[103546]: DEBUG nova.compute.manager [req-f3da21e7-e82f-48e8-ba21-45f6e84b6134 req-83ae0ad2-b272-4c51-a61d-6b67174971fd service nova] [instance: b52cc321-5160-4747-a646-77edfe185310] Received event network-changed-5400cbb0-846c-49a6-8d49-d00324e76bde {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:18:44 user nova-compute[103546]: DEBUG nova.compute.manager [req-f3da21e7-e82f-48e8-ba21-45f6e84b6134 req-83ae0ad2-b272-4c51-a61d-6b67174971fd service nova] [instance: b52cc321-5160-4747-a646-77edfe185310] Refreshing instance network info cache due to event network-changed-5400cbb0-846c-49a6-8d49-d00324e76bde. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 04:18:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-f3da21e7-e82f-48e8-ba21-45f6e84b6134 req-83ae0ad2-b272-4c51-a61d-6b67174971fd service nova] Acquiring lock "refresh_cache-b52cc321-5160-4747-a646-77edfe185310" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:18:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-f3da21e7-e82f-48e8-ba21-45f6e84b6134 req-83ae0ad2-b272-4c51-a61d-6b67174971fd service nova] Acquired lock "refresh_cache-b52cc321-5160-4747-a646-77edfe185310" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:18:44 user nova-compute[103546]: DEBUG nova.network.neutron [req-f3da21e7-e82f-48e8-ba21-45f6e84b6134 req-83ae0ad2-b272-4c51-a61d-6b67174971fd service nova] [instance: b52cc321-5160-4747-a646-77edfe185310] Refreshing network info cache for port 5400cbb0-846c-49a6-8d49-d00324e76bde {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 04:18:44 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:18:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-83ca4fd5-d82b-4323-bce2-6f74c5938068 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Acquiring lock "b52cc321-5160-4747-a646-77edfe185310" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:18:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-83ca4fd5-d82b-4323-bce2-6f74c5938068 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lock "b52cc321-5160-4747-a646-77edfe185310" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:18:44 user nova-compute[103546]: DEBUG nova.objects.instance [None req-83ca4fd5-d82b-4323-bce2-6f74c5938068 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lazy-loading 'flavor' on Instance uuid b52cc321-5160-4747-a646-77edfe185310 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:18:44 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-83ca4fd5-d82b-4323-bce2-6f74c5938068 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: b52cc321-5160-4747-a646-77edfe185310] Ignoring supplied device name: /dev/vdb
Nov 16 04:18:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-83ca4fd5-d82b-4323-bce2-6f74c5938068 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lock "b52cc321-5160-4747-a646-77edfe185310" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:18:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-83ca4fd5-d82b-4323-bce2-6f74c5938068 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Acquiring lock "b52cc321-5160-4747-a646-77edfe185310" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:18:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-83ca4fd5-d82b-4323-bce2-6f74c5938068 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lock "b52cc321-5160-4747-a646-77edfe185310" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:18:44 user nova-compute[103546]: INFO nova.compute.manager [None req-83ca4fd5-d82b-4323-bce2-6f74c5938068 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: b52cc321-5160-4747-a646-77edfe185310] Attaching volume 211822fa-c4dc-4d12-8be6-ceddcc080235 to /dev/vdb
Nov 16 04:18:44 user nova-compute[103546]: DEBUG nova.network.neutron [req-f3da21e7-e82f-48e8-ba21-45f6e84b6134 req-83ae0ad2-b272-4c51-a61d-6b67174971fd service nova] [instance: b52cc321-5160-4747-a646-77edfe185310] Updated VIF entry in instance network info cache for port 5400cbb0-846c-49a6-8d49-d00324e76bde. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 04:18:44 user nova-compute[103546]: DEBUG nova.network.neutron [req-f3da21e7-e82f-48e8-ba21-45f6e84b6134 req-83ae0ad2-b272-4c51-a61d-6b67174971fd service nova] [instance: b52cc321-5160-4747-a646-77edfe185310] Updating instance_info_cache with network_info: [{"id": "5400cbb0-846c-49a6-8d49-d00324e76bde", "address": "fa:16:3e:65:f4:e9", "network": {"id": "855d0097-2e3c-4168-900e-d811676a8bff", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1275657618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7de09c5b11a4b0f96a66c9788e5942c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5400cbb0-84", "ovs_interfaceid": "5400cbb0-846c-49a6-8d49-d00324e76bde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:18:44 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:18:44 user nova-compute[103546]: DEBUG os_brick.utils [None req-83ca4fd5-d82b-4323-bce2-6f74c5938068 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:18:44 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:18:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-f3da21e7-e82f-48e8-ba21-45f6e84b6134 req-83ae0ad2-b272-4c51-a61d-6b67174971fd service nova] Releasing lock "refresh_cache-b52cc321-5160-4747-a646-77edfe185310" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:18:44 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:18:44 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a05ee8b-ffba-4989-93d4-4c708331d3f2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af5c39b14ece\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:18:44 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:18:44 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:18:44 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c567dc-518d-41d2-a8b7-eca097be2e38]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:18:44 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:18:44 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:18:44 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d2bccd-93a4-4b16-a858-3e935f698c4d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:18:44 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68b0cd3-b853-4a68-a14e-44c7aec22d66]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:18:44 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-83ca4fd5-d82b-4323-bce2-6f74c5938068 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Running cmd (subprocess): nvme version {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:18:44 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-83ca4fd5-d82b-4323-bce2-6f74c5938068 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] 'nvme version' failed. Not Retrying. {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 04:18:44 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.nvmeof [None req-83ca4fd5-d82b-4323-bce2-6f74c5938068 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] nvme not present on system {{(pid=103546) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 04:18:44 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:18:44 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 04:18:44 user nova-compute[103546]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 04:18:44 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5fc6867-f71d-438a-8add-d656ef99c5db]: (4, '') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:18:44 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-83ca4fd5-d82b-4323-bce2-6f74c5938068 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=103546) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 04:18:44 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-83ca4fd5-d82b-4323-bce2-6f74c5938068 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 04:18:44 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-83ca4fd5-d82b-4323-bce2-6f74c5938068 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] LIGHTOS: no hostnqn found. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 04:18:44 user nova-compute[103546]: DEBUG os_brick.utils [None req-83ca4fd5-d82b-4323-bce2-6f74c5938068 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af5c39b14ece', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:18:44 user nova-compute[103546]: DEBUG nova.virt.block_device [None req-83ca4fd5-d82b-4323-bce2-6f74c5938068 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: b52cc321-5160-4747-a646-77edfe185310] Updating existing volume attachment record: d29af72d-1c1c-4108-b0a7-4311d459f1c0 {{(pid=103546) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 04:18:45 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:18:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:18:47 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:18:47 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Starting heal instance info cache {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 04:18:47 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Rebuilding the list of instances to heal {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 04:18:47 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "refresh_cache-a276ab3f-657a-4148-bd08-007f79230ace" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:18:47 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquired lock "refresh_cache-a276ab3f-657a-4148-bd08-007f79230ace" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:18:47 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Forcefully refreshing network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 04:18:47 user nova-compute[103546]: DEBUG nova.objects.instance [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lazy-loading 'info_cache' on Instance uuid a276ab3f-657a-4148-bd08-007f79230ace {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:18:48 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Updating instance_info_cache with network_info: [{"id": "b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3", "address": "fa:16:3e:52:f7:34", "network": {"id": "a758762c-c27c-4509-9870-1d42187aeaf4", "bridge": "br-int", "label": "tempest-TestStampPattern-405695915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21df2cbfb9234c13a504ad4a513970f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9fb2a6f-ec", "ovs_interfaceid": "b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:18:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Releasing lock "refresh_cache-a276ab3f-657a-4148-bd08-007f79230ace" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:18:48 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Updated the network info_cache for instance {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 04:18:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:18:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83ca4fd5-d82b-4323-bce2-6f74c5938068 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: b52cc321-5160-4747-a646-77edfe185310] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 04:18:49 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ca4fd5-d82b-4323-bce2-6f74c5938068 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:211822fa-c4dc-4d12-8be6-ceddcc080235', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wRAhLMOW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:18:49 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-83ca4fd5-d82b-4323-bce2-6f74c5938068 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:18:49 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-83ca4fd5-d82b-4323-bce2-6f74c5938068 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:18:49 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-83ca4fd5-d82b-4323-bce2-6f74c5938068 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:18:49 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-83ca4fd5-d82b-4323-bce2-6f74c5938068 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:18:49 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-83ca4fd5-d82b-4323-bce2-6f74c5938068 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:211822fa-c4dc-4d12-8be6-ceddcc080235" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:18:49 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-83ca4fd5-d82b-4323-bce2-6f74c5938068 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:211822fa-c4dc-4d12-8be6-ceddcc080235" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:18:49 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-83ca4fd5-d82b-4323-bce2-6f74c5938068 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 04:18:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:211822fa-c4dc-4d12-8be6-ceddcc080235 -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:18:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:211822fa-c4dc-4d12-8be6-ceddcc080235 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:18:49 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f143e0de-b14c-4735-8734-7da3a434dc5e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:18:49 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ca4fd5-d82b-4323-bce2-6f74c5938068 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 04:18:49 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:18:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:211822fa-c4dc-4d12-8be6-ceddcc080235 -p 172.16.0.220:3260 --interface default --op new {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:18:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:211822fa-c4dc-4d12-8be6-ceddcc080235 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:18:49 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb6a3ad-b7a7-402c-a2a8-a3e728543a07]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:211822fa-c4dc-4d12-8be6-ceddcc080235] added\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:18:49 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ca4fd5-d82b-4323-bce2-6f74c5938068 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:211822fa-c4dc-4d12-8be6-ceddcc080235] added
Nov 16 04:18:49 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:18:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:211822fa-c4dc-4d12-8be6-ceddcc080235 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:18:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:211822fa-c4dc-4d12-8be6-ceddcc080235 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:18:49 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[492808b7-b059-4b76-95dd-9f1351bdb87b]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:18:49 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ca4fd5-d82b-4323-bce2-6f74c5938068 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:18:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:211822fa-c4dc-4d12-8be6-ceddcc080235 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:18:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:211822fa-c4dc-4d12-8be6-ceddcc080235 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:18:49 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a305038-31de-4a02-bd12-b8c9aebeab58]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:18:49 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ca4fd5-d82b-4323-bce2-6f74c5938068 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:18:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:211822fa-c4dc-4d12-8be6-ceddcc080235 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wRAhLMOW {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:18:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:211822fa-c4dc-4d12-8be6-ceddcc080235 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wRAhLMOW" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:18:49 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78b2843-918a-4f51-b059-568768926d74]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:18:49 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ca4fd5-d82b-4323-bce2-6f74c5938068 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wRAhLMOW'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:18:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:211822fa-c4dc-4d12-8be6-ceddcc080235 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:18:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:211822fa-c4dc-4d12-8be6-ceddcc080235 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:18:49 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79a8d9b-db12-443d-a08e-6c1af750b708]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:18:49 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ca4fd5-d82b-4323-bce2-6f74c5938068 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:18:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:18:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:18:49 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[71fbe1a6-1736-43c9-b97a-6499c16f0520]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:18:49 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ca4fd5-d82b-4323-bce2-6f74c5938068 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 04:18:49 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:18:49 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ca4fd5-d82b-4323-bce2-6f74c5938068 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 04:18:49 user nova-compute[103546]:  {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:18:49 user nova-compute[103546]: WARNING os_brick.initiator.connectors.iscsi [None req-83ca4fd5-d82b-4323-bce2-6f74c5938068 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 04:18:49 user nova-compute[103546]: 
Nov 16 04:18:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:211822fa-c4dc-4d12-8be6-ceddcc080235 -p 172.16.0.220:3260 --login {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:18:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:211822fa-c4dc-4d12-8be6-ceddcc080235 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:18:49 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d80025-07d2-4639-a679-178faeb98eda]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:211822fa-c4dc-4d12-8be6-ceddcc080235, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:211822fa-c4dc-4d12-8be6-ceddcc080235, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:18:49 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ca4fd5-d82b-4323-bce2-6f74c5938068 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:211822fa-c4dc-4d12-8be6-ceddcc080235, portal: 172.16.0.220,3260]
Nov 16 04:18:49 user nova-compute[103546]: Login to [iface: default, target: iqn.2010-10.org.openstack:211822fa-c4dc-4d12-8be6-ceddcc080235, portal: 172.16.0.220,3260] successful.
Nov 16 04:18:49 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:18:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:211822fa-c4dc-4d12-8be6-ceddcc080235 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:18:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:211822fa-c4dc-4d12-8be6-ceddcc080235 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:18:49 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0aae918-fa8e-458d-9a80-09ff080f4e22]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:18:49 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ca4fd5-d82b-4323-bce2-6f74c5938068 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:18:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:18:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:18:49 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[434a95af-33d6-4845-952c-bef6a7f4c3ec]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211822fa-c4dc-4d12-8be6-ceddcc080235 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:18:49 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ca4fd5-d82b-4323-bce2-6f74c5938068 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211822fa-c4dc-4d12-8be6-ceddcc080235 (non-flash)
Nov 16 04:18:49 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:18:49 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ca4fd5-d82b-4323-bce2-6f74c5938068 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211822fa-c4dc-4d12-8be6-ceddcc080235 (non-flash)
Nov 16 04:18:49 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:18:49 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-83ca4fd5-d82b-4323-bce2-6f74c5938068 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:211822fa-c4dc-4d12-8be6-ceddcc080235" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:18:49 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ca4fd5-d82b-4323-bce2-6f74c5938068 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 04:18:49 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-83ca4fd5-d82b-4323-bce2-6f74c5938068 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 04:18:49 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-83ca4fd5-d82b-4323-bce2-6f74c5938068 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 04:18:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:18:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:18:49 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e69ca29-5ccd-4f6a-92b9-a63fa6a19316]: (4, ('- - 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:18:49 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-83ca4fd5-d82b-4323-bce2-6f74c5938068 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 04:18:49 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ca4fd5-d82b-4323-bce2-6f74c5938068 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:211822fa-c4dc-4d12-8be6-ceddcc080235', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wRAhLMOW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 04:18:50 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-83ca4fd5-d82b-4323-bce2-6f74c5938068 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.277s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:18:50 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ca4fd5-d82b-4323-bce2-6f74c5938068 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] <== connect_volume: return (1278ms) {'type': 'block', 'scsi_wwn': '23132383162393739', 'path': '/dev/sdb'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:18:50 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83ca4fd5-d82b-4323-bce2-6f74c5938068 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: b52cc321-5160-4747-a646-77edfe185310] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23132383162393739', 'path': '/dev/sdb'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 04:18:50 user nova-compute[103546]: DEBUG nova.objects.instance [None req-83ca4fd5-d82b-4323-bce2-6f74c5938068 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lazy-loading 'flavor' on Instance uuid b52cc321-5160-4747-a646-77edfe185310 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:18:50 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-83ca4fd5-d82b-4323-bce2-6f74c5938068 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 04:18:50 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:18:50 user nova-compute[103546]:   <source dev="/dev/sdb"/>
Nov 16 04:18:50 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 04:18:50 user nova-compute[103546]:   <serial>211822fa-c4dc-4d12-8be6-ceddcc080235</serial>
Nov 16 04:18:50 user nova-compute[103546]: </disk>
Nov 16 04:18:50 user nova-compute[103546]:  {{(pid=103546) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 04:18:51 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:18:51 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-83ca4fd5-d82b-4323-bce2-6f74c5938068 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:18:51 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-83ca4fd5-d82b-4323-bce2-6f74c5938068 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] No BDM found with device name vdb, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:18:51 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-83ca4fd5-d82b-4323-bce2-6f74c5938068 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] No VIF found with MAC fa:16:3e:65:f4:e9, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 04:18:51 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-83ca4fd5-d82b-4323-bce2-6f74c5938068 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lock "b52cc321-5160-4747-a646-77edfe185310" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.685s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:18:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:18:56 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:18:59 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:19:01 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:19:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f2648fef-44db-4cc0-9519-4a1f37c2820c tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Acquiring lock "b52cc321-5160-4747-a646-77edfe185310" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:19:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f2648fef-44db-4cc0-9519-4a1f37c2820c tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lock "b52cc321-5160-4747-a646-77edfe185310" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:19:03 user nova-compute[103546]: INFO nova.compute.manager [None req-f2648fef-44db-4cc0-9519-4a1f37c2820c tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: b52cc321-5160-4747-a646-77edfe185310] Detaching volume 211822fa-c4dc-4d12-8be6-ceddcc080235
Nov 16 04:19:03 user nova-compute[103546]: INFO nova.virt.block_device [None req-f2648fef-44db-4cc0-9519-4a1f37c2820c tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: b52cc321-5160-4747-a646-77edfe185310] Attempting to driver detach volume 211822fa-c4dc-4d12-8be6-ceddcc080235 from mountpoint /dev/vdb
Nov 16 04:19:03 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-f2648fef-44db-4cc0-9519-4a1f37c2820c tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Attempting to detach device vdb from instance b52cc321-5160-4747-a646-77edfe185310 from the persistent domain config. {{(pid=103546) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 04:19:03 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-f2648fef-44db-4cc0-9519-4a1f37c2820c tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 04:19:03 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:19:03 user nova-compute[103546]:   <source dev="/dev/sdb"/>
Nov 16 04:19:03 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 04:19:03 user nova-compute[103546]:   <serial>211822fa-c4dc-4d12-8be6-ceddcc080235</serial>
Nov 16 04:19:03 user nova-compute[103546]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 04:19:03 user nova-compute[103546]: </disk>
Nov 16 04:19:03 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 04:19:03 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-f2648fef-44db-4cc0-9519-4a1f37c2820c tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Successfully detached device vdb from instance b52cc321-5160-4747-a646-77edfe185310 from the persistent domain config.
Nov 16 04:19:03 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-f2648fef-44db-4cc0-9519-4a1f37c2820c tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b52cc321-5160-4747-a646-77edfe185310 from the live domain config. {{(pid=103546) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 04:19:03 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-f2648fef-44db-4cc0-9519-4a1f37c2820c tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 04:19:03 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:19:03 user nova-compute[103546]:   <source dev="/dev/sdb"/>
Nov 16 04:19:03 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 04:19:03 user nova-compute[103546]:   <serial>211822fa-c4dc-4d12-8be6-ceddcc080235</serial>
Nov 16 04:19:03 user nova-compute[103546]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 04:19:03 user nova-compute[103546]: </disk>
Nov 16 04:19:03 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 04:19:03 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-51246793-81ef-41aa-8f02-1a6c29cb2902 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Acquiring lock "b52cc321-5160-4747-a646-77edfe185310" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:19:03 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-f2648fef-44db-4cc0-9519-4a1f37c2820c tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b52cc321-5160-4747-a646-77edfe185310 {{(pid=103546) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 04:19:06 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:19:11 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:19:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:19:18 user nova-compute[103546]: DEBUG nova.compute.manager [req-fcf37317-01dd-4565-ad61-cc31b568d6cf req-20b3f962-3453-4883-9e9d-894c2291b623 service nova] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Received event network-changed-be3177c3-f31d-4783-8231-d9d4b5819aef {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:19:18 user nova-compute[103546]: DEBUG nova.compute.manager [req-fcf37317-01dd-4565-ad61-cc31b568d6cf req-20b3f962-3453-4883-9e9d-894c2291b623 service nova] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Refreshing instance network info cache due to event network-changed-be3177c3-f31d-4783-8231-d9d4b5819aef. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 04:19:18 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-fcf37317-01dd-4565-ad61-cc31b568d6cf req-20b3f962-3453-4883-9e9d-894c2291b623 service nova] Acquiring lock "refresh_cache-0805eb5a-79c7-43f2-b560-df687f7fbc0f" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:19:18 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-fcf37317-01dd-4565-ad61-cc31b568d6cf req-20b3f962-3453-4883-9e9d-894c2291b623 service nova] Acquired lock "refresh_cache-0805eb5a-79c7-43f2-b560-df687f7fbc0f" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:19:18 user nova-compute[103546]: DEBUG nova.network.neutron [req-fcf37317-01dd-4565-ad61-cc31b568d6cf req-20b3f962-3453-4883-9e9d-894c2291b623 service nova] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Refreshing network info cache for port be3177c3-f31d-4783-8231-d9d4b5819aef {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 04:19:19 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:19:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-fc48d7e3-0b23-4402-b6b0-c54cfc8a0122 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Acquiring lock "0805eb5a-79c7-43f2-b560-df687f7fbc0f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:19:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-fc48d7e3-0b23-4402-b6b0-c54cfc8a0122 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lock "0805eb5a-79c7-43f2-b560-df687f7fbc0f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:19:19 user nova-compute[103546]: DEBUG nova.objects.instance [None req-fc48d7e3-0b23-4402-b6b0-c54cfc8a0122 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lazy-loading 'flavor' on Instance uuid 0805eb5a-79c7-43f2-b560-df687f7fbc0f {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:19:19 user nova-compute[103546]: DEBUG nova.network.neutron [req-fcf37317-01dd-4565-ad61-cc31b568d6cf req-20b3f962-3453-4883-9e9d-894c2291b623 service nova] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Updated VIF entry in instance network info cache for port be3177c3-f31d-4783-8231-d9d4b5819aef. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 04:19:19 user nova-compute[103546]: DEBUG nova.network.neutron [req-fcf37317-01dd-4565-ad61-cc31b568d6cf req-20b3f962-3453-4883-9e9d-894c2291b623 service nova] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Updating instance_info_cache with network_info: [{"id": "be3177c3-f31d-4783-8231-d9d4b5819aef", "address": "fa:16:3e:57:29:00", "network": {"id": "a758762c-c27c-4509-9870-1d42187aeaf4", "bridge": "br-int", "label": "tempest-TestStampPattern-405695915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21df2cbfb9234c13a504ad4a513970f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe3177c3-f3", "ovs_interfaceid": "be3177c3-f31d-4783-8231-d9d4b5819aef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:19:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-fc48d7e3-0b23-4402-b6b0-c54cfc8a0122 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lock "0805eb5a-79c7-43f2-b560-df687f7fbc0f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:19:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-fcf37317-01dd-4565-ad61-cc31b568d6cf req-20b3f962-3453-4883-9e9d-894c2291b623 service nova] Releasing lock "refresh_cache-0805eb5a-79c7-43f2-b560-df687f7fbc0f" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:19:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-fc48d7e3-0b23-4402-b6b0-c54cfc8a0122 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Acquiring lock "0805eb5a-79c7-43f2-b560-df687f7fbc0f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:19:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-fc48d7e3-0b23-4402-b6b0-c54cfc8a0122 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lock "0805eb5a-79c7-43f2-b560-df687f7fbc0f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:19:19 user nova-compute[103546]: INFO nova.compute.manager [None req-fc48d7e3-0b23-4402-b6b0-c54cfc8a0122 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Attaching volume 6e2c6781-b036-458f-91d2-bfc2d8302a90 to /dev/vdb
Nov 16 04:19:19 user nova-compute[103546]: DEBUG os_brick.utils [None req-fc48d7e3-0b23-4402-b6b0-c54cfc8a0122 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:19:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:19:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:19:19 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ab01de-cda3-4958-a0de-1f319dd3a974]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af5c39b14ece\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:19:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:19:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:19:19 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d98cd4d-7583-4318-af3c-32acb3297334]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:19:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:19:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:19:19 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[73bc8ce1-9193-4968-9b97-94840937ebf8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:19:19 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[7606adf3-c397-4541-aa90-c17fc4ac73a1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:19:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-fc48d7e3-0b23-4402-b6b0-c54cfc8a0122 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Running cmd (subprocess): nvme version {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:19:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-fc48d7e3-0b23-4402-b6b0-c54cfc8a0122 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] 'nvme version' failed. Not Retrying. {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 04:19:19 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fc48d7e3-0b23-4402-b6b0-c54cfc8a0122 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] nvme not present on system {{(pid=103546) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 04:19:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:19:19 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 04:19:19 user nova-compute[103546]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 04:19:19 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[9874d7ee-f9e9-4674-86f7-ad23dfc66f31]: (4, '') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:19:19 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-fc48d7e3-0b23-4402-b6b0-c54cfc8a0122 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=103546) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 04:19:19 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-fc48d7e3-0b23-4402-b6b0-c54cfc8a0122 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 04:19:19 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-fc48d7e3-0b23-4402-b6b0-c54cfc8a0122 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] LIGHTOS: no hostnqn found. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 04:19:19 user nova-compute[103546]: DEBUG os_brick.utils [None req-fc48d7e3-0b23-4402-b6b0-c54cfc8a0122 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af5c39b14ece', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:19:19 user nova-compute[103546]: DEBUG nova.virt.block_device [None req-fc48d7e3-0b23-4402-b6b0-c54cfc8a0122 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Updating existing volume attachment record: e6e20b88-31ff-4367-bf65-bc2f6b10b31c {{(pid=103546) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 04:19:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:19:23 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-f2648fef-44db-4cc0-9519-4a1f37c2820c tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b52cc321-5160-4747-a646-77edfe185310 is timed out.
Nov 16 04:19:23 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-f2648fef-44db-4cc0-9519-4a1f37c2820c tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Successfully detached device vdb from instance b52cc321-5160-4747-a646-77edfe185310 from the live domain config.
Nov 16 04:19:23 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2648fef-44db-4cc0-9519-4a1f37c2820c tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: b52cc321-5160-4747-a646-77edfe185310] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 04:19:23 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2648fef-44db-4cc0-9519-4a1f37c2820c tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:211822fa-c4dc-4d12-8be6-ceddcc080235', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wRAhLMOW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:19:23 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-f2648fef-44db-4cc0-9519-4a1f37c2820c tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:19:23 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-f2648fef-44db-4cc0-9519-4a1f37c2820c tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:19:23 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-f2648fef-44db-4cc0-9519-4a1f37c2820c tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:19:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:19:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:19:23 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f87445-d55e-4620-880d-07697ae72de5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:343e75a3-c48d-4ca1-acc2-466dabbf8c06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:211822fa-c4dc-4d12-8be6-ceddcc080235\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:19:23 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2648fef-44db-4cc0-9519-4a1f37c2820c tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 04:19:23 user nova-compute[103546]: No targets found.
Nov 16 04:19:23 user nova-compute[103546]: iSNS:
Nov 16 04:19:23 user nova-compute[103546]: No targets found.
Nov 16 04:19:23 user nova-compute[103546]: STATIC:
Nov 16 04:19:23 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:343e75a3-c48d-4ca1-acc2-466dabbf8c06
Nov 16 04:19:23 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:19:23 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:19:23 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:211822fa-c4dc-4d12-8be6-ceddcc080235
Nov 16 04:19:23 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:19:23 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:19:23 user nova-compute[103546]: FIRMWARE:
Nov 16 04:19:23 user nova-compute[103546]: No targets found.
Nov 16 04:19:23 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:19:23 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2648fef-44db-4cc0-9519-4a1f37c2820c tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 04:19:23 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 04:19:23 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 04:19:23 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2648fef-44db-4cc0-9519-4a1f37c2820c tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:211822fa-c4dc-4d12-8be6-ceddcc080235', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 04:19:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:19:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:19:23 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd8bce2-f28f-497a-a6e6-28ba1779f2e7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:211822fa-c4dc-4d12-8be6-ceddcc080235\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:343e75a3-c48d-4ca1-acc2-466dabbf8c06\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:19:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:19:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:19:23 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[95bfa0d1-15ae-41b5-ba31-76ee58094138]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211822fa-c4dc-4d12-8be6-ceddcc080235 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:19:23 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2648fef-44db-4cc0-9519-4a1f37c2820c tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211822fa-c4dc-4d12-8be6-ceddcc080235 (non-flash)
Nov 16 04:19:23 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:19:23 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2648fef-44db-4cc0-9519-4a1f37c2820c tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211822fa-c4dc-4d12-8be6-ceddcc080235 (non-flash)
Nov 16 04:19:23 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:19:23 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2648fef-44db-4cc0-9519-4a1f37c2820c tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60ac386b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:211822fa-c4dc-4d12-8be6-ceddcc080235'): ({'sdb'}, set())}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 04:19:23 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-f2648fef-44db-4cc0-9519-4a1f37c2820c tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Removing single pathed devices sdb {{(pid=103546) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 04:19:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:19:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:19:23 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b2c720-99cb-4b86-b94a-c1e69a52bfe4]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:19:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:19:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:19:23 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b909c1df-ad41-4760-9200-2d2d628ddfca]: (4, ('ok\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:19:23 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-f2648fef-44db-4cc0-9519-4a1f37c2820c tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Flushing IO for device /dev/sdb {{(pid=103546) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 04:19:23 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68b92ab-d4fe-4840-b59f-b8afa0228595]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-f2648fef-44db-4cc0-9519-4a1f37c2820c tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=103546) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9dd8b9-4aca-4696-a7f5-b3bd27e0d0d0]: (4, ('1', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-f2648fef-44db-4cc0-9519-4a1f37c2820c tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-f2648fef-44db-4cc0-9519-4a1f37c2820c tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] SCSI volumes sdb have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2648fef-44db-4cc0-9519-4a1f37c2820c tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:211822fa-c4dc-4d12-8be6-ceddcc080235')] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:211822fa-c4dc-4d12-8be6-ceddcc080235 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:211822fa-c4dc-4d12-8be6-ceddcc080235 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[987dfbdf-f2eb-4c0e-ac95-189bb5042c37]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2648fef-44db-4cc0-9519-4a1f37c2820c tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:211822fa-c4dc-4d12-8be6-ceddcc080235 -p 172.16.0.220:3260 --logout {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:211822fa-c4dc-4d12-8be6-ceddcc080235 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52cc7ce-c954-4a4c-8031-c73f4837a928]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:211822fa-c4dc-4d12-8be6-ceddcc080235, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:211822fa-c4dc-4d12-8be6-ceddcc080235, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2648fef-44db-4cc0-9519-4a1f37c2820c tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:211822fa-c4dc-4d12-8be6-ceddcc080235, portal: 172.16.0.220,3260]
Nov 16 04:19:24 user nova-compute[103546]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:211822fa-c4dc-4d12-8be6-ceddcc080235, portal: 172.16.0.220,3260] successful.
Nov 16 04:19:24 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:211822fa-c4dc-4d12-8be6-ceddcc080235 -p 172.16.0.220:3260 --op delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:211822fa-c4dc-4d12-8be6-ceddcc080235 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3401b9a-8104-4f67-a52f-942834a8d8be]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2648fef-44db-4cc0-9519-4a1f37c2820c tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-f2648fef-44db-4cc0-9519-4a1f37c2820c tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2648fef-44db-4cc0-9519-4a1f37c2820c tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] <== disconnect_volume: return (290ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2648fef-44db-4cc0-9519-4a1f37c2820c tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: b52cc321-5160-4747-a646-77edfe185310] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc48d7e3-0b23-4402-b6b0-c54cfc8a0122 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc48d7e3-0b23-4402-b6b0-c54cfc8a0122 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6e2c6781-b036-458f-91d2-bfc2d8302a90', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HOqpFhWj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:19:24 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-fc48d7e3-0b23-4402-b6b0-c54cfc8a0122 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:19:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-fc48d7e3-0b23-4402-b6b0-c54cfc8a0122 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-fc48d7e3-0b23-4402-b6b0-c54cfc8a0122 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:19:24 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-fc48d7e3-0b23-4402-b6b0-c54cfc8a0122 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:19:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-fc48d7e3-0b23-4402-b6b0-c54cfc8a0122 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e2c6781-b036-458f-91d2-bfc2d8302a90" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-fc48d7e3-0b23-4402-b6b0-c54cfc8a0122 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e2c6781-b036-458f-91d2-bfc2d8302a90" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:19:24 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-fc48d7e3-0b23-4402-b6b0-c54cfc8a0122 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 04:19:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e2c6781-b036-458f-91d2-bfc2d8302a90 -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e2c6781-b036-458f-91d2-bfc2d8302a90 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef08ebc-20a3-480e-a810-3c6bff75ef3e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc48d7e3-0b23-4402-b6b0-c54cfc8a0122 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 04:19:24 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e2c6781-b036-458f-91d2-bfc2d8302a90 -p 172.16.0.220:3260 --interface default --op new {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG nova.objects.instance [None req-f2648fef-44db-4cc0-9519-4a1f37c2820c tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lazy-loading 'flavor' on Instance uuid b52cc321-5160-4747-a646-77edfe185310 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e2c6781-b036-458f-91d2-bfc2d8302a90 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b166f4d-f9cd-4b29-9aaa-88a278a78dc6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e2c6781-b036-458f-91d2-bfc2d8302a90] added\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc48d7e3-0b23-4402-b6b0-c54cfc8a0122 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e2c6781-b036-458f-91d2-bfc2d8302a90] added
Nov 16 04:19:24 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e2c6781-b036-458f-91d2-bfc2d8302a90 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e2c6781-b036-458f-91d2-bfc2d8302a90 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d20c9568-d31b-4208-86f6-71c5e26288eb]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc48d7e3-0b23-4402-b6b0-c54cfc8a0122 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e2c6781-b036-458f-91d2-bfc2d8302a90 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e2c6781-b036-458f-91d2-bfc2d8302a90 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9cc3a61-29f8-4bd7-82e0-1a6b01c6284b]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc48d7e3-0b23-4402-b6b0-c54cfc8a0122 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f2648fef-44db-4cc0-9519-4a1f37c2820c tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lock "b52cc321-5160-4747-a646-77edfe185310" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.679s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e2c6781-b036-458f-91d2-bfc2d8302a90 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HOqpFhWj {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-51246793-81ef-41aa-8f02-1a6c29cb2902 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lock "b52cc321-5160-4747-a646-77edfe185310" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.566s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-51246793-81ef-41aa-8f02-1a6c29cb2902 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Acquiring lock "b52cc321-5160-4747-a646-77edfe185310-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-51246793-81ef-41aa-8f02-1a6c29cb2902 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lock "b52cc321-5160-4747-a646-77edfe185310-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-51246793-81ef-41aa-8f02-1a6c29cb2902 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lock "b52cc321-5160-4747-a646-77edfe185310-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:19:24 user nova-compute[103546]: INFO nova.compute.manager [None req-51246793-81ef-41aa-8f02-1a6c29cb2902 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: b52cc321-5160-4747-a646-77edfe185310] Terminating instance
Nov 16 04:19:24 user nova-compute[103546]: DEBUG nova.compute.manager [None req-51246793-81ef-41aa-8f02-1a6c29cb2902 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: b52cc321-5160-4747-a646-77edfe185310] Start destroying the instance on the hypervisor. {{(pid=103546) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e2c6781-b036-458f-91d2-bfc2d8302a90 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HOqpFhWj" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70e7631-0675-4c2e-bf98-019803f8e8bf]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc48d7e3-0b23-4402-b6b0-c54cfc8a0122 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HOqpFhWj'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e2c6781-b036-458f-91d2-bfc2d8302a90 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e2c6781-b036-458f-91d2-bfc2d8302a90 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[82940452-6439-4682-908d-36a6e2a81495]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc48d7e3-0b23-4402-b6b0-c54cfc8a0122 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[be256ee3-6743-4159-8fcd-ef95bbc47718]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc48d7e3-0b23-4402-b6b0-c54cfc8a0122 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 04:19:24 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc48d7e3-0b23-4402-b6b0-c54cfc8a0122 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 04:19:24 user nova-compute[103546]:  {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:19:24 user nova-compute[103546]: WARNING os_brick.initiator.connectors.iscsi [None req-fc48d7e3-0b23-4402-b6b0-c54cfc8a0122 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 04:19:24 user nova-compute[103546]: 
Nov 16 04:19:24 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e2c6781-b036-458f-91d2-bfc2d8302a90 -p 172.16.0.220:3260 --login {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:19:24 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:19:25 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:19:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e2c6781-b036-458f-91d2-bfc2d8302a90 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:19:25 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3bb9673-786a-4dca-9118-ee87ab386c8f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e2c6781-b036-458f-91d2-bfc2d8302a90, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6e2c6781-b036-458f-91d2-bfc2d8302a90, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:19:25 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc48d7e3-0b23-4402-b6b0-c54cfc8a0122 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e2c6781-b036-458f-91d2-bfc2d8302a90, portal: 172.16.0.220,3260]
Nov 16 04:19:25 user nova-compute[103546]: Login to [iface: default, target: iqn.2010-10.org.openstack:6e2c6781-b036-458f-91d2-bfc2d8302a90, portal: 172.16.0.220,3260] successful.
Nov 16 04:19:25 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:19:25 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:19:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e2c6781-b036-458f-91d2-bfc2d8302a90 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:19:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e2c6781-b036-458f-91d2-bfc2d8302a90 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:19:25 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0fb082-6259-499a-a5c7-df7160ecf6f6]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:19:25 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc48d7e3-0b23-4402-b6b0-c54cfc8a0122 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:19:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:19:25 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:19:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:19:25 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc25b222-5e74-4aa1-890d-d855caa6732b]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2c6781-b036-458f-91d2-bfc2d8302a90 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:19:25 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc48d7e3-0b23-4402-b6b0-c54cfc8a0122 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2c6781-b036-458f-91d2-bfc2d8302a90 (non-flash)
Nov 16 04:19:25 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:19:25 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc48d7e3-0b23-4402-b6b0-c54cfc8a0122 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2c6781-b036-458f-91d2-bfc2d8302a90 (non-flash)
Nov 16 04:19:25 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:19:25 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-fc48d7e3-0b23-4402-b6b0-c54cfc8a0122 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e2c6781-b036-458f-91d2-bfc2d8302a90" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:19:25 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc48d7e3-0b23-4402-b6b0-c54cfc8a0122 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 04:19:25 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-fc48d7e3-0b23-4402-b6b0-c54cfc8a0122 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] HCTL ('33', '-', '-', 0) found on session 63 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 04:19:25 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-fc48d7e3-0b23-4402-b6b0-c54cfc8a0122 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 04:19:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:19:25 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:19:25 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da6c7db-f813-4659-870a-f3d3bad36d23]: (4, ('- - 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:19:25 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-fc48d7e3-0b23-4402-b6b0-c54cfc8a0122 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 04:19:25 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc48d7e3-0b23-4402-b6b0-c54cfc8a0122 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6e2c6781-b036-458f-91d2-bfc2d8302a90', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HOqpFhWj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 04:19:25 user nova-compute[103546]: DEBUG nova.compute.manager [req-a0ee2fca-3ed4-4af8-8e03-7b7ed27f3bc1 req-eab90329-2fa5-42b5-8a31-182bab0d4e55 service nova] [instance: b52cc321-5160-4747-a646-77edfe185310] Received event network-vif-unplugged-5400cbb0-846c-49a6-8d49-d00324e76bde {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:19:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a0ee2fca-3ed4-4af8-8e03-7b7ed27f3bc1 req-eab90329-2fa5-42b5-8a31-182bab0d4e55 service nova] Acquiring lock "b52cc321-5160-4747-a646-77edfe185310-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:19:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a0ee2fca-3ed4-4af8-8e03-7b7ed27f3bc1 req-eab90329-2fa5-42b5-8a31-182bab0d4e55 service nova] Lock "b52cc321-5160-4747-a646-77edfe185310-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:19:25 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a0ee2fca-3ed4-4af8-8e03-7b7ed27f3bc1 req-eab90329-2fa5-42b5-8a31-182bab0d4e55 service nova] Lock "b52cc321-5160-4747-a646-77edfe185310-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:19:25 user nova-compute[103546]: DEBUG nova.compute.manager [req-a0ee2fca-3ed4-4af8-8e03-7b7ed27f3bc1 req-eab90329-2fa5-42b5-8a31-182bab0d4e55 service nova] [instance: b52cc321-5160-4747-a646-77edfe185310] No waiting events found dispatching network-vif-unplugged-5400cbb0-846c-49a6-8d49-d00324e76bde {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:19:25 user nova-compute[103546]: DEBUG nova.compute.manager [req-a0ee2fca-3ed4-4af8-8e03-7b7ed27f3bc1 req-eab90329-2fa5-42b5-8a31-182bab0d4e55 service nova] [instance: b52cc321-5160-4747-a646-77edfe185310] Received event network-vif-unplugged-5400cbb0-846c-49a6-8d49-d00324e76bde for instance with task_state deleting. {{(pid=103546) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 04:19:25 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:19:25 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: b52cc321-5160-4747-a646-77edfe185310] Instance destroyed successfully.
Nov 16 04:19:25 user nova-compute[103546]: DEBUG nova.objects.instance [None req-51246793-81ef-41aa-8f02-1a6c29cb2902 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lazy-loading 'resources' on Instance uuid b52cc321-5160-4747-a646-77edfe185310 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:19:25 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-51246793-81ef-41aa-8f02-1a6c29cb2902 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:16:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-121018800',display_name='tempest-VolumesSnapshotTestJSON-instance-121018800',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-121018800',id=51,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBELNLEmudfvz0YrxPfLxsA2mB4Eey2V7x6nbYHjwF+YXEO5PbJZwh2LGklfZ2uVNvnXV5gag6RG9bc/CUZmxnE9Qi68cD9S90tugSLix5QBFExfBLm9jXLpDTgd36/Xiaw==',key_name='tempest-keypair-1471533643',keypairs=<?>,launch_index=0,launched_at=2023-11-16T04:16:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c7de09c5b11a4b0f96a66c9788e5942c',ramdisk_id='',reservation_id='r-byqy7zob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1700179265',owner_user_name='tempest-VolumesSnapshotTestJSON-1700179265-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T04:16:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04ea7f587fd94211b18f97f3fe23714a',uuid=b52cc321-5160-4747-a646-77edfe185310,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5400cbb0-846c-49a6-8d49-d00324e76bde", "address": "fa:16:3e:65:f4:e9", "network": {"id": "855d0097-2e3c-4168-900e-d811676a8bff", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1275657618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7de09c5b11a4b0f96a66c9788e5942c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5400cbb0-84", "ovs_interfaceid": "5400cbb0-846c-49a6-8d49-d00324e76bde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 04:19:25 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-51246793-81ef-41aa-8f02-1a6c29cb2902 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Converting VIF {"id": "5400cbb0-846c-49a6-8d49-d00324e76bde", "address": "fa:16:3e:65:f4:e9", "network": {"id": "855d0097-2e3c-4168-900e-d811676a8bff", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1275657618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7de09c5b11a4b0f96a66c9788e5942c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5400cbb0-84", "ovs_interfaceid": "5400cbb0-846c-49a6-8d49-d00324e76bde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:19:25 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-51246793-81ef-41aa-8f02-1a6c29cb2902 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:f4:e9,bridge_name='br-int',has_traffic_filtering=True,id=5400cbb0-846c-49a6-8d49-d00324e76bde,network=Network(855d0097-2e3c-4168-900e-d811676a8bff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5400cbb0-84') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:19:25 user nova-compute[103546]: DEBUG os_vif [None req-51246793-81ef-41aa-8f02-1a6c29cb2902 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:f4:e9,bridge_name='br-int',has_traffic_filtering=True,id=5400cbb0-846c-49a6-8d49-d00324e76bde,network=Network(855d0097-2e3c-4168-900e-d811676a8bff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5400cbb0-84') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 04:19:25 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:19:25 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5400cbb0-84, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:19:25 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:19:25 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:19:25 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:19:25 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=720260f6-e902-44f4-b13f-352b6f717550) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:19:25 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:19:25 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:19:25 user nova-compute[103546]: INFO os_vif [None req-51246793-81ef-41aa-8f02-1a6c29cb2902 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:f4:e9,bridge_name='br-int',has_traffic_filtering=True,id=5400cbb0-846c-49a6-8d49-d00324e76bde,network=Network(855d0097-2e3c-4168-900e-d811676a8bff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5400cbb0-84')
Nov 16 04:19:25 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51246793-81ef-41aa-8f02-1a6c29cb2902 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: b52cc321-5160-4747-a646-77edfe185310] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 04:19:25 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-51246793-81ef-41aa-8f02-1a6c29cb2902 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:211822fa-c4dc-4d12-8be6-ceddcc080235', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wRAhLMOW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:19:25 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-51246793-81ef-41aa-8f02-1a6c29cb2902 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:19:25 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-51246793-81ef-41aa-8f02-1a6c29cb2902 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:19:26 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-fc48d7e3-0b23-4402-b6b0-c54cfc8a0122 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:19:26 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc48d7e3-0b23-4402-b6b0-c54cfc8a0122 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23962336434326261', 'path': '/dev/sdb'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:19:26 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc48d7e3-0b23-4402-b6b0-c54cfc8a0122 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962336434326261', 'path': '/dev/sdb'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 04:19:26 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-51246793-81ef-41aa-8f02-1a6c29cb2902 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.368s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:19:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:19:26 user nova-compute[103546]: DEBUG nova.objects.instance [None req-fc48d7e3-0b23-4402-b6b0-c54cfc8a0122 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lazy-loading 'flavor' on Instance uuid 0805eb5a-79c7-43f2-b560-df687f7fbc0f {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:19:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:19:26 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[02620c6d-4d20-4867-a262-5c80559ff453]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6e2c6781-b036-458f-91d2-bfc2d8302a90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:19:26 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-51246793-81ef-41aa-8f02-1a6c29cb2902 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 04:19:26 user nova-compute[103546]: No targets found.
Nov 16 04:19:26 user nova-compute[103546]: iSNS:
Nov 16 04:19:26 user nova-compute[103546]: No targets found.
Nov 16 04:19:26 user nova-compute[103546]: STATIC:
Nov 16 04:19:26 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:6e2c6781-b036-458f-91d2-bfc2d8302a90
Nov 16 04:19:26 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:19:26 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:19:26 user nova-compute[103546]: FIRMWARE:
Nov 16 04:19:26 user nova-compute[103546]: No targets found.
Nov 16 04:19:26 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:19:26 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-51246793-81ef-41aa-8f02-1a6c29cb2902 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 04:19:26 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 04:19:26 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 04:19:26 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-51246793-81ef-41aa-8f02-1a6c29cb2902 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:211822fa-c4dc-4d12-8be6-ceddcc080235', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 04:19:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:19:26 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-fc48d7e3-0b23-4402-b6b0-c54cfc8a0122 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 04:19:26 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:19:26 user nova-compute[103546]:   <source dev="/dev/sdb"/>
Nov 16 04:19:26 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 04:19:26 user nova-compute[103546]:   <serial>6e2c6781-b036-458f-91d2-bfc2d8302a90</serial>
Nov 16 04:19:26 user nova-compute[103546]: </disk>
Nov 16 04:19:26 user nova-compute[103546]:  {{(pid=103546) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 04:19:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:19:26 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[32686277-7b6d-4cb9-a199-34ffbb47868a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e2c6781-b036-458f-91d2-bfc2d8302a90\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:19:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:19:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:19:26 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9918fd-297c-4a83-a426-f3e03e9d46ec]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2c6781-b036-458f-91d2-bfc2d8302a90 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:19:26 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-51246793-81ef-41aa-8f02-1a6c29cb2902 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2c6781-b036-458f-91d2-bfc2d8302a90 (non-flash)
Nov 16 04:19:26 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:19:26 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-51246793-81ef-41aa-8f02-1a6c29cb2902 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2c6781-b036-458f-91d2-bfc2d8302a90 (non-flash)
Nov 16 04:19:26 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:19:26 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-51246793-81ef-41aa-8f02-1a6c29cb2902 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60c40ee950>, {}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 04:19:26 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-51246793-81ef-41aa-8f02-1a6c29cb2902 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Disconnecting from: [] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 04:19:26 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-51246793-81ef-41aa-8f02-1a6c29cb2902 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.071s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:19:26 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-51246793-81ef-41aa-8f02-1a6c29cb2902 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] <== disconnect_volume: return (439ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:19:26 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51246793-81ef-41aa-8f02-1a6c29cb2902 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: b52cc321-5160-4747-a646-77edfe185310] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 04:19:26 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-51246793-81ef-41aa-8f02-1a6c29cb2902 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: b52cc321-5160-4747-a646-77edfe185310] Deleting instance files /opt/stack/data/nova/instances/b52cc321-5160-4747-a646-77edfe185310_del
Nov 16 04:19:26 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-51246793-81ef-41aa-8f02-1a6c29cb2902 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: b52cc321-5160-4747-a646-77edfe185310] Deletion of /opt/stack/data/nova/instances/b52cc321-5160-4747-a646-77edfe185310_del complete
Nov 16 04:19:26 user nova-compute[103546]: INFO nova.compute.manager [None req-51246793-81ef-41aa-8f02-1a6c29cb2902 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: b52cc321-5160-4747-a646-77edfe185310] Took 1.32 seconds to destroy the instance on the hypervisor.
Nov 16 04:19:26 user nova-compute[103546]: DEBUG oslo.service.loopingcall [None req-51246793-81ef-41aa-8f02-1a6c29cb2902 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=103546) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 04:19:26 user nova-compute[103546]: DEBUG nova.compute.manager [-] [instance: b52cc321-5160-4747-a646-77edfe185310] Deallocating network for instance {{(pid=103546) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 04:19:26 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: b52cc321-5160-4747-a646-77edfe185310] deallocate_for_instance() {{(pid=103546) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 04:19:26 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-fc48d7e3-0b23-4402-b6b0-c54cfc8a0122 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:19:26 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-fc48d7e3-0b23-4402-b6b0-c54cfc8a0122 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] No BDM found with device name vdb, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:19:26 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-fc48d7e3-0b23-4402-b6b0-c54cfc8a0122 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] No VIF found with MAC fa:16:3e:57:29:00, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 04:19:26 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-fc48d7e3-0b23-4402-b6b0-c54cfc8a0122 tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lock "0805eb5a-79c7-43f2-b560-df687f7fbc0f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.028s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:19:27 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: b52cc321-5160-4747-a646-77edfe185310] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:19:27 user nova-compute[103546]: INFO nova.compute.manager [-] [instance: b52cc321-5160-4747-a646-77edfe185310] Took 1.06 seconds to deallocate network for instance.
Nov 16 04:19:27 user nova-compute[103546]: DEBUG nova.compute.manager [req-425ad11c-f40d-49a0-a178-bcda2c7d2465 req-1d4ad948-6540-4ff2-b813-f288c1ec157b service nova] [instance: b52cc321-5160-4747-a646-77edfe185310] Received event network-vif-deleted-5400cbb0-846c-49a6-8d49-d00324e76bde {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:19:27 user nova-compute[103546]: INFO nova.compute.manager [req-425ad11c-f40d-49a0-a178-bcda2c7d2465 req-1d4ad948-6540-4ff2-b813-f288c1ec157b service nova] [instance: b52cc321-5160-4747-a646-77edfe185310] Neutron deleted interface 5400cbb0-846c-49a6-8d49-d00324e76bde; detaching it from the instance and deleting it from the info cache
Nov 16 04:19:27 user nova-compute[103546]: DEBUG nova.network.neutron [req-425ad11c-f40d-49a0-a178-bcda2c7d2465 req-1d4ad948-6540-4ff2-b813-f288c1ec157b service nova] [instance: b52cc321-5160-4747-a646-77edfe185310] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:19:27 user nova-compute[103546]: WARNING nova.volume.cinder [None req-51246793-81ef-41aa-8f02-1a6c29cb2902 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Attachment d29af72d-1c1c-4108-b0a7-4311d459f1c0 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = d29af72d-1c1c-4108-b0a7-4311d459f1c0. (HTTP 404) (Request-ID: req-d4301bbb-0d9b-4f40-8168-1d5a0e63d343)
Nov 16 04:19:27 user nova-compute[103546]: INFO nova.compute.manager [None req-51246793-81ef-41aa-8f02-1a6c29cb2902 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] [instance: b52cc321-5160-4747-a646-77edfe185310] Took 0.03 seconds to detach 1 volumes for instance.
Nov 16 04:19:27 user nova-compute[103546]: DEBUG nova.compute.manager [req-425ad11c-f40d-49a0-a178-bcda2c7d2465 req-1d4ad948-6540-4ff2-b813-f288c1ec157b service nova] [instance: b52cc321-5160-4747-a646-77edfe185310] Detach interface failed, port_id=5400cbb0-846c-49a6-8d49-d00324e76bde, reason: Instance b52cc321-5160-4747-a646-77edfe185310 could not be found. {{(pid=103546) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 04:19:27 user nova-compute[103546]: DEBUG nova.compute.manager [req-e70c420b-d8a4-4cbf-9e31-3433085ad9ef req-2b63579b-bffa-4bb1-85a0-cb6cdaf2ca0d service nova] [instance: b52cc321-5160-4747-a646-77edfe185310] Received event network-vif-plugged-5400cbb0-846c-49a6-8d49-d00324e76bde {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:19:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-e70c420b-d8a4-4cbf-9e31-3433085ad9ef req-2b63579b-bffa-4bb1-85a0-cb6cdaf2ca0d service nova] Acquiring lock "b52cc321-5160-4747-a646-77edfe185310-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:19:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-e70c420b-d8a4-4cbf-9e31-3433085ad9ef req-2b63579b-bffa-4bb1-85a0-cb6cdaf2ca0d service nova] Lock "b52cc321-5160-4747-a646-77edfe185310-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:19:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-e70c420b-d8a4-4cbf-9e31-3433085ad9ef req-2b63579b-bffa-4bb1-85a0-cb6cdaf2ca0d service nova] Lock "b52cc321-5160-4747-a646-77edfe185310-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:19:27 user nova-compute[103546]: DEBUG nova.compute.manager [req-e70c420b-d8a4-4cbf-9e31-3433085ad9ef req-2b63579b-bffa-4bb1-85a0-cb6cdaf2ca0d service nova] [instance: b52cc321-5160-4747-a646-77edfe185310] No waiting events found dispatching network-vif-plugged-5400cbb0-846c-49a6-8d49-d00324e76bde {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:19:27 user nova-compute[103546]: WARNING nova.compute.manager [req-e70c420b-d8a4-4cbf-9e31-3433085ad9ef req-2b63579b-bffa-4bb1-85a0-cb6cdaf2ca0d service nova] [instance: b52cc321-5160-4747-a646-77edfe185310] Received unexpected event network-vif-plugged-5400cbb0-846c-49a6-8d49-d00324e76bde for instance with vm_state active and task_state deleting.
Nov 16 04:19:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-51246793-81ef-41aa-8f02-1a6c29cb2902 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:19:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-51246793-81ef-41aa-8f02-1a6c29cb2902 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:19:27 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-51246793-81ef-41aa-8f02-1a6c29cb2902 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:19:27 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-51246793-81ef-41aa-8f02-1a6c29cb2902 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:19:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-51246793-81ef-41aa-8f02-1a6c29cb2902 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.171s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:19:27 user nova-compute[103546]: INFO nova.scheduler.client.report [None req-51246793-81ef-41aa-8f02-1a6c29cb2902 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Deleted allocations for instance b52cc321-5160-4747-a646-77edfe185310
Nov 16 04:19:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-51246793-81ef-41aa-8f02-1a6c29cb2902 tempest-VolumesSnapshotTestJSON-1700179265 tempest-VolumesSnapshotTestJSON-1700179265-project-member] Lock "b52cc321-5160-4747-a646-77edfe185310" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.784s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:19:28 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b57530c3-b1f2-4dec-a7a4-8d130ef7bd4f tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Acquiring lock "0805eb5a-79c7-43f2-b560-df687f7fbc0f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:19:28 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b57530c3-b1f2-4dec-a7a4-8d130ef7bd4f tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lock "0805eb5a-79c7-43f2-b560-df687f7fbc0f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:19:28 user nova-compute[103546]: INFO nova.compute.manager [None req-b57530c3-b1f2-4dec-a7a4-8d130ef7bd4f tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Detaching volume 6e2c6781-b036-458f-91d2-bfc2d8302a90
Nov 16 04:19:28 user nova-compute[103546]: INFO nova.virt.block_device [None req-b57530c3-b1f2-4dec-a7a4-8d130ef7bd4f tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Attempting to driver detach volume 6e2c6781-b036-458f-91d2-bfc2d8302a90 from mountpoint /dev/vdb
Nov 16 04:19:28 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-b57530c3-b1f2-4dec-a7a4-8d130ef7bd4f tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Attempting to detach device vdb from instance 0805eb5a-79c7-43f2-b560-df687f7fbc0f from the persistent domain config. {{(pid=103546) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 04:19:28 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-b57530c3-b1f2-4dec-a7a4-8d130ef7bd4f tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 04:19:28 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:19:28 user nova-compute[103546]:   <source dev="/dev/sdb"/>
Nov 16 04:19:28 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 04:19:28 user nova-compute[103546]:   <serial>6e2c6781-b036-458f-91d2-bfc2d8302a90</serial>
Nov 16 04:19:28 user nova-compute[103546]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 04:19:28 user nova-compute[103546]: </disk>
Nov 16 04:19:28 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 04:19:28 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-b57530c3-b1f2-4dec-a7a4-8d130ef7bd4f tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Successfully detached device vdb from instance 0805eb5a-79c7-43f2-b560-df687f7fbc0f from the persistent domain config.
Nov 16 04:19:28 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-b57530c3-b1f2-4dec-a7a4-8d130ef7bd4f tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0805eb5a-79c7-43f2-b560-df687f7fbc0f from the live domain config. {{(pid=103546) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 04:19:28 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-b57530c3-b1f2-4dec-a7a4-8d130ef7bd4f tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 04:19:28 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:19:28 user nova-compute[103546]:   <source dev="/dev/sdb"/>
Nov 16 04:19:28 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 04:19:28 user nova-compute[103546]:   <serial>6e2c6781-b036-458f-91d2-bfc2d8302a90</serial>
Nov 16 04:19:28 user nova-compute[103546]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 04:19:28 user nova-compute[103546]: </disk>
Nov 16 04:19:28 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 04:19:28 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-b57530c3-b1f2-4dec-a7a4-8d130ef7bd4f tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0805eb5a-79c7-43f2-b560-df687f7fbc0f {{(pid=103546) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 04:19:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:19:30 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:19:34 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:19:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:19:37 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:19:37 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager.update_available_resource {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:19:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:19:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:19:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:19:37 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Auditing locally available compute resources for user (node: user) {{(pid=103546) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 04:19:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0805eb5a-79c7-43f2-b560-df687f7fbc0f/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:19:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0805eb5a-79c7-43f2-b560-df687f7fbc0f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:19:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0805eb5a-79c7-43f2-b560-df687f7fbc0f/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:19:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0805eb5a-79c7-43f2-b560-df687f7fbc0f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:19:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a276ab3f-657a-4148-bd08-007f79230ace/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:19:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a276ab3f-657a-4148-bd08-007f79230ace/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:19:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a276ab3f-657a-4148-bd08-007f79230ace/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:19:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a276ab3f-657a-4148-bd08-007f79230ace/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:19:38 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:19:38 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:19:38 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Hypervisor/Node resource view: name=user free_ram=8813MB free_disk=24.963871002197266GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=103546) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 04:19:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:19:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:19:39 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance a276ab3f-657a-4148-bd08-007f79230ace actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:19:39 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 0805eb5a-79c7-43f2-b560-df687f7fbc0f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:19:39 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 04:19:39 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 04:19:39 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:19:39 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:19:39 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Compute_service record updated for user:user {{(pid=103546) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 04:19:39 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.255s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:19:40 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:19:41 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:19:41 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:19:41 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:19:41 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:19:41 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=103546) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 04:19:44 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:19:45 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:19:46 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:19:47 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:19:47 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Starting heal instance info cache {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 04:19:47 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "refresh_cache-0805eb5a-79c7-43f2-b560-df687f7fbc0f" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:19:47 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquired lock "refresh_cache-0805eb5a-79c7-43f2-b560-df687f7fbc0f" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:19:47 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Forcefully refreshing network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 04:19:48 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Updating instance_info_cache with network_info: [{"id": "be3177c3-f31d-4783-8231-d9d4b5819aef", "address": "fa:16:3e:57:29:00", "network": {"id": "a758762c-c27c-4509-9870-1d42187aeaf4", "bridge": "br-int", "label": "tempest-TestStampPattern-405695915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21df2cbfb9234c13a504ad4a513970f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe3177c3-f3", "ovs_interfaceid": "be3177c3-f31d-4783-8231-d9d4b5819aef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:19:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Releasing lock "refresh_cache-0805eb5a-79c7-43f2-b560-df687f7fbc0f" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:19:48 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Updated the network info_cache for instance {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 04:19:48 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-b57530c3-b1f2-4dec-a7a4-8d130ef7bd4f tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0805eb5a-79c7-43f2-b560-df687f7fbc0f is timed out.
Nov 16 04:19:48 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-b57530c3-b1f2-4dec-a7a4-8d130ef7bd4f tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Successfully detached device vdb from instance 0805eb5a-79c7-43f2-b560-df687f7fbc0f from the live domain config.
Nov 16 04:19:48 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b57530c3-b1f2-4dec-a7a4-8d130ef7bd4f tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 04:19:48 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57530c3-b1f2-4dec-a7a4-8d130ef7bd4f tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:6e2c6781-b036-458f-91d2-bfc2d8302a90', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HOqpFhWj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:19:48 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-b57530c3-b1f2-4dec-a7a4-8d130ef7bd4f tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:19:48 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-b57530c3-b1f2-4dec-a7a4-8d130ef7bd4f tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:19:48 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-b57530c3-b1f2-4dec-a7a4-8d130ef7bd4f tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:19:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:19:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:19:48 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c441628e-89ec-4fc7-9ce4-05e839a75010]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6e2c6781-b036-458f-91d2-bfc2d8302a90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:19:48 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57530c3-b1f2-4dec-a7a4-8d130ef7bd4f tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 04:19:48 user nova-compute[103546]: No targets found.
Nov 16 04:19:48 user nova-compute[103546]: iSNS:
Nov 16 04:19:48 user nova-compute[103546]: No targets found.
Nov 16 04:19:48 user nova-compute[103546]: STATIC:
Nov 16 04:19:48 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:6e2c6781-b036-458f-91d2-bfc2d8302a90
Nov 16 04:19:48 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:19:48 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:19:48 user nova-compute[103546]: FIRMWARE:
Nov 16 04:19:48 user nova-compute[103546]: No targets found.
Nov 16 04:19:48 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:19:48 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57530c3-b1f2-4dec-a7a4-8d130ef7bd4f tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 04:19:48 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 04:19:48 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 04:19:48 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57530c3-b1f2-4dec-a7a4-8d130ef7bd4f tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e2c6781-b036-458f-91d2-bfc2d8302a90', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 04:19:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:19:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:19:49 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6d9054-32e1-4554-8571-20469b673e29]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e2c6781-b036-458f-91d2-bfc2d8302a90\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:19:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:19:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:19:49 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[82fcd8c6-ff60-4b12-88de-f8c7868b59d6]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2c6781-b036-458f-91d2-bfc2d8302a90 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:19:49 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57530c3-b1f2-4dec-a7a4-8d130ef7bd4f tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2c6781-b036-458f-91d2-bfc2d8302a90 (non-flash)
Nov 16 04:19:49 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:19:49 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57530c3-b1f2-4dec-a7a4-8d130ef7bd4f tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e2c6781-b036-458f-91d2-bfc2d8302a90 (non-flash)
Nov 16 04:19:49 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:19:49 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57530c3-b1f2-4dec-a7a4-8d130ef7bd4f tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60ac300280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e2c6781-b036-458f-91d2-bfc2d8302a90'): ({'sdb'}, set())}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 04:19:49 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-b57530c3-b1f2-4dec-a7a4-8d130ef7bd4f tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Removing single pathed devices sdb {{(pid=103546) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 04:19:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:19:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:19:49 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f84d8b-9bc1-4828-b5cf-900b4951ce8a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:19:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:19:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:19:49 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47cf711-0116-402a-bd5a-0d49ef866d89]: (4, ('ok\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:19:49 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-b57530c3-b1f2-4dec-a7a4-8d130ef7bd4f tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Flushing IO for device /dev/sdb {{(pid=103546) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 04:19:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:19:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:19:49 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f1e587-70ef-4d94-a391-f71bf65345f8]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:19:49 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-b57530c3-b1f2-4dec-a7a4-8d130ef7bd4f tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=103546) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 04:19:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:19:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:19:49 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92d4553-bb46-4393-9edc-bf16eb3aa2a9]: (4, ('1', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:19:49 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-b57530c3-b1f2-4dec-a7a4-8d130ef7bd4f tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 04:19:49 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-b57530c3-b1f2-4dec-a7a4-8d130ef7bd4f tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] SCSI volumes sdb have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 04:19:49 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57530c3-b1f2-4dec-a7a4-8d130ef7bd4f tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e2c6781-b036-458f-91d2-bfc2d8302a90')] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 04:19:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e2c6781-b036-458f-91d2-bfc2d8302a90 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:19:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e2c6781-b036-458f-91d2-bfc2d8302a90 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:19:49 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b8e27c-bca5-4f13-a692-5a41b91947f1]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:19:49 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57530c3-b1f2-4dec-a7a4-8d130ef7bd4f tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:19:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e2c6781-b036-458f-91d2-bfc2d8302a90 -p 172.16.0.220:3260 --logout {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:19:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e2c6781-b036-458f-91d2-bfc2d8302a90 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:19:49 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[989732f0-e9d2-41a5-8609-fc1cefac713c]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:6e2c6781-b036-458f-91d2-bfc2d8302a90, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:6e2c6781-b036-458f-91d2-bfc2d8302a90, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:19:49 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57530c3-b1f2-4dec-a7a4-8d130ef7bd4f tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:6e2c6781-b036-458f-91d2-bfc2d8302a90, portal: 172.16.0.220,3260]
Nov 16 04:19:49 user nova-compute[103546]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:6e2c6781-b036-458f-91d2-bfc2d8302a90, portal: 172.16.0.220,3260] successful.
Nov 16 04:19:49 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:19:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e2c6781-b036-458f-91d2-bfc2d8302a90 -p 172.16.0.220:3260 --op delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:19:49 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e2c6781-b036-458f-91d2-bfc2d8302a90 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:19:49 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcaf0936-b08a-4892-96b7-56aa13246731]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:19:49 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57530c3-b1f2-4dec-a7a4-8d130ef7bd4f tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:19:49 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-b57530c3-b1f2-4dec-a7a4-8d130ef7bd4f tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.273s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:19:49 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b57530c3-b1f2-4dec-a7a4-8d130ef7bd4f tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] <== disconnect_volume: return (276ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:19:49 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b57530c3-b1f2-4dec-a7a4-8d130ef7bd4f tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 04:19:50 user nova-compute[103546]: DEBUG nova.objects.instance [None req-b57530c3-b1f2-4dec-a7a4-8d130ef7bd4f tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lazy-loading 'flavor' on Instance uuid 0805eb5a-79c7-43f2-b560-df687f7fbc0f {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:19:50 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b57530c3-b1f2-4dec-a7a4-8d130ef7bd4f tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lock "0805eb5a-79c7-43f2-b560-df687f7fbc0f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.654s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:19:50 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:19:50 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:19:50 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=103546) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 04:19:50 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:19:50 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:19:50 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:19:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:19:55 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:20:00 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:20:05 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:20:10 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:20:15 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:20:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-505b63f7-7000-4261-9359-38618c0557ab tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Acquiring lock "0805eb5a-79c7-43f2-b560-df687f7fbc0f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:20:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-505b63f7-7000-4261-9359-38618c0557ab tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lock "0805eb5a-79c7-43f2-b560-df687f7fbc0f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:20:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-505b63f7-7000-4261-9359-38618c0557ab tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Acquiring lock "0805eb5a-79c7-43f2-b560-df687f7fbc0f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:20:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-505b63f7-7000-4261-9359-38618c0557ab tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lock "0805eb5a-79c7-43f2-b560-df687f7fbc0f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:20:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-505b63f7-7000-4261-9359-38618c0557ab tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lock "0805eb5a-79c7-43f2-b560-df687f7fbc0f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:20:19 user nova-compute[103546]: INFO nova.compute.manager [None req-505b63f7-7000-4261-9359-38618c0557ab tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Terminating instance
Nov 16 04:20:19 user nova-compute[103546]: DEBUG nova.compute.manager [None req-505b63f7-7000-4261-9359-38618c0557ab tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Start destroying the instance on the hypervisor. {{(pid=103546) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 04:20:19 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:20:19 user nova-compute[103546]: DEBUG nova.compute.manager [req-fb321b05-bf9f-4abf-b18b-82df849bab67 req-07bd5257-10c0-49eb-96a8-d80e69a78c7b service nova] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Received event network-changed-be3177c3-f31d-4783-8231-d9d4b5819aef {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:20:19 user nova-compute[103546]: DEBUG nova.compute.manager [req-fb321b05-bf9f-4abf-b18b-82df849bab67 req-07bd5257-10c0-49eb-96a8-d80e69a78c7b service nova] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Refreshing instance network info cache due to event network-changed-be3177c3-f31d-4783-8231-d9d4b5819aef. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 04:20:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-fb321b05-bf9f-4abf-b18b-82df849bab67 req-07bd5257-10c0-49eb-96a8-d80e69a78c7b service nova] Acquiring lock "refresh_cache-0805eb5a-79c7-43f2-b560-df687f7fbc0f" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:20:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-fb321b05-bf9f-4abf-b18b-82df849bab67 req-07bd5257-10c0-49eb-96a8-d80e69a78c7b service nova] Acquired lock "refresh_cache-0805eb5a-79c7-43f2-b560-df687f7fbc0f" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:20:19 user nova-compute[103546]: DEBUG nova.network.neutron [req-fb321b05-bf9f-4abf-b18b-82df849bab67 req-07bd5257-10c0-49eb-96a8-d80e69a78c7b service nova] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Refreshing network info cache for port be3177c3-f31d-4783-8231-d9d4b5819aef {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 04:20:19 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:20:19 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:20:19 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:20:19 user nova-compute[103546]: DEBUG nova.network.neutron [req-fb321b05-bf9f-4abf-b18b-82df849bab67 req-07bd5257-10c0-49eb-96a8-d80e69a78c7b service nova] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Updated VIF entry in instance network info cache for port be3177c3-f31d-4783-8231-d9d4b5819aef. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 04:20:19 user nova-compute[103546]: DEBUG nova.network.neutron [req-fb321b05-bf9f-4abf-b18b-82df849bab67 req-07bd5257-10c0-49eb-96a8-d80e69a78c7b service nova] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Updating instance_info_cache with network_info: [{"id": "be3177c3-f31d-4783-8231-d9d4b5819aef", "address": "fa:16:3e:57:29:00", "network": {"id": "a758762c-c27c-4509-9870-1d42187aeaf4", "bridge": "br-int", "label": "tempest-TestStampPattern-405695915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21df2cbfb9234c13a504ad4a513970f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe3177c3-f3", "ovs_interfaceid": "be3177c3-f31d-4783-8231-d9d4b5819aef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:20:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-fb321b05-bf9f-4abf-b18b-82df849bab67 req-07bd5257-10c0-49eb-96a8-d80e69a78c7b service nova] Releasing lock "refresh_cache-0805eb5a-79c7-43f2-b560-df687f7fbc0f" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:20:19 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:20:19 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:20:19 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Instance destroyed successfully.
Nov 16 04:20:19 user nova-compute[103546]: DEBUG nova.objects.instance [None req-505b63f7-7000-4261-9359-38618c0557ab tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lazy-loading 'resources' on Instance uuid 0805eb5a-79c7-43f2-b560-df687f7fbc0f {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:20:19 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:20:19 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-505b63f7-7000-4261-9359-38618c0557ab tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:17:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1623828387',display_name='tempest-TestStampPattern-server-1623828387',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1623828387',id=52,image_ref='2ff5cacb-6cbc-4a18-83f7-c3485801c61f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMD4VeEQuyJQyIGByr5hnPNM80o5OzPF3CeZqlbvdjIFKuOQFbXyRn3ly86qjzEqmVlnZHqKHtk99JTBXYtTMc0ItAcSuqq3ptLxvKqOk9JWyorrPApaaM7CXlXFiNx/Q==',key_name='tempest-TestStampPattern-780202401',keypairs=<?>,launch_index=0,launched_at=2023-11-16T04:17:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='21df2cbfb9234c13a504ad4a513970f3',ramdisk_id='',reservation_id='r-o1ss28xz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='a276ab3f-657a-4148-bd08-007f79230ace',image_min_disk='1',image_min_ram='0',image_owner_id='21df2cbfb9234c13a504ad4a513970f3',image_owner_project_name='tempest-TestStampPattern-1443950495',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1443950495-project-member',image_user_id='d11cfaa98a7a427bbda21bc38ddba079',owner_project_name='tempest-TestStampPattern-1443950495',owner_user_name='tempest-TestStampPattern-1443950495-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T04:17:34Z,user_data=None,user_id='d11cfaa98a7a427bbda21bc38ddba079',uuid=0805eb5a-79c7-43f2-b560-df687f7fbc0f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be3177c3-f31d-4783-8231-d9d4b5819aef", "address": "fa:16:3e:57:29:00", "network": {"id": "a758762c-c27c-4509-9870-1d42187aeaf4", "bridge": "br-int", "label": "tempest-TestStampPattern-405695915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21df2cbfb9234c13a504ad4a513970f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe3177c3-f3", "ovs_interfaceid": "be3177c3-f31d-4783-8231-d9d4b5819aef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 04:20:19 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-505b63f7-7000-4261-9359-38618c0557ab tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Converting VIF {"id": "be3177c3-f31d-4783-8231-d9d4b5819aef", "address": "fa:16:3e:57:29:00", "network": {"id": "a758762c-c27c-4509-9870-1d42187aeaf4", "bridge": "br-int", "label": "tempest-TestStampPattern-405695915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21df2cbfb9234c13a504ad4a513970f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe3177c3-f3", "ovs_interfaceid": "be3177c3-f31d-4783-8231-d9d4b5819aef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:20:19 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-505b63f7-7000-4261-9359-38618c0557ab tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:29:00,bridge_name='br-int',has_traffic_filtering=True,id=be3177c3-f31d-4783-8231-d9d4b5819aef,network=Network(a758762c-c27c-4509-9870-1d42187aeaf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe3177c3-f3') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:20:19 user nova-compute[103546]: DEBUG os_vif [None req-505b63f7-7000-4261-9359-38618c0557ab tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:29:00,bridge_name='br-int',has_traffic_filtering=True,id=be3177c3-f31d-4783-8231-d9d4b5819aef,network=Network(a758762c-c27c-4509-9870-1d42187aeaf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe3177c3-f3') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 04:20:19 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:20:19 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbe3177c3-f3, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:20:19 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:20:20 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:20:20 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:20:20 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c25a4b11-1aeb-4b29-a3ac-83421f1fdbbf) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:20:20 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:20:20 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:20:20 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:20:20 user nova-compute[103546]: INFO os_vif [None req-505b63f7-7000-4261-9359-38618c0557ab tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:29:00,bridge_name='br-int',has_traffic_filtering=True,id=be3177c3-f31d-4783-8231-d9d4b5819aef,network=Network(a758762c-c27c-4509-9870-1d42187aeaf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe3177c3-f3')
Nov 16 04:20:20 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-505b63f7-7000-4261-9359-38618c0557ab tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Deleting instance files /opt/stack/data/nova/instances/0805eb5a-79c7-43f2-b560-df687f7fbc0f_del
Nov 16 04:20:20 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-505b63f7-7000-4261-9359-38618c0557ab tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Deletion of /opt/stack/data/nova/instances/0805eb5a-79c7-43f2-b560-df687f7fbc0f_del complete
Nov 16 04:20:20 user nova-compute[103546]: INFO nova.compute.manager [None req-505b63f7-7000-4261-9359-38618c0557ab tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 16 04:20:20 user nova-compute[103546]: DEBUG oslo.service.loopingcall [None req-505b63f7-7000-4261-9359-38618c0557ab tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=103546) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 04:20:20 user nova-compute[103546]: DEBUG nova.compute.manager [-] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Deallocating network for instance {{(pid=103546) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 04:20:20 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] deallocate_for_instance() {{(pid=103546) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 04:20:20 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:20:20 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:20:20 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:20:20 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:20:20 user nova-compute[103546]: INFO nova.compute.manager [-] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Took 0.45 seconds to deallocate network for instance.
Nov 16 04:20:20 user nova-compute[103546]: DEBUG nova.compute.manager [req-ed045532-3bc9-4a09-a5ef-315a62b8b62e req-81c5bd38-155d-4469-85bb-3edf66ec98ff service nova] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Received event network-vif-deleted-be3177c3-f31d-4783-8231-d9d4b5819aef {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:20:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-505b63f7-7000-4261-9359-38618c0557ab tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:20:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-505b63f7-7000-4261-9359-38618c0557ab tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:20:20 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-505b63f7-7000-4261-9359-38618c0557ab tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:20:20 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-505b63f7-7000-4261-9359-38618c0557ab tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:20:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-505b63f7-7000-4261-9359-38618c0557ab tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.266s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:20:20 user nova-compute[103546]: INFO nova.scheduler.client.report [None req-505b63f7-7000-4261-9359-38618c0557ab tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Deleted allocations for instance 0805eb5a-79c7-43f2-b560-df687f7fbc0f
Nov 16 04:20:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-505b63f7-7000-4261-9359-38618c0557ab tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lock "0805eb5a-79c7-43f2-b560-df687f7fbc0f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.831s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:20:21 user nova-compute[103546]: DEBUG nova.compute.manager [req-d2859d75-10ba-4fdb-8e9f-c0f90ffe9637 req-1bca57f0-c42d-4ec6-aeb7-1f1809ce3cd6 service nova] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Received event network-vif-unplugged-be3177c3-f31d-4783-8231-d9d4b5819aef {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:20:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d2859d75-10ba-4fdb-8e9f-c0f90ffe9637 req-1bca57f0-c42d-4ec6-aeb7-1f1809ce3cd6 service nova] Acquiring lock "0805eb5a-79c7-43f2-b560-df687f7fbc0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:20:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d2859d75-10ba-4fdb-8e9f-c0f90ffe9637 req-1bca57f0-c42d-4ec6-aeb7-1f1809ce3cd6 service nova] Lock "0805eb5a-79c7-43f2-b560-df687f7fbc0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:20:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d2859d75-10ba-4fdb-8e9f-c0f90ffe9637 req-1bca57f0-c42d-4ec6-aeb7-1f1809ce3cd6 service nova] Lock "0805eb5a-79c7-43f2-b560-df687f7fbc0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:20:21 user nova-compute[103546]: DEBUG nova.compute.manager [req-d2859d75-10ba-4fdb-8e9f-c0f90ffe9637 req-1bca57f0-c42d-4ec6-aeb7-1f1809ce3cd6 service nova] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] No waiting events found dispatching network-vif-unplugged-be3177c3-f31d-4783-8231-d9d4b5819aef {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:20:21 user nova-compute[103546]: WARNING nova.compute.manager [req-d2859d75-10ba-4fdb-8e9f-c0f90ffe9637 req-1bca57f0-c42d-4ec6-aeb7-1f1809ce3cd6 service nova] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Received unexpected event network-vif-unplugged-be3177c3-f31d-4783-8231-d9d4b5819aef for instance with vm_state deleted and task_state None.
Nov 16 04:20:21 user nova-compute[103546]: DEBUG nova.compute.manager [req-d2859d75-10ba-4fdb-8e9f-c0f90ffe9637 req-1bca57f0-c42d-4ec6-aeb7-1f1809ce3cd6 service nova] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Received event network-vif-plugged-be3177c3-f31d-4783-8231-d9d4b5819aef {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:20:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d2859d75-10ba-4fdb-8e9f-c0f90ffe9637 req-1bca57f0-c42d-4ec6-aeb7-1f1809ce3cd6 service nova] Acquiring lock "0805eb5a-79c7-43f2-b560-df687f7fbc0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:20:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d2859d75-10ba-4fdb-8e9f-c0f90ffe9637 req-1bca57f0-c42d-4ec6-aeb7-1f1809ce3cd6 service nova] Lock "0805eb5a-79c7-43f2-b560-df687f7fbc0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:20:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d2859d75-10ba-4fdb-8e9f-c0f90ffe9637 req-1bca57f0-c42d-4ec6-aeb7-1f1809ce3cd6 service nova] Lock "0805eb5a-79c7-43f2-b560-df687f7fbc0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:20:21 user nova-compute[103546]: DEBUG nova.compute.manager [req-d2859d75-10ba-4fdb-8e9f-c0f90ffe9637 req-1bca57f0-c42d-4ec6-aeb7-1f1809ce3cd6 service nova] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] No waiting events found dispatching network-vif-plugged-be3177c3-f31d-4783-8231-d9d4b5819aef {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:20:21 user nova-compute[103546]: WARNING nova.compute.manager [req-d2859d75-10ba-4fdb-8e9f-c0f90ffe9637 req-1bca57f0-c42d-4ec6-aeb7-1f1809ce3cd6 service nova] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Received unexpected event network-vif-plugged-be3177c3-f31d-4783-8231-d9d4b5819aef for instance with vm_state deleted and task_state None.
Nov 16 04:20:21 user nova-compute[103546]: DEBUG nova.compute.manager [req-d2859d75-10ba-4fdb-8e9f-c0f90ffe9637 req-1bca57f0-c42d-4ec6-aeb7-1f1809ce3cd6 service nova] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Received event network-vif-plugged-be3177c3-f31d-4783-8231-d9d4b5819aef {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:20:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d2859d75-10ba-4fdb-8e9f-c0f90ffe9637 req-1bca57f0-c42d-4ec6-aeb7-1f1809ce3cd6 service nova] Acquiring lock "0805eb5a-79c7-43f2-b560-df687f7fbc0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:20:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d2859d75-10ba-4fdb-8e9f-c0f90ffe9637 req-1bca57f0-c42d-4ec6-aeb7-1f1809ce3cd6 service nova] Lock "0805eb5a-79c7-43f2-b560-df687f7fbc0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:20:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d2859d75-10ba-4fdb-8e9f-c0f90ffe9637 req-1bca57f0-c42d-4ec6-aeb7-1f1809ce3cd6 service nova] Lock "0805eb5a-79c7-43f2-b560-df687f7fbc0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:20:21 user nova-compute[103546]: DEBUG nova.compute.manager [req-d2859d75-10ba-4fdb-8e9f-c0f90ffe9637 req-1bca57f0-c42d-4ec6-aeb7-1f1809ce3cd6 service nova] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] No waiting events found dispatching network-vif-plugged-be3177c3-f31d-4783-8231-d9d4b5819aef {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:20:21 user nova-compute[103546]: WARNING nova.compute.manager [req-d2859d75-10ba-4fdb-8e9f-c0f90ffe9637 req-1bca57f0-c42d-4ec6-aeb7-1f1809ce3cd6 service nova] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Received unexpected event network-vif-plugged-be3177c3-f31d-4783-8231-d9d4b5819aef for instance with vm_state deleted and task_state None.
Nov 16 04:20:21 user nova-compute[103546]: DEBUG nova.compute.manager [req-d2859d75-10ba-4fdb-8e9f-c0f90ffe9637 req-1bca57f0-c42d-4ec6-aeb7-1f1809ce3cd6 service nova] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Received event network-vif-plugged-be3177c3-f31d-4783-8231-d9d4b5819aef {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:20:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d2859d75-10ba-4fdb-8e9f-c0f90ffe9637 req-1bca57f0-c42d-4ec6-aeb7-1f1809ce3cd6 service nova] Acquiring lock "0805eb5a-79c7-43f2-b560-df687f7fbc0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:20:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d2859d75-10ba-4fdb-8e9f-c0f90ffe9637 req-1bca57f0-c42d-4ec6-aeb7-1f1809ce3cd6 service nova] Lock "0805eb5a-79c7-43f2-b560-df687f7fbc0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:20:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d2859d75-10ba-4fdb-8e9f-c0f90ffe9637 req-1bca57f0-c42d-4ec6-aeb7-1f1809ce3cd6 service nova] Lock "0805eb5a-79c7-43f2-b560-df687f7fbc0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:20:21 user nova-compute[103546]: DEBUG nova.compute.manager [req-d2859d75-10ba-4fdb-8e9f-c0f90ffe9637 req-1bca57f0-c42d-4ec6-aeb7-1f1809ce3cd6 service nova] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] No waiting events found dispatching network-vif-plugged-be3177c3-f31d-4783-8231-d9d4b5819aef {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:20:21 user nova-compute[103546]: WARNING nova.compute.manager [req-d2859d75-10ba-4fdb-8e9f-c0f90ffe9637 req-1bca57f0-c42d-4ec6-aeb7-1f1809ce3cd6 service nova] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Received unexpected event network-vif-plugged-be3177c3-f31d-4783-8231-d9d4b5819aef for instance with vm_state deleted and task_state None.
Nov 16 04:20:21 user nova-compute[103546]: DEBUG nova.compute.manager [req-d2859d75-10ba-4fdb-8e9f-c0f90ffe9637 req-1bca57f0-c42d-4ec6-aeb7-1f1809ce3cd6 service nova] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Received event network-vif-plugged-be3177c3-f31d-4783-8231-d9d4b5819aef {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:20:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d2859d75-10ba-4fdb-8e9f-c0f90ffe9637 req-1bca57f0-c42d-4ec6-aeb7-1f1809ce3cd6 service nova] Acquiring lock "0805eb5a-79c7-43f2-b560-df687f7fbc0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:20:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d2859d75-10ba-4fdb-8e9f-c0f90ffe9637 req-1bca57f0-c42d-4ec6-aeb7-1f1809ce3cd6 service nova] Lock "0805eb5a-79c7-43f2-b560-df687f7fbc0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:20:21 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-d2859d75-10ba-4fdb-8e9f-c0f90ffe9637 req-1bca57f0-c42d-4ec6-aeb7-1f1809ce3cd6 service nova] Lock "0805eb5a-79c7-43f2-b560-df687f7fbc0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:20:21 user nova-compute[103546]: DEBUG nova.compute.manager [req-d2859d75-10ba-4fdb-8e9f-c0f90ffe9637 req-1bca57f0-c42d-4ec6-aeb7-1f1809ce3cd6 service nova] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] No waiting events found dispatching network-vif-plugged-be3177c3-f31d-4783-8231-d9d4b5819aef {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:20:21 user nova-compute[103546]: WARNING nova.compute.manager [req-d2859d75-10ba-4fdb-8e9f-c0f90ffe9637 req-1bca57f0-c42d-4ec6-aeb7-1f1809ce3cd6 service nova] [instance: 0805eb5a-79c7-43f2-b560-df687f7fbc0f] Received unexpected event network-vif-plugged-be3177c3-f31d-4783-8231-d9d4b5819aef for instance with vm_state deleted and task_state None.
Nov 16 04:20:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:20:25 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:20:30 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:20:35 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:20:37 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager.update_available_resource {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:20:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:20:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:20:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:20:37 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Auditing locally available compute resources for user (node: user) {{(pid=103546) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 04:20:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a276ab3f-657a-4148-bd08-007f79230ace/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:20:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a276ab3f-657a-4148-bd08-007f79230ace/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:20:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a276ab3f-657a-4148-bd08-007f79230ace/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:20:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a276ab3f-657a-4148-bd08-007f79230ace/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:20:38 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:20:38 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:20:38 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Hypervisor/Node resource view: name=user free_ram=8973MB free_disk=24.962642669677734GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=103546) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 04:20:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:20:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:20:38 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance a276ab3f-657a-4148-bd08-007f79230ace actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:20:38 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 04:20:38 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 04:20:38 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:20:38 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:20:38 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Compute_service record updated for user:user {{(pid=103546) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 04:20:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.188s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:20:39 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:20:40 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:20:40 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:20:40 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:20:40 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=103546) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 04:20:42 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:20:42 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:20:44 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:20:45 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:20:45 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:20:45 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=103546) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 04:20:45 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:20:45 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:20:45 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:20:46 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:20:48 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:20:48 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Starting heal instance info cache {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 04:20:48 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Rebuilding the list of instances to heal {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 04:20:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "refresh_cache-a276ab3f-657a-4148-bd08-007f79230ace" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:20:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquired lock "refresh_cache-a276ab3f-657a-4148-bd08-007f79230ace" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:20:48 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Forcefully refreshing network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 04:20:48 user nova-compute[103546]: DEBUG nova.objects.instance [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lazy-loading 'info_cache' on Instance uuid a276ab3f-657a-4148-bd08-007f79230ace {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:20:49 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Updating instance_info_cache with network_info: [{"id": "b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3", "address": "fa:16:3e:52:f7:34", "network": {"id": "a758762c-c27c-4509-9870-1d42187aeaf4", "bridge": "br-int", "label": "tempest-TestStampPattern-405695915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21df2cbfb9234c13a504ad4a513970f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9fb2a6f-ec", "ovs_interfaceid": "b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:20:49 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Releasing lock "refresh_cache-a276ab3f-657a-4148-bd08-007f79230ace" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:20:49 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Updated the network info_cache for instance {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 04:20:49 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:20:50 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:20:55 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:21:00 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:21:05 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:21:10 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:21:15 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:21:15 user nova-compute[103546]: DEBUG nova.compute.manager [req-3bb22d0c-4a71-4355-ba40-9e773e017b31 req-7384eedc-d2e6-4215-8cba-8ea00089d632 service nova] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Received event network-changed-b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:21:15 user nova-compute[103546]: DEBUG nova.compute.manager [req-3bb22d0c-4a71-4355-ba40-9e773e017b31 req-7384eedc-d2e6-4215-8cba-8ea00089d632 service nova] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Refreshing instance network info cache due to event network-changed-b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 04:21:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3bb22d0c-4a71-4355-ba40-9e773e017b31 req-7384eedc-d2e6-4215-8cba-8ea00089d632 service nova] Acquiring lock "refresh_cache-a276ab3f-657a-4148-bd08-007f79230ace" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:21:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3bb22d0c-4a71-4355-ba40-9e773e017b31 req-7384eedc-d2e6-4215-8cba-8ea00089d632 service nova] Acquired lock "refresh_cache-a276ab3f-657a-4148-bd08-007f79230ace" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:21:15 user nova-compute[103546]: DEBUG nova.network.neutron [req-3bb22d0c-4a71-4355-ba40-9e773e017b31 req-7384eedc-d2e6-4215-8cba-8ea00089d632 service nova] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Refreshing network info cache for port b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3 {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 04:21:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0783200c-2dd0-4224-8497-a8bf120cbb7d tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Acquiring lock "a276ab3f-657a-4148-bd08-007f79230ace" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:21:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0783200c-2dd0-4224-8497-a8bf120cbb7d tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lock "a276ab3f-657a-4148-bd08-007f79230ace" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:21:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0783200c-2dd0-4224-8497-a8bf120cbb7d tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Acquiring lock "a276ab3f-657a-4148-bd08-007f79230ace-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:21:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0783200c-2dd0-4224-8497-a8bf120cbb7d tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lock "a276ab3f-657a-4148-bd08-007f79230ace-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:21:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0783200c-2dd0-4224-8497-a8bf120cbb7d tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lock "a276ab3f-657a-4148-bd08-007f79230ace-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:21:15 user nova-compute[103546]: INFO nova.compute.manager [None req-0783200c-2dd0-4224-8497-a8bf120cbb7d tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Terminating instance
Nov 16 04:21:15 user nova-compute[103546]: DEBUG nova.compute.manager [None req-0783200c-2dd0-4224-8497-a8bf120cbb7d tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Start destroying the instance on the hypervisor. {{(pid=103546) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 04:21:15 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:21:15 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:21:15 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:21:15 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:21:15 user nova-compute[103546]: DEBUG nova.network.neutron [req-3bb22d0c-4a71-4355-ba40-9e773e017b31 req-7384eedc-d2e6-4215-8cba-8ea00089d632 service nova] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Updated VIF entry in instance network info cache for port b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 04:21:15 user nova-compute[103546]: DEBUG nova.network.neutron [req-3bb22d0c-4a71-4355-ba40-9e773e017b31 req-7384eedc-d2e6-4215-8cba-8ea00089d632 service nova] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Updating instance_info_cache with network_info: [{"id": "b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3", "address": "fa:16:3e:52:f7:34", "network": {"id": "a758762c-c27c-4509-9870-1d42187aeaf4", "bridge": "br-int", "label": "tempest-TestStampPattern-405695915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21df2cbfb9234c13a504ad4a513970f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9fb2a6f-ec", "ovs_interfaceid": "b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:21:15 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-3bb22d0c-4a71-4355-ba40-9e773e017b31 req-7384eedc-d2e6-4215-8cba-8ea00089d632 service nova] Releasing lock "refresh_cache-a276ab3f-657a-4148-bd08-007f79230ace" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:21:15 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Instance destroyed successfully.
Nov 16 04:21:15 user nova-compute[103546]: DEBUG nova.objects.instance [None req-0783200c-2dd0-4224-8497-a8bf120cbb7d tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lazy-loading 'resources' on Instance uuid a276ab3f-657a-4148-bd08-007f79230ace {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:21:15 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-0783200c-2dd0-4224-8497-a8bf120cbb7d tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:14:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-818214812',display_name='tempest-TestStampPattern-server-818214812',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-818214812',id=50,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMD4VeEQuyJQyIGByr5hnPNM80o5OzPF3CeZqlbvdjIFKuOQFbXyRn3ly86qjzEqmVlnZHqKHtk99JTBXYtTMc0ItAcSuqq3ptLxvKqOk9JWyorrPApaaM7CXlXFiNx/Q==',key_name='tempest-TestStampPattern-780202401',keypairs=<?>,launch_index=0,launched_at=2023-11-16T04:14:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='21df2cbfb9234c13a504ad4a513970f3',ramdisk_id='',reservation_id='r-hzkzr248',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1443950495',owner_user_name='tempest-TestStampPattern-1443950495-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T04:17:25Z,user_data=None,user_id='d11cfaa98a7a427bbda21bc38ddba079',uuid=a276ab3f-657a-4148-bd08-007f79230ace,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3", "address": "fa:16:3e:52:f7:34", "network": {"id": "a758762c-c27c-4509-9870-1d42187aeaf4", "bridge": "br-int", "label": "tempest-TestStampPattern-405695915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21df2cbfb9234c13a504ad4a513970f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9fb2a6f-ec", "ovs_interfaceid": "b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 04:21:15 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-0783200c-2dd0-4224-8497-a8bf120cbb7d tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Converting VIF {"id": "b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3", "address": "fa:16:3e:52:f7:34", "network": {"id": "a758762c-c27c-4509-9870-1d42187aeaf4", "bridge": "br-int", "label": "tempest-TestStampPattern-405695915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21df2cbfb9234c13a504ad4a513970f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9fb2a6f-ec", "ovs_interfaceid": "b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:21:15 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-0783200c-2dd0-4224-8497-a8bf120cbb7d tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:52:f7:34,bridge_name='br-int',has_traffic_filtering=True,id=b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3,network=Network(a758762c-c27c-4509-9870-1d42187aeaf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9fb2a6f-ec') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:21:15 user nova-compute[103546]: DEBUG os_vif [None req-0783200c-2dd0-4224-8497-a8bf120cbb7d tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:f7:34,bridge_name='br-int',has_traffic_filtering=True,id=b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3,network=Network(a758762c-c27c-4509-9870-1d42187aeaf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9fb2a6f-ec') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 04:21:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:21:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb9fb2a6f-ec, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:21:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:21:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:21:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:21:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dae53bd4-4b0a-46f7-a0e7-2fb39d9f257d) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:21:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:21:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:21:16 user nova-compute[103546]: INFO os_vif [None req-0783200c-2dd0-4224-8497-a8bf120cbb7d tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:f7:34,bridge_name='br-int',has_traffic_filtering=True,id=b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3,network=Network(a758762c-c27c-4509-9870-1d42187aeaf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9fb2a6f-ec')
Nov 16 04:21:16 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-0783200c-2dd0-4224-8497-a8bf120cbb7d tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Deleting instance files /opt/stack/data/nova/instances/a276ab3f-657a-4148-bd08-007f79230ace_del
Nov 16 04:21:16 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-0783200c-2dd0-4224-8497-a8bf120cbb7d tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Deletion of /opt/stack/data/nova/instances/a276ab3f-657a-4148-bd08-007f79230ace_del complete
Nov 16 04:21:16 user nova-compute[103546]: INFO nova.compute.manager [None req-0783200c-2dd0-4224-8497-a8bf120cbb7d tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 16 04:21:16 user nova-compute[103546]: DEBUG oslo.service.loopingcall [None req-0783200c-2dd0-4224-8497-a8bf120cbb7d tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=103546) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 04:21:16 user nova-compute[103546]: DEBUG nova.compute.manager [-] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Deallocating network for instance {{(pid=103546) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 04:21:16 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: a276ab3f-657a-4148-bd08-007f79230ace] deallocate_for_instance() {{(pid=103546) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 04:21:16 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:21:16 user nova-compute[103546]: INFO nova.compute.manager [-] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Took 0.36 seconds to deallocate network for instance.
Nov 16 04:21:16 user nova-compute[103546]: DEBUG nova.compute.manager [req-4356683b-cd33-4a02-85eb-b23c2fea3d2f req-7d900da9-9bcb-4ffb-8839-7dcf4e0a6e4a service nova] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Received event network-vif-deleted-b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:21:16 user nova-compute[103546]: INFO nova.compute.manager [req-4356683b-cd33-4a02-85eb-b23c2fea3d2f req-7d900da9-9bcb-4ffb-8839-7dcf4e0a6e4a service nova] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Neutron deleted interface b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3; detaching it from the instance and deleting it from the info cache
Nov 16 04:21:16 user nova-compute[103546]: DEBUG nova.network.neutron [req-4356683b-cd33-4a02-85eb-b23c2fea3d2f req-7d900da9-9bcb-4ffb-8839-7dcf4e0a6e4a service nova] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:21:16 user nova-compute[103546]: DEBUG nova.compute.manager [req-4356683b-cd33-4a02-85eb-b23c2fea3d2f req-7d900da9-9bcb-4ffb-8839-7dcf4e0a6e4a service nova] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Detach interface failed, port_id=b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3, reason: Instance a276ab3f-657a-4148-bd08-007f79230ace could not be found. {{(pid=103546) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 04:21:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0783200c-2dd0-4224-8497-a8bf120cbb7d tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:21:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0783200c-2dd0-4224-8497-a8bf120cbb7d tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:21:16 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-0783200c-2dd0-4224-8497-a8bf120cbb7d tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:21:16 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-0783200c-2dd0-4224-8497-a8bf120cbb7d tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:21:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0783200c-2dd0-4224-8497-a8bf120cbb7d tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.110s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:21:16 user nova-compute[103546]: INFO nova.scheduler.client.report [None req-0783200c-2dd0-4224-8497-a8bf120cbb7d tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Deleted allocations for instance a276ab3f-657a-4148-bd08-007f79230ace
Nov 16 04:21:16 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-0783200c-2dd0-4224-8497-a8bf120cbb7d tempest-TestStampPattern-1443950495 tempest-TestStampPattern-1443950495-project-member] Lock "a276ab3f-657a-4148-bd08-007f79230ace" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.490s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:21:17 user nova-compute[103546]: DEBUG nova.compute.manager [req-04557d00-9d81-48ac-8b0f-5f400287d5e3 req-7be0799e-e866-4834-ad78-9a361ad761f9 service nova] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Received event network-vif-unplugged-b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:21:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-04557d00-9d81-48ac-8b0f-5f400287d5e3 req-7be0799e-e866-4834-ad78-9a361ad761f9 service nova] Acquiring lock "a276ab3f-657a-4148-bd08-007f79230ace-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:21:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-04557d00-9d81-48ac-8b0f-5f400287d5e3 req-7be0799e-e866-4834-ad78-9a361ad761f9 service nova] Lock "a276ab3f-657a-4148-bd08-007f79230ace-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:21:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-04557d00-9d81-48ac-8b0f-5f400287d5e3 req-7be0799e-e866-4834-ad78-9a361ad761f9 service nova] Lock "a276ab3f-657a-4148-bd08-007f79230ace-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:21:17 user nova-compute[103546]: DEBUG nova.compute.manager [req-04557d00-9d81-48ac-8b0f-5f400287d5e3 req-7be0799e-e866-4834-ad78-9a361ad761f9 service nova] [instance: a276ab3f-657a-4148-bd08-007f79230ace] No waiting events found dispatching network-vif-unplugged-b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:21:17 user nova-compute[103546]: WARNING nova.compute.manager [req-04557d00-9d81-48ac-8b0f-5f400287d5e3 req-7be0799e-e866-4834-ad78-9a361ad761f9 service nova] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Received unexpected event network-vif-unplugged-b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3 for instance with vm_state deleted and task_state None.
Nov 16 04:21:17 user nova-compute[103546]: DEBUG nova.compute.manager [req-04557d00-9d81-48ac-8b0f-5f400287d5e3 req-7be0799e-e866-4834-ad78-9a361ad761f9 service nova] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Received event network-vif-plugged-b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3 {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:21:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-04557d00-9d81-48ac-8b0f-5f400287d5e3 req-7be0799e-e866-4834-ad78-9a361ad761f9 service nova] Acquiring lock "a276ab3f-657a-4148-bd08-007f79230ace-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:21:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-04557d00-9d81-48ac-8b0f-5f400287d5e3 req-7be0799e-e866-4834-ad78-9a361ad761f9 service nova] Lock "a276ab3f-657a-4148-bd08-007f79230ace-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:21:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-04557d00-9d81-48ac-8b0f-5f400287d5e3 req-7be0799e-e866-4834-ad78-9a361ad761f9 service nova] Lock "a276ab3f-657a-4148-bd08-007f79230ace-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:21:17 user nova-compute[103546]: DEBUG nova.compute.manager [req-04557d00-9d81-48ac-8b0f-5f400287d5e3 req-7be0799e-e866-4834-ad78-9a361ad761f9 service nova] [instance: a276ab3f-657a-4148-bd08-007f79230ace] No waiting events found dispatching network-vif-plugged-b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3 {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:21:17 user nova-compute[103546]: WARNING nova.compute.manager [req-04557d00-9d81-48ac-8b0f-5f400287d5e3 req-7be0799e-e866-4834-ad78-9a361ad761f9 service nova] [instance: a276ab3f-657a-4148-bd08-007f79230ace] Received unexpected event network-vif-plugged-b9fb2a6f-ec2b-4cec-b3ad-318c2d5fdfb3 for instance with vm_state deleted and task_state None.
Nov 16 04:21:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:21:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:21:31 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:21:36 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:21:36 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:21:36 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=103546) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 04:21:36 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:21:36 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:21:36 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:21:37 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager.update_available_resource {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:21:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:21:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:21:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:21:37 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Auditing locally available compute resources for user (node: user) {{(pid=103546) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 04:21:38 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:21:38 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:21:38 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Hypervisor/Node resource view: name=user free_ram=9165MB free_disk=25.078960418701172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=103546) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 04:21:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:21:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:21:38 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 04:21:38 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 04:21:38 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:21:38 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:21:38 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Compute_service record updated for user:user {{(pid=103546) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 04:21:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.134s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:21:40 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:21:41 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:21:41 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:21:42 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:21:42 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=103546) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 04:21:43 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:21:44 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:21:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:21:46 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:21:49 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:21:50 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:21:50 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Starting heal instance info cache {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 04:21:50 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Rebuilding the list of instances to heal {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 04:21:50 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Didn't find any instances for network info cache update. {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 04:21:51 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:21:56 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:22:01 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:22:02 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:22:02 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:22:02 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:22:02 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:22:02 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:22:02 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:22:02 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:22:02 user nova-compute[103546]: DEBUG nova.virt.libvirt.imagecache [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Verify base images {{(pid=103546) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 16 04:22:02 user nova-compute[103546]: WARNING nova.virt.libvirt.imagecache [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Unknown base file: /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7
Nov 16 04:22:02 user nova-compute[103546]: WARNING nova.virt.libvirt.imagecache [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Unknown base file: /opt/stack/data/nova/instances/_base/d3ffd15992fc9ad9c0a868117892d44bb6f8a890
Nov 16 04:22:02 user nova-compute[103546]: WARNING nova.virt.libvirt.imagecache [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Unknown base file: /opt/stack/data/nova/instances/_base/9aacccc48d0fa1178106af598e9de8d7663e3e2d
Nov 16 04:22:02 user nova-compute[103546]: WARNING nova.virt.libvirt.imagecache [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Unknown base file: /opt/stack/data/nova/instances/_base/91592c93882f514851496add737cbef0207b8c12
Nov 16 04:22:02 user nova-compute[103546]: WARNING nova.virt.libvirt.imagecache [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Unknown base file: /opt/stack/data/nova/instances/_base/7acc2bd223399694aed68f2794b4a5a6570ce0c5
Nov 16 04:22:02 user nova-compute[103546]: WARNING nova.virt.libvirt.imagecache [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Unknown base file: /opt/stack/data/nova/instances/_base/86fe3eebd87582e7733a5bbce163201dc262c3e2
Nov 16 04:22:02 user nova-compute[103546]: WARNING nova.virt.libvirt.imagecache [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Unknown base file: /opt/stack/data/nova/instances/_base/aff2fecfa733fdaa8a82d537599b00ae87291713
Nov 16 04:22:02 user nova-compute[103546]: WARNING nova.virt.libvirt.imagecache [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Unknown base file: /opt/stack/data/nova/instances/_base/abf9be852dab915566569e456598b5410a058cd5
Nov 16 04:22:02 user nova-compute[103546]: WARNING nova.virt.libvirt.imagecache [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Unknown base file: /opt/stack/data/nova/instances/_base/2ef5aa205bcf7f26d550c1475eac377d08e83f55
Nov 16 04:22:02 user nova-compute[103546]: WARNING nova.virt.libvirt.imagecache [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Unknown base file: /opt/stack/data/nova/instances/_base/bad05ded55573e12bcd6eb828dae11d7f3886ecc
Nov 16 04:22:02 user nova-compute[103546]: INFO nova.virt.libvirt.imagecache [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Removable base files: /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 /opt/stack/data/nova/instances/_base/d3ffd15992fc9ad9c0a868117892d44bb6f8a890 /opt/stack/data/nova/instances/_base/9aacccc48d0fa1178106af598e9de8d7663e3e2d /opt/stack/data/nova/instances/_base/91592c93882f514851496add737cbef0207b8c12 /opt/stack/data/nova/instances/_base/7acc2bd223399694aed68f2794b4a5a6570ce0c5 /opt/stack/data/nova/instances/_base/86fe3eebd87582e7733a5bbce163201dc262c3e2 /opt/stack/data/nova/instances/_base/aff2fecfa733fdaa8a82d537599b00ae87291713 /opt/stack/data/nova/instances/_base/abf9be852dab915566569e456598b5410a058cd5 /opt/stack/data/nova/instances/_base/2ef5aa205bcf7f26d550c1475eac377d08e83f55 /opt/stack/data/nova/instances/_base/bad05ded55573e12bcd6eb828dae11d7f3886ecc
Nov 16 04:22:02 user nova-compute[103546]: INFO nova.virt.libvirt.imagecache [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7
Nov 16 04:22:02 user nova-compute[103546]: INFO nova.virt.libvirt.imagecache [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d3ffd15992fc9ad9c0a868117892d44bb6f8a890
Nov 16 04:22:02 user nova-compute[103546]: INFO nova.virt.libvirt.imagecache [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9aacccc48d0fa1178106af598e9de8d7663e3e2d
Nov 16 04:22:02 user nova-compute[103546]: INFO nova.virt.libvirt.imagecache [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/91592c93882f514851496add737cbef0207b8c12
Nov 16 04:22:02 user nova-compute[103546]: INFO nova.virt.libvirt.imagecache [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7acc2bd223399694aed68f2794b4a5a6570ce0c5
Nov 16 04:22:02 user nova-compute[103546]: INFO nova.virt.libvirt.imagecache [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/86fe3eebd87582e7733a5bbce163201dc262c3e2
Nov 16 04:22:02 user nova-compute[103546]: INFO nova.virt.libvirt.imagecache [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/aff2fecfa733fdaa8a82d537599b00ae87291713
Nov 16 04:22:02 user nova-compute[103546]: INFO nova.virt.libvirt.imagecache [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/abf9be852dab915566569e456598b5410a058cd5
Nov 16 04:22:02 user nova-compute[103546]: INFO nova.virt.libvirt.imagecache [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2ef5aa205bcf7f26d550c1475eac377d08e83f55
Nov 16 04:22:02 user nova-compute[103546]: INFO nova.virt.libvirt.imagecache [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/bad05ded55573e12bcd6eb828dae11d7f3886ecc
Nov 16 04:22:02 user nova-compute[103546]: DEBUG nova.virt.libvirt.imagecache [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Verification complete {{(pid=103546) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 16 04:22:02 user nova-compute[103546]: DEBUG nova.virt.libvirt.imagecache [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Verify swap images {{(pid=103546) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 16 04:22:02 user nova-compute[103546]: DEBUG nova.virt.libvirt.imagecache [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Verify ephemeral images {{(pid=103546) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 16 04:22:06 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:22:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:22:10 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:22:11 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:22:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:22:16 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:22:21 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:22:26 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:22:31 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:22:36 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:22:37 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager.update_available_resource {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:22:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:22:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:22:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:22:37 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Auditing locally available compute resources for user (node: user) {{(pid=103546) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 04:22:38 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:22:38 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:22:38 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Hypervisor/Node resource view: name=user free_ram=8918MB free_disk=25.075729370117188GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=103546) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 04:22:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:22:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:22:38 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 04:22:38 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 04:22:38 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Refreshing inventories for resource provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 04:22:38 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Updating ProviderTree inventory for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 04:22:38 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Updating inventory in ProviderTree for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 04:22:38 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Refreshing aggregate associations for resource provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a, aggregates: None {{(pid=103546) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 04:22:38 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Refreshing trait associations for resource provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=103546) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 04:22:38 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:22:38 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:22:38 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Compute_service record updated for user:user {{(pid=103546) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 04:22:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.458s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:22:39 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:22:40 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:22:41 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:22:41 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:22:41 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:22:42 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:22:42 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=103546) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 04:22:43 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:22:44 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:22:44 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:22:45 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:22:46 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:22:47 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:22:47 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Cleaning up deleted instances {{(pid=103546) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 04:22:47 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] There are 0 instances to clean {{(pid=103546) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 04:22:48 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:22:48 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:22:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:22:49 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:22:50 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:22:51 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:22:52 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:22:52 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Starting heal instance info cache {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 04:22:52 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Rebuilding the list of instances to heal {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 04:22:52 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Didn't find any instances for network info cache update. {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 04:22:53 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Acquiring lock "8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:22:53 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:22:53 user nova-compute[103546]: DEBUG nova.compute.manager [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Starting instance... {{(pid=103546) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 04:22:53 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:22:53 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:22:53 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=103546) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 04:22:53 user nova-compute[103546]: INFO nova.compute.claims [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Claim successful on node user
Nov 16 04:22:54 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:22:54 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:22:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.264s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:22:54 user nova-compute[103546]: DEBUG nova.compute.manager [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Start building networks asynchronously for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 04:22:54 user nova-compute[103546]: DEBUG nova.compute.manager [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Allocating IP information in the background. {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 04:22:54 user nova-compute[103546]: DEBUG nova.network.neutron [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] allocate_for_instance() {{(pid=103546) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 04:22:54 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 04:22:54 user nova-compute[103546]: DEBUG nova.compute.manager [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Start building block device mappings for instance. {{(pid=103546) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 04:22:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:22:54 user nova-compute[103546]: DEBUG nova.compute.manager [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Start spawning the instance on the hypervisor. {{(pid=103546) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 04:22:54 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Creating instance directory {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 04:22:54 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Creating image(s)
Nov 16 04:22:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Acquiring lock "/opt/stack/data/nova/instances/8c331c2c-90a3-4f5e-8b9a-40dbb19e0907/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:22:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "/opt/stack/data/nova/instances/8c331c2c-90a3-4f5e-8b9a-40dbb19e0907/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:22:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "/opt/stack/data/nova/instances/8c331c2c-90a3-4f5e-8b9a-40dbb19e0907/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:22:54 user nova-compute[103546]: DEBUG nova.policy [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8285ca34203a4243a4c99d34cba2bbaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12cb3bcaf4264c31bb5c65516f5632a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103546) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 04:22:54 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:22:54 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.196s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:22:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Acquiring lock "8c9efafb670bfe5842ba1f4ce398924612164af7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:22:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:22:54 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:22:54 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.216s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:22:54 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/8c331c2c-90a3-4f5e-8b9a-40dbb19e0907/disk 1073741824 {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:22:54 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7,backing_fmt=raw /opt/stack/data/nova/instances/8c331c2c-90a3-4f5e-8b9a-40dbb19e0907/disk 1073741824" returned: 0 in 0.059s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:22:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "8c9efafb670bfe5842ba1f4ce398924612164af7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:22:54 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:22:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c9efafb670bfe5842ba1f4ce398924612164af7 --force-share --output=json" returned: 0 in 0.183s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:22:55 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8c331c2c-90a3-4f5e-8b9a-40dbb19e0907/disk. size=1073741824 {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 04:22:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c331c2c-90a3-4f5e-8b9a-40dbb19e0907/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:22:55 user nova-compute[103546]: DEBUG nova.network.neutron [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Successfully created port: 390d2610-ed90-40db-84e7-00104ff08d0c {{(pid=103546) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 04:22:55 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c331c2c-90a3-4f5e-8b9a-40dbb19e0907/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:22:55 user nova-compute[103546]: DEBUG nova.virt.disk.api [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Cannot resize image /opt/stack/data/nova/instances/8c331c2c-90a3-4f5e-8b9a-40dbb19e0907/disk to a smaller size. {{(pid=103546) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 04:22:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Created local disks {{(pid=103546) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 04:22:55 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Ensure instance console log exists: /opt/stack/data/nova/instances/8c331c2c-90a3-4f5e-8b9a-40dbb19e0907/console.log {{(pid=103546) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 04:22:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:22:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:22:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:22:56 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:22:56 user nova-compute[103546]: DEBUG nova.network.neutron [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Successfully updated port: 390d2610-ed90-40db-84e7-00104ff08d0c {{(pid=103546) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 04:22:56 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Acquiring lock "refresh_cache-8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:22:56 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Acquired lock "refresh_cache-8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:22:56 user nova-compute[103546]: DEBUG nova.network.neutron [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Building network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 04:22:56 user nova-compute[103546]: DEBUG nova.compute.manager [req-b155b15e-2c5c-4579-8cad-671c27c9993b req-aa50e015-266c-4f1e-83b5-5ee8faab405f service nova] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Received event network-changed-390d2610-ed90-40db-84e7-00104ff08d0c {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:22:56 user nova-compute[103546]: DEBUG nova.compute.manager [req-b155b15e-2c5c-4579-8cad-671c27c9993b req-aa50e015-266c-4f1e-83b5-5ee8faab405f service nova] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Refreshing instance network info cache due to event network-changed-390d2610-ed90-40db-84e7-00104ff08d0c. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 04:22:56 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-b155b15e-2c5c-4579-8cad-671c27c9993b req-aa50e015-266c-4f1e-83b5-5ee8faab405f service nova] Acquiring lock "refresh_cache-8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:22:56 user nova-compute[103546]: DEBUG nova.network.neutron [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Instance cache missing network info. {{(pid=103546) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 04:22:56 user nova-compute[103546]: DEBUG nova.network.neutron [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Updating instance_info_cache with network_info: [{"id": "390d2610-ed90-40db-84e7-00104ff08d0c", "address": "fa:16:3e:97:d2:8b", "network": {"id": "ea7af6ae-5b5f-413e-8d3f-40a597d9e4c4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-156065771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12cb3bcaf4264c31bb5c65516f5632a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390d2610-ed", "ovs_interfaceid": "390d2610-ed90-40db-84e7-00104ff08d0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:22:56 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Releasing lock "refresh_cache-8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:22:56 user nova-compute[103546]: DEBUG nova.compute.manager [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Instance network_info: |[{"id": "390d2610-ed90-40db-84e7-00104ff08d0c", "address": "fa:16:3e:97:d2:8b", "network": {"id": "ea7af6ae-5b5f-413e-8d3f-40a597d9e4c4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-156065771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12cb3bcaf4264c31bb5c65516f5632a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390d2610-ed", "ovs_interfaceid": "390d2610-ed90-40db-84e7-00104ff08d0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=103546) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 04:22:56 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-b155b15e-2c5c-4579-8cad-671c27c9993b req-aa50e015-266c-4f1e-83b5-5ee8faab405f service nova] Acquired lock "refresh_cache-8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:22:56 user nova-compute[103546]: DEBUG nova.network.neutron [req-b155b15e-2c5c-4579-8cad-671c27c9993b req-aa50e015-266c-4f1e-83b5-5ee8faab405f service nova] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Refreshing network info cache for port 390d2610-ed90-40db-84e7-00104ff08d0c {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 04:22:56 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Start _get_guest_xml network_info=[{"id": "390d2610-ed90-40db-84e7-00104ff08d0c", "address": "fa:16:3e:97:d2:8b", "network": {"id": "ea7af6ae-5b5f-413e-8d3f-40a597d9e4c4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-156065771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12cb3bcaf4264c31bb5c65516f5632a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390d2610-ed", "ovs_interfaceid": "390d2610-ed90-40db-84e7-00104ff08d0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'image_id': '5c6f539a-01e5-4478-bf8f-a14310b5d7dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 04:22:56 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:22:56 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:22:56 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 04:22:56 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] CPU controller missing on host. {{(pid=103546) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 04:22:56 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 04:22:56 user nova-compute[103546]: DEBUG nova.virt.libvirt.host [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] CPU controller found on host. {{(pid=103546) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 04:22:56 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=103546) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 04:22:56 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T03:42:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T03:42:31Z,direct_url=<?>,disk_format='qcow2',id=5c6f539a-01e5-4478-bf8f-a14310b5d7dd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6f027778eecb4af282f5bb7ebd069be0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T03:42:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 04:22:56 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Flavor limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 04:22:56 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Image limits 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 04:22:56 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Flavor pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 04:22:56 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Image pref 0:0:0 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 04:22:56 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103546) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 04:22:56 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 04:22:56 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 04:22:56 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Got 1 possible topologies {{(pid=103546) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 04:22:56 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 04:22:56 user nova-compute[103546]: DEBUG nova.virt.hardware [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=103546) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 04:22:57 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:22:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-725088862',display_name='tempest-SnapshotDataIntegrityTests-server-725088862',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-725088862',id=53,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBewTO/MlPnyAEzx7kE8P3yVPcSblAmBo5wdQD6Og+TmEkntX01hZUc+dNvc3qU+7DkjJ0OzHt8tEV5UDJ+uBzATFGaPE3KtFiqONnkIN7drHWwX7Ycv5uz8Q8vJzdemeQ==',key_name='tempest-keypair-1770534859',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12cb3bcaf4264c31bb5c65516f5632a8',ramdisk_id='',reservation_id='r-x7yrq9zl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-217003347',owner_user_name='tempest-SnapshotDataIntegrityTests-217003347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T04:22:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8285ca34203a4243a4c99d34cba2bbaf',uuid=8c331c2c-90a3-4f5e-8b9a-40dbb19e0907,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "390d2610-ed90-40db-84e7-00104ff08d0c", "address": "fa:16:3e:97:d2:8b", "network": {"id": "ea7af6ae-5b5f-413e-8d3f-40a597d9e4c4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-156065771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12cb3bcaf4264c31bb5c65516f5632a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390d2610-ed", "ovs_interfaceid": "390d2610-ed90-40db-84e7-00104ff08d0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=103546) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 04:22:57 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Converting VIF {"id": "390d2610-ed90-40db-84e7-00104ff08d0c", "address": "fa:16:3e:97:d2:8b", "network": {"id": "ea7af6ae-5b5f-413e-8d3f-40a597d9e4c4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-156065771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12cb3bcaf4264c31bb5c65516f5632a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390d2610-ed", "ovs_interfaceid": "390d2610-ed90-40db-84e7-00104ff08d0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:22:57 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:d2:8b,bridge_name='br-int',has_traffic_filtering=True,id=390d2610-ed90-40db-84e7-00104ff08d0c,network=Network(ea7af6ae-5b5f-413e-8d3f-40a597d9e4c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap390d2610-ed') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:22:57 user nova-compute[103546]: DEBUG nova.objects.instance [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lazy-loading 'pci_devices' on Instance uuid 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:22:57 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] End _get_guest_xml xml=<domain type="kvm">
Nov 16 04:22:57 user nova-compute[103546]:   <uuid>8c331c2c-90a3-4f5e-8b9a-40dbb19e0907</uuid>
Nov 16 04:22:57 user nova-compute[103546]:   <name>instance-00000035</name>
Nov 16 04:22:57 user nova-compute[103546]:   <memory>524288</memory>
Nov 16 04:22:57 user nova-compute[103546]:   <vcpu>1</vcpu>
Nov 16 04:22:57 user nova-compute[103546]:   <metadata>
Nov 16 04:22:57 user nova-compute[103546]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 04:22:57 user nova-compute[103546]:       <nova:package version="0.0.0"/>
Nov 16 04:22:57 user nova-compute[103546]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-725088862</nova:name>
Nov 16 04:22:57 user nova-compute[103546]:       <nova:creationTime>2023-11-16 04:22:56</nova:creationTime>
Nov 16 04:22:57 user nova-compute[103546]:       <nova:flavor name="m1.tiny">
Nov 16 04:22:57 user nova-compute[103546]:         <nova:memory>512</nova:memory>
Nov 16 04:22:57 user nova-compute[103546]:         <nova:disk>1</nova:disk>
Nov 16 04:22:57 user nova-compute[103546]:         <nova:swap>0</nova:swap>
Nov 16 04:22:57 user nova-compute[103546]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 04:22:57 user nova-compute[103546]:         <nova:vcpus>1</nova:vcpus>
Nov 16 04:22:57 user nova-compute[103546]:       </nova:flavor>
Nov 16 04:22:57 user nova-compute[103546]:       <nova:owner>
Nov 16 04:22:57 user nova-compute[103546]:         <nova:user uuid="8285ca34203a4243a4c99d34cba2bbaf">tempest-SnapshotDataIntegrityTests-217003347-project-member</nova:user>
Nov 16 04:22:57 user nova-compute[103546]:         <nova:project uuid="12cb3bcaf4264c31bb5c65516f5632a8">tempest-SnapshotDataIntegrityTests-217003347</nova:project>
Nov 16 04:22:57 user nova-compute[103546]:       </nova:owner>
Nov 16 04:22:57 user nova-compute[103546]:       <nova:root type="image" uuid="5c6f539a-01e5-4478-bf8f-a14310b5d7dd"/>
Nov 16 04:22:57 user nova-compute[103546]:       <nova:ports>
Nov 16 04:22:57 user nova-compute[103546]:         <nova:port uuid="390d2610-ed90-40db-84e7-00104ff08d0c">
Nov 16 04:22:57 user nova-compute[103546]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 04:22:57 user nova-compute[103546]:         </nova:port>
Nov 16 04:22:57 user nova-compute[103546]:       </nova:ports>
Nov 16 04:22:57 user nova-compute[103546]:     </nova:instance>
Nov 16 04:22:57 user nova-compute[103546]:   </metadata>
Nov 16 04:22:57 user nova-compute[103546]:   <sysinfo type="smbios">
Nov 16 04:22:57 user nova-compute[103546]:     <system>
Nov 16 04:22:57 user nova-compute[103546]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 04:22:57 user nova-compute[103546]:       <entry name="product">OpenStack Nova</entry>
Nov 16 04:22:57 user nova-compute[103546]:       <entry name="version">0.0.0</entry>
Nov 16 04:22:57 user nova-compute[103546]:       <entry name="serial">8c331c2c-90a3-4f5e-8b9a-40dbb19e0907</entry>
Nov 16 04:22:57 user nova-compute[103546]:       <entry name="uuid">8c331c2c-90a3-4f5e-8b9a-40dbb19e0907</entry>
Nov 16 04:22:57 user nova-compute[103546]:       <entry name="family">Virtual Machine</entry>
Nov 16 04:22:57 user nova-compute[103546]:     </system>
Nov 16 04:22:57 user nova-compute[103546]:   </sysinfo>
Nov 16 04:22:57 user nova-compute[103546]:   <os>
Nov 16 04:22:57 user nova-compute[103546]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 04:22:57 user nova-compute[103546]:     <boot dev="hd"/>
Nov 16 04:22:57 user nova-compute[103546]:     <smbios mode="sysinfo"/>
Nov 16 04:22:57 user nova-compute[103546]:   </os>
Nov 16 04:22:57 user nova-compute[103546]:   <features>
Nov 16 04:22:57 user nova-compute[103546]:     <acpi/>
Nov 16 04:22:57 user nova-compute[103546]:     <apic/>
Nov 16 04:22:57 user nova-compute[103546]:     <vmcoreinfo/>
Nov 16 04:22:57 user nova-compute[103546]:   </features>
Nov 16 04:22:57 user nova-compute[103546]:   <clock offset="utc">
Nov 16 04:22:57 user nova-compute[103546]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 04:22:57 user nova-compute[103546]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 04:22:57 user nova-compute[103546]:     <timer name="hpet" present="no"/>
Nov 16 04:22:57 user nova-compute[103546]:   </clock>
Nov 16 04:22:57 user nova-compute[103546]:   <cpu mode="custom" match="exact">
Nov 16 04:22:57 user nova-compute[103546]:     <model>Nehalem</model>
Nov 16 04:22:57 user nova-compute[103546]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 04:22:57 user nova-compute[103546]:   </cpu>
Nov 16 04:22:57 user nova-compute[103546]:   <devices>
Nov 16 04:22:57 user nova-compute[103546]:     <disk type="file" device="disk">
Nov 16 04:22:57 user nova-compute[103546]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 04:22:57 user nova-compute[103546]:       <source file="/opt/stack/data/nova/instances/8c331c2c-90a3-4f5e-8b9a-40dbb19e0907/disk"/>
Nov 16 04:22:57 user nova-compute[103546]:       <target dev="vda" bus="virtio"/>
Nov 16 04:22:57 user nova-compute[103546]:     </disk>
Nov 16 04:22:57 user nova-compute[103546]:     <interface type="ethernet">
Nov 16 04:22:57 user nova-compute[103546]:       <mac address="fa:16:3e:97:d2:8b"/>
Nov 16 04:22:57 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 04:22:57 user nova-compute[103546]:       <mtu size="1442"/>
Nov 16 04:22:57 user nova-compute[103546]:       <target dev="tap390d2610-ed"/>
Nov 16 04:22:57 user nova-compute[103546]:     </interface>
Nov 16 04:22:57 user nova-compute[103546]:     <serial type="pty">
Nov 16 04:22:57 user nova-compute[103546]:       <log file="/opt/stack/data/nova/instances/8c331c2c-90a3-4f5e-8b9a-40dbb19e0907/console.log" append="off"/>
Nov 16 04:22:57 user nova-compute[103546]:     </serial>
Nov 16 04:22:57 user nova-compute[103546]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 04:22:57 user nova-compute[103546]:     <video>
Nov 16 04:22:57 user nova-compute[103546]:       <model type="virtio"/>
Nov 16 04:22:57 user nova-compute[103546]:     </video>
Nov 16 04:22:57 user nova-compute[103546]:     <rng model="virtio">
Nov 16 04:22:57 user nova-compute[103546]:       <backend model="random">/dev/urandom</backend>
Nov 16 04:22:57 user nova-compute[103546]:     </rng>
Nov 16 04:22:57 user nova-compute[103546]:     <controller type="usb" index="0" model="none"/>
Nov 16 04:22:57 user nova-compute[103546]:     <memballoon model="virtio">
Nov 16 04:22:57 user nova-compute[103546]:       <stats period="10"/>
Nov 16 04:22:57 user nova-compute[103546]:     </memballoon>
Nov 16 04:22:57 user nova-compute[103546]:   </devices>
Nov 16 04:22:57 user nova-compute[103546]: </domain>
Nov 16 04:22:57 user nova-compute[103546]:  {{(pid=103546) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 04:22:57 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:22:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-725088862',display_name='tempest-SnapshotDataIntegrityTests-server-725088862',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-725088862',id=53,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBewTO/MlPnyAEzx7kE8P3yVPcSblAmBo5wdQD6Og+TmEkntX01hZUc+dNvc3qU+7DkjJ0OzHt8tEV5UDJ+uBzATFGaPE3KtFiqONnkIN7drHWwX7Ycv5uz8Q8vJzdemeQ==',key_name='tempest-keypair-1770534859',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12cb3bcaf4264c31bb5c65516f5632a8',ramdisk_id='',reservation_id='r-x7yrq9zl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-217003347',owner_user_name='tempest-SnapshotDataIntegrityTests-217003347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T04:22:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8285ca34203a4243a4c99d34cba2bbaf',uuid=8c331c2c-90a3-4f5e-8b9a-40dbb19e0907,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "390d2610-ed90-40db-84e7-00104ff08d0c", "address": "fa:16:3e:97:d2:8b", "network": {"id": "ea7af6ae-5b5f-413e-8d3f-40a597d9e4c4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-156065771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12cb3bcaf4264c31bb5c65516f5632a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390d2610-ed", "ovs_interfaceid": "390d2610-ed90-40db-84e7-00104ff08d0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 04:22:57 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Converting VIF {"id": "390d2610-ed90-40db-84e7-00104ff08d0c", "address": "fa:16:3e:97:d2:8b", "network": {"id": "ea7af6ae-5b5f-413e-8d3f-40a597d9e4c4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-156065771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12cb3bcaf4264c31bb5c65516f5632a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390d2610-ed", "ovs_interfaceid": "390d2610-ed90-40db-84e7-00104ff08d0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:22:57 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:d2:8b,bridge_name='br-int',has_traffic_filtering=True,id=390d2610-ed90-40db-84e7-00104ff08d0c,network=Network(ea7af6ae-5b5f-413e-8d3f-40a597d9e4c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap390d2610-ed') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:22:57 user nova-compute[103546]: DEBUG os_vif [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:d2:8b,bridge_name='br-int',has_traffic_filtering=True,id=390d2610-ed90-40db-84e7-00104ff08d0c,network=Network(ea7af6ae-5b5f-413e-8d3f-40a597d9e4c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap390d2610-ed') {{(pid=103546) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 04:22:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:22:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:22:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 04:22:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:22:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0e3ce9fc-51ba-5d02-9fec-92a51132f3ec', '_type': 'linux-noop'}}, row=False) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:22:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:22:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:22:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:22:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap390d2610-ed, may_exist=True, interface_attrs={}) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:22:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap390d2610-ed, col_values=(('qos', UUID('42566095-8b1c-4fff-ad88-25f906c1082f')),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:22:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap390d2610-ed, col_values=(('external_ids', {'iface-id': '390d2610-ed90-40db-84e7-00104ff08d0c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:d2:8b', 'vm-uuid': '8c331c2c-90a3-4f5e-8b9a-40dbb19e0907'}),), if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:22:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:22:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:22:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:22:57 user nova-compute[103546]: INFO os_vif [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:d2:8b,bridge_name='br-int',has_traffic_filtering=True,id=390d2610-ed90-40db-84e7-00104ff08d0c,network=Network(ea7af6ae-5b5f-413e-8d3f-40a597d9e4c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap390d2610-ed')
Nov 16 04:22:57 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:22:57 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] No VIF found with MAC fa:16:3e:97:d2:8b, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 04:22:57 user nova-compute[103546]: DEBUG nova.network.neutron [req-b155b15e-2c5c-4579-8cad-671c27c9993b req-aa50e015-266c-4f1e-83b5-5ee8faab405f service nova] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Updated VIF entry in instance network info cache for port 390d2610-ed90-40db-84e7-00104ff08d0c. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 04:22:57 user nova-compute[103546]: DEBUG nova.network.neutron [req-b155b15e-2c5c-4579-8cad-671c27c9993b req-aa50e015-266c-4f1e-83b5-5ee8faab405f service nova] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Updating instance_info_cache with network_info: [{"id": "390d2610-ed90-40db-84e7-00104ff08d0c", "address": "fa:16:3e:97:d2:8b", "network": {"id": "ea7af6ae-5b5f-413e-8d3f-40a597d9e4c4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-156065771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12cb3bcaf4264c31bb5c65516f5632a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390d2610-ed", "ovs_interfaceid": "390d2610-ed90-40db-84e7-00104ff08d0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:22:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-b155b15e-2c5c-4579-8cad-671c27c9993b req-aa50e015-266c-4f1e-83b5-5ee8faab405f service nova] Releasing lock "refresh_cache-8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:22:57 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:22:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:22:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:22:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:22:58 user nova-compute[103546]: DEBUG nova.compute.manager [req-20c55edb-37f4-496f-9f72-e954928032b8 req-3d82bf10-f38d-4002-bda2-6ea00bd50852 service nova] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Received event network-vif-plugged-390d2610-ed90-40db-84e7-00104ff08d0c {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:22:58 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-20c55edb-37f4-496f-9f72-e954928032b8 req-3d82bf10-f38d-4002-bda2-6ea00bd50852 service nova] Acquiring lock "8c331c2c-90a3-4f5e-8b9a-40dbb19e0907-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:22:58 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-20c55edb-37f4-496f-9f72-e954928032b8 req-3d82bf10-f38d-4002-bda2-6ea00bd50852 service nova] Lock "8c331c2c-90a3-4f5e-8b9a-40dbb19e0907-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:22:58 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-20c55edb-37f4-496f-9f72-e954928032b8 req-3d82bf10-f38d-4002-bda2-6ea00bd50852 service nova] Lock "8c331c2c-90a3-4f5e-8b9a-40dbb19e0907-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:22:58 user nova-compute[103546]: DEBUG nova.compute.manager [req-20c55edb-37f4-496f-9f72-e954928032b8 req-3d82bf10-f38d-4002-bda2-6ea00bd50852 service nova] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] No waiting events found dispatching network-vif-plugged-390d2610-ed90-40db-84e7-00104ff08d0c {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:22:58 user nova-compute[103546]: WARNING nova.compute.manager [req-20c55edb-37f4-496f-9f72-e954928032b8 req-3d82bf10-f38d-4002-bda2-6ea00bd50852 service nova] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Received unexpected event network-vif-plugged-390d2610-ed90-40db-84e7-00104ff08d0c for instance with vm_state building and task_state spawning.
Nov 16 04:22:59 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:22:59 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:22:59 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:22:59 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:23:00 user nova-compute[103546]: DEBUG nova.compute.manager [req-16eb56bf-2ead-41eb-b888-3237e19d802a req-5c905dc3-8388-4626-b629-e2745debad94 service nova] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Received event network-vif-plugged-390d2610-ed90-40db-84e7-00104ff08d0c {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:23:00 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-16eb56bf-2ead-41eb-b888-3237e19d802a req-5c905dc3-8388-4626-b629-e2745debad94 service nova] Acquiring lock "8c331c2c-90a3-4f5e-8b9a-40dbb19e0907-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:23:00 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-16eb56bf-2ead-41eb-b888-3237e19d802a req-5c905dc3-8388-4626-b629-e2745debad94 service nova] Lock "8c331c2c-90a3-4f5e-8b9a-40dbb19e0907-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:23:00 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-16eb56bf-2ead-41eb-b888-3237e19d802a req-5c905dc3-8388-4626-b629-e2745debad94 service nova] Lock "8c331c2c-90a3-4f5e-8b9a-40dbb19e0907-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:23:00 user nova-compute[103546]: DEBUG nova.compute.manager [req-16eb56bf-2ead-41eb-b888-3237e19d802a req-5c905dc3-8388-4626-b629-e2745debad94 service nova] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] No waiting events found dispatching network-vif-plugged-390d2610-ed90-40db-84e7-00104ff08d0c {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:23:00 user nova-compute[103546]: WARNING nova.compute.manager [req-16eb56bf-2ead-41eb-b888-3237e19d802a req-5c905dc3-8388-4626-b629-e2745debad94 service nova] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Received unexpected event network-vif-plugged-390d2610-ed90-40db-84e7-00104ff08d0c for instance with vm_state building and task_state spawning.
Nov 16 04:23:00 user nova-compute[103546]: DEBUG nova.compute.manager [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Instance event wait completed in 0 seconds for  {{(pid=103546) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 04:23:00 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Guest created on hypervisor {{(pid=103546) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 04:23:00 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Instance spawned successfully.
Nov 16 04:23:00 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 04:23:00 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Found default for hw_cdrom_bus of ide {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:23:00 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Found default for hw_disk_bus of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:23:00 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Found default for hw_input_bus of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:23:00 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Found default for hw_pointer_model of None {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:23:00 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Found default for hw_video_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:23:00 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Found default for hw_vif_model of virtio {{(pid=103546) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 04:23:00 user nova-compute[103546]: INFO nova.compute.manager [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Took 6.33 seconds to spawn the instance on the hypervisor.
Nov 16 04:23:00 user nova-compute[103546]: DEBUG nova.compute.manager [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Checking state {{(pid=103546) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 04:23:00 user nova-compute[103546]: INFO nova.compute.manager [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Took 6.94 seconds to build instance.
Nov 16 04:23:00 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-26259c1f-af8e-4eb1-a552-46b87f1a180f tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.066s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:23:02 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:23:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:23:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:23:10 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:23:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:23:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:23:17 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:23:19 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:23:21 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:23:21 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Cleaning up deleted instances with incomplete migration  {{(pid=103546) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 04:23:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:23:24 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:23:27 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:23:29 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:23:32 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:23:34 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:23:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:23:37 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager.update_available_resource {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:23:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:23:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:23:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:23:37 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Auditing locally available compute resources for user (node: user) {{(pid=103546) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 04:23:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c331c2c-90a3-4f5e-8b9a-40dbb19e0907/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:23:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c331c2c-90a3-4f5e-8b9a-40dbb19e0907/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:23:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c331c2c-90a3-4f5e-8b9a-40dbb19e0907/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:23:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c331c2c-90a3-4f5e-8b9a-40dbb19e0907/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:23:38 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:23:38 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:23:38 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Hypervisor/Node resource view: name=user free_ram=9011MB free_disk=25.03335189819336GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=103546) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 04:23:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:23:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:23:38 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:23:38 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 04:23:38 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 04:23:38 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:23:38 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:23:38 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Compute_service record updated for user:user {{(pid=103546) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 04:23:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.212s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:23:42 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:23:42 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:23:42 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:23:42 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._sync_power_states {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:23:43 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Triggering sync for uuid 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907 {{(pid=103546) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 04:23:43 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:23:43 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:23:43 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:23:43 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:23:43 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:23:43 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=103546) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 04:23:45 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:23:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:23:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:23:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=103546) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 04:23:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:23:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:23:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:23:50 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:23:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:23:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:23:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=103546) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 04:23:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:23:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:23:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:23:52 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:23:52 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Starting heal instance info cache {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 04:23:52 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Rebuilding the list of instances to heal {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 04:23:52 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "refresh_cache-8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:23:52 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquired lock "refresh_cache-8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:23:52 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Forcefully refreshing network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 04:23:52 user nova-compute[103546]: DEBUG nova.objects.instance [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lazy-loading 'info_cache' on Instance uuid 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:23:53 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Updating instance_info_cache with network_info: [{"id": "390d2610-ed90-40db-84e7-00104ff08d0c", "address": "fa:16:3e:97:d2:8b", "network": {"id": "ea7af6ae-5b5f-413e-8d3f-40a597d9e4c4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-156065771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12cb3bcaf4264c31bb5c65516f5632a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390d2610-ed", "ovs_interfaceid": "390d2610-ed90-40db-84e7-00104ff08d0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:23:53 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Releasing lock "refresh_cache-8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:23:53 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Updated the network info_cache for instance {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 04:23:53 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:23:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:23:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:23:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=103546) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 04:23:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:23:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:23:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:24:02 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:24:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:24:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:24:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=103546) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 04:24:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:24:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:24:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:24:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:24:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:24:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=103546) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 04:24:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:24:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:24:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:24:17 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4996-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:24:17 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:24:17 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=103546) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 04:24:17 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:24:17 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:24:17 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:24:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:24:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:24:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=103546) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 04:24:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:24:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:24:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:24:27 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:24:27 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:24:27 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=103546) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 04:24:27 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:24:27 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:24:27 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:24:32 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:24:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:24:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:24:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=103546) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 04:24:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:24:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:24:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:24:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:24:37 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager.update_available_resource {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:24:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:24:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:24:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:24:37 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Auditing locally available compute resources for user (node: user) {{(pid=103546) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 04:24:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c331c2c-90a3-4f5e-8b9a-40dbb19e0907/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:24:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c331c2c-90a3-4f5e-8b9a-40dbb19e0907/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:24:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c331c2c-90a3-4f5e-8b9a-40dbb19e0907/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:24:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c331c2c-90a3-4f5e-8b9a-40dbb19e0907/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:24:38 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:24:38 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:24:38 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Hypervisor/Node resource view: name=user free_ram=9044MB free_disk=25.032787322998047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=103546) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 04:24:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:24:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:24:38 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:24:38 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 04:24:38 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 04:24:38 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:24:38 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:24:38 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Compute_service record updated for user:user {{(pid=103546) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 04:24:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.214s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:24:42 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:24:42 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:24:42 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=103546) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 04:24:42 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:24:42 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:24:42 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:24:42 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:24:43 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:24:44 user nova-compute[103546]: DEBUG nova.compute.manager [req-a2bd7ba2-7eb7-4616-8130-a0ea813d739d req-c922d559-a29e-4c29-a31b-612f6c1fa67e service nova] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Received event network-changed-390d2610-ed90-40db-84e7-00104ff08d0c {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:24:44 user nova-compute[103546]: DEBUG nova.compute.manager [req-a2bd7ba2-7eb7-4616-8130-a0ea813d739d req-c922d559-a29e-4c29-a31b-612f6c1fa67e service nova] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Refreshing instance network info cache due to event network-changed-390d2610-ed90-40db-84e7-00104ff08d0c. {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 04:24:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a2bd7ba2-7eb7-4616-8130-a0ea813d739d req-c922d559-a29e-4c29-a31b-612f6c1fa67e service nova] Acquiring lock "refresh_cache-8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:24:44 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a2bd7ba2-7eb7-4616-8130-a0ea813d739d req-c922d559-a29e-4c29-a31b-612f6c1fa67e service nova] Acquired lock "refresh_cache-8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:24:44 user nova-compute[103546]: DEBUG nova.network.neutron [req-a2bd7ba2-7eb7-4616-8130-a0ea813d739d req-c922d559-a29e-4c29-a31b-612f6c1fa67e service nova] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Refreshing network info cache for port 390d2610-ed90-40db-84e7-00104ff08d0c {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 04:24:45 user nova-compute[103546]: DEBUG nova.network.neutron [req-a2bd7ba2-7eb7-4616-8130-a0ea813d739d req-c922d559-a29e-4c29-a31b-612f6c1fa67e service nova] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Updated VIF entry in instance network info cache for port 390d2610-ed90-40db-84e7-00104ff08d0c. {{(pid=103546) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 04:24:45 user nova-compute[103546]: DEBUG nova.network.neutron [req-a2bd7ba2-7eb7-4616-8130-a0ea813d739d req-c922d559-a29e-4c29-a31b-612f6c1fa67e service nova] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Updating instance_info_cache with network_info: [{"id": "390d2610-ed90-40db-84e7-00104ff08d0c", "address": "fa:16:3e:97:d2:8b", "network": {"id": "ea7af6ae-5b5f-413e-8d3f-40a597d9e4c4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-156065771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12cb3bcaf4264c31bb5c65516f5632a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390d2610-ed", "ovs_interfaceid": "390d2610-ed90-40db-84e7-00104ff08d0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:24:45 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-a2bd7ba2-7eb7-4616-8130-a0ea813d739d req-c922d559-a29e-4c29-a31b-612f6c1fa67e service nova] Releasing lock "refresh_cache-8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:24:45 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:24:45 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:24:45 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=103546) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 04:24:46 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:24:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:24:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:24:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=103546) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 04:24:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:24:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:24:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:24:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a45b3b78-681f-42d2-8363-c06c03b35491 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Acquiring lock "8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:24:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a45b3b78-681f-42d2-8363-c06c03b35491 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:24:48 user nova-compute[103546]: DEBUG nova.objects.instance [None req-a45b3b78-681f-42d2-8363-c06c03b35491 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lazy-loading 'flavor' on Instance uuid 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:24:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a45b3b78-681f-42d2-8363-c06c03b35491 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:24:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a45b3b78-681f-42d2-8363-c06c03b35491 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Acquiring lock "8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:24:48 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a45b3b78-681f-42d2-8363-c06c03b35491 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:24:48 user nova-compute[103546]: INFO nova.compute.manager [None req-a45b3b78-681f-42d2-8363-c06c03b35491 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Attaching volume 639c12db-02d5-4c20-8d6d-f29bd4bbef0f to /dev/vdb
Nov 16 04:24:48 user nova-compute[103546]: DEBUG os_brick.utils [None req-a45b3b78-681f-42d2-8363-c06c03b35491 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:24:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:24:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:24:48 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75a31ec-f9b6-4015-94da-af0af0d882e7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af5c39b14ece\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:24:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:24:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:24:48 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b4fab0-6a00-468c-9af3-f0e129ce4ec4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:24:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:24:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:24:48 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6e835b-64b1-4eb8-9621-8b91e03c9591]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:24:48 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb9387d-1e9c-4dfe-94f7-e3dcff437f9d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:24:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-a45b3b78-681f-42d2-8363-c06c03b35491 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Running cmd (subprocess): nvme version {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:24:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-a45b3b78-681f-42d2-8363-c06c03b35491 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] 'nvme version' failed. Not Retrying. {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 04:24:48 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a45b3b78-681f-42d2-8363-c06c03b35491 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] nvme not present on system {{(pid=103546) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 04:24:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:24:48 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 04:24:48 user nova-compute[103546]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 04:24:48 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[84144fb2-6674-4f5d-901b-adef255cfb80]: (4, '') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:24:48 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-a45b3b78-681f-42d2-8363-c06c03b35491 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=103546) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 04:24:48 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-a45b3b78-681f-42d2-8363-c06c03b35491 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 04:24:48 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-a45b3b78-681f-42d2-8363-c06c03b35491 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] LIGHTOS: no hostnqn found. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 04:24:48 user nova-compute[103546]: DEBUG os_brick.utils [None req-a45b3b78-681f-42d2-8363-c06c03b35491 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af5c39b14ece', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:24:48 user nova-compute[103546]: DEBUG nova.virt.block_device [None req-a45b3b78-681f-42d2-8363-c06c03b35491 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Updating existing volume attachment record: b359cad5-3f1b-4f26-bcea-d30e1766cd69 {{(pid=103546) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 04:24:49 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:24:49 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:24:51 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:24:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:24:53 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a45b3b78-681f-42d2-8363-c06c03b35491 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 04:24:53 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45b3b78-681f-42d2-8363-c06c03b35491 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:639c12db-02d5-4c20-8d6d-f29bd4bbef0f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nlfbxpuq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:24:53 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-a45b3b78-681f-42d2-8363-c06c03b35491 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:24:53 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-a45b3b78-681f-42d2-8363-c06c03b35491 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:24:53 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-a45b3b78-681f-42d2-8363-c06c03b35491 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:24:53 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-a45b3b78-681f-42d2-8363-c06c03b35491 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:24:53 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-a45b3b78-681f-42d2-8363-c06c03b35491 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:639c12db-02d5-4c20-8d6d-f29bd4bbef0f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:24:53 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-a45b3b78-681f-42d2-8363-c06c03b35491 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:639c12db-02d5-4c20-8d6d-f29bd4bbef0f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:24:53 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-a45b3b78-681f-42d2-8363-c06c03b35491 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 04:24:53 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:639c12db-02d5-4c20-8d6d-f29bd4bbef0f -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:24:53 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:639c12db-02d5-4c20-8d6d-f29bd4bbef0f -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:24:53 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c35a4d-9c1b-4431-8bba-b46c8397ee60]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:24:53 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45b3b78-681f-42d2-8363-c06c03b35491 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 04:24:53 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:24:53 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:639c12db-02d5-4c20-8d6d-f29bd4bbef0f -p 172.16.0.220:3260 --interface default --op new {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:24:53 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:639c12db-02d5-4c20-8d6d-f29bd4bbef0f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:24:53 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2c6ee8-a0fa-4f9d-8e4f-938d3ddb5337]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:639c12db-02d5-4c20-8d6d-f29bd4bbef0f] added\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:24:53 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45b3b78-681f-42d2-8363-c06c03b35491 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:639c12db-02d5-4c20-8d6d-f29bd4bbef0f] added
Nov 16 04:24:53 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:24:53 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:639c12db-02d5-4c20-8d6d-f29bd4bbef0f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:24:53 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:639c12db-02d5-4c20-8d6d-f29bd4bbef0f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:24:53 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb35304-133d-42ba-b0d7-5a05d0242248]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:24:53 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45b3b78-681f-42d2-8363-c06c03b35491 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:24:53 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:639c12db-02d5-4c20-8d6d-f29bd4bbef0f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:24:53 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:639c12db-02d5-4c20-8d6d-f29bd4bbef0f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:24:53 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2b9a8f-b54f-4fa1-b73f-b57246061b27]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:24:53 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45b3b78-681f-42d2-8363-c06c03b35491 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:24:53 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:639c12db-02d5-4c20-8d6d-f29bd4bbef0f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nlfbxpuq {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:24:53 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:639c12db-02d5-4c20-8d6d-f29bd4bbef0f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nlfbxpuq" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:24:53 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2c8171-4583-46ec-a13c-a8fb1bf20d33]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:24:53 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45b3b78-681f-42d2-8363-c06c03b35491 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nlfbxpuq'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:24:53 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:639c12db-02d5-4c20-8d6d-f29bd4bbef0f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:24:53 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:639c12db-02d5-4c20-8d6d-f29bd4bbef0f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:24:53 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[4310745c-ab30-4bc8-9285-22e2af6a82c9]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:24:53 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45b3b78-681f-42d2-8363-c06c03b35491 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:24:53 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:24:53 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:24:53 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5743ec-4ad0-4363-820f-379e9280af61]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:24:53 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45b3b78-681f-42d2-8363-c06c03b35491 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 04:24:53 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:24:53 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45b3b78-681f-42d2-8363-c06c03b35491 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 04:24:53 user nova-compute[103546]:  {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:24:53 user nova-compute[103546]: WARNING os_brick.initiator.connectors.iscsi [None req-a45b3b78-681f-42d2-8363-c06c03b35491 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 04:24:53 user nova-compute[103546]: 
Nov 16 04:24:53 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:639c12db-02d5-4c20-8d6d-f29bd4bbef0f -p 172.16.0.220:3260 --login {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:24:53 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:639c12db-02d5-4c20-8d6d-f29bd4bbef0f -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:24:53 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5153e088-a517-4738-bc68-15ebffd75ec2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:639c12db-02d5-4c20-8d6d-f29bd4bbef0f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:639c12db-02d5-4c20-8d6d-f29bd4bbef0f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:24:53 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45b3b78-681f-42d2-8363-c06c03b35491 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:639c12db-02d5-4c20-8d6d-f29bd4bbef0f, portal: 172.16.0.220,3260]
Nov 16 04:24:53 user nova-compute[103546]: Login to [iface: default, target: iqn.2010-10.org.openstack:639c12db-02d5-4c20-8d6d-f29bd4bbef0f, portal: 172.16.0.220,3260] successful.
Nov 16 04:24:53 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:24:53 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:639c12db-02d5-4c20-8d6d-f29bd4bbef0f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:24:53 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:639c12db-02d5-4c20-8d6d-f29bd4bbef0f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:24:53 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9995c2-02d4-4002-b7a6-aeef56f716c8]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:24:53 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45b3b78-681f-42d2-8363-c06c03b35491 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:24:53 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:24:53 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:24:53 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9ce336-724f-4f2b-abfb-cc22747d5dc6]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:639c12db-02d5-4c20-8d6d-f29bd4bbef0f (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:24:53 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45b3b78-681f-42d2-8363-c06c03b35491 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:639c12db-02d5-4c20-8d6d-f29bd4bbef0f (non-flash)
Nov 16 04:24:53 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:24:53 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45b3b78-681f-42d2-8363-c06c03b35491 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:639c12db-02d5-4c20-8d6d-f29bd4bbef0f (non-flash)
Nov 16 04:24:53 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:24:53 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-a45b3b78-681f-42d2-8363-c06c03b35491 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:639c12db-02d5-4c20-8d6d-f29bd4bbef0f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:24:53 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45b3b78-681f-42d2-8363-c06c03b35491 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 04:24:53 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-a45b3b78-681f-42d2-8363-c06c03b35491 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 04:24:53 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-a45b3b78-681f-42d2-8363-c06c03b35491 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 04:24:53 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:24:53 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:24:53 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82fa30d-d04e-4c3c-be2d-934a38a37e27]: (4, ('- - 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:24:53 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-a45b3b78-681f-42d2-8363-c06c03b35491 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 04:24:53 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45b3b78-681f-42d2-8363-c06c03b35491 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:639c12db-02d5-4c20-8d6d-f29bd4bbef0f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nlfbxpuq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 04:24:53 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:24:53 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Starting heal instance info cache {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 04:24:53 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Rebuilding the list of instances to heal {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 04:24:53 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "refresh_cache-8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:24:53 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquired lock "refresh_cache-8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:24:53 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Forcefully refreshing network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 04:24:53 user nova-compute[103546]: DEBUG nova.objects.instance [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lazy-loading 'info_cache' on Instance uuid 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:24:54 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Updating instance_info_cache with network_info: [{"id": "390d2610-ed90-40db-84e7-00104ff08d0c", "address": "fa:16:3e:97:d2:8b", "network": {"id": "ea7af6ae-5b5f-413e-8d3f-40a597d9e4c4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-156065771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12cb3bcaf4264c31bb5c65516f5632a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390d2610-ed", "ovs_interfaceid": "390d2610-ed90-40db-84e7-00104ff08d0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:24:54 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Releasing lock "refresh_cache-8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:24:54 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Updated the network info_cache for instance {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 04:24:54 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:24:54 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-a45b3b78-681f-42d2-8363-c06c03b35491 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:24:54 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45b3b78-681f-42d2-8363-c06c03b35491 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23366356363373032', 'path': '/dev/sdb'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:24:54 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a45b3b78-681f-42d2-8363-c06c03b35491 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366356363373032', 'path': '/dev/sdb'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 04:24:54 user nova-compute[103546]: DEBUG nova.objects.instance [None req-a45b3b78-681f-42d2-8363-c06c03b35491 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lazy-loading 'flavor' on Instance uuid 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:24:54 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-a45b3b78-681f-42d2-8363-c06c03b35491 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 04:24:54 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:24:54 user nova-compute[103546]:   <source dev="/dev/sdb"/>
Nov 16 04:24:54 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 04:24:54 user nova-compute[103546]:   <serial>639c12db-02d5-4c20-8d6d-f29bd4bbef0f</serial>
Nov 16 04:24:54 user nova-compute[103546]: </disk>
Nov 16 04:24:54 user nova-compute[103546]:  {{(pid=103546) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 04:24:54 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:24:54 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a45b3b78-681f-42d2-8363-c06c03b35491 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:24:54 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a45b3b78-681f-42d2-8363-c06c03b35491 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] No BDM found with device name vdb, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:24:54 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-a45b3b78-681f-42d2-8363-c06c03b35491 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] No VIF found with MAC fa:16:3e:97:d2:8b, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 04:24:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-a45b3b78-681f-42d2-8363-c06c03b35491 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.558s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:24:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:24:59 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:25:02 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:25:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:25:06 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-20d8d78a-a137-43ac-a289-c8a46f06c12e tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Acquiring lock "8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:25:06 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-20d8d78a-a137-43ac-a289-c8a46f06c12e tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:25:06 user nova-compute[103546]: INFO nova.compute.manager [None req-20d8d78a-a137-43ac-a289-c8a46f06c12e tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Detaching volume 639c12db-02d5-4c20-8d6d-f29bd4bbef0f
Nov 16 04:25:06 user nova-compute[103546]: INFO nova.virt.block_device [None req-20d8d78a-a137-43ac-a289-c8a46f06c12e tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Attempting to driver detach volume 639c12db-02d5-4c20-8d6d-f29bd4bbef0f from mountpoint /dev/vdb
Nov 16 04:25:06 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-20d8d78a-a137-43ac-a289-c8a46f06c12e tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Attempting to detach device vdb from instance 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907 from the persistent domain config. {{(pid=103546) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 04:25:06 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-20d8d78a-a137-43ac-a289-c8a46f06c12e tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 04:25:06 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:25:06 user nova-compute[103546]:   <source dev="/dev/sdb"/>
Nov 16 04:25:06 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 04:25:06 user nova-compute[103546]:   <serial>639c12db-02d5-4c20-8d6d-f29bd4bbef0f</serial>
Nov 16 04:25:06 user nova-compute[103546]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 04:25:06 user nova-compute[103546]: </disk>
Nov 16 04:25:06 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 04:25:06 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-20d8d78a-a137-43ac-a289-c8a46f06c12e tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Successfully detached device vdb from instance 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907 from the persistent domain config.
Nov 16 04:25:06 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-20d8d78a-a137-43ac-a289-c8a46f06c12e tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907 from the live domain config. {{(pid=103546) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 04:25:06 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-20d8d78a-a137-43ac-a289-c8a46f06c12e tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 04:25:06 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:25:06 user nova-compute[103546]:   <source dev="/dev/sdb"/>
Nov 16 04:25:06 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 04:25:06 user nova-compute[103546]:   <serial>639c12db-02d5-4c20-8d6d-f29bd4bbef0f</serial>
Nov 16 04:25:06 user nova-compute[103546]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 04:25:06 user nova-compute[103546]: </disk>
Nov 16 04:25:06 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 04:25:06 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-20d8d78a-a137-43ac-a289-c8a46f06c12e tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907 {{(pid=103546) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 04:25:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:25:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:25:17 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:25:17 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:25:17 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=103546) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 04:25:17 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:25:17 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:25:17 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:25:19 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:25:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:25:26 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-20d8d78a-a137-43ac-a289-c8a46f06c12e tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907 is timed out.
Nov 16 04:25:26 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-20d8d78a-a137-43ac-a289-c8a46f06c12e tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Successfully detached device vdb from instance 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907 from the live domain config.
Nov 16 04:25:26 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20d8d78a-a137-43ac-a289-c8a46f06c12e tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 04:25:26 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d8d78a-a137-43ac-a289-c8a46f06c12e tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:639c12db-02d5-4c20-8d6d-f29bd4bbef0f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nlfbxpuq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:25:26 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-20d8d78a-a137-43ac-a289-c8a46f06c12e tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:25:26 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-20d8d78a-a137-43ac-a289-c8a46f06c12e tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:25:26 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-20d8d78a-a137-43ac-a289-c8a46f06c12e tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:25:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:25:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:25:26 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[7efa7850-68f6-4f47-b213-12db60857ad3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:639c12db-02d5-4c20-8d6d-f29bd4bbef0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:25:26 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d8d78a-a137-43ac-a289-c8a46f06c12e tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 04:25:26 user nova-compute[103546]: No targets found.
Nov 16 04:25:26 user nova-compute[103546]: iSNS:
Nov 16 04:25:26 user nova-compute[103546]: No targets found.
Nov 16 04:25:26 user nova-compute[103546]: STATIC:
Nov 16 04:25:26 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:639c12db-02d5-4c20-8d6d-f29bd4bbef0f
Nov 16 04:25:26 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:25:26 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:25:26 user nova-compute[103546]: FIRMWARE:
Nov 16 04:25:26 user nova-compute[103546]: No targets found.
Nov 16 04:25:26 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:25:26 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d8d78a-a137-43ac-a289-c8a46f06c12e tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 04:25:26 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 04:25:26 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 04:25:26 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d8d78a-a137-43ac-a289-c8a46f06c12e tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:639c12db-02d5-4c20-8d6d-f29bd4bbef0f', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 04:25:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:25:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:25:26 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef2da4e-54cf-4404-9f97-88cbcb132718]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:639c12db-02d5-4c20-8d6d-f29bd4bbef0f\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:25:26 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:25:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:25:27 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[8185e63b-db40-4c27-9d9e-2fb831f21831]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:639c12db-02d5-4c20-8d6d-f29bd4bbef0f (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:25:27 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d8d78a-a137-43ac-a289-c8a46f06c12e tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:639c12db-02d5-4c20-8d6d-f29bd4bbef0f (non-flash)
Nov 16 04:25:27 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:25:27 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d8d78a-a137-43ac-a289-c8a46f06c12e tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:639c12db-02d5-4c20-8d6d-f29bd4bbef0f (non-flash)
Nov 16 04:25:27 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:25:27 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d8d78a-a137-43ac-a289-c8a46f06c12e tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60ac3029e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:639c12db-02d5-4c20-8d6d-f29bd4bbef0f'): ({'sdb'}, set())}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 04:25:27 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-20d8d78a-a137-43ac-a289-c8a46f06c12e tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Removing single pathed devices sdb {{(pid=103546) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 04:25:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:25:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:25:27 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a012460-a860-42cc-8068-2d61f46fe7a5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:25:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:25:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:25:27 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4585902-2d87-475c-a42a-5fe6ceb021ef]: (4, ('ok\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:25:27 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-20d8d78a-a137-43ac-a289-c8a46f06c12e tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Flushing IO for device /dev/sdb {{(pid=103546) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 04:25:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:25:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:25:27 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[88413e80-5bdb-4229-ade2-80e5fea1025d]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:25:27 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-20d8d78a-a137-43ac-a289-c8a46f06c12e tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=103546) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 04:25:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:25:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:25:27 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34ee318-656f-455d-87a8-3fdc3b6f66b7]: (4, ('1', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:25:27 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-20d8d78a-a137-43ac-a289-c8a46f06c12e tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 04:25:27 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-20d8d78a-a137-43ac-a289-c8a46f06c12e tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] SCSI volumes sdb have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 04:25:27 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d8d78a-a137-43ac-a289-c8a46f06c12e tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:639c12db-02d5-4c20-8d6d-f29bd4bbef0f')] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 04:25:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:639c12db-02d5-4c20-8d6d-f29bd4bbef0f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:25:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:639c12db-02d5-4c20-8d6d-f29bd4bbef0f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:25:27 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c8e2c7-8beb-45f8-a1d0-bdfd25a5e737]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:25:27 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d8d78a-a137-43ac-a289-c8a46f06c12e tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:25:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:639c12db-02d5-4c20-8d6d-f29bd4bbef0f -p 172.16.0.220:3260 --logout {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:25:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:639c12db-02d5-4c20-8d6d-f29bd4bbef0f -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:25:27 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6cec72b-de29-43c2-a084-4ed5eca26e86]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:639c12db-02d5-4c20-8d6d-f29bd4bbef0f, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:639c12db-02d5-4c20-8d6d-f29bd4bbef0f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:25:27 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d8d78a-a137-43ac-a289-c8a46f06c12e tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:639c12db-02d5-4c20-8d6d-f29bd4bbef0f, portal: 172.16.0.220,3260]
Nov 16 04:25:27 user nova-compute[103546]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:639c12db-02d5-4c20-8d6d-f29bd4bbef0f, portal: 172.16.0.220,3260] successful.
Nov 16 04:25:27 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:25:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:639c12db-02d5-4c20-8d6d-f29bd4bbef0f -p 172.16.0.220:3260 --op delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:25:27 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:639c12db-02d5-4c20-8d6d-f29bd4bbef0f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:25:27 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f1d210-d2f4-4c72-99a0-a3eea86e148a]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:25:27 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d8d78a-a137-43ac-a289-c8a46f06c12e tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:25:27 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-20d8d78a-a137-43ac-a289-c8a46f06c12e tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:25:27 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d8d78a-a137-43ac-a289-c8a46f06c12e tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] <== disconnect_volume: return (294ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:25:27 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20d8d78a-a137-43ac-a289-c8a46f06c12e tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 04:25:27 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:25:27 user nova-compute[103546]: DEBUG nova.objects.instance [None req-20d8d78a-a137-43ac-a289-c8a46f06c12e tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lazy-loading 'flavor' on Instance uuid 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:25:27 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-20d8d78a-a137-43ac-a289-c8a46f06c12e tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.606s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:25:32 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:25:32 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:25:32 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=103546) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 04:25:32 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:25:32 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:25:32 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:25:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:25:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:25:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=103546) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 04:25:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:25:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:25:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:25:37 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager.update_available_resource {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:25:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:25:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:25:37 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:25:37 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Auditing locally available compute resources for user (node: user) {{(pid=103546) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 04:25:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c331c2c-90a3-4f5e-8b9a-40dbb19e0907/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:25:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c331c2c-90a3-4f5e-8b9a-40dbb19e0907/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:25:37 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c331c2c-90a3-4f5e-8b9a-40dbb19e0907/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:25:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c331c2c-90a3-4f5e-8b9a-40dbb19e0907/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:25:38 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:25:38 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:25:38 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Hypervisor/Node resource view: name=user free_ram=9054MB free_disk=25.031532287597656GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=103546) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 04:25:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:25:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:25:38 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:25:38 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 04:25:38 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 04:25:38 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:25:38 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:25:38 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Compute_service record updated for user:user {{(pid=103546) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 04:25:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.183s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:25:42 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:25:42 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:25:42 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=103546) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 04:25:42 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:25:42 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:25:42 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:25:42 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:25:44 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:25:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:25:47 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:25:47 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:25:47 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:25:47 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=103546) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 04:25:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:25:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:25:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=103546) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 04:25:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:25:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:25:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:25:52 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:25:54 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:25:55 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:25:55 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Starting heal instance info cache {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 04:25:55 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Rebuilding the list of instances to heal {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 04:25:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "refresh_cache-8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:25:55 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquired lock "refresh_cache-8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:25:55 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Forcefully refreshing network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 04:25:55 user nova-compute[103546]: DEBUG nova.objects.instance [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lazy-loading 'info_cache' on Instance uuid 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:25:56 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Updating instance_info_cache with network_info: [{"id": "390d2610-ed90-40db-84e7-00104ff08d0c", "address": "fa:16:3e:97:d2:8b", "network": {"id": "ea7af6ae-5b5f-413e-8d3f-40a597d9e4c4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-156065771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12cb3bcaf4264c31bb5c65516f5632a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390d2610-ed", "ovs_interfaceid": "390d2610-ed90-40db-84e7-00104ff08d0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:25:56 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Releasing lock "refresh_cache-8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:25:56 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Updated the network info_cache for instance {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 04:25:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:25:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:25:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=103546) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 04:25:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:25:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:25:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:25:58 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-9e914c80-c47f-49f7-8cb9-e1671322bb1a tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Acquiring lock "8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:25:58 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-9e914c80-c47f-49f7-8cb9-e1671322bb1a tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:25:58 user nova-compute[103546]: DEBUG nova.objects.instance [None req-9e914c80-c47f-49f7-8cb9-e1671322bb1a tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lazy-loading 'flavor' on Instance uuid 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:25:58 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-9e914c80-c47f-49f7-8cb9-e1671322bb1a tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:25:58 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-9e914c80-c47f-49f7-8cb9-e1671322bb1a tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Acquiring lock "8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:25:58 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-9e914c80-c47f-49f7-8cb9-e1671322bb1a tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:25:58 user nova-compute[103546]: INFO nova.compute.manager [None req-9e914c80-c47f-49f7-8cb9-e1671322bb1a tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Attaching volume 2b96b020-e675-4c05-8a3f-436dd862869d to /dev/vdb
Nov 16 04:25:58 user nova-compute[103546]: DEBUG os_brick.utils [None req-9e914c80-c47f-49f7-8cb9-e1671322bb1a tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:25:58 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:25:58 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:25:58 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[55230f82-6059-4442-9ec5-80649890b6bc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af5c39b14ece\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:25:58 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:25:58 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:25:58 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9bfb946-d5fb-4b83-9fef-020acc2d6357]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:25:58 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:25:58 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:25:58 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b237b68-04ba-4e8a-bf56-eef137ca01e1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:25:58 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4ad770-fc52-4c95-9507-c23ad69cc72d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:25:58 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-9e914c80-c47f-49f7-8cb9-e1671322bb1a tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Running cmd (subprocess): nvme version {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:25:58 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-9e914c80-c47f-49f7-8cb9-e1671322bb1a tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] 'nvme version' failed. Not Retrying. {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 04:25:58 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9e914c80-c47f-49f7-8cb9-e1671322bb1a tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] nvme not present on system {{(pid=103546) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 04:25:58 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:25:58 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 04:25:58 user nova-compute[103546]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 04:25:58 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab939679-019d-4fea-b793-45fa41ff7583]: (4, '') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:25:58 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-9e914c80-c47f-49f7-8cb9-e1671322bb1a tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=103546) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 04:25:58 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-9e914c80-c47f-49f7-8cb9-e1671322bb1a tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 04:25:58 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-9e914c80-c47f-49f7-8cb9-e1671322bb1a tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] LIGHTOS: no hostnqn found. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 04:25:58 user nova-compute[103546]: DEBUG os_brick.utils [None req-9e914c80-c47f-49f7-8cb9-e1671322bb1a tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af5c39b14ece', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:25:58 user nova-compute[103546]: DEBUG nova.virt.block_device [None req-9e914c80-c47f-49f7-8cb9-e1671322bb1a tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Updating existing volume attachment record: 8f701b9c-ee3e-40c0-8a66-9c5dcf6eb5ca {{(pid=103546) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 04:25:59 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:26:02 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:26:03 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e914c80-c47f-49f7-8cb9-e1671322bb1a tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 04:26:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e914c80-c47f-49f7-8cb9-e1671322bb1a tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2b96b020-e675-4c05-8a3f-436dd862869d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TgwbMVOm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:26:03 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-9e914c80-c47f-49f7-8cb9-e1671322bb1a tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:26:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-9e914c80-c47f-49f7-8cb9-e1671322bb1a tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:26:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-9e914c80-c47f-49f7-8cb9-e1671322bb1a tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:26:03 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-9e914c80-c47f-49f7-8cb9-e1671322bb1a tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:26:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-9e914c80-c47f-49f7-8cb9-e1671322bb1a tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b96b020-e675-4c05-8a3f-436dd862869d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:26:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-9e914c80-c47f-49f7-8cb9-e1671322bb1a tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b96b020-e675-4c05-8a3f-436dd862869d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:26:03 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-9e914c80-c47f-49f7-8cb9-e1671322bb1a tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 04:26:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b96b020-e675-4c05-8a3f-436dd862869d -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:26:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b96b020-e675-4c05-8a3f-436dd862869d -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:26:03 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[94be376e-688d-4dac-b638-93e873f606b7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:26:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e914c80-c47f-49f7-8cb9-e1671322bb1a tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 04:26:03 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:26:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b96b020-e675-4c05-8a3f-436dd862869d -p 172.16.0.220:3260 --interface default --op new {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:26:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b96b020-e675-4c05-8a3f-436dd862869d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:26:03 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b6dc04-439c-47ba-88e8-a02672dbc85a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b96b020-e675-4c05-8a3f-436dd862869d] added\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:26:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e914c80-c47f-49f7-8cb9-e1671322bb1a tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b96b020-e675-4c05-8a3f-436dd862869d] added
Nov 16 04:26:03 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:26:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b96b020-e675-4c05-8a3f-436dd862869d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:26:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b96b020-e675-4c05-8a3f-436dd862869d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:26:03 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d9e575-bfe7-4152-9904-a7bdb435c067]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:26:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e914c80-c47f-49f7-8cb9-e1671322bb1a tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:26:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b96b020-e675-4c05-8a3f-436dd862869d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:26:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b96b020-e675-4c05-8a3f-436dd862869d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:26:03 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a74ae3c-0182-469d-825b-f554e87b1f06]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:26:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e914c80-c47f-49f7-8cb9-e1671322bb1a tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:26:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b96b020-e675-4c05-8a3f-436dd862869d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TgwbMVOm {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:26:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b96b020-e675-4c05-8a3f-436dd862869d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TgwbMVOm" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:26:03 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c17890-e476-4218-ac4f-744645d56ec6]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:26:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e914c80-c47f-49f7-8cb9-e1671322bb1a tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TgwbMVOm'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:26:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b96b020-e675-4c05-8a3f-436dd862869d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:26:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b96b020-e675-4c05-8a3f-436dd862869d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:26:03 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[6445510a-3bec-4170-ae40-e4e95af5b26f]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:26:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e914c80-c47f-49f7-8cb9-e1671322bb1a tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:26:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:26:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:26:03 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[76278aec-95aa-4fc4-981c-7a435d62de1d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:26:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e914c80-c47f-49f7-8cb9-e1671322bb1a tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 04:26:03 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:26:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e914c80-c47f-49f7-8cb9-e1671322bb1a tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 04:26:03 user nova-compute[103546]:  {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:26:03 user nova-compute[103546]: WARNING os_brick.initiator.connectors.iscsi [None req-9e914c80-c47f-49f7-8cb9-e1671322bb1a tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 04:26:03 user nova-compute[103546]: 
Nov 16 04:26:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b96b020-e675-4c05-8a3f-436dd862869d -p 172.16.0.220:3260 --login {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:26:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b96b020-e675-4c05-8a3f-436dd862869d -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:26:03 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[357ef089-047d-44b0-9f6f-7cc37b1b5188]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b96b020-e675-4c05-8a3f-436dd862869d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2b96b020-e675-4c05-8a3f-436dd862869d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:26:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e914c80-c47f-49f7-8cb9-e1671322bb1a tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b96b020-e675-4c05-8a3f-436dd862869d, portal: 172.16.0.220,3260]
Nov 16 04:26:03 user nova-compute[103546]: Login to [iface: default, target: iqn.2010-10.org.openstack:2b96b020-e675-4c05-8a3f-436dd862869d, portal: 172.16.0.220,3260] successful.
Nov 16 04:26:03 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:26:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b96b020-e675-4c05-8a3f-436dd862869d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:26:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b96b020-e675-4c05-8a3f-436dd862869d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:26:03 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce84d689-92f6-47ae-907c-ae8c53044b93]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:26:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e914c80-c47f-49f7-8cb9-e1671322bb1a tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:26:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:26:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:26:03 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f034027a-6c4e-4edb-a467-f92927114607]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b96b020-e675-4c05-8a3f-436dd862869d (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:26:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e914c80-c47f-49f7-8cb9-e1671322bb1a tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b96b020-e675-4c05-8a3f-436dd862869d (non-flash)
Nov 16 04:26:03 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:26:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e914c80-c47f-49f7-8cb9-e1671322bb1a tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b96b020-e675-4c05-8a3f-436dd862869d (non-flash)
Nov 16 04:26:03 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:26:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-9e914c80-c47f-49f7-8cb9-e1671322bb1a tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b96b020-e675-4c05-8a3f-436dd862869d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.238s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:26:03 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e914c80-c47f-49f7-8cb9-e1671322bb1a tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 04:26:03 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-9e914c80-c47f-49f7-8cb9-e1671322bb1a tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 04:26:03 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-9e914c80-c47f-49f7-8cb9-e1671322bb1a tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 04:26:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:26:03 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:26:03 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[2274e0ef-cbf6-464f-a71c-193de848502c]: (4, ('- - 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:26:03 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-9e914c80-c47f-49f7-8cb9-e1671322bb1a tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: None {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 04:26:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:26:04 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-9e914c80-c47f-49f7-8cb9-e1671322bb1a tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 04:26:04 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e914c80-c47f-49f7-8cb9-e1671322bb1a tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2b96b020-e675-4c05-8a3f-436dd862869d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TgwbMVOm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 04:26:04 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-9e914c80-c47f-49f7-8cb9-e1671322bb1a tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.266s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:26:04 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e914c80-c47f-49f7-8cb9-e1671322bb1a tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] <== connect_volume: return (1268ms) {'type': 'block', 'scsi_wwn': '23761393666656235', 'path': '/dev/sdb'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:26:04 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e914c80-c47f-49f7-8cb9-e1671322bb1a tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23761393666656235', 'path': '/dev/sdb'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 04:26:04 user nova-compute[103546]: DEBUG nova.objects.instance [None req-9e914c80-c47f-49f7-8cb9-e1671322bb1a tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lazy-loading 'flavor' on Instance uuid 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:26:04 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-9e914c80-c47f-49f7-8cb9-e1671322bb1a tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 04:26:04 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:26:04 user nova-compute[103546]:   <source dev="/dev/sdb"/>
Nov 16 04:26:04 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 04:26:04 user nova-compute[103546]:   <serial>2b96b020-e675-4c05-8a3f-436dd862869d</serial>
Nov 16 04:26:04 user nova-compute[103546]: </disk>
Nov 16 04:26:04 user nova-compute[103546]:  {{(pid=103546) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 04:26:05 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-9e914c80-c47f-49f7-8cb9-e1671322bb1a tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:26:05 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-9e914c80-c47f-49f7-8cb9-e1671322bb1a tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] No BDM found with device name vdb, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:26:05 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-9e914c80-c47f-49f7-8cb9-e1671322bb1a tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] No VIF found with MAC fa:16:3e:97:d2:8b, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 04:26:05 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-9e914c80-c47f-49f7-8cb9-e1671322bb1a tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.734s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:26:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:26:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f773ac17-d4c7-49e9-a534-09f37bb138a0 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Acquiring lock "8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:26:07 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f773ac17-d4c7-49e9-a534-09f37bb138a0 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:26:07 user nova-compute[103546]: INFO nova.compute.manager [None req-f773ac17-d4c7-49e9-a534-09f37bb138a0 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Detaching volume 2b96b020-e675-4c05-8a3f-436dd862869d
Nov 16 04:26:07 user nova-compute[103546]: INFO nova.virt.block_device [None req-f773ac17-d4c7-49e9-a534-09f37bb138a0 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Attempting to driver detach volume 2b96b020-e675-4c05-8a3f-436dd862869d from mountpoint /dev/vdb
Nov 16 04:26:07 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-f773ac17-d4c7-49e9-a534-09f37bb138a0 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Attempting to detach device vdb from instance 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907 from the persistent domain config. {{(pid=103546) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 04:26:07 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-f773ac17-d4c7-49e9-a534-09f37bb138a0 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 04:26:07 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:26:07 user nova-compute[103546]:   <source dev="/dev/sdb"/>
Nov 16 04:26:07 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 04:26:07 user nova-compute[103546]:   <serial>2b96b020-e675-4c05-8a3f-436dd862869d</serial>
Nov 16 04:26:07 user nova-compute[103546]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 04:26:07 user nova-compute[103546]: </disk>
Nov 16 04:26:07 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 04:26:07 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-f773ac17-d4c7-49e9-a534-09f37bb138a0 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Successfully detached device vdb from instance 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907 from the persistent domain config.
Nov 16 04:26:07 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-f773ac17-d4c7-49e9-a534-09f37bb138a0 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907 from the live domain config. {{(pid=103546) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 04:26:07 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-f773ac17-d4c7-49e9-a534-09f37bb138a0 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 04:26:07 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:26:07 user nova-compute[103546]:   <source dev="/dev/sdb"/>
Nov 16 04:26:07 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 04:26:07 user nova-compute[103546]:   <serial>2b96b020-e675-4c05-8a3f-436dd862869d</serial>
Nov 16 04:26:07 user nova-compute[103546]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 04:26:07 user nova-compute[103546]: </disk>
Nov 16 04:26:07 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 04:26:08 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-f773ac17-d4c7-49e9-a534-09f37bb138a0 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907 {{(pid=103546) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 04:26:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:26:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:26:17 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:26:17 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:26:17 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=103546) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 04:26:17 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:26:17 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:26:17 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:26:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:26:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:26:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=103546) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 04:26:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:26:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:26:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:26:27 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:26:27 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:26:27 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=103546) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 04:26:27 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:26:27 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:26:27 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:26:28 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-f773ac17-d4c7-49e9-a534-09f37bb138a0 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907 is timed out.
Nov 16 04:26:28 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-f773ac17-d4c7-49e9-a534-09f37bb138a0 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Successfully detached device vdb from instance 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907 from the live domain config.
Nov 16 04:26:28 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f773ac17-d4c7-49e9-a534-09f37bb138a0 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 04:26:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f773ac17-d4c7-49e9-a534-09f37bb138a0 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:2b96b020-e675-4c05-8a3f-436dd862869d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TgwbMVOm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:26:28 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-f773ac17-d4c7-49e9-a534-09f37bb138a0 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:26:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-f773ac17-d4c7-49e9-a534-09f37bb138a0 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:26:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-f773ac17-d4c7-49e9-a534-09f37bb138a0 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:26:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:26:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:26:28 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[89eaf4fe-f8f5-41cb-a12a-bc7eec226cca]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2b96b020-e675-4c05-8a3f-436dd862869d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:26:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f773ac17-d4c7-49e9-a534-09f37bb138a0 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 04:26:28 user nova-compute[103546]: No targets found.
Nov 16 04:26:28 user nova-compute[103546]: iSNS:
Nov 16 04:26:28 user nova-compute[103546]: No targets found.
Nov 16 04:26:28 user nova-compute[103546]: STATIC:
Nov 16 04:26:28 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:2b96b020-e675-4c05-8a3f-436dd862869d
Nov 16 04:26:28 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:26:28 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:26:28 user nova-compute[103546]: FIRMWARE:
Nov 16 04:26:28 user nova-compute[103546]: No targets found.
Nov 16 04:26:28 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:26:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f773ac17-d4c7-49e9-a534-09f37bb138a0 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 04:26:28 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 04:26:28 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 04:26:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f773ac17-d4c7-49e9-a534-09f37bb138a0 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b96b020-e675-4c05-8a3f-436dd862869d', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 04:26:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:26:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:26:28 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5f6526-9d16-4192-ad3c-17260656c512]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b96b020-e675-4c05-8a3f-436dd862869d\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:26:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:26:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:26:28 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe79bedd-2b2f-479a-b6ef-d0e0886d036e]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b96b020-e675-4c05-8a3f-436dd862869d (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:26:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f773ac17-d4c7-49e9-a534-09f37bb138a0 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b96b020-e675-4c05-8a3f-436dd862869d (non-flash)
Nov 16 04:26:28 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:26:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f773ac17-d4c7-49e9-a534-09f37bb138a0 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b96b020-e675-4c05-8a3f-436dd862869d (non-flash)
Nov 16 04:26:28 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:26:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f773ac17-d4c7-49e9-a534-09f37bb138a0 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60ac61aef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b96b020-e675-4c05-8a3f-436dd862869d'): ({'sdb'}, set())}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 04:26:28 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-f773ac17-d4c7-49e9-a534-09f37bb138a0 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Removing single pathed devices sdb {{(pid=103546) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 04:26:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:26:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:26:28 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dfe51e4-59b9-4535-91b4-df51363026d8]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:26:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:26:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:26:28 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2191a5-ae3d-40e4-8df5-113d779c8fc3]: (4, ('ok\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:26:28 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-f773ac17-d4c7-49e9-a534-09f37bb138a0 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Flushing IO for device /dev/sdb {{(pid=103546) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 04:26:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:26:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:26:28 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[24df955c-dc81-496b-b592-6eb205d4987d]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:26:28 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-f773ac17-d4c7-49e9-a534-09f37bb138a0 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=103546) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 04:26:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:26:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:26:28 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96fdc59-e9c0-4bcc-b686-fb5f46e73363]: (4, ('1', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:26:28 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-f773ac17-d4c7-49e9-a534-09f37bb138a0 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 04:26:28 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-f773ac17-d4c7-49e9-a534-09f37bb138a0 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] SCSI volumes sdb have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 04:26:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f773ac17-d4c7-49e9-a534-09f37bb138a0 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b96b020-e675-4c05-8a3f-436dd862869d')] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 04:26:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b96b020-e675-4c05-8a3f-436dd862869d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:26:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b96b020-e675-4c05-8a3f-436dd862869d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:26:28 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c893ce5-94f0-4883-b464-73a3c52cc480]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:26:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f773ac17-d4c7-49e9-a534-09f37bb138a0 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:26:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b96b020-e675-4c05-8a3f-436dd862869d -p 172.16.0.220:3260 --logout {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:26:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b96b020-e675-4c05-8a3f-436dd862869d -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:26:28 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec24541b-e4e9-4a23-900a-27637d94e004]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:2b96b020-e675-4c05-8a3f-436dd862869d, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:2b96b020-e675-4c05-8a3f-436dd862869d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:26:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f773ac17-d4c7-49e9-a534-09f37bb138a0 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:2b96b020-e675-4c05-8a3f-436dd862869d, portal: 172.16.0.220,3260]
Nov 16 04:26:28 user nova-compute[103546]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:2b96b020-e675-4c05-8a3f-436dd862869d, portal: 172.16.0.220,3260] successful.
Nov 16 04:26:28 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:26:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b96b020-e675-4c05-8a3f-436dd862869d -p 172.16.0.220:3260 --op delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:26:28 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b96b020-e675-4c05-8a3f-436dd862869d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:26:28 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c8ca15-0864-42bb-ada2-fd64ecea0ca7]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:26:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f773ac17-d4c7-49e9-a534-09f37bb138a0 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:26:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-f773ac17-d4c7-49e9-a534-09f37bb138a0 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:26:28 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f773ac17-d4c7-49e9-a534-09f37bb138a0 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] <== disconnect_volume: return (306ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:26:28 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f773ac17-d4c7-49e9-a534-09f37bb138a0 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 04:26:29 user nova-compute[103546]: DEBUG nova.objects.instance [None req-f773ac17-d4c7-49e9-a534-09f37bb138a0 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lazy-loading 'flavor' on Instance uuid 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:26:29 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f773ac17-d4c7-49e9-a534-09f37bb138a0 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.676s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:26:32 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:26:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:26:38 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager.update_available_resource {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:26:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:26:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:26:38 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:26:38 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Auditing locally available compute resources for user (node: user) {{(pid=103546) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 04:26:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c331c2c-90a3-4f5e-8b9a-40dbb19e0907/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:26:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c331c2c-90a3-4f5e-8b9a-40dbb19e0907/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:26:38 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c331c2c-90a3-4f5e-8b9a-40dbb19e0907/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:26:39 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c331c2c-90a3-4f5e-8b9a-40dbb19e0907/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:26:39 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:26:39 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:26:39 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Hypervisor/Node resource view: name=user free_ram=9031MB free_disk=25.030536651611328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=103546) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 04:26:39 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:26:39 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:26:39 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:26:39 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 04:26:39 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 04:26:39 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:26:39 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:26:39 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Compute_service record updated for user:user {{(pid=103546) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 04:26:39 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.166s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:26:42 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:26:44 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:26:45 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:26:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:26:47 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:26:48 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:26:48 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:26:48 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=103546) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 04:26:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:26:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:26:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=103546) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 04:26:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:26:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:26:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:26:52 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:26:52 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:26:55 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:26:56 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:26:56 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Starting heal instance info cache {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 04:26:56 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Rebuilding the list of instances to heal {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 04:26:56 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "refresh_cache-8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:26:56 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquired lock "refresh_cache-8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:26:56 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Forcefully refreshing network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 04:26:56 user nova-compute[103546]: DEBUG nova.objects.instance [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lazy-loading 'info_cache' on Instance uuid 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:26:57 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Updating instance_info_cache with network_info: [{"id": "390d2610-ed90-40db-84e7-00104ff08d0c", "address": "fa:16:3e:97:d2:8b", "network": {"id": "ea7af6ae-5b5f-413e-8d3f-40a597d9e4c4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-156065771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12cb3bcaf4264c31bb5c65516f5632a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390d2610-ed", "ovs_interfaceid": "390d2610-ed90-40db-84e7-00104ff08d0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:26:57 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Releasing lock "refresh_cache-8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:26:57 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Updated the network info_cache for instance {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 04:26:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:26:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:26:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=103546) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 04:26:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:26:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:26:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:26:59 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:26:59 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f35012c0-1840-4962-b3ce-cff6b94208c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Acquiring lock "8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:26:59 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f35012c0-1840-4962-b3ce-cff6b94208c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:26:59 user nova-compute[103546]: DEBUG nova.objects.instance [None req-f35012c0-1840-4962-b3ce-cff6b94208c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lazy-loading 'flavor' on Instance uuid 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:26:59 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f35012c0-1840-4962-b3ce-cff6b94208c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:26:59 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f35012c0-1840-4962-b3ce-cff6b94208c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Acquiring lock "8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:26:59 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f35012c0-1840-4962-b3ce-cff6b94208c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:26:59 user nova-compute[103546]: INFO nova.compute.manager [None req-f35012c0-1840-4962-b3ce-cff6b94208c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Attaching volume 72d277f3-85f8-45f0-b775-70d86161c7a0 to /dev/vdb
Nov 16 04:26:59 user nova-compute[103546]: DEBUG os_brick.utils [None req-f35012c0-1840-4962-b3ce-cff6b94208c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:26:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:26:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:26:59 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[63375194-e6d2-42fc-9132-cf9a8d1bd1f4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af5c39b14ece\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:26:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:26:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:26:59 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[275e3fb7-7cff-4102-9056-38786a67e9f6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:26:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:26:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:26:59 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a369837-7878-4924-a0d5-0924c7ea427d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:26:59 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[566bdcb1-3d3b-46e3-87b1-e197fbc16695]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:26:59 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-f35012c0-1840-4962-b3ce-cff6b94208c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Running cmd (subprocess): nvme version {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:27:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-f35012c0-1840-4962-b3ce-cff6b94208c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] 'nvme version' failed. Not Retrying. {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 04:27:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f35012c0-1840-4962-b3ce-cff6b94208c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] nvme not present on system {{(pid=103546) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 04:27:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:27:00 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 04:27:00 user nova-compute[103546]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 04:27:00 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[894e4cae-dac2-41a8-bcdc-e9396353f57c]: (4, '') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:27:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-f35012c0-1840-4962-b3ce-cff6b94208c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=103546) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 04:27:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-f35012c0-1840-4962-b3ce-cff6b94208c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 04:27:00 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-f35012c0-1840-4962-b3ce-cff6b94208c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] LIGHTOS: no hostnqn found. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 04:27:00 user nova-compute[103546]: DEBUG os_brick.utils [None req-f35012c0-1840-4962-b3ce-cff6b94208c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af5c39b14ece', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:27:00 user nova-compute[103546]: DEBUG nova.virt.block_device [None req-f35012c0-1840-4962-b3ce-cff6b94208c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Updating existing volume attachment record: ace7663f-b043-4df2-a223-a3d06de8f71e {{(pid=103546) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 04:27:02 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:27:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:27:04 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f35012c0-1840-4962-b3ce-cff6b94208c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 04:27:04 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35012c0-1840-4962-b3ce-cff6b94208c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:72d277f3-85f8-45f0-b775-70d86161c7a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IKqRNLci', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:27:04 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-f35012c0-1840-4962-b3ce-cff6b94208c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:27:04 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-f35012c0-1840-4962-b3ce-cff6b94208c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:27:04 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-f35012c0-1840-4962-b3ce-cff6b94208c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:27:04 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-f35012c0-1840-4962-b3ce-cff6b94208c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:27:04 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-f35012c0-1840-4962-b3ce-cff6b94208c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72d277f3-85f8-45f0-b775-70d86161c7a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:27:04 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-f35012c0-1840-4962-b3ce-cff6b94208c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72d277f3-85f8-45f0-b775-70d86161c7a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:27:04 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-f35012c0-1840-4962-b3ce-cff6b94208c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 04:27:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d277f3-85f8-45f0-b775-70d86161c7a0 -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:27:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d277f3-85f8-45f0-b775-70d86161c7a0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:27:04 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f9e053-bd9a-43cb-81ce-b709e78c2d9f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:27:04 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35012c0-1840-4962-b3ce-cff6b94208c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 04:27:04 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:27:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d277f3-85f8-45f0-b775-70d86161c7a0 -p 172.16.0.220:3260 --interface default --op new {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:27:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d277f3-85f8-45f0-b775-70d86161c7a0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:27:04 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[735d5dff-3714-4205-a28e-7ae19b6698cc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72d277f3-85f8-45f0-b775-70d86161c7a0] added\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:27:04 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35012c0-1840-4962-b3ce-cff6b94208c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72d277f3-85f8-45f0-b775-70d86161c7a0] added
Nov 16 04:27:04 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:27:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d277f3-85f8-45f0-b775-70d86161c7a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:27:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d277f3-85f8-45f0-b775-70d86161c7a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:27:04 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[80916397-fdf3-4049-9d96-eeeb3c321c78]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:27:04 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35012c0-1840-4962-b3ce-cff6b94208c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:27:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d277f3-85f8-45f0-b775-70d86161c7a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:27:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d277f3-85f8-45f0-b775-70d86161c7a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:27:04 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b285b7-b6dd-493e-a981-1822abc14a5b]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:27:04 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35012c0-1840-4962-b3ce-cff6b94208c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:27:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d277f3-85f8-45f0-b775-70d86161c7a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IKqRNLci {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:27:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d277f3-85f8-45f0-b775-70d86161c7a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IKqRNLci" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:27:04 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9768b7b-b3b8-4201-ad0b-9d1c2a9d0826]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:27:04 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35012c0-1840-4962-b3ce-cff6b94208c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IKqRNLci'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:27:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d277f3-85f8-45f0-b775-70d86161c7a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:27:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d277f3-85f8-45f0-b775-70d86161c7a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:27:04 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9eb5ea0-fe15-4c55-b562-58b3b68cd447]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:27:04 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35012c0-1840-4962-b3ce-cff6b94208c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:27:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:27:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:27:04 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[19bb413d-0225-4015-bf67-d2aaee891858]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:27:04 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35012c0-1840-4962-b3ce-cff6b94208c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 04:27:04 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:27:04 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35012c0-1840-4962-b3ce-cff6b94208c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 04:27:04 user nova-compute[103546]:  {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:27:04 user nova-compute[103546]: WARNING os_brick.initiator.connectors.iscsi [None req-f35012c0-1840-4962-b3ce-cff6b94208c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 04:27:04 user nova-compute[103546]: 
Nov 16 04:27:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d277f3-85f8-45f0-b775-70d86161c7a0 -p 172.16.0.220:3260 --login {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:27:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d277f3-85f8-45f0-b775-70d86161c7a0 -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:27:04 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d8b963-e748-42ad-b45a-e8443b972daf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:72d277f3-85f8-45f0-b775-70d86161c7a0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:72d277f3-85f8-45f0-b775-70d86161c7a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:27:04 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35012c0-1840-4962-b3ce-cff6b94208c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:72d277f3-85f8-45f0-b775-70d86161c7a0, portal: 172.16.0.220,3260]
Nov 16 04:27:04 user nova-compute[103546]: Login to [iface: default, target: iqn.2010-10.org.openstack:72d277f3-85f8-45f0-b775-70d86161c7a0, portal: 172.16.0.220,3260] successful.
Nov 16 04:27:04 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:27:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d277f3-85f8-45f0-b775-70d86161c7a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:27:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d277f3-85f8-45f0-b775-70d86161c7a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:27:04 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87e5727-0679-4365-a359-245b9e561de4]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:27:04 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35012c0-1840-4962-b3ce-cff6b94208c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:27:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:27:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:27:04 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[555e11db-f566-425c-b86d-12214d32d230]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d277f3-85f8-45f0-b775-70d86161c7a0 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:27:04 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35012c0-1840-4962-b3ce-cff6b94208c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d277f3-85f8-45f0-b775-70d86161c7a0 (non-flash)
Nov 16 04:27:04 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:27:04 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35012c0-1840-4962-b3ce-cff6b94208c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d277f3-85f8-45f0-b775-70d86161c7a0 (non-flash)
Nov 16 04:27:04 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:27:04 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-f35012c0-1840-4962-b3ce-cff6b94208c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72d277f3-85f8-45f0-b775-70d86161c7a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.235s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:27:04 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35012c0-1840-4962-b3ce-cff6b94208c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 04:27:04 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-f35012c0-1840-4962-b3ce-cff6b94208c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 04:27:04 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-f35012c0-1840-4962-b3ce-cff6b94208c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 04:27:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:27:04 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:27:04 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb0e4cd-3a72-470c-a352-825696ae5a80]: (4, ('- - 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:27:04 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-f35012c0-1840-4962-b3ce-cff6b94208c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 04:27:04 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35012c0-1840-4962-b3ce-cff6b94208c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:72d277f3-85f8-45f0-b775-70d86161c7a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IKqRNLci', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 04:27:05 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-f35012c0-1840-4962-b3ce-cff6b94208c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.267s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:27:05 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35012c0-1840-4962-b3ce-cff6b94208c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] <== connect_volume: return (1270ms) {'type': 'block', 'scsi_wwn': '23832326330336138', 'path': '/dev/sdb'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:27:05 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f35012c0-1840-4962-b3ce-cff6b94208c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23832326330336138', 'path': '/dev/sdb'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 04:27:05 user nova-compute[103546]: DEBUG nova.objects.instance [None req-f35012c0-1840-4962-b3ce-cff6b94208c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lazy-loading 'flavor' on Instance uuid 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:27:05 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-f35012c0-1840-4962-b3ce-cff6b94208c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 04:27:05 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:27:05 user nova-compute[103546]:   <source dev="/dev/sdb"/>
Nov 16 04:27:05 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 04:27:05 user nova-compute[103546]:   <serial>72d277f3-85f8-45f0-b775-70d86161c7a0</serial>
Nov 16 04:27:05 user nova-compute[103546]: </disk>
Nov 16 04:27:05 user nova-compute[103546]:  {{(pid=103546) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 04:27:06 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-f35012c0-1840-4962-b3ce-cff6b94208c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:27:06 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-f35012c0-1840-4962-b3ce-cff6b94208c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] No BDM found with device name vdb, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:27:06 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-f35012c0-1840-4962-b3ce-cff6b94208c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] No VIF found with MAC fa:16:3e:97:d2:8b, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 04:27:06 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-f35012c0-1840-4962-b3ce-cff6b94208c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.535s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:27:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:27:08 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b003e5fd-cdb3-465a-9a76-b4d97e95b5f2 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Acquiring lock "8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:27:08 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b003e5fd-cdb3-465a-9a76-b4d97e95b5f2 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:27:08 user nova-compute[103546]: INFO nova.compute.manager [None req-b003e5fd-cdb3-465a-9a76-b4d97e95b5f2 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Detaching volume 72d277f3-85f8-45f0-b775-70d86161c7a0
Nov 16 04:27:09 user nova-compute[103546]: INFO nova.virt.block_device [None req-b003e5fd-cdb3-465a-9a76-b4d97e95b5f2 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Attempting to driver detach volume 72d277f3-85f8-45f0-b775-70d86161c7a0 from mountpoint /dev/vdb
Nov 16 04:27:09 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-b003e5fd-cdb3-465a-9a76-b4d97e95b5f2 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Attempting to detach device vdb from instance 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907 from the persistent domain config. {{(pid=103546) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 04:27:09 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-b003e5fd-cdb3-465a-9a76-b4d97e95b5f2 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 04:27:09 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:27:09 user nova-compute[103546]:   <source dev="/dev/sdb"/>
Nov 16 04:27:09 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 04:27:09 user nova-compute[103546]:   <serial>72d277f3-85f8-45f0-b775-70d86161c7a0</serial>
Nov 16 04:27:09 user nova-compute[103546]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 04:27:09 user nova-compute[103546]: </disk>
Nov 16 04:27:09 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 04:27:09 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-b003e5fd-cdb3-465a-9a76-b4d97e95b5f2 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Successfully detached device vdb from instance 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907 from the persistent domain config.
Nov 16 04:27:09 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-b003e5fd-cdb3-465a-9a76-b4d97e95b5f2 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907 from the live domain config. {{(pid=103546) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 04:27:09 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-b003e5fd-cdb3-465a-9a76-b4d97e95b5f2 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 04:27:09 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:27:09 user nova-compute[103546]:   <source dev="/dev/sdb"/>
Nov 16 04:27:09 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 04:27:09 user nova-compute[103546]:   <serial>72d277f3-85f8-45f0-b775-70d86161c7a0</serial>
Nov 16 04:27:09 user nova-compute[103546]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 04:27:09 user nova-compute[103546]: </disk>
Nov 16 04:27:09 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 04:27:09 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-b003e5fd-cdb3-465a-9a76-b4d97e95b5f2 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907 {{(pid=103546) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 04:27:09 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:27:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:27:17 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:27:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:27:27 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:27:27 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:27:27 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=103546) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 04:27:27 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:27:27 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:27:27 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:27:29 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-b003e5fd-cdb3-465a-9a76-b4d97e95b5f2 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907 is timed out.
Nov 16 04:27:29 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-b003e5fd-cdb3-465a-9a76-b4d97e95b5f2 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Successfully detached device vdb from instance 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907 from the live domain config.
Nov 16 04:27:29 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b003e5fd-cdb3-465a-9a76-b4d97e95b5f2 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 04:27:29 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b003e5fd-cdb3-465a-9a76-b4d97e95b5f2 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:72d277f3-85f8-45f0-b775-70d86161c7a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IKqRNLci', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:27:29 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-b003e5fd-cdb3-465a-9a76-b4d97e95b5f2 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:27:29 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-b003e5fd-cdb3-465a-9a76-b4d97e95b5f2 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:27:29 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-b003e5fd-cdb3-465a-9a76-b4d97e95b5f2 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:27:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:27:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:27:29 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20768cc-3ea4-44a9-bc1e-44f4e09abdb3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:72d277f3-85f8-45f0-b775-70d86161c7a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:27:29 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b003e5fd-cdb3-465a-9a76-b4d97e95b5f2 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 04:27:29 user nova-compute[103546]: No targets found.
Nov 16 04:27:29 user nova-compute[103546]: iSNS:
Nov 16 04:27:29 user nova-compute[103546]: No targets found.
Nov 16 04:27:29 user nova-compute[103546]: STATIC:
Nov 16 04:27:29 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:72d277f3-85f8-45f0-b775-70d86161c7a0
Nov 16 04:27:29 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:27:29 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:27:29 user nova-compute[103546]: FIRMWARE:
Nov 16 04:27:29 user nova-compute[103546]: No targets found.
Nov 16 04:27:29 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:27:29 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b003e5fd-cdb3-465a-9a76-b4d97e95b5f2 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 04:27:29 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 04:27:29 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 04:27:29 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b003e5fd-cdb3-465a-9a76-b4d97e95b5f2 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72d277f3-85f8-45f0-b775-70d86161c7a0', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 04:27:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:27:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:27:29 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[73989ab1-7441-4efc-a1ca-caae517755cd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72d277f3-85f8-45f0-b775-70d86161c7a0\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:27:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:27:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:27:29 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e6209f-3127-4138-a043-de7092104efa]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d277f3-85f8-45f0-b775-70d86161c7a0 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:27:29 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b003e5fd-cdb3-465a-9a76-b4d97e95b5f2 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d277f3-85f8-45f0-b775-70d86161c7a0 (non-flash)
Nov 16 04:27:29 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:27:29 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b003e5fd-cdb3-465a-9a76-b4d97e95b5f2 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d277f3-85f8-45f0-b775-70d86161c7a0 (non-flash)
Nov 16 04:27:29 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:27:29 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b003e5fd-cdb3-465a-9a76-b4d97e95b5f2 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60cffdf490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72d277f3-85f8-45f0-b775-70d86161c7a0'): ({'sdb'}, set())}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 04:27:29 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-b003e5fd-cdb3-465a-9a76-b4d97e95b5f2 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Removing single pathed devices sdb {{(pid=103546) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 04:27:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:27:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:27:29 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[6971e000-85d7-430f-b9ee-928b747b2cfb]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:27:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:27:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:27:29 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bba7690-6286-4be4-ae40-4bb20f241da7]: (4, ('ok\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:27:29 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-b003e5fd-cdb3-465a-9a76-b4d97e95b5f2 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Flushing IO for device /dev/sdb {{(pid=103546) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 04:27:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:27:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:27:29 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac339d2-9732-47a3-8ca9-7ec785d9ed23]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:27:29 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-b003e5fd-cdb3-465a-9a76-b4d97e95b5f2 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=103546) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 04:27:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:27:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:27:29 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e205596d-3ccd-4c4b-902a-37333c2127e4]: (4, ('1', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:27:29 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-b003e5fd-cdb3-465a-9a76-b4d97e95b5f2 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 04:27:29 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-b003e5fd-cdb3-465a-9a76-b4d97e95b5f2 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] SCSI volumes sdb have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 04:27:29 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b003e5fd-cdb3-465a-9a76-b4d97e95b5f2 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72d277f3-85f8-45f0-b775-70d86161c7a0')] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 04:27:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d277f3-85f8-45f0-b775-70d86161c7a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:27:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d277f3-85f8-45f0-b775-70d86161c7a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:27:29 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[af634e29-2ca6-44df-b9d0-57f8982f4d90]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:27:29 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b003e5fd-cdb3-465a-9a76-b4d97e95b5f2 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:27:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d277f3-85f8-45f0-b775-70d86161c7a0 -p 172.16.0.220:3260 --logout {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:27:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d277f3-85f8-45f0-b775-70d86161c7a0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:27:29 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[590c4a70-35f8-4d98-a636-5db09e8b757c]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:72d277f3-85f8-45f0-b775-70d86161c7a0, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:72d277f3-85f8-45f0-b775-70d86161c7a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:27:29 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b003e5fd-cdb3-465a-9a76-b4d97e95b5f2 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:72d277f3-85f8-45f0-b775-70d86161c7a0, portal: 172.16.0.220,3260]
Nov 16 04:27:29 user nova-compute[103546]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:72d277f3-85f8-45f0-b775-70d86161c7a0, portal: 172.16.0.220,3260] successful.
Nov 16 04:27:29 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:27:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d277f3-85f8-45f0-b775-70d86161c7a0 -p 172.16.0.220:3260 --op delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:27:29 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d277f3-85f8-45f0-b775-70d86161c7a0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:27:29 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f6e4b2-8143-43a6-85eb-f498fb771215]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:27:29 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b003e5fd-cdb3-465a-9a76-b4d97e95b5f2 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:27:29 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-b003e5fd-cdb3-465a-9a76-b4d97e95b5f2 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:27:29 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-b003e5fd-cdb3-465a-9a76-b4d97e95b5f2 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] <== disconnect_volume: return (285ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:27:29 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b003e5fd-cdb3-465a-9a76-b4d97e95b5f2 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 04:27:30 user nova-compute[103546]: DEBUG nova.objects.instance [None req-b003e5fd-cdb3-465a-9a76-b4d97e95b5f2 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lazy-loading 'flavor' on Instance uuid 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:27:30 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-b003e5fd-cdb3-465a-9a76-b4d97e95b5f2 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.754s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:27:32 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:27:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:27:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:27:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=103546) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 04:27:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:27:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:27:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:27:40 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager.update_available_resource {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:27:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:27:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:27:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:27:40 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Auditing locally available compute resources for user (node: user) {{(pid=103546) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 04:27:40 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c331c2c-90a3-4f5e-8b9a-40dbb19e0907/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:27:40 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c331c2c-90a3-4f5e-8b9a-40dbb19e0907/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:27:40 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c331c2c-90a3-4f5e-8b9a-40dbb19e0907/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:27:41 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c331c2c-90a3-4f5e-8b9a-40dbb19e0907/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:27:41 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:27:41 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:27:41 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Hypervisor/Node resource view: name=user free_ram=9027MB free_disk=25.029560089111328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=103546) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 04:27:41 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:27:41 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:27:41 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:27:41 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 04:27:41 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 04:27:41 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Refreshing inventories for resource provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 04:27:41 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Updating ProviderTree inventory for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 04:27:41 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Updating inventory in ProviderTree for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 04:27:41 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Refreshing aggregate associations for resource provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a, aggregates: None {{(pid=103546) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 04:27:41 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Refreshing trait associations for resource provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=103546) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 04:27:42 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:27:42 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:27:42 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Compute_service record updated for user:user {{(pid=103546) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 04:27:42 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.513s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:27:42 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:27:45 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:27:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:27:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:27:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=103546) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 04:27:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:27:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:27:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:27:47 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:27:47 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:27:48 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:27:49 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:27:49 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=103546) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 04:27:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:27:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:27:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=103546) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 04:27:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:27:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:27:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:27:52 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:27:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:27:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:27:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=103546) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 04:27:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:27:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:27:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:27:57 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:27:58 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:27:58 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Starting heal instance info cache {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 04:27:58 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Rebuilding the list of instances to heal {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 04:27:58 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "refresh_cache-8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:27:58 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquired lock "refresh_cache-8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:27:58 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Forcefully refreshing network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 04:27:58 user nova-compute[103546]: DEBUG nova.objects.instance [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lazy-loading 'info_cache' on Instance uuid 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:27:59 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Updating instance_info_cache with network_info: [{"id": "390d2610-ed90-40db-84e7-00104ff08d0c", "address": "fa:16:3e:97:d2:8b", "network": {"id": "ea7af6ae-5b5f-413e-8d3f-40a597d9e4c4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-156065771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12cb3bcaf4264c31bb5c65516f5632a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390d2610-ed", "ovs_interfaceid": "390d2610-ed90-40db-84e7-00104ff08d0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:27:59 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Releasing lock "refresh_cache-8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:27:59 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Updated the network info_cache for instance {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 04:27:59 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:27:59 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Cleaning up deleted instances {{(pid=103546) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 04:27:59 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] There are 0 instances to clean {{(pid=103546) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 04:28:01 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-ff5578eb-6ec7-4626-a835-a6a3a1e8b871 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Acquiring lock "8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:28:01 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-ff5578eb-6ec7-4626-a835-a6a3a1e8b871 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:28:01 user nova-compute[103546]: DEBUG nova.objects.instance [None req-ff5578eb-6ec7-4626-a835-a6a3a1e8b871 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lazy-loading 'flavor' on Instance uuid 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:28:01 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-ff5578eb-6ec7-4626-a835-a6a3a1e8b871 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:28:02 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-ff5578eb-6ec7-4626-a835-a6a3a1e8b871 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Acquiring lock "8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:28:02 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-ff5578eb-6ec7-4626-a835-a6a3a1e8b871 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:28:02 user nova-compute[103546]: INFO nova.compute.manager [None req-ff5578eb-6ec7-4626-a835-a6a3a1e8b871 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Attaching volume 70c30d1e-5d91-4e86-8342-a528d8f565a5 to /dev/vdb
Nov 16 04:28:02 user nova-compute[103546]: DEBUG os_brick.utils [None req-ff5578eb-6ec7-4626-a835-a6a3a1e8b871 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:28:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:28:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:28:02 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e9e01c-2d86-4f1f-a85a-22dc729ef005]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af5c39b14ece\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:28:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:28:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:28:02 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[12567f1e-3c77-4ab1-b7a4-a3f081aa061e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:28:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:28:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:28:02 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f565fad4-753c-4f74-af1b-a11617cf0bf9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:28:02 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[102f45ed-fec0-4e59-8d33-a1af909bd545]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:28:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-ff5578eb-6ec7-4626-a835-a6a3a1e8b871 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Running cmd (subprocess): nvme version {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:28:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-ff5578eb-6ec7-4626-a835-a6a3a1e8b871 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] 'nvme version' failed. Not Retrying. {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 04:28:02 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ff5578eb-6ec7-4626-a835-a6a3a1e8b871 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] nvme not present on system {{(pid=103546) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 04:28:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:28:02 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 04:28:02 user nova-compute[103546]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 04:28:02 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eeac966-0feb-47ec-b75d-4b396b70f42e]: (4, '') {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:28:02 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-ff5578eb-6ec7-4626-a835-a6a3a1e8b871 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=103546) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 04:28:02 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-ff5578eb-6ec7-4626-a835-a6a3a1e8b871 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 04:28:02 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.lightos [None req-ff5578eb-6ec7-4626-a835-a6a3a1e8b871 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] LIGHTOS: no hostnqn found. {{(pid=103546) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 04:28:02 user nova-compute[103546]: DEBUG os_brick.utils [None req-ff5578eb-6ec7-4626-a835-a6a3a1e8b871 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af5c39b14ece', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:28:02 user nova-compute[103546]: DEBUG nova.virt.block_device [None req-ff5578eb-6ec7-4626-a835-a6a3a1e8b871 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Updating existing volume attachment record: a28d09fb-2e98-48c9-a050-dfb2dd94e748 {{(pid=103546) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 04:28:02 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:28:02 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:28:02 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=103546) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 04:28:02 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:28:02 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:28:02 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:28:04 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:28:06 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff5578eb-6ec7-4626-a835-a6a3a1e8b871 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Calling os-brick to attach iSCSI Volume {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 04:28:06 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5578eb-6ec7-4626-a835-a6a3a1e8b871 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:70c30d1e-5d91-4e86-8342-a528d8f565a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IuqAHnhf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:28:06 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-ff5578eb-6ec7-4626-a835-a6a3a1e8b871 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:28:06 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-ff5578eb-6ec7-4626-a835-a6a3a1e8b871 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:28:06 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-ff5578eb-6ec7-4626-a835-a6a3a1e8b871 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:28:06 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-ff5578eb-6ec7-4626-a835-a6a3a1e8b871 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:28:06 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-ff5578eb-6ec7-4626-a835-a6a3a1e8b871 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70c30d1e-5d91-4e86-8342-a528d8f565a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:28:06 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-ff5578eb-6ec7-4626-a835-a6a3a1e8b871 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70c30d1e-5d91-4e86-8342-a528d8f565a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:28:06 user nova-compute[103546]: INFO os_brick.initiator.connectors.iscsi [None req-ff5578eb-6ec7-4626-a835-a6a3a1e8b871 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 04:28:06 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c30d1e-5d91-4e86-8342-a528d8f565a5 -p 172.16.0.220:3260 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:28:06 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c30d1e-5d91-4e86-8342-a528d8f565a5 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:28:06 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f553d0ea-6fec-4d2b-8eca-af975738571c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:28:06 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5578eb-6ec7-4626-a835-a6a3a1e8b871 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 04:28:06 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:28:06 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c30d1e-5d91-4e86-8342-a528d8f565a5 -p 172.16.0.220:3260 --interface default --op new {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:28:06 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c30d1e-5d91-4e86-8342-a528d8f565a5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:28:06 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[710ea94d-8d46-4841-a9f9-a6808bbb26b8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:70c30d1e-5d91-4e86-8342-a528d8f565a5] added\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:28:06 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5578eb-6ec7-4626-a835-a6a3a1e8b871 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:70c30d1e-5d91-4e86-8342-a528d8f565a5] added
Nov 16 04:28:06 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:28:06 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c30d1e-5d91-4e86-8342-a528d8f565a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:28:06 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c30d1e-5d91-4e86-8342-a528d8f565a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:28:06 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3837f9b0-0844-4cf3-bd8d-70f3ae8a7924]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:28:06 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5578eb-6ec7-4626-a835-a6a3a1e8b871 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:28:06 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c30d1e-5d91-4e86-8342-a528d8f565a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:28:06 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c30d1e-5d91-4e86-8342-a528d8f565a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:28:06 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3da8b3-1117-427e-9471-55b0c0fd22a1]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:28:06 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5578eb-6ec7-4626-a835-a6a3a1e8b871 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:28:06 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c30d1e-5d91-4e86-8342-a528d8f565a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IuqAHnhf {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:28:06 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c30d1e-5d91-4e86-8342-a528d8f565a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IuqAHnhf" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:28:06 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f558cd51-4e11-4199-a7fc-0bbbacb3407a]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:28:06 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5578eb-6ec7-4626-a835-a6a3a1e8b871 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IuqAHnhf'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:28:06 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c30d1e-5d91-4e86-8342-a528d8f565a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:28:06 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c30d1e-5d91-4e86-8342-a528d8f565a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:28:06 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2048bf-47db-4082-a0d0-ea9326ce1119]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:28:06 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5578eb-6ec7-4626-a835-a6a3a1e8b871 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:28:06 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:28:06 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:28:06 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a45695-b56c-438c-ae0e-818830c90592]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:28:06 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5578eb-6ec7-4626-a835-a6a3a1e8b871 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 04:28:06 user nova-compute[103546]:  {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:28:06 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5578eb-6ec7-4626-a835-a6a3a1e8b871 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 04:28:06 user nova-compute[103546]:  {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:28:06 user nova-compute[103546]: WARNING os_brick.initiator.connectors.iscsi [None req-ff5578eb-6ec7-4626-a835-a6a3a1e8b871 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 04:28:06 user nova-compute[103546]: 
Nov 16 04:28:06 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c30d1e-5d91-4e86-8342-a528d8f565a5 -p 172.16.0.220:3260 --login {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:28:06 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c30d1e-5d91-4e86-8342-a528d8f565a5 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:28:06 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[7696dd7b-8cff-49eb-a3a6-1ef0e75a7941]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:70c30d1e-5d91-4e86-8342-a528d8f565a5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:70c30d1e-5d91-4e86-8342-a528d8f565a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:28:06 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5578eb-6ec7-4626-a835-a6a3a1e8b871 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:70c30d1e-5d91-4e86-8342-a528d8f565a5, portal: 172.16.0.220,3260]
Nov 16 04:28:06 user nova-compute[103546]: Login to [iface: default, target: iqn.2010-10.org.openstack:70c30d1e-5d91-4e86-8342-a528d8f565a5, portal: 172.16.0.220,3260] successful.
Nov 16 04:28:06 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:28:07 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c30d1e-5d91-4e86-8342-a528d8f565a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:28:07 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c30d1e-5d91-4e86-8342-a528d8f565a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:28:07 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e4f6a9-60bc-4077-b7e0-1df7bc140ea1]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:28:07 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5578eb-6ec7-4626-a835-a6a3a1e8b871 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:28:07 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:28:07 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:28:07 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dcd30f9-1420-4767-9cd1-11993680e6ee]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c30d1e-5d91-4e86-8342-a528d8f565a5 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:28:07 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5578eb-6ec7-4626-a835-a6a3a1e8b871 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c30d1e-5d91-4e86-8342-a528d8f565a5 (non-flash)
Nov 16 04:28:07 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:28:07 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5578eb-6ec7-4626-a835-a6a3a1e8b871 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c30d1e-5d91-4e86-8342-a528d8f565a5 (non-flash)
Nov 16 04:28:07 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:28:07 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-ff5578eb-6ec7-4626-a835-a6a3a1e8b871 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70c30d1e-5d91-4e86-8342-a528d8f565a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:28:07 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5578eb-6ec7-4626-a835-a6a3a1e8b871 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Connected to 172.16.0.220:3260 {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 04:28:07 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-ff5578eb-6ec7-4626-a835-a6a3a1e8b871 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=103546) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 04:28:07 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-ff5578eb-6ec7-4626-a835-a6a3a1e8b871 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=103546) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 04:28:07 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:28:07 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:28:07 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcfc2318-4ec4-46a8-9626-75986b285865]: (4, ('- - 0', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:28:07 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-ff5578eb-6ec7-4626-a835-a6a3a1e8b871 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: None {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 04:28:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:28:08 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-ff5578eb-6ec7-4626-a835-a6a3a1e8b871 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=103546) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 04:28:08 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5578eb-6ec7-4626-a835-a6a3a1e8b871 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:70c30d1e-5d91-4e86-8342-a528d8f565a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IuqAHnhf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=103546) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 04:28:08 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-ff5578eb-6ec7-4626-a835-a6a3a1e8b871 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:28:08 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5578eb-6ec7-4626-a835-a6a3a1e8b871 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23339633936363565', 'path': '/dev/sdb'} {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:28:08 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff5578eb-6ec7-4626-a835-a6a3a1e8b871 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23339633936363565', 'path': '/dev/sdb'} {{(pid=103546) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 04:28:08 user nova-compute[103546]: DEBUG nova.objects.instance [None req-ff5578eb-6ec7-4626-a835-a6a3a1e8b871 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lazy-loading 'flavor' on Instance uuid 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:28:08 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-ff5578eb-6ec7-4626-a835-a6a3a1e8b871 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 04:28:08 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:28:08 user nova-compute[103546]:   <source dev="/dev/sdb"/>
Nov 16 04:28:08 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 04:28:08 user nova-compute[103546]:   <serial>70c30d1e-5d91-4e86-8342-a528d8f565a5</serial>
Nov 16 04:28:08 user nova-compute[103546]: </disk>
Nov 16 04:28:08 user nova-compute[103546]:  {{(pid=103546) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 04:28:08 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-ff5578eb-6ec7-4626-a835-a6a3a1e8b871 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] No BDM found with device name vda, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:28:08 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-ff5578eb-6ec7-4626-a835-a6a3a1e8b871 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] No BDM found with device name vdb, not building metadata. {{(pid=103546) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 04:28:08 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-ff5578eb-6ec7-4626-a835-a6a3a1e8b871 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] No VIF found with MAC fa:16:3e:97:d2:8b, not building metadata {{(pid=103546) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 04:28:08 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-ff5578eb-6ec7-4626-a835-a6a3a1e8b871 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.531s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:28:08 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:28:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-162a285c-786f-455c-b39b-8a070bdb7948 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Acquiring lock "8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:28:11 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-162a285c-786f-455c-b39b-8a070bdb7948 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:28:11 user nova-compute[103546]: INFO nova.compute.manager [None req-162a285c-786f-455c-b39b-8a070bdb7948 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Detaching volume 70c30d1e-5d91-4e86-8342-a528d8f565a5
Nov 16 04:28:11 user nova-compute[103546]: INFO nova.virt.block_device [None req-162a285c-786f-455c-b39b-8a070bdb7948 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Attempting to driver detach volume 70c30d1e-5d91-4e86-8342-a528d8f565a5 from mountpoint /dev/vdb
Nov 16 04:28:11 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-162a285c-786f-455c-b39b-8a070bdb7948 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Attempting to detach device vdb from instance 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907 from the persistent domain config. {{(pid=103546) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 04:28:11 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-162a285c-786f-455c-b39b-8a070bdb7948 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 04:28:11 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:28:11 user nova-compute[103546]:   <source dev="/dev/sdb"/>
Nov 16 04:28:11 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 04:28:11 user nova-compute[103546]:   <serial>70c30d1e-5d91-4e86-8342-a528d8f565a5</serial>
Nov 16 04:28:11 user nova-compute[103546]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 04:28:11 user nova-compute[103546]: </disk>
Nov 16 04:28:11 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 04:28:11 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-162a285c-786f-455c-b39b-8a070bdb7948 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Successfully detached device vdb from instance 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907 from the persistent domain config.
Nov 16 04:28:11 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-162a285c-786f-455c-b39b-8a070bdb7948 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907 from the live domain config. {{(pid=103546) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 04:28:11 user nova-compute[103546]: DEBUG nova.virt.libvirt.guest [None req-162a285c-786f-455c-b39b-8a070bdb7948 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 04:28:11 user nova-compute[103546]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 04:28:11 user nova-compute[103546]:   <source dev="/dev/sdb"/>
Nov 16 04:28:11 user nova-compute[103546]:   <target dev="vdb" bus="virtio"/>
Nov 16 04:28:11 user nova-compute[103546]:   <serial>70c30d1e-5d91-4e86-8342-a528d8f565a5</serial>
Nov 16 04:28:11 user nova-compute[103546]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 04:28:11 user nova-compute[103546]: </disk>
Nov 16 04:28:11 user nova-compute[103546]:  {{(pid=103546) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 04:28:11 user nova-compute[103546]: DEBUG nova.virt.libvirt.driver [None req-162a285c-786f-455c-b39b-8a070bdb7948 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907 {{(pid=103546) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 04:28:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:28:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:28:17 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:28:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:28:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:28:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=103546) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 04:28:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:28:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:28:22 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:28:27 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:28:28 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:28:28 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Cleaning up deleted instances with incomplete migration  {{(pid=103546) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 04:28:31 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-162a285c-786f-455c-b39b-8a070bdb7948 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907 is timed out.
Nov 16 04:28:31 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-162a285c-786f-455c-b39b-8a070bdb7948 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Successfully detached device vdb from instance 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907 from the live domain config.
Nov 16 04:28:31 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-162a285c-786f-455c-b39b-8a070bdb7948 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] calling os-brick to detach iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 04:28:31 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-162a285c-786f-455c-b39b-8a070bdb7948 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f60cc3c3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:70c30d1e-5d91-4e86-8342-a528d8f565a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IuqAHnhf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 04:28:31 user nova-compute[103546]: WARNING os_brick.initiator.connectors.base [None req-162a285c-786f-455c-b39b-8a070bdb7948 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 04:28:31 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-162a285c-786f-455c-b39b-8a070bdb7948 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 04:28:31 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-162a285c-786f-455c-b39b-8a070bdb7948 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 04:28:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:28:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:28:31 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89ac9e1-dd46-425a-8a93-0dab1a790dc3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:70c30d1e-5d91-4e86-8342-a528d8f565a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:28:31 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-162a285c-786f-455c-b39b-8a070bdb7948 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 04:28:31 user nova-compute[103546]: No targets found.
Nov 16 04:28:31 user nova-compute[103546]: iSNS:
Nov 16 04:28:31 user nova-compute[103546]: No targets found.
Nov 16 04:28:31 user nova-compute[103546]: STATIC:
Nov 16 04:28:31 user nova-compute[103546]: Target: iqn.2010-10.org.openstack:70c30d1e-5d91-4e86-8342-a528d8f565a5
Nov 16 04:28:31 user nova-compute[103546]:         Portal: 172.16.0.220:3260,-1
Nov 16 04:28:31 user nova-compute[103546]:                 Iface Name: default
Nov 16 04:28:31 user nova-compute[103546]: FIRMWARE:
Nov 16 04:28:31 user nova-compute[103546]: No targets found.
Nov 16 04:28:31 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:28:31 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-162a285c-786f-455c-b39b-8a070bdb7948 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 04:28:31 user nova-compute[103546]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 04:28:31 user nova-compute[103546]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=103546) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 04:28:31 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-162a285c-786f-455c-b39b-8a070bdb7948 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70c30d1e-5d91-4e86-8342-a528d8f565a5', 0)] {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 04:28:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:28:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:28:31 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87a3d08-f859-4496-94cc-efabd65a2de4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70c30d1e-5d91-4e86-8342-a528d8f565a5\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:28:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:28:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:28:31 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba6bcde3-4e79-4ca0-8bb9-65d6038d5082]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c30d1e-5d91-4e86-8342-a528d8f565a5 (non-flash)\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:28:31 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-162a285c-786f-455c-b39b-8a070bdb7948 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c30d1e-5d91-4e86-8342-a528d8f565a5 (non-flash)
Nov 16 04:28:31 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 04:28:31 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-162a285c-786f-455c-b39b-8a070bdb7948 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70c30d1e-5d91-4e86-8342-a528d8f565a5 (non-flash)
Nov 16 04:28:31 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 04:28:31 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-162a285c-786f-455c-b39b-8a070bdb7948 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f60ac5bc280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70c30d1e-5d91-4e86-8342-a528d8f565a5'): ({'sdb'}, set())}) {{(pid=103546) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 04:28:31 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-162a285c-786f-455c-b39b-8a070bdb7948 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Removing single pathed devices sdb {{(pid=103546) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 04:28:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:28:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:28:31 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c381f70-a0a2-4784-b261-b1db6d4ee7a0]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:28:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:28:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:28:31 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[92021cc0-cd0f-415f-bb1e-2100273358c4]: (4, ('ok\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:28:31 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-162a285c-786f-455c-b39b-8a070bdb7948 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Flushing IO for device /dev/sdb {{(pid=103546) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 04:28:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:28:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:28:31 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f020215-4000-4c73-844a-3bd1d2602588]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:28:31 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-162a285c-786f-455c-b39b-8a070bdb7948 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=103546) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 04:28:31 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:28:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:28:32 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7ceac4-e4c0-48f6-8cee-1a025e13be5f]: (4, ('1', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:28:32 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-162a285c-786f-455c-b39b-8a070bdb7948 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 04:28:32 user nova-compute[103546]: DEBUG os_brick.initiator.linuxscsi [None req-162a285c-786f-455c-b39b-8a070bdb7948 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] SCSI volumes sdb have been removed. {{(pid=103546) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 04:28:32 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-162a285c-786f-455c-b39b-8a070bdb7948 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70c30d1e-5d91-4e86-8342-a528d8f565a5')] {{(pid=103546) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 04:28:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c30d1e-5d91-4e86-8342-a528d8f565a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:28:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c30d1e-5d91-4e86-8342-a528d8f565a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:28:32 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[54cb7600-4925-4384-9362-d73d788fb3dd]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:28:32 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-162a285c-786f-455c-b39b-8a070bdb7948 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:28:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c30d1e-5d91-4e86-8342-a528d8f565a5 -p 172.16.0.220:3260 --logout {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:28:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c30d1e-5d91-4e86-8342-a528d8f565a5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:28:32 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3b30ac-5d83-4f93-a486-fa19e85c9af5]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:70c30d1e-5d91-4e86-8342-a528d8f565a5, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:70c30d1e-5d91-4e86-8342-a528d8f565a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:28:32 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-162a285c-786f-455c-b39b-8a070bdb7948 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:70c30d1e-5d91-4e86-8342-a528d8f565a5, portal: 172.16.0.220,3260]
Nov 16 04:28:32 user nova-compute[103546]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:70c30d1e-5d91-4e86-8342-a528d8f565a5, portal: 172.16.0.220,3260] successful.
Nov 16 04:28:32 user nova-compute[103546]:  stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:28:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70c30d1e-5d91-4e86-8342-a528d8f565a5 -p 172.16.0.220:3260 --op delete {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:28:32 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70c30d1e-5d91-4e86-8342-a528d8f565a5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=114461) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:28:32 user nova-compute[103546]: DEBUG oslo.privsep.daemon [-] privsep: reply[109d42dd-41b5-43d1-a19c-bb9c6676c3f7]: (4, ('', '')) {{(pid=114461) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 04:28:32 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-162a285c-786f-455c-b39b-8a070bdb7948 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=103546) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 04:28:32 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.base [None req-162a285c-786f-455c-b39b-8a070bdb7948 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 04:28:32 user nova-compute[103546]: DEBUG os_brick.initiator.connectors.iscsi [None req-162a285c-786f-455c-b39b-8a070bdb7948 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] <== disconnect_volume: return (284ms) None {{(pid=103546) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 04:28:32 user nova-compute[103546]: DEBUG nova.virt.libvirt.volume.iscsi [None req-162a285c-786f-455c-b39b-8a070bdb7948 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Disconnected iSCSI Volume {{(pid=103546) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 04:28:32 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:28:33 user nova-compute[103546]: DEBUG nova.objects.instance [None req-162a285c-786f-455c-b39b-8a070bdb7948 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lazy-loading 'flavor' on Instance uuid 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:28:33 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-162a285c-786f-455c-b39b-8a070bdb7948 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.808s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:28:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:28:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:28:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=103546) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 04:28:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:28:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:28:37 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:28:40 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager.update_available_resource {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:28:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:28:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:28:40 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:28:40 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Auditing locally available compute resources for user (node: user) {{(pid=103546) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 04:28:40 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c331c2c-90a3-4f5e-8b9a-40dbb19e0907/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:28:40 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c331c2c-90a3-4f5e-8b9a-40dbb19e0907/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:28:40 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c331c2c-90a3-4f5e-8b9a-40dbb19e0907/disk --force-share --output=json {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 04:28:41 user nova-compute[103546]: DEBUG oslo_concurrency.processutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c331c2c-90a3-4f5e-8b9a-40dbb19e0907/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=103546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 04:28:41 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:28:41 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:28:41 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Hypervisor/Node resource view: name=user free_ram=9039MB free_disk=25.028587341308594GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=103546) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 04:28:41 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:28:41 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:28:41 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Instance 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=103546) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 04:28:41 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 04:28:41 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 04:28:41 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:28:41 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:28:41 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Compute_service record updated for user:user {{(pid=103546) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 04:28:41 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.181s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:28:42 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:28:44 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:28:47 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:28:47 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:28:48 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:28:49 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:28:51 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:28:51 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=103546) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 04:28:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:28:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:28:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=103546) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 04:28:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:28:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:28:52 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:28:52 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:28:54 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:28:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:28:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:28:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=103546) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 04:28:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:28:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:28:57 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:28:58 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:28:59 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:28:59 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Starting heal instance info cache {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 04:28:59 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Rebuilding the list of instances to heal {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 04:28:59 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "refresh_cache-8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 04:28:59 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquired lock "refresh_cache-8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 04:28:59 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Forcefully refreshing network info cache for instance {{(pid=103546) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 04:28:59 user nova-compute[103546]: DEBUG nova.objects.instance [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lazy-loading 'info_cache' on Instance uuid 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:29:00 user nova-compute[103546]: DEBUG nova.network.neutron [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Updating instance_info_cache with network_info: [{"id": "390d2610-ed90-40db-84e7-00104ff08d0c", "address": "fa:16:3e:97:d2:8b", "network": {"id": "ea7af6ae-5b5f-413e-8d3f-40a597d9e4c4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-156065771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12cb3bcaf4264c31bb5c65516f5632a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390d2610-ed", "ovs_interfaceid": "390d2610-ed90-40db-84e7-00104ff08d0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:29:00 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Releasing lock "refresh_cache-8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" {{(pid=103546) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 04:29:00 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Updated the network info_cache for instance {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 04:29:02 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:29:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:29:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:29:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=103546) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 04:29:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:29:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:29:07 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:29:12 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:29:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-05c2b8f1-8d13-444e-856b-d243a386f4c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Acquiring lock "8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:29:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-05c2b8f1-8d13-444e-856b-d243a386f4c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:29:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-05c2b8f1-8d13-444e-856b-d243a386f4c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Acquiring lock "8c331c2c-90a3-4f5e-8b9a-40dbb19e0907-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:29:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-05c2b8f1-8d13-444e-856b-d243a386f4c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "8c331c2c-90a3-4f5e-8b9a-40dbb19e0907-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:29:17 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-05c2b8f1-8d13-444e-856b-d243a386f4c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "8c331c2c-90a3-4f5e-8b9a-40dbb19e0907-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:29:17 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:29:17 user nova-compute[103546]: INFO nova.compute.manager [None req-05c2b8f1-8d13-444e-856b-d243a386f4c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Terminating instance
Nov 16 04:29:17 user nova-compute[103546]: DEBUG nova.compute.manager [None req-05c2b8f1-8d13-444e-856b-d243a386f4c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Start destroying the instance on the hypervisor. {{(pid=103546) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 04:29:17 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:29:17 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:29:17 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:29:17 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:29:18 user nova-compute[103546]: DEBUG nova.compute.manager [req-7d4201ff-87c2-4d8a-be9e-df8bb15496fc req-6552fab2-fd18-4ff3-a30e-e8b4bd4c1b40 service nova] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Received event network-vif-unplugged-390d2610-ed90-40db-84e7-00104ff08d0c {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:29:18 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-7d4201ff-87c2-4d8a-be9e-df8bb15496fc req-6552fab2-fd18-4ff3-a30e-e8b4bd4c1b40 service nova] Acquiring lock "8c331c2c-90a3-4f5e-8b9a-40dbb19e0907-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:29:18 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-7d4201ff-87c2-4d8a-be9e-df8bb15496fc req-6552fab2-fd18-4ff3-a30e-e8b4bd4c1b40 service nova] Lock "8c331c2c-90a3-4f5e-8b9a-40dbb19e0907-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:29:18 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-7d4201ff-87c2-4d8a-be9e-df8bb15496fc req-6552fab2-fd18-4ff3-a30e-e8b4bd4c1b40 service nova] Lock "8c331c2c-90a3-4f5e-8b9a-40dbb19e0907-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:29:18 user nova-compute[103546]: DEBUG nova.compute.manager [req-7d4201ff-87c2-4d8a-be9e-df8bb15496fc req-6552fab2-fd18-4ff3-a30e-e8b4bd4c1b40 service nova] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] No waiting events found dispatching network-vif-unplugged-390d2610-ed90-40db-84e7-00104ff08d0c {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:29:18 user nova-compute[103546]: DEBUG nova.compute.manager [req-7d4201ff-87c2-4d8a-be9e-df8bb15496fc req-6552fab2-fd18-4ff3-a30e-e8b4bd4c1b40 service nova] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Received event network-vif-unplugged-390d2610-ed90-40db-84e7-00104ff08d0c for instance with task_state deleting. {{(pid=103546) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 04:29:18 user nova-compute[103546]: INFO nova.virt.libvirt.driver [-] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Instance destroyed successfully.
Nov 16 04:29:18 user nova-compute[103546]: DEBUG nova.objects.instance [None req-05c2b8f1-8d13-444e-856b-d243a386f4c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lazy-loading 'resources' on Instance uuid 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907 {{(pid=103546) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 04:29:18 user nova-compute[103546]: DEBUG nova.virt.libvirt.vif [None req-05c2b8f1-8d13-444e-856b-d243a386f4c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T04:22:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-725088862',display_name='tempest-SnapshotDataIntegrityTests-server-725088862',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-725088862',id=53,image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBewTO/MlPnyAEzx7kE8P3yVPcSblAmBo5wdQD6Og+TmEkntX01hZUc+dNvc3qU+7DkjJ0OzHt8tEV5UDJ+uBzATFGaPE3KtFiqONnkIN7drHWwX7Ycv5uz8Q8vJzdemeQ==',key_name='tempest-keypair-1770534859',keypairs=<?>,launch_index=0,launched_at=2023-11-16T04:23:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12cb3bcaf4264c31bb5c65516f5632a8',ramdisk_id='',reservation_id='r-x7yrq9zl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5c6f539a-01e5-4478-bf8f-a14310b5d7dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-217003347',owner_user_name='tempest-SnapshotDataIntegrityTests-217003347-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T04:23:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8285ca34203a4243a4c99d34cba2bbaf',uuid=8c331c2c-90a3-4f5e-8b9a-40dbb19e0907,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "390d2610-ed90-40db-84e7-00104ff08d0c", "address": "fa:16:3e:97:d2:8b", "network": {"id": "ea7af6ae-5b5f-413e-8d3f-40a597d9e4c4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-156065771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12cb3bcaf4264c31bb5c65516f5632a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390d2610-ed", "ovs_interfaceid": "390d2610-ed90-40db-84e7-00104ff08d0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 04:29:18 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-05c2b8f1-8d13-444e-856b-d243a386f4c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Converting VIF {"id": "390d2610-ed90-40db-84e7-00104ff08d0c", "address": "fa:16:3e:97:d2:8b", "network": {"id": "ea7af6ae-5b5f-413e-8d3f-40a597d9e4c4", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-156065771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12cb3bcaf4264c31bb5c65516f5632a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390d2610-ed", "ovs_interfaceid": "390d2610-ed90-40db-84e7-00104ff08d0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 04:29:18 user nova-compute[103546]: DEBUG nova.network.os_vif_util [None req-05c2b8f1-8d13-444e-856b-d243a386f4c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:d2:8b,bridge_name='br-int',has_traffic_filtering=True,id=390d2610-ed90-40db-84e7-00104ff08d0c,network=Network(ea7af6ae-5b5f-413e-8d3f-40a597d9e4c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap390d2610-ed') {{(pid=103546) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 04:29:18 user nova-compute[103546]: DEBUG os_vif [None req-05c2b8f1-8d13-444e-856b-d243a386f4c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:d2:8b,bridge_name='br-int',has_traffic_filtering=True,id=390d2610-ed90-40db-84e7-00104ff08d0c,network=Network(ea7af6ae-5b5f-413e-8d3f-40a597d9e4c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap390d2610-ed') {{(pid=103546) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 04:29:18 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:29:18 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap390d2610-ed, bridge=br-int, if_exists=True) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:29:18 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:29:18 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:29:18 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:29:18 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=42566095-8b1c-4fff-ad88-25f906c1082f) {{(pid=103546) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 04:29:18 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:29:18 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:29:18 user nova-compute[103546]: INFO os_vif [None req-05c2b8f1-8d13-444e-856b-d243a386f4c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:d2:8b,bridge_name='br-int',has_traffic_filtering=True,id=390d2610-ed90-40db-84e7-00104ff08d0c,network=Network(ea7af6ae-5b5f-413e-8d3f-40a597d9e4c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap390d2610-ed')
Nov 16 04:29:18 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-05c2b8f1-8d13-444e-856b-d243a386f4c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Deleting instance files /opt/stack/data/nova/instances/8c331c2c-90a3-4f5e-8b9a-40dbb19e0907_del
Nov 16 04:29:18 user nova-compute[103546]: INFO nova.virt.libvirt.driver [None req-05c2b8f1-8d13-444e-856b-d243a386f4c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Deletion of /opt/stack/data/nova/instances/8c331c2c-90a3-4f5e-8b9a-40dbb19e0907_del complete
Nov 16 04:29:18 user nova-compute[103546]: INFO nova.compute.manager [None req-05c2b8f1-8d13-444e-856b-d243a386f4c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 16 04:29:18 user nova-compute[103546]: DEBUG oslo.service.loopingcall [None req-05c2b8f1-8d13-444e-856b-d243a386f4c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=103546) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 04:29:18 user nova-compute[103546]: DEBUG nova.compute.manager [-] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Deallocating network for instance {{(pid=103546) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 04:29:18 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] deallocate_for_instance() {{(pid=103546) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 04:29:18 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:29:19 user nova-compute[103546]: DEBUG nova.network.neutron [-] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Updating instance_info_cache with network_info: [] {{(pid=103546) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 04:29:19 user nova-compute[103546]: INFO nova.compute.manager [-] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Took 0.75 seconds to deallocate network for instance.
Nov 16 04:29:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-05c2b8f1-8d13-444e-856b-d243a386f4c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:29:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-05c2b8f1-8d13-444e-856b-d243a386f4c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:29:19 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-05c2b8f1-8d13-444e-856b-d243a386f4c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:29:19 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-05c2b8f1-8d13-444e-856b-d243a386f4c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:29:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-05c2b8f1-8d13-444e-856b-d243a386f4c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.113s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:29:19 user nova-compute[103546]: INFO nova.scheduler.client.report [None req-05c2b8f1-8d13-444e-856b-d243a386f4c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Deleted allocations for instance 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907
Nov 16 04:29:19 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-05c2b8f1-8d13-444e-856b-d243a386f4c1 tempest-SnapshotDataIntegrityTests-217003347 tempest-SnapshotDataIntegrityTests-217003347-project-member] Lock "8c331c2c-90a3-4f5e-8b9a-40dbb19e0907" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.931s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:29:20 user nova-compute[103546]: DEBUG nova.compute.manager [req-cd8f2da1-28ad-470f-b0ec-7e91ee1c2ea3 req-ec1e9f44-7477-40f6-84aa-949e66211845 service nova] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Received event network-vif-plugged-390d2610-ed90-40db-84e7-00104ff08d0c {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:29:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-cd8f2da1-28ad-470f-b0ec-7e91ee1c2ea3 req-ec1e9f44-7477-40f6-84aa-949e66211845 service nova] Acquiring lock "8c331c2c-90a3-4f5e-8b9a-40dbb19e0907-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:29:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-cd8f2da1-28ad-470f-b0ec-7e91ee1c2ea3 req-ec1e9f44-7477-40f6-84aa-949e66211845 service nova] Lock "8c331c2c-90a3-4f5e-8b9a-40dbb19e0907-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:29:20 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [req-cd8f2da1-28ad-470f-b0ec-7e91ee1c2ea3 req-ec1e9f44-7477-40f6-84aa-949e66211845 service nova] Lock "8c331c2c-90a3-4f5e-8b9a-40dbb19e0907-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:29:20 user nova-compute[103546]: DEBUG nova.compute.manager [req-cd8f2da1-28ad-470f-b0ec-7e91ee1c2ea3 req-ec1e9f44-7477-40f6-84aa-949e66211845 service nova] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] No waiting events found dispatching network-vif-plugged-390d2610-ed90-40db-84e7-00104ff08d0c {{(pid=103546) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 04:29:20 user nova-compute[103546]: WARNING nova.compute.manager [req-cd8f2da1-28ad-470f-b0ec-7e91ee1c2ea3 req-ec1e9f44-7477-40f6-84aa-949e66211845 service nova] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Received unexpected event network-vif-plugged-390d2610-ed90-40db-84e7-00104ff08d0c for instance with vm_state deleted and task_state None.
Nov 16 04:29:20 user nova-compute[103546]: DEBUG nova.compute.manager [req-cd8f2da1-28ad-470f-b0ec-7e91ee1c2ea3 req-ec1e9f44-7477-40f6-84aa-949e66211845 service nova] [instance: 8c331c2c-90a3-4f5e-8b9a-40dbb19e0907] Received event network-vif-deleted-390d2610-ed90-40db-84e7-00104ff08d0c {{(pid=103546) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 04:29:23 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:29:28 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:29:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:29:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:29:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=103546) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 04:29:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:29:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=103546) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 04:29:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:29:38 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:29:42 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager.update_available_resource {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:29:42 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:29:42 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:29:42 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:29:42 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Auditing locally available compute resources for user (node: user) {{(pid=103546) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 04:29:43 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:29:43 user nova-compute[103546]: WARNING nova.virt.libvirt.driver [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 04:29:43 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Hypervisor/Node resource view: name=user free_ram=9171MB free_disk=25.055736541748047GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=103546) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 04:29:43 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 04:29:43 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 04:29:43 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 04:29:43 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=103546) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 04:29:43 user nova-compute[103546]: DEBUG nova.compute.provider_tree [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed in ProviderTree for provider: 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a {{(pid=103546) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 04:29:43 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:29:43 user nova-compute[103546]: DEBUG nova.scheduler.client.report [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Inventory has not changed for provider 0b01254b-dc4d-4d00-a9a7-dd4ef815de7a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=103546) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 04:29:43 user nova-compute[103546]: DEBUG nova.compute.resource_tracker [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Compute_service record updated for user:user {{(pid=103546) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 04:29:43 user nova-compute[103546]: DEBUG oslo_concurrency.lockutils [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.143s {{(pid=103546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 04:29:45 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:29:48 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:29:48 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:29:48 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:29:50 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:29:51 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:29:51 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=103546) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 04:29:53 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:29:55 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:29:58 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:29:58 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:29:59 user nova-compute[103546]: DEBUG oslo_service.periodic_task [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=103546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 04:29:59 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Starting heal instance info cache {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 04:29:59 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Rebuilding the list of instances to heal {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 04:29:59 user nova-compute[103546]: DEBUG nova.compute.manager [None req-77dd7a6c-c673-4900-a770-86742ece76de None None] Didn't find any instances for network info cache update. {{(pid=103546) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 04:30:03 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:30:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 04:30:08 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:30:11 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:30:13 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:30:14 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:30:18 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:30:23 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:30:28 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 04:30:33 user nova-compute[103546]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=103546) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}